本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表,以自然语言处理、信息检索、计算机视觉等类目进行划分。
统计
今日共更新808篇论文,其中:
- 自然语言处理138篇
- 信息检索25篇
- 计算机视觉138篇
自然语言处理
1. 【2610.30132】LongZero: Enhancing Long-Context Reasoning in LLMs from Zero Data
链接:https://arxiv.org/abs/2610.30132
作者:Zhennan Wan,Jianfei Chen
类目:Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词:Reinforcement learning, large language models, large language, long-context reasoning, Reinforcement
备注: Code and data are available at [this https URL](https://github.com/zhennan1/LongZero)
点击查看摘要
Abstract:Reinforcement learning (RL) is an effective way to strengthen the long-context reasoning of large language models (LLMs), but it needs training data that are long, diverse, challenging, and verifiable. Human annotation of such data is expensive, naturally occurring data are too scarce to sustain RL, and existing synthesis methods depend on external corpora or stronger teacher models, which become harder to obtain as the trained models get stronger. Recently, RL from zero data, in which a model learns from tasks it proposes itself, has achieved excellent performance, but existing methods target short-context tasks. Therefore, we propose $\textbf{LongZero}$, a method that lets an LLM improve its own long-context reasoning without any external data. Instead of writing questions and answers over existing documents, LongZero first has the model synthesize the question and answer with its supporting evidence in a compact structured form, and only then separately expands the evidence into a long multi-document context. LongZero combines these self-written multi-hop reasoning tasks with self-written multi-round retrieval tasks and trains the model with GRPO. We evaluate LongZero on two LLMs across five long-context reasoning benchmarks and compare it with RL on data synthesized from external corpora. Experimental results show that LongZero can generalize to real tasks, and outperforms both baselines, suggesting a viable and promising path to improving long-context reasoning of LLMs.
2. 【2610.30128】hink Harder Where It Matters: Item-Level Adaptive Recursion for Sequential Recommendation
链接:https://arxiv.org/abs/2610.30128
作者:Zhanshuo Cao,Jiakai Tang,Yuqi Zhou,Sunhao Dai,Jun Xu
类目:Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词:Existing sequential recommenders, user interaction history, final prediction, sequential recommenders, recommenders usually allocate
备注:
点击查看摘要
Abstract:Existing sequential recommenders usually allocate a fixed computational budget to every item in a user's interaction history, regardless of the item's contribution to the final prediction. We challenge this de facto design with two diagnostic findings. (1) Non-uniform computational need: items within the same sequence vary drastically in how much computation they require. Most converge after shallow processing while a critical minority only stabilizes at full depth. (2) Suboptimality of fixed allocation: given oracle access to the target item, a non-uniform depth assignment consistently outranks the fixed one, indicating that existing uniform computation both wastes capacity on already-converged items and sacrifices overall recommendation quality. These observations motivate a shift from fixed-depth computation to item-level adaptive reasoning. To this end, we propose LoopRec. LoopRec recursively applies a single weight-shared block and introduces a lightweight gate at each recursion boundary that makes a binary exit-or-continue decision for every item independently. Items whose representations have sufficiently matured exit early, while those requiring deeper reasoning continue to subsequent recursions. This design converts the fixed global depth into a learned, per-item property without auxiliary depth labels, and is readily adaptable to diverse backbone architectures. Extensive experiments on public benchmarks with four backbone families demonstrate that LoopRec consistently outperforms matched fixed-depth counterparts. Further analysis reveals that LoopRec's learned allocation exhibits interpretable patterns aligned with our post-hoc oracle analysis: lower-frequency items and more recent interactions naturally receive deeper computation. Our code is available at this https URL.
3. 【2610.30116】Environment Duels: A Microcosm of LLM Co-Evolution
链接:https://arxiv.org/abs/2610.30116
作者:Shibo Jin,Zhiqiu Xu,Yiling Zou,Shangyu Gong,Mayur Naik
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词:synthetic training pipelines, open web, competitors create, tangle of real-world, pipelines to data
备注:
点击查看摘要
Abstract:Through a tangle of real-world interactions, from synthetic training pipelines to data shared on the open web, frontier LLMs absorb what their predecessors and competitors create. How well does each model play its role in this ecosystem, as a creator and as a solver? We introduce Environment Duels, a dynamic agentic benchmark that evaluates both capabilities on interactive environments. Each model writes environments, each with a privileged hint, aiming for tasks that capable solvers fail without the hint and pass with it. Across nine frontier LLMs, solving and authoring prove to be distinct skills: the strongest solvers are not the strongest authors, while smaller models learn more from how others played and write the hardest environments and the most useful hints. Beyond the scores, the pairwise interactions form a microcosm of how models affect one another. Head-to-head outcomes are transitive and so yield a stable ranking; independent authors converge on the same designs; and in a reinforcement-learning study with Qwen3.8-27B, the learner's hint lift on an author's environments tracks how much training on those environments improves it on held-out reasoning and agentic benchmarks, whether the environments are its own or another model's. Each of these patterns has a counterpart in how models shape one another outside the duel. By staging these interactions under controlled conditions, Environment Duels offers a window onto how LLMs teach, challenge and learn from one another. Code is available at this https URL.
4. 【2610.30113】Quant-Arena: Benchmarking LLM Agents for Quantitative Trading Research
链接:https://arxiv.org/abs/2610.30113
作者:Houde Qian,Zheng Jiang,Wenyi Li,Chenxi Xu,Xinjie Lin,Yuzhao Peng,Ruoyu Han,Youjie Zheng,Kaisen Yang,Qinhuai Na,You Fu,Calvin Xiao
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computational Engineering, Finance, and Science (cs.CE)
关键词:Quantitative research, researcher proposes, A-share market data, iterative loop, historical data
备注: Project page: [this https URL](https://lab.einsia.ai/quant-arena)
点击查看摘要
Abstract:Quantitative research is an iterative loop: a researcher proposes a market hypothesis, implements it as an executable signal, tests it on historical data, and decides what to keep. Existing benchmarks score formulas, code, or individual trading decisions, leaving open whether large language models (LLMs) can complete this loop and produce strategies that work beyond the research period. We introduce Quant-Arena, a benchmark and public leaderboard for end-to-end quantitative research on real A-share market data. A model constructs features and stock-scoring code, receives feedback only on 2022--2023, and freezes one strategy for assessment on the sealed year 2024. A cash-account evaluator applies trading constraints and costs, including market impact estimated from a simulated order book. Scores are dominated by realized excess return and complemented by signal quality and the diversity of features used by the strategy. We evaluate nine frontier models, among which GPT-6 Astra scores highest; yet no model beats the equal-weight market in 2024. Quant-Arena is open to submissions from any model or agent harness.
5. 【2610.30103】Did the Problem Actually Get Harder? Testing LLMs on Paired P and NP-Complete Problems Hardened by Adversarial Multi-Agent Rewriting
链接:https://arxiv.org/abs/2610.30103
作者:Nurul Labib Sayeedi,Md. Faiyaz Abdullah Sayeedi,Zabir Al Nazi,Mahbub E Sobhani,Shubhashis Roy Dipta
类目:Computation and Language (cs.CL)
关键词:single structural detail, structural detail, single structural, NPC, NPC problem
备注: [this https URL](https://github.com/Labib1610/complexity-benchmark)
点击查看摘要
Abstract:Many NP-complete (NPC) problems have a polynomial-time (P) twin that differs in a single structural detail, such as 3- versus 2-colouring a graph. A model that reasons rather than recalls should notice which side of this boundary a problem falls on, yet existing benchmarks either fix the wording of each task or ignore its complexity class, so they cannot separate the two. We introduce P2NPCBench, a benchmark of 12 problem families in which every NPC problem is paired with a P twin posed over the same surface. To remove the textbook cues that enable recall, we build it with AgentGAN, an adversarial multi-agent framework in which a generator rewrites each statement until a panel of frozen code models fails, while an executable validity gate keeps every rewrite answer- and class-preserving. The result is 2,114 hardened statements with hand-verified reference human solvers. Evaluating 12 proprietary and open-source models, we find that every model scores lower on NPC statements than on their P twins (35.4% vs. 63.8% pass@1), and that 95.1% of model-family pairs fail more often on the NPC side. A tenfold time limit raises NPC accuracy only from 28.5% to 31.9%, so failures stem from wrong or crashing programs rather than slow ones. Hardening also narrows the class gap from 24.8 to 14.6 points, showing that part of the apparent gap reflects familiarity with textbook phrasing rather than complexity class.
6. 【2610.30090】VX-One: Typed, Calibrated Decision Heads for Real-Time Perimeter Triage - An empirical study of unknown-attack honesty, cascade gray zones, and calibration under drift
链接:https://arxiv.org/abs/2610.30090
作者:Juan S. Santillana
类目:Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG); Networking and Internet Architecture (cs.NI)
关键词:produce unparseable output, semantics trade-off, faces a latency, unseen attacks, Perimeter triage faces
备注: 11 pages, 7 tables, 1 figure
点击查看摘要
Abstract:Perimeter triage faces a latency/semantics trade-off: signature engines are fast and format-safe but blind to unseen attacks, while generative models are semantic but slow and produce unparseable output. In late 2026 a class of commercial System One decision models (TypeSafe Jev; Microsoft-Decision-1) began selling typed decision primitives - binary gates, closed-set choices, ordinal scores - as product APIs, with no academic treatment. We present VX-One: a small multi-head network (100K-10M parameters) whose outputs are these primitives - a calibrated gate, a choice over a closed candidate set that always includes an explicit unknown option, and an ordinal score, trained multi-task, temperature-calibrated per head (~0.7-1.7 ms p50 on CPU). We evaluate it on UNSW-NB15, CIC-IDS2017, EMBER2024 against calibrated XGBoost, Random-Forest, MLP, Kitsune, and measure a two-phase cascade (Suricata with 52,674 Emerging-Threats rules - VX-One) over five days of CIC-IDS2017. Findings: (i) VX-One wins detection (AUROC/FPR@95%TPR) on UNSW-NB15 and under temporal drift on CIC-IDS2017 (0.711 vs 0.637), but XGBoost wins multi-class attribution on all three benchmarks; (ii) leave-one-family-out gate detects never-seen families on 9/9 UNSW folds yet drops below chance on CIC recon family, and abstention threshold transfers poorly across benchmarks; (iii) on payload-less reconstructions signature engines resolve ~0.1% of flows - gray zone ~99.9% of traffic, recovered by Phase 2 (combined recall =0.978); (iv) calibration collapses under temporal drift (ECE 0.04-0.40) for every method while ranking partially survives. We provide a measured account of where typed calibrated decisions help perimeter triage, and where they fail.
7. 【2610.30067】GoiBERT: Compact Vietnamese Language Models via Two-Stage Knowledge Distillation
链接:https://arxiv.org/abs/2610.30067
作者:Quang Anh Kiet Tran,Nam Anh Tran,Manh Hung Trinh,Thanh Danh Le,Khang Nhat Hoang Vo,Huynh Dai Nhan Tran
类目:Computation and Language (cs.CL)
关键词:external word segmentation, Vietnamese pre-trained encoders, improved rapidly, word segmentation, Vietnamese pre-trained
备注:
点击查看摘要
Abstract:Vietnamese pre-trained encoders have improved rapidly, but the strongest ones are large, multilingual-vocabulary models or depend on external word segmentation, which makes them costly to deploy. We present GoiBERT, a family of two compact Vietnamese encoders with 26M and 49M parameters that operate directly on raw text. GoiBERT learns from two complementary teachers. A same-tokenizer Vietnamese encoder first teaches general-purpose representations. A much larger teacher then provides task-level guidance through soft labels that are generated without ever labeling its own training data. Across eight benchmarks covering text classification, aspect-based sentiment analysis, natural language inference, and named entity recognition, GoiBERT-large achieves the highest average score among non-teacher models. It does so with fewer than half the parameters of the strongest compact baseline and twice its throughput. GoiBERT-base retains 99% of that baseline's performance at a quarter of its size. Our analysis shows that compression is nearly lossless for sentiment and classification tasks but remains costly for inference and entity recognition, which points to clear directions for future work. Our code and models are available at: this https URL
8. 【2610.30066】Looped Uniform Diffusion Language Models
链接:https://arxiv.org/abs/2610.30066
作者:Saiteja Utpala,Chieh-Hsin Lai,Yuki Mitsufuji,Praneeth Vepakomma
类目:Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词:diffusion language models, language models, iteratively denoising sequences, ordinary vocabulary tokens, diffusion language
备注: 27 pages
点击查看摘要
Abstract:Uniform diffusion language models (UDLMs) generate text by iteratively denoising sequences of ordinary vocabulary tokens, any of which may be corrupted and subsequently revised. During training, UDLMs must denoise from a context that may itself be unreliable, whereas masked diffusion language models (MDLMs) always condition on a clean context. This challenging training objective makes UDLMs more FLOP-intensive to train than MDLMs, but it yields stronger downstream reasoning performance. Recently, selective looping, which recursively applies a few early Transformer layers within each denoising step, has been shown to improve training efficiency in MDLMs under an iso-FLOP budget. We investigate looping in UDLMs while keeping the training objective and sampler unchanged. We find that looping significantly improves training efficiency: looped UDLMs reach the validation NLL of a non-looped UDLM trained on about 0.5 trillion tokens with up to 2.8x fewer training FLOPs on OpenWebText and 3.3x fewer on FineWeb-Edu. We also find that, at a matched NFE budget, looped UDLMs reach up to 9.8% lower generation perplexity than the non-looped UDLM, with most gains achieved at moderate loop counts. Finally, we study different loop-count distributions and find that sampling smaller loop counts more frequently during training improves inference efficiency: on downstream tasks, this strategy uses 12% fewer loops than uniform loop-count sampling without degrading accuracy.
9. 【2610.30026】What the Author Wrote, What the Agent Reads: Silent Cue Loss in Enterprise Document Ingestion
链接:https://arxiv.org/abs/2610.30026
作者:Yikai Zhao,Saurabh Pandey,Pradeep Kumar Misra
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词:Enterprise agents act, Enterprise agents, agents act, Enterprise, agent
备注: 28 pages, 5 figures
点击查看摘要
Abstract:Enterprise agents act on documents. Before an agent can follow a policy, answer a compliance question or file a ticket, some ingestion layer must turn a Word file or PDF into tokens - and that layer is where an agent deployed in the wild silently loses information. We show that one layer is lost by every mainstream converter - the meaning an author encodes in how text looks - and that the loss makes agents confidently wrong rather than visibly incomplete. We build a task from 76 real policy documents: recover the requirements the author singled out, scored against the file's own OOXML properties by a deterministic matcher with no LLM judge. Formatting-blind ingestion collapses from micro F1 0.690 to 0.150 (docling) and 0.075 (plain text), a gap that replicates across six answering models from two vendors - five Claude models spanning the Opus, Sonnet and Haiku tiers, and OpenAI's GPT-5.6. An agent that cannot see the cue guesses, and docling's false-positive rate on requirements the author did not flag is four times ours. A span-level leave-one-out localises the loss to two cues - highlight (+0.302) and colour (+0.262), both Holm-adjusted p 1e-4 - while bold, italic, monospace and strikethrough each sit within +/-0.003 of zero. The same asymmetry appears in PDF. Colour is also the cue no mainstream converter preserves and no parsing benchmark scores, and it is common: 32.8% of 6,460 documents carry a deliberate colour or highlight, 10.3% on an obligation. A pre-registered test shows that typing a cue for the agent adds +0.085 beyond merely preserving it (Holm-adjusted p = 0.049). We validate the labels against rendered page images through an independent modality (kappa = 0.72) and bound what wording alone can achieve (AUC 0.664). For agent builders the practical finding is that ingestion, not reasoning, is where this reliability is won or lost, and that the fix is cheap and measurable.
10. 【2610.30014】Agent Behavior Maps: Locating Agents by What They Would Do, Without Running Them
链接:https://arxiv.org/abs/2610.30014
作者:Shota Fujikawa,Takuya Tamura,Kosuke Akimoto,Daichi Haraguchi,Masafumi Oyamada
类目:Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词:Agent Behavior Map, Behavior Map represents, action sequences, Behavior Map, similar success rates
备注: 23 pages, 5 figures, 12 tables. Under review
点击查看摘要
Abstract:LLM agents with similar success rates can follow different action sequences. An Agent Behavior Map represents LLM-harness combinations using centered action log-likelihoods on shared reference trajectories, without requiring new environment rollouts from the target agent. We derive error bounds relating squared coordinate distances to trajectory KL under explicit assumptions, and across eight cross-scored models the distances track the directly measured trajectory KL in rank order. Across 100 LLMs and four environments, ALFWorld-based coordinates support performance prediction and identify behavioral similarities. In ALFWorld, these similarities persist after controlling for success rates and model size, including across model families. As an extension, harness-component displacements approximately compose, with accuracy varying across components and environments.
11. 【2610.30006】Building Auditable AI Text Detectors with Sparse Autoencoders
链接:https://arxiv.org/abs/2610.30006
作者:Liam Dugan,Callum McDougall,Matthew Denton,Philip Pham,Christine Kaeser-Chen,Chris Callison-Burch
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词:directly affect individuals, outputs directly affect, peer review, consequential settings, content moderation
备注: EMNLP 2026
点击查看摘要
Abstract:AI-generated text detectors are increasingly deployed in consequential settings---peer review, education, admissions, journalism, and content moderation---where their outputs directly affect individuals. Yet the strongest detectors are fine-tuned neural classifiers whose decisions are opaque, while transparent alternatives (stylometric and linguistic-feature classifiers) underperform them by wide margins. We present a pipeline that converts a fine-tuned neural detector into a classifier that operates on human-readable concepts. We accomplish this by training sparse autoencoders (SAEs) directly on a detector's residual stream, assigning auto-interpretation labels to each SAE feature, and retaining only features whose generated descriptions pass a global fidelity threshold. We then train a lightweight classifier on just the interpretable features. We find that our SAEs recover latent concepts that correspond to highly specific and predictive linguistic "tells" of AI-generated text. Classifiers built on these extracted features are not only highly interpretable but exhibit stronger performance on out-of-distribution texts than either neural or stylometric alternatives.
12. 【2610.29996】HiddenLens: A Multi-Layer LLM Framework for Detecting and Resolving Hidden Assumptions in Software Requirements
链接:https://arxiv.org/abs/2610.29996
作者:Tanu Singh,Aashna Suman,Vinod Patidar
类目:oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词:Natural-language software requirements, operating conditions, user behaviour, affecting architecture, Natural-language software
备注: 24 pages, 14 figures, 10 tables
点击查看摘要
Abstract:Natural-language software requirements often omit assumptions about performance, operating conditions, user behaviour, and domain constraints, affecting architecture, testing, and deployment. If undiscovered until implementation, resolving them is far more costly than addressing them early. Although ambiguity and vagueness are widely studied, less attention has been given to assumptions embedded in requirements that appear clear and reasonable. We propose HiddenLens, a novel six-layer BERT-LLM pipeline and, to our knowledge, the first framework engineered to detect, classify, question, and resolve hidden assumptions rather than merely flag ambiguity. Layer 1 uses BERT attention entropy to localise unresolved spans; Layer 2 uses CoT-prompted LLM reasoning to articulate each assumption and its failure risk; Layer 3 uses fine-tuned BERT to classify assumptions into six non-functional requirement categories: performance, security, scalability, usability, reliability, and domain; Layer 4 generates ranked clarification options using FS LLM prompting; Layer 5 enables human validation through confirmation, editing, or rephrasing; and Layer 6 rewrites the requirement using the confirmed resolution, producing an explicit, testable, and traceable requirement. We also introduce the HiddenLens Corpus (HLC), comprising 312 requirements annotated with 847 hidden assumptions across six NFR categories. Inspired by PROMISE and PURE, HLC addresses the lack of annotated data for this task and is, to our knowledge, the first dataset developed specifically for it. HiddenLens outperforms keyword-based and QuARS-Adapted baselines by 71% and 61%, respectively, achieving an end-to-end F1-score of 0.79; its BERT-based NFR classifier achieves an F1-score of 0.847. These results indicate that HiddenLens can help analysts resolve hidden assumptions before they propagate through software development.
13. 【2610.29995】Remembering Through Change: Provenance-Preserving Hypergraph Memory for Multimodal Agents
链接:https://arxiv.org/abs/2610.29995
作者:Jielong Tang,Ling-An Zeng,Xujie Yuan,Xiao Dong,Zhiqian Xia,Qingfeng Li,Shixiong Kai,Kaichao Liang,Rong Yao,Jian Yin
类目:Computation and Language (cs.CL)
关键词:agents remains challenging, multimodal agents remains, Long-term memory, remains challenging, agents remains
备注: 31 pages,10 figures
点击查看摘要
Abstract:Long-term memory for multimodal agents remains challenging, as it must preserve fine-grained visual evidence while tracking entity evolution across sessions. Existing abstraction-based memories compress images into text, often discarding visually discriminative details, whereas pixel-preserving memories retain raw observations but struggle to reliably associate diverse observations with persistent entity identities and track their evolving states. To address these limitations, we propose MHG-Mem, a multimodal hypergraph memory that jointly organizes entity identity, state evolution, and provenance to visual evidence. Specifically, MHG-Mem represents distinct entity mentions and their observed facts as individual nodes, grouping identity-consistent mentions and facts through occurrence hyperedges. It then synthesizes aspect-specific evolution states from these grouped observations and links them to supporting entities, facts, and source evidence through evolutionary and evidential hyperedges. To navigate this structured memory, we introduce hypergraph-based agentic search, which adaptively selects an entry layer, traverses typed hyperedges across memory levels, and inspects source observations when fine-grained verification is required. These designs support both detailed visual verification and reasoning over cross-session state changes. Extensive experiments across three benchmarks demonstrate the effectiveness of MHG-Mem, improving performance by 8.20-9.98% over the strongest baseline.
14. 【2610.29968】CulturalRiddles: A Multicultural Benchmark of Riddles
链接:https://arxiv.org/abs/2610.29968
作者:My Chiffon Nguyen,Tianyi Hu,Vinod Anbalagan,Henry Gagnier,Pouya Sadeghi,Farah Abdou,Tidor-Vlad Pricope,Diego MMS Oliveira,Jocelyn K D'Arcy,Madeline Smith,Oluwaseun A Ajayi,Yusser Al Ghussin,Zena Al-Khalili,Micol Altomare,Shayan Amir,Ahanaf Aziz,Bryan Chen,Ruchira Dhar,Abdellah El Mekki,Rawan Mohammed Elframawy,Akhil Eppa,Silvia Fernandez,Alex Gimei,Arya Hariharan,Christian Hoang,RamMohanRao Kadiyala,Diana Kozachek,Peerat Limkonchotiwat,Ankita Maity,Di Mo,Ayush Munot,Aylin Naebzadeh,Anastasiia Nikitina,Dina Pisarevskaya,Divas Poudel,Jebish Purbey,Md Rabius Sany Apu,Ahmad Mufli Ramadhan,Ralitza Nikolova Rizova,Diogo M. Serrano-Miranda,Vivek Gopalkrishna Silimkhan,Luis Fernando Solis Navarro,Kaiser Sun,Arya Suneesh,Manaswitha Sunkara,Tejaswi Sunkara,Jonathan E Swindell,Hanna Yukhymenko,Jingyi Zheng,Esther Adenuga,Ilia Afanasev,Wafa Aissa,Lisa Alazraki,Lauren C Altomare,Priscilla Amondi Amuok,Emile Anand,Gabriel Assis,José Matías Avalos,Silvia Lorena Avila,Zakaria Baannou,Niyati Bafna,Yash Bagla,Sarah Bahrami,Bontu F Balcha,Vanya Bannihatti Kumar,Irene Baucells,Abdumutalib Begmuratov,Naman Bhatia,Souvik Bhattacharyya,Isabel Blanco Ferreiro,Felipe Bochini,Sayuru Bopitiya,Angana Borah,Tulika Bose,Olena Bugaiova,Juliana Carvalho,Nancy F Chen,Stephy Chen,Rochelle Choenni,Jayanth Krishna Chundru,Leandro A Cossio,Nebojša Damnjanović,Ona de Gibert,Marco De Santis,Pedro Delgado,Kaustubh Dholé,Adnan El Assadi,Wesam El-Sayed,Nadine M Elframawy,Oumayma Essarhi,Naome A Etori,Reuben Chagas Fernandes,Saanidhi Pravin Gade,Javier García Gilabert,Álvaro González-Escapa,Bin Hu,Kaiyu Huang,Abderrahmane Issam,Danka Jokić,Ulugbek Khalilov
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词:represent diverse cultures, increasingly important, understand and represent, represent diverse, benchmarks remain English-centric
备注: 37 pages. Dataset: [this https URL](https://huggingface.co/datasets/CohereLabsCommunity/CulturalRiddles) Code: [this https URL](https://github.com/Cohere-Labs-Community/CulturalRiddles)
点击查看摘要
Abstract:As LLMs expand their language coverage, evaluating how well they understand and represent diverse cultures becomes increasingly important. However, many benchmarks remain English-centric, with limited cultural coverage and a focus on factual knowledge over its application in real-world cultural contexts. We propose CulturalRiddles, a benchmark of original, culturally grounded riddles created entirely by humans through a participatory community effort, spanning 62 cultures (45 countries, 51 languages). These riddles are deeply rooted in their respective cultures and require abductive and compositional reasoning, alongside detailed factual and social knowledge, language skills, and an understanding of culturally specific associations. We benchmark 28 LLM configurations using both automatic and large-scale human evaluation. Even frontier models achieve at most 22% accuracy in some communities. We publicly release all artifacts alongside an open contribution process to expand the benchmark's linguistic and cultural coverage.
15. 【2610.29961】Commit or Abstain? System One Decision Models, LLMs, and Missing Legal Authority
链接:https://arxiv.org/abs/2610.29961
作者:M. Mikail Demir
类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词:requires scalable, enormous number, number of claims, decision model, decision
备注: 16 pages, 4 figures, 4 tables. Under review. Code, data, and model outputs: [this https URL](https://github.com/mmikaildemir/commit-or-abstain)
点击查看摘要
Abstract:Given the enormous number of claims to be checked, verifiable legal AI requires scalable, cost-effective models that answer the practical needs of law. System One decision models are built on large language models but, instead of generating text, return a calibrated probability for each option. This suits the verification of legal authority, where the question is closed: a given holding, or none of them. We test whether such models abstain when the correct authority is missing. We extend CaseHOLD with an abstention condition in which the correct holding is replaced in 1,670 of 5,314 items, and compare four decision models with six generative LLMs. When no option is correct, generative LLMs still pick one in 38-86% of items; the most cautious decision model does so in 30%. On standard CaseHOLD, a decision model matches the best generative LLM (88.1% vs. 88.2%) at 1/55 of the cost. Accepting that LLM's answer only when a decision model agrees halves its wrong citations, and distilling a decision model's probabilities into Qwen3-8B, without labels, yields a well-calibrated local model. Legal AI should be judged by its wrong citations, not by accuracy alone.
16. 【2610.29943】owards English - Mizo Legal Machine Translation: Corpus Creation, Analysis, and Benchmarks
链接:https://arxiv.org/abs/2610.29943
作者:Telem Joyson Singh,Sanabam Boyshana,Sanasam Ranbir Singh,Priyankoo Sarmah
类目:Computation and Language (cs.CL)
关键词:Indian court proceedings, limited translation technology, Indian court judgments, Indian court, Gauhati High Court
备注: Accepted in OCOCOSDA 2026
点击查看摘要
Abstract:Indian court proceedings are held in English, so speakers of languages with limited translation technology have limited access to them. We present the first English Mizo parallel dataset of Indian court judgments. It contains 13,168 sentence pairs from the Gauhati High Court and the Supreme Court of India. Professional native Mizo translators translated complete documents; sentence pairs were manually aligned, and two independent reviewers checked the results. Our study finds that English words are borrowed in a very selective way: official and legal terms are almost always kept in English, but words for everyday things like actions, situations, and results are usually expressed in native Mizo. Mizo diacritics are also used inconsistently across the corpus. When we fine tune the NLLB 200 1.3B model on our training data, it scores 27.47 BLEU on a balanced legal test set of 1,000 sentence pairs, an improvement of 7.16 BLEU over the base model. However, it still uses English words about three times more often than a human translator does.
17. 【2610.29934】oM2Vec: Continuous Theory-of-Mind Tokens for Multi-Agent Coordination
链接:https://arxiv.org/abs/2610.29934
作者:Nithin Sivakumaran,Ali Payani,Hyunji Lee,Mohit Bansal,Elias Stengel-Eskin
类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA)
关键词:Forming an accurate, key to successful, single partner state, Forming, tokens
备注: Code: [this https URL](https://github.com/nsivaku/tom2vec)
点击查看摘要
Abstract:Forming an accurate theory-of-mind (ToM) is key to successful multi-agent collaboration and requires reasoning under uncertainty to capture multiple possible partner states. This is hard to do in the text representation space native to large language model (LLM) agents, which more easily describe a single partner state. To address this challenge, we introduce ToM2Vec, which learns to form abstract theories-of-mind in a rich latent space via a fixed budget of continuous reasoning tokens. During training, supervision for these tokens comes from the partner's actual thoughts, which the ToM tokens are trained to abstract and match. At test-time, ToM tokens are generated by each agent and act as conditioners for that agent's thoughts and actions. Across several environments covering collaborative, competitive, and mixed-motive settings (Overcooked-AI, multiparty negotiation, Decrypto, Hanabi, and Collab Escape/Capture), we evaluate ToM2Vec's ability to support multi-agent interactions and collaboration, finding consistent improvements over the base model and a variety of competitive trained and prompted baselines. We show that latent reasoning is critical, with performance dropping when reasoning is expressed in text. Moreover, we show that ToM2Vec training generalizes to partner model families not seen at train-time, including a proprietary model (GPT-5.4). In our analysis, we provide evidence that the latent tokens encode a ToM, rather than task-specific information: ToM2Vec's tokens improve the agent's ability to directly answer questions about partner beliefs, desires, and next actions.
18. 【2610.29933】Graph Topology Meets Energy-Driven Pathfinding: Preserving Contextual Consistency in Retrieval-Augmented Generation
链接:https://arxiv.org/abs/2610.29933
作者:Yufeng Li,Zaijing Li,Fuchen Zhang,Zongzong Wu,Ming Zhao,Fengxiao Tang
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词:frequently integrates knowledge, Retrieval-augmented generation, multi-hop question answering, complex multi-hop question, integrates knowledge graphs
备注: Accepted to Findings of the Association for Computational Linguistics: EMNLP 2026
点击查看摘要
Abstract:Retrieval-augmented generation (RAG) frequently integrates knowledge graphs (KGs) for complex multi-hop question answering. However, their performance is increasingly bottlenecked by the knowledge structuring and reasoning processes. (i) Severe semantic loss: Distilling continuous texts into discrete symbols strips away contextual nuances and narrative coherence. (ii) Pronounced modality mismatch: Fragmented graph structures clash with the continuous texts LLMs are pre-trained on, while rewriting them into natural language introduces generative noise and omits information. To address these limitations, we propose ThreadRAG, a semantic-topology-based RAG framework for context-preserving knowledge structuring and modality-native evidence reasoning. ThreadRAG introduces a Semantic Topology Mapper (STM), which organizes retrieved documents into context-intact Semantic Nodes and constructs a Semantic Topology Graph (STG) through narrative, semantic, and lexical edges. It further incorporates Energy-Driven Pathfinding (EDP), which identifies query-relevant subgraphs via energy diffusion and deterministically linearizes them into coherent textual evidence paths. Experiments on three multi-hop QA benchmarks demonstrate that ThreadRAG consistently outperforms strong baselines. Notably, it achieves a 14.4% EM improvement over text-centric methods on HotpotQA and surpasses the best baseline by 5.8% EM on 2WikiMultihop, while reducing token cost to 23.3% of the strongest baseline.
19. 【2610.29927】Your Benchmark Is an Empirical Measure Over Difficulty
链接:https://arxiv.org/abs/2610.29927
作者:Yifan Sun,Naicheng Yu,Jiawen Gong,Jingyan Shen,Huan Zhang
类目:Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词:test questions, collection of test, naturally induces, induces an empirical, difficulty
备注: Accepted at NeurIPS 2026
点击查看摘要
Abstract:A benchmark is not merely a collection of test questions; it naturally induces an empirical measure over difficulty. In this work, we develop this measure-based view of benchmark evaluation. This perspective allows us to identify and formalize two central failure modes: measure mismatch, where the benchmark difficulty distribution differs from the intended difficulty distribution, and coverage gaps, where uncovered regions along the difficulty axis prevent benchmarks from detecting meaningful localized training progress. We propose two diagnostic metrics that capture these two failure modes and provide rigorous theoretical guarantees. Empirically, we analyze 25 popular benchmarks spanning 7 domains using carefully estimated item difficulties. Our results show that many benchmarks implicitly overweight certain difficulty regions, so their leaderboard conclusions should be interpreted with caution; others leave substantial portions of the difficulty axis uncovered, limiting their ability to monitor the model improvement process. Finally, we turn diagnosis into action by introducing BenchFill, a simple difficulty-targeted item rewriting algorithm that effectively reduces local coverage gaps.
20. 【2610.29926】ask-Preserving Multilingual Instruction Tuning for Open-Ended QA in WMT 2026 MIST
链接:https://arxiv.org/abs/2610.29926
作者:Aleix Sant,Jordi Luque,Carlos Escolano
类目:Computation and Language (cs.CL)
关键词:Multilingual Instruction Shared, Instruction Shared Task, Instruction Shared, Multilingual Instruction, multilingual instruction dataset
备注:
点击查看摘要
Abstract:This paper describes our submission to the WMT 2026 Multilingual Instruction Shared Task. We adapt Qwen3-8B with LoRA using organiser-provided data, EuroAlpaca, a multilingual instruction dataset created through task-preserving localisation, and CrossEuroAlpaca, a cross-lingual augmentation that assigns different source and target languages to instructions, contexts and responses. Our system targets open-ended question answering (QA-OEG) in ten shared-task languages represented in the auxiliary data. Under matched decoding, adaptation improves the mean Gemma-4 judge score on target-language QA-OEG by 7.8% relative to the base model. On an additional evaluation using the Aya Evaluation Suite across all shared-task languages, it yields relative gains of 41.5% in macro-averaged ROUGE-L and 2.9% in BERTScore-F1, with larger improvements in target languages. However, these gains are task- and language-specific. Gemma-4 scores improve for QA-OEG and summarisation in the target languages but decline for context-grounded QA there and across all three tasks in the non-target languages.
21. 【2610.29922】Unintended Side Effects of Value Training in LLMs
链接:https://arxiv.org/abs/2610.29922
作者:Siddhesh Pawar,Chen Cecilia Liu,Anna Korhonen,Isabelle Augenstein
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词:guiding model behaviour, objective in NLP, value-sensitive contexts, aimed at instilling, increasingly deployed
备注: 37 pages, 31 figures, 26 tables
点击查看摘要
Abstract:As LLMs are increasingly deployed in value-sensitive contexts, aligning them with human values has emerged as a post-training objective in NLP, aimed at instilling additional values and guiding model behaviour. However, current evaluations remain narrow. Because values are interconnected, it is unclear how fine-tuning for specific values alters unrelated capabilities and behaviours. In this work, we adapt four instruction-tuned LLMs across individual Hofstede's value dimensions and evaluate them on both cross-value transfer and broader behaviours. We find that value-specific training produces unintended side effects on untrained values, risk preferences, social cognition, and safety traits. Consequently, we suggest that value alignment after post-training should incorporate broader behavioral evaluations, and we highlight the need to investigate where additional value training might best fit into the pipeline.
22. 【2610.29907】Benchmarking Large Language Models for Detecting Satirical Code-Mixed Sentences
链接:https://arxiv.org/abs/2610.29907
作者:Răzvan-Alexandru Smădu,Ioana Buhnila,Daniela Tanase,Dumitru-Clementin Cercel,Florin Pop,Mihaela-Claudia Cercel
类目:Computation and Language (cs.CL)
关键词:remains largely unexplored, natural linguistic phenomenon, high-level reasoning tasks, reasoning tasks remains, tasks remains largely
备注: 35 pages, 8 figures
点击查看摘要
Abstract:Code-switching is a natural linguistic phenomenon, yet its impact on high-level reasoning tasks remains largely unexplored in under-resourced languages like Romanian. Natural language processing tasks, such as satire detection, rely heavily on nuanced cultural and syntactic cues that large language models struggle to capture. In this paper, we investigate four methods (i.e., random replacement, phrase translation, dependency parsing, and large language models) for generating synthetic code-mixed Romanian sentences with English, German, French, and Italian. We start with an existing dataset for satire detection, compiled from Romanian news articles and annotated at the sentence level by humans, and augment it with over 600k samples, namely CS-SeLeRoSa. We provide an in-depth analysis of the dataset generation process. Then, we evaluate several multilingual large language models across zero-shot, chain-of-thought, and fine-tuning regimes on both the synthetic corpus and a human-adjudicated gold benchmark, namely CS-SeLeRoSa-Gold. While older open models suffer substantial degradation (dropping to 37%-55% macro-F1), newer models like Gemma 4 31B achieve 68.1% zero-shot, rivaling frontier models like GPT-5 mini (69.5%). Furthermore, fine-tuning significantly reduces formatting errors and improves the results, increasing Gemma 4 31B to 77.5% on CS-SeLeRoSa and 72.6% on the gold standard, outperforming frontier zero-shot baselines.
23. 【2610.29896】Investigating the Impact of Learner Errors on Social Bias in Large Language Models
链接:https://arxiv.org/abs/2610.29896
作者:Federico Marcuzzi,Martin Christoph,Iryna Gurevych,Alla Rozovskays
类目:Computation and Language (cs.CL)
关键词:Existing social bias, reflecting native speaker, evaluate large language, large language models, native speaker usage
备注:
点击查看摘要
Abstract:Existing social bias benchmarks evaluate large language models mostly on fluent, well-formed English, reflecting native speaker usage and leaving non-native writers unrepresented. To address this gap, we investigate how grammatical errors by non-native writers affect social bias. We develop a controlled framework that injects common learner errors into prompts and apply it to three bias benchmarks covering stereotype alignment and demographic preference across gender, race, and religion. We find that grammatical errors increase bias, and the effect grows with the error rate. Among the four common error types we consider, preposition errors produce the largest and most consistent increase in stereotype alignment. Our analysis suggests that errors increase bias when they are more likely to interfere with comprehension. Finally, fine-tuning on erroneous texts reduces the bias increase caused by grammatical errors. Our findings show that bias evaluations based exclusively on well-formed prompts may underestimate the bias experienced by users whose English contains grammatical errors.
24. 【2610.29843】Every Part Has Its Role: Part-of-Speech Effects in LLM Post-Training
链接:https://arxiv.org/abs/2610.29843
作者:Laya Iyer,Chen Shani
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词:Large language models, rewards predicting specific, predicting specific tokens, Large language, ran home
备注:
点击查看摘要
Abstract:Large language models are typically trained with next-token prediction (NTP), which rewards predicting specific tokens rather than explicitly accounting for the semantic similarities between different words or expressions. Prior work has addressed this limitation by augmenting training data with minimally varying sentences that replace a target word with conceptually related alternatives, e.g., "The tired coach ran home" $\rightarrow$ {"The tired trainer ran home", "The tired instructor ran home", ...}. Such concept augmentation improves performance, but it remains unclear whether its effectiveness depends on where in the sentence the concept is expressed. We reproduce and extend prior work $\textit{beyond nouns}$ to verbs and adjectives, asking whether the part of speech (POS) carrying the concept signal affects perplexity and downstream performance. We find different patterns across evaluation settings: concept augmentation improves perplexity most consistently on news, independent of the POS used, whereas verbs provide the most reliable downstream gains. Despite these behavioral differences, representational analyses using CKA and linear probing show that the conditions yielding the largest downstream gains are not necessarily those that most alter the model's internal representations. Together, these results suggest that the effectiveness of concept augmentation depends on where and how conceptual information is introduced during training.
25. 【2610.29832】S-EDL: Eliciting Self-Evidence from Sequence Likelihoods for Semantic Calibration of LLMs
链接:https://arxiv.org/abs/2610.29832
作者:Yawei Li,Jiazheng Li,David Rügamer,Bernd Bischl,Yulan He,Mina Rezaei
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词:Calibrating large language, Calibrating large, distinct token sequences, large language models, underlying meaning
备注: 34 pages, 8 figures
点击查看摘要
Abstract:Calibrating large language models (LLMs) in open-ended generation is uniquely challenging because many distinct token sequences can express the same underlying meaning. Prior calibration techniques target either fixed-set classification confidence or the binary correctness of individual strings, making them inherently ill-suited for the dynamic, multi-string nature of open-ended semantic outcomes. To bridge this gap, we introduce S-EDL, a novel evidential method that natively optimizes LLMs for semantic calibration. By eliciting evidence from the sequence likelihoods of the model itself, S-EDL constructs a differentiable Dirichlet prior over prompt-specific semantic classes. Optimizing the evidential loss under this prior yields a calibration-aware training signal over variable semantic classes, completely bypassing the need for fixed multiple-choice options. Evaluations across four open-ended benchmarks and three models demonstrate that S-EDL substantially reduces semantic calibration error while improving accuracy. By aligning generative likelihoods with semantic correctness, this work establishes a framework for deploying trustworthy LLMs in complex, open-ended applications. Code is available at: this https URL.
26. 【2610.29823】MemoryTax: The Bitter Lesson of Agent Memory
链接:https://arxiv.org/abs/2610.29823
作者:Zedong Peng
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词:Claude Opus, Zep decide, raw history, Agent memory systems, Agent memory
备注:
点击查看摘要
Abstract:Agent memory systems such as Mem0 and Zep decide what to keep before any question arrives; coding agents keep the raw history and let the model search it with its own tools. We ask whether designed memory still helps once the model is strong enough to search for itself. On one LoCoMo conversation (419 turns, 152 questions), we run four memory methods (full context, BM25, Mem0, Zep) and three coding agents (Pi, Codex, Claude Code), each with GPT-4o-mini, GPT-6 Luna and Claude Opus 5.5, and record what every rollout costs. This is a short empirical study, with one conversation and one run per cell. Agent memory is a costly patch for a weak model: Mem0 beats full context only with GPT-4o-mini, and its build alone costs more than a whole full-context rollout. Agent memory also has a ceiling, set by the model that writes it: a stronger reader does not recover what a weaker writer left out. With Claude Opus 5.5, Pi tops the cost-accuracy frontier, scoring 99% for less than half the cost of full context; its one miss is a wrong answer key. Part of that lead comes from photo captions that only the agents could read: on the 88 questions whose evidence has no photo, Pi and full context differ by one answer.
27. 【2610.29812】Real PMIDs, Wrong Papers: Harness Design for Biomedical Claim-Verification Agents
链接:https://arxiv.org/abs/2610.29812
作者:Mohammed Saqlain
类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词:Literature-searching language agents, Literature-searching language, life sciences, harness matter, standard component
备注: Accepted to the Agentic AI for Biological Discovery (AgenticLS) Workshop at NeurIPS 2026
点击查看摘要
Abstract:Literature-searching language agents are becoming a standard component of scientific assistants for the life sciences, yet there is little controlled evidence on which parts of their harness matter. We run a controlled ablation on biomedical claim verification (SciFact) with the live PubMed API as the only tool. Holding the backbone and output format fixed, we compare four harnesses: closed-book answering, single-shot retrieval using the claim as the query, a ReAct-style agent that writes its own PubMed queries, and an oracle given the gold abstracts, each with two efficient frontier backbones. Naive single-shot retrieval finds the gold paper for only 6% of claims and turns overconfident errors into abstentions without improving accuracy. Letting the model formulate its own queries triples gold recall and yields the best verdicts (62% accuracy vs. 49-59% for the other realistic harnesses), although these differences are not significant at our sample size and agents use fewer than half of their search budget. With gold abstracts, the same models reach 79-86% accuracy, a significant 17-24 point gap showing that retrieval, not reasoning, is the main bottleneck. Finally, a citation audit shows that closed-book models cite PubMed IDs that almost always exist (327/335) but are almost never relevant: a cross-family LLM judge rates only 3 of 327 existing citations as relevant to the claim, versus 67% for citations produced by the search agent. Existence checks are therefore insufficient safeguards for scientific agents. We release code, prompts, and all cached tool calls at this https URL.
28. 【2610.29792】MAPS: Macro-Adaptive Parallel Reasoning for Regulating Search Momentum in Retrieval-Augmented Generation
链接:https://arxiv.org/abs/2610.29792
作者:Xinze Li,Dingwen Zhang,Zhenghao Liu,Yukun Yan,Shuo Wang,Yu Gu,Ge Yu,Maosong Sun
类目:Computation and Language (cs.CL)
关键词:Large Language Models, Large Language, performance of Large, Language Models, RAG methods
备注:
点击查看摘要
Abstract:Retrieval-Augmented Generation (RAG) improves the performance of Large Language Models (LLMs) by retrieving external knowledge. Recently, some RAG methods interleave reasoning and retrieval, enabling LLMs to progressively generate sub-queries and retrieve external knowledge. However, these methods may suffer from redundant or ineffective sub-queries and insufficiently diverse query exploration. Moreover, due to the tightly interleaved nature of reasoning and retrieval, it remains unclear how the evolving reasoning process influences query intent. To characterize the evolution of query intent during reasoning, we introduce search momentum, which captures the accumulated retrieval tendency induced by historical changes in generated sub-queries along the reasoning trajectory. Through momentum-based analysis, we find that the query generation process tends to continuously evolve along existing retrieval trajectories. Based on this observation, we propose MAPS, a Macro-Adaptive Parallel Reasoning framework for regulating search momentum and mitigating query-intent drift. MAPS first retains the retrieved knowledge and a refined reasoning state, thereby reducing the influence of historical reasoning trajectories on subsequent sub-query generation. Subsequently, MAPS extends the conventional sequential reasoning process into a parallel reasoning paradigm. At each iteration, MAPS identifies complementary retrieval directions, generates corresponding sub-queries for parallel retrieval, and consolidates the retrieved evidence to update the knowledge and reasoning states. Experiments on six question-answering benchmarks demonstrate that MAPS consistently outperforms representative RAG methods across different backbone models. All code and resources are available at this https URL.
29. 【2610.29785】Where Do LLMs Learn to Recommend AI?
链接:https://arxiv.org/abs/2610.29785
作者:Benaya Trabelsi,Jonathan Shaki,Sarit Kraus
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Machine Learning (cs.LG)
关键词:large language models, recommend AI-related options, career to pursue, product to build, large language
备注: 18 pages, 4 figures. Companion paper to [arXiv:2601.13749](https://arxiv.org/abs/2601.13749)
点击查看摘要
Abstract:Asked what to study, which career to pursue, or what product to build, large language models (LLMs) often recommend AI-related options. We ask where this tendency comes from by comparing models before and after fine-tuning and by varying how questions are asked. First, pretrained models already include explicit AI/ML terms in the recommendations of 27% of their responses, and their released instruction-tuned versions do so in 59%. Second, fine-tuning models ourselves shows that this rise is not inevitable: general instruction tuning leaves the rate unchanged, but removing the 7% of instruction examples that concern AI cuts it by 14 percentage points, below the level of the pretrained models it starts from. Data rewarding helpfulness raise it by 9 points, while data ranked by the preferences of diverse simulated users lower it by 9. Finally, with models held fixed, asking for the "best" option or for what to do "right now" raises the rate by 8 and 18 points, whereas telling the model it is an AI advisor adds 4. Overall, the tendency starts in pretraining, and what models learn afterward, together with how a question is phrased, decides how strongly it appears.
30. 【2610.29784】Evolving with Open Worlds: Towards Recursive Self-Improvement for Future Forecasting
链接:https://arxiv.org/abs/2610.29784
作者:Zhipeng Chen,Yunsen Liang,Yanxi Chen,Hongkang Zhao,Lingyun Feng,Ruiyang Ren,Guoxin Chen,Jia Deng,Feng Chang,Chuan Hao,Ran Tao,Jian Yang,Ji-Rong Wen,Bryan Dai,Wayne Xin Zhao
类目:Computation and Language (cs.CL)
关键词:contemporary artificial intelligence, call recursive self-improvement, artificial intelligence, studying RSI requires, contemporary artificial
备注: 47 pages, 13 figures. Working in progress
点击查看摘要
Abstract:Most contemporary artificial intelligence (AI) systems are released with frozen parameters and improve through external updates, whereas an ideal system would keep improving from its own experience, a capacity we call recursive self-improvement (RSI). Yet studying RSI requires an environment that is continuously changing, objectively verifiable, and naturally grounded, posing a fundamental challenge for agent evolution. Here we introduce DeepEvolve, a sustainable evolution agent system grounded in future event prediction, in which agents continuously interact with a dynamically evolving environment and improve by internalizing and externalizing the experience gained through these interactions. A living environment synthesizes verifiable tasks, and a recursive-evolution engine turns the reasoning trajectory behind each prediction back into capability: decoupling search from prediction adapts parameter-level evolution to the contamination-prone live environment, while distilling reusable skills lets the agent evolve from the limited live trajectories such an environment affords. On the external FutureX leaderboard, which evaluates predictions against real-world outcomes and is updated weekly, our self-improved forecaster ranked first across all systems over three consecutive weeks, achieving up to a 195% improvement in rating. On our synthesized evaluation, it ranked among the top three across four base LLMs, outperforming the strongest baseline by up to 10.7 Bradley--Terry points. More broadly, these results suggest that a system built for self-improvement is best understood as an agent that co-evolves with a genuinely living, open-ended environment, pointing to a shift in AI from training static models on fixed data toward cultivating agents that grow stronger from their own experience, with such an open world as the indispensable basis of that growth.
31. 【2610.29767】ALIAS: Evaluating Performance and Memorization in LLM-Written TLA+ Specifications
链接:https://arxiv.org/abs/2610.29767
作者:Arslan Bisharat,Mujtaba Nazari,Khushboo Bhadauria,Brian Ortiz,Eric Spencer,Beatriz Santos,TaiNing Wang,George K. Thiruvathukal,Konstantin Laufer,Mohammed Abuhamad
类目:Computation and Language (cs.CL); Software Engineering (cs.SE)
关键词:large language models, inflates the benchmark, reproduce answers, benchmark scores, lower score
备注: 19 pages (8 main + appendix), 6 figures, 9 tables. Code and data: [this https URL](https://github.com/LUC-AI4FM/ALIAS)
点击查看摘要
Abstract:Memorization inflates the benchmark scores of large language models (LLMs), since a model can reproduce answers it saw in training. Researchers test for it with consistent identifier renaming (CIR), which gives every identifier in a task a new name, and treat a lower score on the renamed task as evidence of recall. We test this method on the Temporal Logic of Actions Plus (TLA+) language, whose model checker acts as an oracle by confirming whether a renamed task preserves the exact behaviors of the original. Across 111 TLA+-Bench tasks, renaming lowers the correctness of Claude Opus 4.8 from 28% to 18% and of GPT-5 from 9% to 7%. Most of this decrease comes from how the test grades, which requires exact names that most descriptions never state. Grading by behavior shrinks the decrease to about 3 percentage points for Opus 4.8 and to 0 for GPT-5. In two model families fine-tuned on disjoint halves of the tasks, renaming removes about half of the training gain in likelihood and costs 4.9 percentage points (Qwen) and 1.3 percentage points (Gemma) on unseen tasks. A lower score after renaming therefore mixes memorization, name-based grading, and the cost of new names.
32. 【2610.29751】Bridging Foundational and Agentic Capabilities of LLMs
链接:https://arxiv.org/abs/2610.29751
作者:Wei Guo,Yuanjian Xu,Jianing Hao,Yongyao Duan,Ran Chen,Zhong Li,Guang Zhang
类目:Computation and Language (cs.CL); Software Engineering (cs.SE)
关键词:Large language models, Large language, increasingly deployed, Large, foundational capabilities translate
备注:
点击查看摘要
Abstract:Large language models (LLMs) are increasingly deployed as agents, yet it remains unclear how their foundational capabilities translate into agentic capabilities. End-to-end scores leave unresolved whether low benchmark capability or weak deployment drives a failure, limiting actionable diagnosis. We bridge foundational and agentic capabilities through an operation-level measurement framework. We represent each model with a foundational profile derived from capability benchmarks and an operation profile derived from interaction trajectories, and define capability realization gaps as deviations of observed operation performance from predictions based on foundational capabilities. Experiments on fifteen model services in $\tau^2$-Bench show that foundational profiles only partially predict agentic operations. Models with comparable profiles can differ substantially in execution, and these gaps remain consistent across task subsets. Operation profiles add information and substantially improve task-score prediction. The framework locates execution departures at the operation level to inform model development and agent evaluation. We will release our code and analysis artifacts.
33. 【2610.29727】Accept or Repair: Preserving Passage-Supported Answers in Contrastive Decoding
链接:https://arxiv.org/abs/2610.29727
作者:Jungseob Lee,Seungyoon Lee,Hyeonseok Moon,Seongtae Hong,Suhyune Son,Sugyeong Eo,Minhyuk Kim,Chanjun Park,Jaehyung Seo
类目:Computation and Language (cs.CL)
关键词:Large language models, Large language, learned during training, passage, Large
备注: 21 pages, 5 figures. Code will be released at [this https URL](https://github.com/js-lee-AI/AoR)
点击查看摘要
Abstract:Large language models often answer from knowledge learned during training, even when a provided passage contradicts that knowledge. To address this problem, contrastive decoding contrasts the predictions under the full and a modified prompt at every token, but it also alters correct answers that the passage supports. We show that checking answers against the passage removes this trade-off. Based on this observation, we propose Accept-or-Repair (AoR), a training-free procedure. AoR keeps a sampled answer if the passage supports it. Otherwise, it tries up to two replacements with contrastive decoding, returning one as soon as it passes this check. It rejects replacements that repeat the answer generated without the passage when the passage favors another answer. Our experiments show that AoR raises the score over sampling by 12.5 points on counterfactual passages and 2.3 on ordinary ones, surpassing eight contrastive and prompting baselines on both, including when each receives the same rejection rule. Replacing only initial answers that the passage does not support improves the average score of every decoder. These results suggest that models can follow passages that contradict their knowledge while preserving accuracy on passages that agree with it. Code will be released at this https URL.
34. 【2610.29722】Retrieval Augmented Generation Compositionality
链接:https://arxiv.org/abs/2610.29722
作者:Ido Levy,Segev Shlomov,Leshem Choshen
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词:Retrieval Augmented Generation, Augmented Generation, grounds large language, large language models, Retrieval Augmented
备注: 103 pages (9 main), 15 figures, 68 tables. Project page: [this https URL](https://dolev31.github.io/lasagna/) Code: [this https URL](https://github.com/dolev31/lasagna)
点击查看摘要
Abstract:Retrieval Augmented Generation (RAG) grounds large language models in external knowledge. Modern pipelines combine embedding, chunking, retrieval, reranking, query augmentation, context compression, and agentic verification, yet these techniques are typically evaluated one at a time. It remains unclear whether their isolated gains survive composition, whether retrieval quality and answer faithfulness favor the same design choices, and whether conclusions from small corpora hold at large scale. We pre-declare three hypotheses and introduce LASAGNA, an open-source framework for controlled RAG evaluation. We test 450 configurations across eight benchmarks and corpora ranging from 5K to 200K documents. Three findings emerge. First, individually strong techniques from different phases of a RAG pipeline do not necessarily compose: three retrieval techniques predict a +47% combined improvement but deliver only +17% when used together. Second, component gains stack differently for retrieval and faithfulness, and optimizing one can hurt the other. Third, the best composition changes as the corpus grows: the combination that wins on a small corpus may not remain best at large scale. These findings show that gains measured in isolation are not reliable predictors of realistic performance, and that new RAG techniques should be tested with the full surrounding stack. We call on researchers to do so and supply LASAGNA to simplify these experiments.
35. 【2610.29681】Scaling Multilingual Pretraining of Pixel Language Models
链接:https://arxiv.org/abs/2610.29681
作者:Ilker Kesen,Jenny Kunz,Kasra Malihi,Desmond Elliott
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词:models process text, finite vocabulary, process text, text as rendered, rendered images
备注: 33 pages, 25 figures, 14 tables
点击查看摘要
Abstract:Pixel language models process text as rendered images instead of a finite vocabulary, which gives them strong cross-lingual transfer abilities. However, not much is known about how these abilities are influenced by larger-scale pretraining. In this paper, we train a family of MPIXEL models along three axes of variation: more languages, more scripts, and larger model capacity under fixed per-language compute. In evaluations on five tasks covering 83 languages, we find that scaling acts locally: each axis improves the added languages and scripts, while increased capacity mitigates the curse of multilinguality from pretraining on more languages. Transfer to unseen scripts improves with multilingual pretraining, but does not further improve with scaling. On typologically distant low-resource languages, our models outperform subword and character-level baselines across many writing systems. We also show that larger pixel models reserve more layers for visual processing, and that cross-lingual alignment weakens as more languages are added. Overall, our findings characterize how multilingual scaling improves pixel language models.
36. 【2610.29671】Uni-Mem: Learning a Long-Horizon Agentic Memory Manager with Unified Online Policy Optimization
链接:https://arxiv.org/abs/2610.29671
作者:Zhiqian Xia,Jielong Tang,Ling-An Zeng,Shixiong Kai,Rong Yao,Hao Kong,Xiao Dong,Wei Wang,Mingxuan Yuan,Siyu Xia,Haifeng Xia
类目:Computation and Language (cs.CL)
关键词:Long-term agent memory, Long-term agent, shifting from predefined, predefined workflows, workflows toward learnable
备注: 21 pages, 8 figures
点击查看摘要
Abstract:Long-term agent memory is shifting from predefined workflows toward learnable policies for memory construction and retrieval. Existing learning-based methods either optimize construction alone or combine retrieval-side online reinforcement learning (RL) with offline construction supervision, limiting co-adaptation between the two stages. In this paper, we explore end-to-end online RL for a unified memory manager (Uni-Mem) that learns both capabilities under a shared policy. However, joint optimization with existing RL algorithms such as GRPO faces confounded group comparisons and sparse feedback over long memory-management trajectories. To this end, we propose Stage-Decoupled GRPO, which alternates construction and retrieval optimization while controlling variation from the other stage within each rollout group, yielding stage-specific learning signals. We further introduce Event-Wise Credit Assignment (ECA), which localizes feedback to responsible events and propagates event-level advantages to their constituent operations. Experiments on LoCoMo and LongMemEval show that Uni-Mem outperforms the strongest RL-based memory, demonstrating the effectiveness of jointly learning memory construction and retrieval via Stage-Decoupled GRPO and ECA.
37. 【2610.29669】Conflicted Records: Typed Adversarial Contracts for Auditable LLM Output Quality Enforcement
链接:https://arxiv.org/abs/2610.29669
作者:Kardelen Subasi,Jarosław A. Chudziak
类目:Databases (cs.DB); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA)
关键词:increasingly populate production, populate production information, production information systems, LLM-generated records increasingly, data assets subject
备注: Accepted at the International Conference on Cooperative Information Systems (CoopIS 2026)
点击查看摘要
Abstract:LLM-generated records increasingly populate production information systems where they are treated as data assets subject to the same quality expectations as records from operational databases. A single such record can simultaneously satisfy and violate a quality rule: a grounded fact adjacent to a hallucination, a useful answer adjacent to a stereotype. Classical data cleaning cannot resolve this because the two judgments are incompatible over the same span; a single LLM judge cannot either, since it shares the training biases that produced the conflict. Existing interventions such as prompt engineering, chain-of-thought, and RLHF reduce surface error rates but provide no audit trail and cannot distinguish genuine remediation from blanket suppression. The question is whether a deterministic check over structured inter-agent records can catch the defects that referential checks alone miss. We present BiasGuard-D: two adversarial roles drawn from distinct model families exchange typed claim documents, a three-model quorum adjudicates by majority vote, and a combined referential-plus-semantic invariant validates the verdict. The semantic component fires on verdicts referential checks miss; removing the iterative loop drops invariant satisfaction sharply. The deliberation layer transfers from stereotype to hallucination remediation on HaluEval QA with only role-framing changes, raising right-answer recovery by 49 percentage points; the triage gate required a cross-family second auditor to maintain recall on objective hallucination. Every claim, vote, and instruction is stored as a typed record giving operators a provenance trail auditable under emerging AI regulations.
38. 【2610.29662】SPARE: Sparsity Allocation via Routing Entropy for Efficient MoEs
链接:https://arxiv.org/abs/2610.29662
作者:Yifan Yang,Hanling Yi,Dongquan Yang,Feng Lin,Rong Xiao,Aijun Li,Xiaotian Yu
类目:Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词:substantial memory footprint, memory footprint poses, architectures scale model, model capacity efficiently, scale model capacity
备注:
点击查看摘要
Abstract:Mixture-of-Experts (MoE) architectures scale model capacity efficiently, yet their substantial memory footprint poses a major barrier to deployment. Expert pruning reduces this footprint, but most methods focus on which experts to remove and prune every layer equally. We propose SPARE (Sparsity Allocation via Routing Entropy), a training-free, selector-agnostic method that decides how many experts to remove from each layer using routing entropy, the entropy of tokens' normalized Top-K gate weights on calibration data. When a token's gate weight is spread evenly, removing one active expert discards little of it, so SPARE prunes layers with more diffuse routing more aggressively. A perturbation bound under random pruning formalizes this intuition, and controlled interventions with a fixed selector link concentrated routing to larger output changes. With the same selector and budget, SPARE improves average accuracy over uniform allocation on Mixtral, Qwen3, and DeepSeek models, especially at high pruning ratios. At 50% expert pruning, it raises the eight-task average of Qwen3-30B-A3B from 57.2% to 63.8%, and the math, code, and science average of DeepSeek-R1 from 80.1 to 82.8.
39. 【2610.29657】Effects of Model Scale and Quantization on Social Bias and Abstention in Question Answering
链接:https://arxiv.org/abs/2610.29657
作者:Kuniko Paxton,Ifeoluwa Wuraola,Dhavalkumar Thakker
类目:Computation and Language (cs.CL)
关键词:resource-constrained settings raises, quantized language models, compressed model produces, reflect fairer behavior, important fairness question
备注:
点击查看摘要
Abstract:The deployment of small and quantized language models in resource-constrained settings raises an important fairness question: when a compressed model produces fewer biased responses, does this reflect fairer behavior or greater abstention? We study this problem in Question Answering (QA) using the BBQ benchmark across multiple model sizes and quantization settings from Qwen3, Gemma-3, and SmolLM2. We also examine whether the observed trends remain stable across alternative prompt formulations and when the ``Unknown'' option is removed in a forced-choice setting. Our results show that larger models achieved higher QA accuracy, but bias showed no simple scaling trend and quantization effects varied across configurations. Notably, 20 of the 26 configurations with fewer biased responses also show increased over-abstention, indicating that lower observed bias can partly reflect greater abstention. These findings show that lower observed bias can partly reflect greater abstention, and that fairness evaluation should consider biased responses, abstention, prompt formulation, and answer-option design jointly.
40. 【2610.29645】LLMs as survey respondents: Comparison to simple semantic baselines
链接:https://arxiv.org/abs/2610.29645
作者:Esko Lehtonen,Tommi Buder-Gröndahl
类目:Computation and Language (cs.CL)
关键词:Large language models, Large language, language models, explored as surrogates, Large
备注: 16 pages, 5 figures
点击查看摘要
Abstract:Large language models (LLMs) have been explored as surrogates for human survey respondents. A more promising application is data augmentation, where LLMs predict new responses from partial human data. However, the semantic similarity between questionnaire items is a known source of correlation between answers. It is thus unclear whether LLMs actually infer meaningful relationships between question-response pairs, or use surface-level comparison between questions as a heuristic. To assess this, we evaluated how three LLMs can predict responses to held-out items in two surveys measuring attitudes toward automated or light-electric vehicles, based on varying proportions of known responses. Performance was compared to two baselines, where new responses were derived by maximizing embedding-similarity to a prior response. While LLMs mostly predicted human responses better than baselines, their performance consistently declined with a lower share of known responses, even aligning with the baseline in one survey. Our results show that LLMs' capacities for augmenting replies varied across surveys, and can revert to the same levels as simpler embedding similarity baselines when less data is available.
41. 【2610.29606】Overview of CHIP 2026 Shared Task 1: Patient-Specific Phenotype Concept Recognition in Full-Text Biomedical Literature
链接:https://arxiv.org/abs/2610.29606
作者:Xuanlyu Zhu,Feng Tian,Yang Zhong,Pengqi Zheng,Xiwen Bi,Ling Luo,Yuanyuan Sun,Jian Wang,Lingfei Lin
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词:Automatic phenotype information, rare disease diagnosis, information extraction plays, phenotype information extraction, Automatic phenotype
备注:
点击查看摘要
Abstract:Automatic phenotype information extraction plays an important role in rare disease diagnosis, genotype-phenotype analysis, and precision medicine. However, accurately identifying phenotype concepts and determining their associations with specific patients remain challenging, particularly in full-text biomedical articles involving multiple patients and complex clinical descriptions. This paper presents an overview of CHIP 2026 Shared Task 1, which aims to promote the development of methods for patient-specific phenotype concept recognition from full-text biomedical literature. The task consists of two subtasks: full-text phenotype concept recognition and patient-specific phenotype association. For this evaluation, we used 200 annotated full-text biomedical articles from the PatientPheX dataset, containing 506 patients, 15,193 phenotype mentions, and 5,656 patient-phenotype associations. A total of 455 teams registered for the competition, with 189 and 103 valid submissions received on the Phase A and Phase B leaderboards, respectively. The best-performing system achieved an overall score of 0.7389 on the final test set, outperforming the baseline by 8.37 percentage points. The top-performing teams explored diverse approaches combining biomedical language models, large language models (LLMs), and ensemble strategies. The evaluation results highlight both the potential of these approaches and the remaining challenges in patient attribution and phenotype normalization from full-text biomedical literature. The post-evaluation phase remains open at this https URL.
42. 【2610.29602】A Diagnostic Study of Faithfulness in Diffusion Language Models for Table-to-Text Generation
链接:https://arxiv.org/abs/2610.29602
作者:Zaynab Merimi,Noussayba El Marrakchi,Arthur Satouf
类目:Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词:language models generate, Diffusion language models, bidirectional attention, generate by iteratively, iteratively denoising
备注: 9 pages, including references and appendix. Diagnostic study on source faithfulness in table-to-text generation
点击查看摘要
Abstract:Diffusion language models generate by iteratively denoising a masked sequence under bidirectional attention, without the strict left-to-right commitment of autoregressive decoding. Whether this difference affects how reliably they remain grounded in structured inputs is largely unexplored. We study this question in table-to-text generation using ToTTo, where highlighted source cells make factual grounding directly testable. We compare the masked diffusion models MDLM and LLaDA with GPT-2 and GPT-Neo under an identical retrieval-based few-shot protocol, together with a QLoRA-adapted LLaDA, and we score reference similarity and source grounding as separate axes. The two pull apart. Within LLaDA, additional demonstrations raise BLEU from 11.3 to 22.0 while NLI entailment against the source table falls from 0.78 to 0.52; QLoRA reaches the best BLEU of the study, 24.15, and grounds no better for it. Manual annotation shows the failure modes differ in kind: the autoregressive baselines tend to wander off the table, while LLaDA-based models more often stay on topic and swap out individual entities. Reference-based metrics alone are insufficient to assess faithfulness in table-to-text generation.
43. 【2610.29555】WRDO: Weighted Refusal Direction Optimization in Aligned Language Models
链接:https://arxiv.org/abs/2610.29555
作者:Grigoriy Evseev,Vladimir Solodkin,Dmitry Bylinkin,Daniil Medyakov,Vladimir Aletov,Aleksandr Beznosikov
类目:Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词:Aligned large language, Aligned large, trained to comply, comply with benign, benign requests
备注: Accepted for EMNLP 2026
点击查看摘要
Abstract:Aligned large language models are trained to comply with benign requests while refusing harmful ones. However, recent work shows that this refusal behavior is fragile and can often be disrupted by simple activation- or weight-space interventions. In particular, refusal has been shown to be largely mediated by a single residual-stream direction, typically computed as a difference-of-means vector between harmful and harmless prompts. However, this standard construction aggregates heterogeneous harmful prompts into one uniform average, potentially conflating distinct refusal-related phenomena. In this work, we study whether refusal interventions can be strengthened by learning how to combine prompt-specific refusal directions. We propose Weighted Refusal Direction Optimization (WRDO), a procedure that constructs a composite refusal direction from a bank of per-prompt directions using learned aggregation weights. This approach allows different harmful prompts to contribute unequally to the final intervention direction. We evaluate WRDO against prior single-direction methods on three open-weight language models using three guard judges and HarmBench as an external evaluator. We further measure the effect of the intervention on general model capability through standard utility benchmarks. Finally, we investigate a defense-oriented setting in which the same optimization machinery is used in reverse to restore refusal behavior in an abliterated model checkpoint. Our results show that weighted aggregation provides a more effective and flexible mechanism for manipulating refusal representations.
44. 【2610.29545】PACE: Periodic and Channel-Aligned Encoding of Four-Bit Recurrent States
链接:https://arxiv.org/abs/2610.29545
作者:Patrick Haller,Filipe Laitenberger,Alan Akbik
类目:Computation and Language (cs.CL)
关键词:Linear-attention language models, inference system stores, Linear-attention language, state, fixed size
备注: 11 pages, 6 tables, 7 figures
点击查看摘要
Abstract:Linear-attention language models keep their context in a recurrent state of fixed size, where an inference system stores one copy of this state for every sequence it decodes at the same time. Storing the state at lower precision therefore lets more sequences share an accelerator. Existing state quantizers round the state after every generated token and report that four bits lose accuracy unless the bit width is raised or the model is fine-tuned.\par We introduce PACE, a post-hoc four-bit state quantizer. PACE rounds the state only once every few generated tokens, as chunked kernels already do once per chunk during prefill, and keeps the tokens generated in between in a small buffer. Rounding less often reduces the error that accumulates in the state. Additionally, we find that the large entries of the gated-delta state gather in columns, because some channels of the update written at each token remain large across many tokens. PACE therefore shares each quantization scale within one column. It also keeps the heads that retain rounding error longest at eight bits. On four hybrid models from 4B to 35B parameters, PACE with mixed four- and eight-bit heads is competitive with eight-bit DAMP on the three larger models at about two thirds of its memory, PACE with four-bit heads throughout scores higher than Q-Mamba at equal memory, and rounding every few tokens preserves the decoding speedup of the buffer.
45. 【2610.29527】RCSD: Reinforcement and Continual Learning for Domain-Specific Speculative Decoding
链接:https://arxiv.org/abs/2610.29527
作者:Mingkang Liu,Weiming Meng,Peipei Jiao,Jiawei Zhang,Tianyuan Liu,Junyan Li,Lichen Pang
类目:Computation and Language (cs.CL)
关键词:accelerates large language, decoding accelerates large, large language model, Speculative decoding accelerates, compact draft model
备注: 9 pages, 3 figures
点击查看摘要
Abstract:Speculative decoding accelerates large language model inference by employing a compact draft model to propose candidate tokens that are verified in parallel by a target model. Conventional training relies on soft-label distillation, which forces the draft model to mimic the target's full output distribution, including high-entropy regions that degrade acceptance rates and increase early rejection risk. We propose RCSD (Reinforcement and Continual Learning for Speculative Decoding), a training framework that aligns draft model optimization with the system-level objective of maximizing acceptance length. RCSD leverages naturally occurring accepted and rejected sequences during speculative inference to construct implicit preference pairs, with masked loss to avoid penalizing target-aligned tokens. Evaluated across multiple benchmarks, RCSD improves average acceptance length by 35% over HASS and achieves 1.35x faster end-to-end inference than HASS on practical workloads, without compromising generation quality.
46. 【2610.29523】pplx-embed-v2-late Technical Report
链接:https://arxiv.org/abs/2610.29523
作者:Markus Krimmel,Louis Milliken,Ekaterina Glazkova,Maximilian Schall,Antoine Chaffin,Sedigheh Eslami,Jonas Golde,Denis Bykov,Claire Beamer,Jeremy Yang,Bo Wang
类目:Information Retrieval (cs.IR); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词:multimodal late-interaction models, multilingual and multimodal, multimodal late-interaction, visual document retrieval, visual document
备注:
点击查看摘要
Abstract:In this report, we introduce pplx-embed-v2-late, a pair of 0.6B and 9B multilingual and multimodal late-interaction models. Both models achieve state-of-the-art results within their respective size classes across a range of text, image, and visual document retrieval benchmarks. On visual document retrieval tasks, pplx-embed-v2-late-0.6b is competitive with models several times larger than itself. The models are trained via representation distillation from an 18B teacher. Consequently, they share an embedding space that supports asymmetric deployment: documents can be indexed with the 9B model and queried with the low-latency 0.6B model. Both models are available at this https URL.
47. 【2610.29520】Beyond the Vote: When Do LLMs Add Value to Retrieval-Based Tabular Classification?
链接:https://arxiv.org/abs/2610.29520
作者:Ziquan Wang,Yuxuan Nie,Jian Ma,Yingjie Li
类目:Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词:enables large language, Retrieval-based in-context learning, large language models, in-context learning, enables large
备注:
点击查看摘要
Abstract:Retrieval-based in-context learning (ICL) enables large language models (LLMs) to predict tabular labels from similar examples, but it remains unclear whether LLM inference improves on direct voting over those same examples. We address this question by comparing four general-purpose LLMs with distance-weighted nearest-neighbor voting (Distance-KNN) using identical retrieved neighbors across 19 tabular classification datasets. With the number of demonstrations fixed, enlarging the retrieval candidate pool improves accuracy for all predictors, yet Distance-KNN achieves the highest mean accuracy at every pool size. More detailed analyses reveal that LLM gains are concentrated where retrieved neighbors exhibit low label consensus and vary across models. These gains further depend on the average feature-space distance to the test query: under low label consensus, some LLMs outperform Distance-KNN in close and intermediate neighborhoods, but all fall behind on average in the most distant group. Complementary experiments on the number of demonstrations, prompt formulation, retrieval representation, and label-balanced demonstration selection largely preserve the overall findings. These results characterize when LLM inference adds predictive value beyond distance-weighted voting in retrieval-based tabular ICL.
48. 【2610.29518】Mitigating Query Shortcuts in Chain-of-Thought with Context-Aware Decoding
链接:https://arxiv.org/abs/2610.29518
作者:Shin'ya Yamaguchi
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词:large language models, language models, recent studies, performance of large, large language
备注: 9 pages, 3 figures
点击查看摘要
Abstract:While Chain-of-Thought (CoT) prompting improves the reasoning performance of large language models (LLMs), recent studies have shown that final answers do not always depend on the generated rationales. In particular, LLMs may rely on query-specific shortcuts rather than the information provided by their reasoning steps. In this paper, we investigate whether context-aware decoding (CAD), an existing contrastive decoding method, can mitigate such shortcut behavior when applied to CoT reasoning. We study this application as Rationale Contrastive Decoding (RCD), which contrasts the next-token distributions conditioned on the query with and without its rationale, amplifying tokens whose likelihood increases due to the rationale. We provide a theoretical interpretation of this decoding rule via a KL-regularized reward-maximization objective. Experiments across five reasoning benchmarks demonstrate that RCD improves answer accuracy over standard CoT. Furthermore, intervention analyses using ground-truth and random rationales reveal that RCD increases the behavioral dependence of final answers on the rationale content. Our findings suggest that contrastive decoding offers a simple, training-free approach to mitigating query shortcuts.
49. 【2610.29507】Keeping Time vs. Understanding Time: Neither Alone Explains Temporal Reasoning in LLMs
链接:https://arxiv.org/abs/2610.29507
作者:Auss Abbood,Fernando Martínez-Plumed,José Hernández-Orallo,Nigel Collier
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词:causal relations, Temporal, understanding temporal, time calculations, widely assumed
备注: 30 pages, 9 figures, 24 tables (including appendices)
点击查看摘要
Abstract:Temporal reasoning is widely assumed to decompose into two modes: temporal arithmetic (date and time calculations), and temporal semantics (understanding temporal and causal relations). This dichotomy shapes how benchmarks are designed, how models are trained, and how progress is measured, yet its empirical validity has never been directly tested. We provide two lines of evidence that challenge it. First, we test whether tasks labelled as arithmetic or semantic by the benchmarks support transferable gains within their purported mode. Finetuning on these subsets yields predominantly dataset-specific gains ($+6.8$ to $+23.1$ percentage points), while transfer to a different dataset in the same mode ranges from $-3.2$ to $+1.1$ percentage points. Across the two benchmark families used in the transfer analysis, this pattern provides little evidence of coherent, transferable temporal abilities. Second, using cognitive-demand-based model evaluation, we examine which capabilities actually drive performance on these benchmarks. We find that quantitative and logical reasoning, the assumed proxies for temporal arithmetic and temporal semantics, are not the primary drivers; knowledge is. Together, these findings show that current temporal reasoning benchmarks do not cleanly realise the arithmetic-semantics distinction and instead largely reward models for remembering how time typically works.
50. 【2610.29498】A Strong MoE Is All You Need for Process Supervision
链接:https://arxiv.org/abs/2610.29498
作者:Guanzhi Deng,Zengyan Liu,Haibo Wang,Kuan Wu,Shing Yin Wong,Sichun Luo,Zhuoran Wang,Linqi Song
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词:obtaining reliable process, reliable process labels, process labels remains, central bottleneck, obtaining reliable
备注:
点击查看摘要
Abstract:Process reward models (PRMs) provide fine-grained supervision for multi-step reasoning, yet obtaining reliable process labels remains a central bottleneck. Existing approaches typically rely on human annotation, rollout-based estimation, or auxiliary verification. In this work, we explore a different source of process supervision natively exposed by Mixture-of-Experts (MoE) models: expert routing. We show that simple routing statistics provide an intrinsic process-confidence signal that is competitive with conventional output-logit confidence. Building on this observation, we construct routing confidence by combining overall routing mass, head routing mass, and within-step routing variation, and introduce RoCo-Rethink, which identifies the least confident reasoning step and selectively regenerates the subsequent trajectory. We further introduce RoCo-PRM, which uses a strong MoE to automatically annotate reasoning trajectories with routing-derived step scores and distills them into a standalone PRM. Across multiple MoE architectures and diverse reasoning tasks, both RoCo-Rethink and RoCo-PRM consistently outperform strong baselines, while RoCo-PRM transfers effectively across both model architectures and tasks. Our findings suggest that expert routing is more than a computational dispatch mechanism: it provides an architecture-native source of process supervision for reasoning.
51. 【2610.29477】netBench: A Clause-Anchored Russian Corpus for Evaluating Language Models against Professional Codes of Ethics
链接:https://arxiv.org/abs/2610.29477
作者:Yegor Anichkov,Valery Vinogradov,Andrey Furov,Marina Polukoshko,Sergey Bolovtsov
类目:Computation and Language (cs.CL)
关键词:professional ethics guide, ethics guide, guide and restrict, increasingly work, Russian-language professional codes
备注: Preprint under review. 39 pages, 2 figures, 5 tables; Online Resource 1 appended (9 pages). Dataset and code: [this https URL](https://doi.org/10.5281/zenodo.22678484)
点击查看摘要
Abstract:Codes of professional ethics guide and restrict specialists, who increasingly work with assistants built on large language models. Such an assistant can breach the user's code, or help the user breach it, without the user noticing. Evaluations reporting broad categories of harm cannot show how often this happens or which provision is breached. TenetBench pairs 3,433 requests conflicting with clauses of fifteen Russian-language professional codes with benign twins that differ only in the legitimacy of what is asked. An automated pipeline generates the tasks from the text of a code, so the corpus grows with every code added and a provision yields new tasks on every run. It also produced tasks and human-validated verdicts from two English codes of other jurisdictions. In human validation of the frozen pipeline, specialists rated 0.995 of the conflicting tasks plausible, and the model judge agreed with the adjudicated label at Gwet's AC1 of at least 0.894 on 1,860 elements. We evaluated fourteen model and reasoning-mode combinations on whether they produce the conflicting text, decline or warn. Eleven of the fourteen produce conflicting content on most such requests, mostly without a warning, and nearly three warnings in four accompany conflicting content. The models that conform more do so by declining while still serving the legitimate twin, and enabling reasoning halved the refusals of two models. We hope the dataset and pipeline will help evaluate how language models observe professional norms and let diagnostic datasets be built for particular professions and organisations.
52. 【2610.29472】OmniSimulator: Aligning Small Language Models for Authentic Heterogeneous Behavior Modeling
链接:https://arxiv.org/abs/2610.29472
作者:Jiawei Chen,Ruoxi Xu,Boxi Cao,Zhuoqun Li,Ruotong Pan,Yunfei Zhang,Zhirui Yang,Jingyan Chen,Tingting Gao,Han Li,Yaojie Lu,Xianpei Han,Le Sun,Xiangyu Wu,Hongyu Lin
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词:Large language models, shown great potential, Large language, general-purpose user simulators, interactive systems
备注: Accepted by NeurIPS 2026
点击查看摘要
Abstract:Large language models (LLMs) have shown great potential as general-purpose user simulators for interactive systems. Prior studies have demonstrated that training on high-quality data can substantially improve model reasoning and downstream task performance. However, the upper bound of user simulation is still constrained by the model's reasoning paradigm: native chain-of-thought often degenerates into shallow pattern matching and fails to adequately model the behavioral factors underlying real user decisions. In this paper, we propose OmniSimulator, a novel training framework designed to improve the predictive ability of small LLMs for realistic user simulation on short-video platform environments. Specifically, OmniSimulator organizes behavior-oriented reasoning through a structured schema with five dimensions, carefully selects data from real user-behavior scenarios, and introduces a teacher model to generate high-quality reasoning traces under the proposed schema, helping small models learn behavior-relevant reasoning patterns rather than relying on superficial behavioral correlations. Based on this process, we construct 9,881 high-quality training instances from three months of historical interaction trajectories of 200 real users, averaging about 50 distilled examples per user. Experimental results show that OmniSimulator improves the average score of Qwen3-8B by 34.33%, achieves performance competitive with Claude-Sonnet-4.5, and supports smaller-scale, self-hosted deployment. These results suggest that learning structured behavior-oriented reasoning patterns is a promising direction towards scalable and high-fidelity LLM-based user simulation.
53. 【2610.29458】Harness Scaling for Generalizable Agentic Reinforcement Learning
链接:https://arxiv.org/abs/2610.29458
作者:Fei Bai,Huatong Song,Chuan Hao,Ran Tao,Jian Yang,Bryan Dai,Wayne Xin Zhao,Ji-Rong Wen
类目:Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词:coordinate long-horizon interaction, modern agentic systems, Agent harnesses, manage context, long-horizon interaction
备注:
点击查看摘要
Abstract:Agent harnesses have become a central component of modern agentic systems, shaping how models use tools, manage context, and coordinate long-horizon interaction. Realizing the benefits of these harnesses depends on how effectively the underlying model can make use of them, motivating reinforcement learning directly through the harness. However, existing approaches typically train through a single fixed harness, which can lead to specialization and limited transfer across harness configurations. To address this, we introduce \textbf{Harness Scaling}, a new scaling dimension for agentic RL that extends training from a single harness to diverse execution configurations. Concretely, we construct a factorized harness space, select a compact training subset with balanced factorial coverage, and organize cross-harness training to combine global coverage with controlled variation for the same task. Across multiple benchmarks, model scales, and RL algorithms, Harness Scaling consistently improves generalization to unseen white-box configurations. Moreover, models trained through structured white-box variation transfer effectively to unseen external black-box harnesses, outperforming models trained through a single complex black-box harness. These results establish harness diversity as a meaningful scaling dimension for agentic RL and highlight the importance of how this diversity is organized for cross-harness generalization.
54. 【2610.29455】Omnilingual-MsASR: Benchmarking Multimodal, Multilingual, Long-Form Multi-Speaker ASR of Omni Large Language Models
链接:https://arxiv.org/abs/2610.29455
作者:Yuan Ge,Pei Zhang,Xize Cheng,Lingzhou Mu,Mingyang Wang,Jin Xu,Baosong Yang,Shengxiang Gao,Jingbo Zhu,Zhengtao Yu,Tong Xiao
类目:Computation and Language (cs.CL)
关键词:achieved remarkable progress, Automatic Speech Recognition, Multi-speaker Automatic Speech, large language models, achieved remarkable
备注:
点击查看摘要
Abstract:Omni-modal large language models (LLMs) have achieved remarkable progress in audio and video understanding. However, existing models struggle with long-form, multi-speaker videos, especially in understanding the entire video and recognizing who says what and when. To characterize the capability limit of current omni LLMs and guide future model development, we introduce Omnilingual-MsASR, a multilingual, multimodal benchmark for long-form Multi-speaker Automatic Speech Recognition (MsASR) covering six languages, recordings up to 30 minutes, and scenarios with up to 20 speakers. Omnilingual-MsASR provides parallel audio and video inputs to evaluate models' cross-modal consistency and their ability to exploit complementary cues across modalities. Extensive evaluations of leading omni-modal LLMs reveal substantial performance bottlenecks, while their tcpWERs frequently exceed 100%. These findings highlight fine-grained temporal localization, speaker disambiguation, and cross-modal synergy as key challenges for future omni-modal foundation models. Our work is available at this https URL.
55. 【2610.29443】DynaWeave: Learning to Adapt through Dynamic Scenario Synthesis
链接:https://arxiv.org/abs/2610.29443
作者:Xuan Yang,Chunxiao Liu,Hongsheng Xin,Hao Xu,Ning Miao
类目:Computation and Language (cs.CL)
关键词:Large language model, Large language, increasingly use tools, tools to complete, LLM
备注:
点击查看摘要
Abstract:Large language model (LLM) agents increasingly use tools to complete tasks in stateful environments. However, many training environments remain largely static apart from changes caused by the agent's own actions, whereas external events introduced by other users, services, or sudden contingencies in real environments can invalidate ongoing plans. To address this gap, we introduce DynaWeave, an automated synthesis framework that transforms existing static tasks into verifiable dynamic scenarios. The framework generates exogenous events relevant to each task, covering changes in task requirements, environment state, and external information. It uses directed acyclic graphs (DAGs) to represent dependencies between events and an execution engine to activate them during agent interaction. A dynamic verifier revises only the evaluation checks affected by events that actually occur and retains all other checks. Using DynaWeave, we collect 2,095 verified interaction trajectories across 36 environments and use them for supervised fine-tuning of Qwen3.5 models. Experiments on Gaia2, CostBench, and ToolMaze show that DynaWeave achieves consistent improvements in overall performance across all three evaluated model sizes, increasing the task completion rate on CostBench by 67.34 percentage points and even exceeding the performance of Gemini-3.1-Pro-Preview on ToolMaze. These results support dynamic scenario synthesis as a practical approach to training agents to adapt to changing environments. Our code is available at this https URL.
56. 【2610.29426】BIRD-RL: Scaling Agentic Reinforcement Learning over Stateful Data-Centric Environments
链接:https://arxiv.org/abs/2610.29426
作者:Ge Qu,Jinyang Li,Xiaohan Xu,Xiaolong Li,Bowen Qin,Nan Huo,Ziwei Tang,Chenhao Ma,Reynold Cheng
类目:Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词:training small language, small language models, promising paradigm, paradigm for training, training small
备注: Accepted to NeurIPS 2026 Main Track
点击查看摘要
Abstract:While agentic reinforcement learning (RL) has emerged as a promising paradigm for training small language models (SLMs), existing frameworks are predominantly tool-centric and struggle with data-centric environments. Specifically, applying tool-centric frameworks to stateful tasks like SQL debugging introduces severe spatial inefficiencies since proper environment isolation typically requires a separate database container per rollout. Naively reusing databases without tracking evolving states across multi-turn interactions causes trajectory contamination and cross-trajectory interference, which severely destabilizes policy updates. To overcome these bottlenecks, we introduce BIRD-RL, a novel four-stage agentic RL curriculum that alternately enhances foundational agent reasoning and trajectory-adaptive on-policy exploration to circumvent the instability inherently associated with direct end-to-end learning. Crucially, to support this curriculum, BIRD-RL is driven by a Trajectory-scoped Persistent Execution Infrastructure, which enables safe database replica reuse while preserving trajectory isolation. This design improves spatial RL efficiency by 12.8x, successfully enabling scalable agentic RL for complex data-centric tasks without needs of Kubernettes. Empirical evaluations on the BIRD-CRITIC-SQLite benchmark demonstrate that our 7B and 14B models achieve Success Rates of 44.40% and 48.00%, respectively, showing competitive performance against strong proprietary model-based agents such as Claude-Opus-4.6 Agent (48.20%). Furthermore, BIRD-RL successfully trains unified SLMs capable of both advanced SQL debugging and generation, highlighting its broader potential for multi-objective optimization across heterogeneous, real-world data-centric tasks.
57. 【2610.29424】A KAN-based Non-linear Factorization for Embedding Layer Compression
链接:https://arxiv.org/abs/2610.29424
作者:Oliver Giudice,Anna Russo Russo
类目:Computation and Language (cs.CL)
关键词:mathematically principled solution, embedding layer, reduced-rank decomposition, simple and mathematically, mathematically principled
备注: 18th International Conference on Statistical Analysis of Textual Data (JADT 2026)
点击查看摘要
Abstract:Among existing embedding compression approaches, low-rank factorization provides a simple and mathematically principled solution by approximating the embedding matrix with a reduced-rank decomposition. However, its practical effectiveness is often limited, as the resulting linear bottleneck constrains representational capacity. To overcome these limitations, we propose an enhanced factorization scheme that increases expressive power by introducing learnable non-linear projections within the compressed embedding layer. Our method is inspired by the Kolmogorov Arnold Networks (KAN) paradigm, which replaces fixed linear transformations with learnable univariate functions. Despite promising results in other domains, applications of KANs in NLP remain scarce and have so far been largely limited to final or task specific layers, rather than core representational components such as embedding layers. We evaluate the proposed approach by integrating the compressed embedding layer into the Skip-gram framework and comparing it against a standard low-rank baseline under matched parameter budgets on the Word Analogy and Semantic Similarity benchmarks. We further introduce an effective initialization strategy from a pre-trained, uncompressed embedding layer. The behavior of the model is analyzed both immediately after initialization and after a brief post-initialization refinement phase, considering training with the standard Skip-gram objective as well as variants augmented with distillation from the original embedding layer. Overall, our results show that augmenting low-rank factorization with learnable non-linear projections effectively mitigates the limitations of linear bottlenecks, yielding more faithful compressed embeddings under fixed dimensionality and suggesting a promising direction for embedding layer compression beyond purely linear methods.
Comments:
18th International Conference on Statistical Analysis of Textual Data (JADT 2026)
Subjects:
Computation and Language (cs.CL)
Cite as:
arXiv:2610.29424 [cs.CL]
(or
arXiv:2610.29424v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2610.29424
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
58. 【2610.29415】CCG Diffusion: Combinatory Categorial Grammar-Driven Compositional and Syntactically Disambiguated Text-to-Image Generation
链接:https://arxiv.org/abs/2610.29415
作者:Ryosuke Yamaki,Daichi Mochihashi,Nobutaka Shimada,Seitaro Shinagawa,Tadahiro Taniguchi
类目:Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词:CCG Diffusion, syntactically ambiguous prompts, spatial relations, CCG, explicitly receive
备注: Preprint under review
点击查看摘要
Abstract:Text-to-image generation models do not explicitly receive the syntactic structure of the prompt, i.e., which word modifies which and where each phrase attaches. Consequently, they often struggle to bind attributes to the correct objects, to depict spatial relations and counts correctly, and to render syntactically ambiguous prompts in the intended interpretation. Existing syntax-based control methods mainly address attribute binding and have limited ability to control spatial relations and counts or to specify the interpretation of syntactically ambiguous prompts. They rely on phrase-structure or dependency grammars and require additional rules or constraints on the tree structure to extract modification relations between words or to specify a syntactic interpretation. We propose CCG Diffusion, a training-free method that controls image generation using Combinatory Categorial Grammar (CCG). In CCG, the category of each word carries rich syntactic information: it specifies what the word combines with and what phrase it forms. Modification relations between words can therefore be read directly from a CCG parse. Moreover, prepositional phrase (PP) attachment ambiguity, a representative syntactic ambiguity, can be resolved simply by fixing the preposition's category. CCG Diffusion applies the same two CCG-based mechanisms, prompt rewriting and attention guidance, both to controlling attribute binding, spatial relations, and counts and to resolving PP ambiguity. On two architecturally different backbones, Stable Diffusion and Sana, CCG Diffusion achieves the highest scores among the compared methods in attribute binding and 2D spatial relations and significantly outperforms all of them in PP ambiguity resolution.
59. 【2610.29413】Beyond Small Talk: Modeling Disclosure Trajectories in Human-AI Conversation
链接:https://arxiv.org/abs/2610.29413
作者:Keith Kwok,Wanting Ning,Tej Deep Pala,Desmond C. Ong,S. Supraja,Renwen Zhang,Soujanya Poria
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)
关键词:Social Penetration Theory, unfold over time, disclosure, Recently, isolated conversational states
备注: 71 pages, 11 figures. Code available at [this https URL](https://github.com/kwokkeith/Beyond_Small_Talk)
点击查看摘要
Abstract:Recently, we see a rise in conversational agents as a form of social and emotional support, where disclosure will unfold over time. Yet, current evaluations of these agents typically examine isolated conversational states. In analyses of naturally occurring conversations, disclosure history and current disclosure are confounded which tends to make their effects difficult to isolate. We thus introduce Trajectory-based Disclosure Evaluation (TraDE), an evaluation framework grounded in Social Penetration Theory that utilizes predefined disclosure trajectories and evaluates how preceding disclosure history shapes model behavior under matched current disclosure. Through the use of TraDE, we demonstrate across multiple models and relational behavior benchmarks that responses to disclosures matched on depth can differ depending on the preceding trajectory, particularly in whether models accept or challenge the user's framing. We also observed that these differences track accumulated exposure to deeper disclosure rather than any single moment of vulnerability or the order of disclosures. It also tends to persists for several turns after disclosure returns to shallow levels. For several behaviors, we also demonstrate that models diverge most consistently from human supporters in the Emotional Support Conversation corpus (ESConv) not when users open up but rather when they step back in their disclosure. TraDE thus provides a systematic way to expose history-dependent relational behavior that evaluations of isolated conversational states would otherwise miss.
60. 【2610.29410】ECHO: Emergent Common-Mode Hidden Offsets Drive Vocabulary Collapse in Preference Optimization
链接:https://arxiv.org/abs/2610.29410
作者:Yun Li,Ehsan Javanmardi,Simon Thompson,Jiachen Gong,Qunli Zhang,Zifan Zeng,Shiming Liu,Peng Wang,Zixuan Guo,Manabu Tsukada
类目:Computation and Language (cs.CL)
关键词:Preference optimization, eventually destroy generation, shared representation shift, shared directional shift, optimization can improve
备注: 28 pages, 13 figures
点击查看摘要
Abstract:Preference optimization can improve every ranking metric while building a hidden, shared representation shift that the relative loss barely sees, one that can eventually destroy generation. We trace this failure to the common-mode offset, a shared directional shift in the model's hidden states that appears across token positions, prompts, and both chosen and rejected responses. Because it moves chosen and rejected representations together, the relative ranking loss barely reacts to its accumulation. As this offset grows, it projects onto the output layer to form a vocabulary well, elevating a single token's probability until it dominates decoding and causes generation collapse. The isolated offset alone reconstructs the vocabulary well, injecting the learned offset into an untreated base model recreates the collapse where norm-matched random directions do not, and masking this common component from the loss prevents the well in our flagship setting. Under the per-token ranking loss we study, the same collapse appears in 14 of 17 base-model lineages and under full-parameter fine-tuning. Moreover, the offset is not merely an artifact of collapse, since it is already present in textbook DPO and SimPO runs that form no well. Textbook DPO keeps it weakly aligned with any single vocabulary direction even with three times our base budget. Trained from base models for that budget, however, full-parameter SimPO drives it into collapse on both Llama-2 and Llama-3.1, and the same kind of offset grows, without a well, from a public SFT checkpoint under the official SimPO recipe. Across 17 UltraFeedback runs, the better a run ranks held-out responses, the less often two public reward models prefer its samples to the base model's. These findings expose a blind spot in standard ranking metrics and introduce a representation-level signal that can warn of generation collapse before it occurs.
61. 【2610.29378】Right On Q: Recovering Reasoning under Quantization via Self-Generated Trajectories
链接:https://arxiv.org/abs/2610.29378
作者:Boyuan Zheng,Jing Xiong,Chenwei Wu,Hui Shen,Zesen Zhao,Hei Ting Una Chan,Xueshen Liu,Zhen Zhang,Liyue Shen,Zechun Liu,Z. Morley Mao
类目:Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词:large language models, recover reasoning capabilities, low-bit large language, Quantization-aware training, aims to recover
备注: 19 pages, 6 figures, 9 tables
点击查看摘要
Abstract:Quantization-aware training (QAT) aims to recover reasoning capabilities in low-bit large language models (LLMs). Existing recipes typically supervise the quantized student with the original full-precision model on fixed response sequences. However, the resulting low-bit quantized models still struggle on long-horizon reasoning tasks and often fail to terminate within a token budget that suffices for the full-precision model. We identify two challenges in closing this gap. First, fixed-response supervision leaves a mismatch between training prefixes and those encountered during student generation, and this trajectory divergence grows as responses lengthen. Second, on its own prefixes, the student underpredicts some next-token candidates and overpredicts others, and this distributional misalignment becomes more frequent at high-entropy prefixes. We present OnQ, a low-bit recovery pipeline that combines on-policy distillation and candidate-wise Dynamic KL. Starting from block-wise calibration, the quantized student generates responses and receives full-precision teacher supervision on its own prefixes. Dynamic KL weights forward and reverse KL by each candidate's teacher-student probability ratio to balance correction of under- and overprediction. Across Qwen3-1.7B, 4B, and 8B at 2- and 3-bit precision, OnQ achieves the highest nine-benchmark average, with the largest gains on long-horizon reasoning benchmarks. At 2 bits, it outperforms every baseline on every benchmark at every model size, improving the Qwen3-8B average by 10.26 points over the strongest baseline. It also produces shorter responses with fewer truncations and repetitive errors.
62. 【2610.29357】Memory-Centric Continual Learning for AI Agents
链接:https://arxiv.org/abs/2610.29357
作者:Dongfang Li,Zhuoen Chen,Bonian Jia,Zixuan Liu,Zhengxuan Lu,Can Deng,Yukun Shi,Yuhang Meng,Xin Zhang,Jiahe Huang,Fuhao Li,Junmai Wang,Shunyao Wen,Jingjun Sun,Jiaxu Tian,Jiangling Zhang,Zihan Wang,Liangyou Li,Yitong Yao,Shuangyong Song,Beilun Wang,Pengxu Wei,Hanlin Xu,Chang Liu,Yongxiang Li,Baotian Hu,Xiangyang Ji,Min Zhang
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词:limits hinder sustained, hinder sustained learning, context limits hinder, long-term deployment, powered by foundation
备注:
点击查看摘要
Abstract:Autonomous agents powered by foundation models can reason, plan, and use tools, but their fixed weights and context limits hinder sustained learning from experience over long-term deployment. While external memory systems attempt to bridge this gap, they mostly act as passive retrieval caches, evaluated primarily by whether they can recall stored facts or past interactions. Whether memory can drive genuine continual learning remains an open question. In this paper, we introduce Memory-Centric Continual Learning (MCCL), arguing that memory should be judged by whether it improves future actions, not merely what it retrieves. MCCL has three main parts. First, a three-axis taxonomy organizes memory by where state is stored (substrates), what form it takes (assets), and how it is managed (policies). This defines a two-loop lifecycle that updates memory state in an inner loop while refining management policies in an outer loop based on task feedback. Second, an evaluation protocol measures retention under interference, adaptation to change, and task transfer to isolate genuine behavioral gains from simple context expansion. Third, a memory scaling framework models how agent performance scales with experience, storage capacity, and compute budgets across non-parametric and parametric memory. Together, these components reframe agent memory from passive lookup to continuous learning, offering a principled route toward self-improving autonomous agents.
63. 【2610.29352】Don't Stop Long-Context Continual Pre-Training Too Early: An Empirical Scaling Law
链接:https://arxiv.org/abs/2610.29352
作者:Ziqing Qiao,Xiaoyue Xu,Sikui Zhang,Yinuo Xu,Bingxiang He,Chaojun Xiao,Xu Han
类目:Computation and Language (cs.CL)
关键词:LCCP remains unclear, improve long-context capability, LCCP, Long-context continual pre-training, remains unclear
备注: 32 pages, 18 figures
点击查看摘要
Abstract:Long-context continual pre-training (LCCP) is widely used to improve long-context capability, but how its benefits scale with the number of tokens used for LCCP remains unclear. We investigate this question through modeling, monitoring, and validating the benefits of scaling LCCP. First, we establish an empirical additive power law relating long-context performance to model size and the respective token budgets of short-context pre-training and LCCP. Experiments across five model scales and more than one hundred short- and long-context budget configurations show that the fitted law reproduces the observed trends and extrapolates well to held-out model scales. Second, we introduce \textsc{Constant-Last4}, a training and observation protocol that averages the four most recent consecutive checkpoints from a constant-learning-rate run to enable stable monitoring along a single extensible training trajectory. Under this protocol, the same scaling-law form fits well and accurately predicts the LCCP performance trajectory of a 1.22B-parameter model trained on approximately 100B LCCP tokens. Finally, downstream evaluations along this trajectory show continued improvements in long-context performance, with no clear sign of saturation within the evaluated range. These gains persist after both 128K context extension and supervised fine-tuning, with benefits extending to long-context understanding and agentic tasks. Together, these results argue for continuing to scale LCCP rather than stopping early: its gains are stably observable along an extensible trajectory, quantitatively predictable, and transferable to downstream tasks.
64. 【2610.29351】Closed-Loop Dual-Reference Guidance for Accent Control in Cross-Lingual Voice Cloning
链接:https://arxiv.org/abs/2610.29351
作者:Yuanzhong Zheng,Wei Huang,Ming Ma,Kailun Jin,Youhai Jiang
类目:ound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
关键词:Zero-shot cross-lingual voice, Zero-shot cross-lingual, cross-lingual voice cloning, reference speaker accent, target language
备注:
点击查看摘要
Abstract:Zero-shot cross-lingual voice cloning often carries the reference speaker's accent into the target language. We propose closed-loop dual-reference guidance, which pairs the original reference with a reusable native anchor constructed by voice conversion (VC). The references initialize separate language-model (LM) states that guide a shared acoustic trajectory; each completed patch then updates both states, keeping their generated histories aligned with the emitted speech. Anchor construction runs once per speaker, and online synthesis uses a frozen TTS model without per-utterance VC. On 20 held-out French speakers, the fixed setting $\lambda^{\!*}=0.33$ reduces residual French LID mass by 73\% versus direct cloning, at an ECAPA similarity cost of only $0.042$; relative to anchor-only cloning, it recovers $0.155$. The method achieves the lowest mean WER ($0.009$) and highest mean GOP ($4.750$) among the held-out test arms. In blinded preference tests, native-English listeners favor it over direct cloning on pronunciation naturalness, and over both anchor-only cloning and a TTS$\to$VC cascade on speaker identity. Online RTF is approximately 26\% lower than the cascade's ($0.59$ vs.\ $0.80$), and the same setting reduces Spanish LID mass by 56\% without re-tuning.
65. 【2610.29350】B-CARE: Blind Classwise Assessment of Relative Evidence for Stance Error Ranking
链接:https://arxiv.org/abs/2610.29350
作者:Meysam Sabbaghan,Doina Caragea
类目:Computation and Language (cs.CL)
关键词:Stance classifiers make, classifiers make errors, limited human-review budgets, Blind Classwise Assessment, classifiers make
备注:
点击查看摘要
Abstract:Stance classifiers make errors that can be costly to identify under limited human-review budgets. Prioritizing potentially incorrect predictions remains challenging, particularly across heterogeneous base models. We introduce B-CARE (Blind Classwise Assessment of Relative Evidence for Stance Error Ranking), a prediction-blind framework for identifying high-risk stance predictions. Given only a target and text, a fixed LLM verifier assigns ordinal evidence scores to all candidate stance labels without observing the base model's prediction or confidence. B-CARE constructs a comparative risk score by contrasting the strongest alternative-class evidence with the evidence supporting the predicted class. The resulting classwise evidence profile can be reused across multiple base models without training a separate error detector or calibrating risk scores. We evaluate B-CARE on four stance benchmarks and three heterogeneous base LLMs, covering 12 dataset-model settings and 5,206 unique test instances. Evaluation includes error-ranking discrimination (AUROC and AUPRC), selective prediction (E-AURC), and review effectiveness (ErrorCapture at fixed review budgets). B-CARE achieves a mean AUROC of 0.735 and a mean AUPRC of 0.524, capturing 41.06% of errors within the highest-risk 20% of predictions. Although B-CARE does not uniformly outperform strong confidence-based baselines, it provides a reusable, complementary evidence signal for prioritizing potentially incorrect stance predictions across heterogeneous models.
66. 【2610.29348】Data Schedules and Learning Rate Schedules Should Be Designed Together
链接:https://arxiv.org/abs/2610.29348
作者:Haodong Wen,Kairong Luo,Tingkai Yan,Wenguang Chen,Kaifeng Lyu
类目:Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词:LLM training pipelines, data, LLM training, continues pretraining, phase in LLM
备注:
点击查看摘要
Abstract:Mid-training (MT) is a training phase in LLM training pipelines that continues pretraining (PT) on smaller datasets of higher value. Taking the PT and MT phases as a whole, training usually starts with only PT data and then transitions completely to MT data. In this work, we view this complete transition from PT to MT data as a special case of a broader class of data mixing schedules that specify how the proportions of PT and MT tokens in each batch change over training. Under fixed total training compute and MT token budgets, we ask: Is this complete transition to MT data optimal for minimizing final MT loss? We show that the answer depends on the learning rate (LR) schedule: one data schedule may outperform another under one LR schedule, but changing only the LR schedule can reverse the outcome. Specifically, when the LR decays throughout continued training, introducing MT data earlier and mixing it with PT data lowers the final MT loss compared with placing all MT data at the end of training, but this result is reversed if we use constant LR. We therefore study how to jointly choose when to introduce MT data and when to decay the LR through ablation studies, and find that it is better to decay the LR only after MT data enters training. Finally, we develop a theoretical model that explains why the optimal data schedule for a fixed MT token budget depends on the LR schedule.
67. 【2610.29345】Decodability Is Not Controllability: Local and Anisotropic Speaker Control in Continuous-Latent TTS
链接:https://arxiv.org/abs/2610.29345
作者:Yuanzhong Zheng,Wei Huang,Ming Ma,Kailun Jin,Youhai Jiang
类目:ound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
关键词:High linear decodability, entail causal controllability, High linear, controllability in continuous-latent, linear decodability
备注:
点击查看摘要
Abstract:High linear decodability does not entail causal controllability in continuous-latent text-to-speech (TTS). In VoxCPM2, position-matched probes and equal-norm interventions across 30 speakers and 60 directed dyads expose this separation: reference-audio states at the final residual acoustic language model layer (RALM L7) retain 0.970 probe accuracy, yet aligned edits yield 0/60 target-dominant dyads. Edits at early reference-audio positions produce the opposite pattern. At L0, pair-aligned updates increase target similarity by 0.326 and achieve target dominance in all 60 dyads, against at most 1/60 under any equal-norm direction or position control. Independent speaker encoders, retrieval against held-out speaker prototypes, and double-blind listening confirm that the shifted voice is heard as the intended target. Cross-architecture interventions in this http URL distinguish backbone leverage from direct acoustic control: backbone edits displace the source without target attraction, while x-vector ablation reduces source similarity from 0.849 to 0.006. These findings identify two requirements for training-free speaker control: geometric specificity and a computational route that carries the intended speaker condition into acoustic synthesis.
68. 【2610.29342】Uncensored Is Not Unbiased: Abliteration Removes Refusals but Not Script-Dependent Bias About Taiwan
链接:https://arxiv.org/abs/2610.29342
作者:Ju-Chun Ko
类目:Computers and Society (cs.CY); Computation and Language (cs.CL)
关键词:Republic of China, Traditional Chinese, Simplified Chinese, open-weight language models, language models remove
备注: 33 pages, 3 figures, 18 tables. Code, data and an interactive project page: [this https URL](https://daaab.github.io/uncensored-not-unbiased/)
点击查看摘要
Abstract:"Abliterated" ("uncensored") builds of open-weight language models remove the activation direction that mediates refusal, and are popular partly on the assumption that a model that no longer refuses is also free of political censorship. We test this on two matched pairs of 2-bit models: NVIDIA's Nemotron 3.5 Bolt 74B-A9B and Qwen3.8-Flash-Next, each against a community abliteration. Each model judged 22 statement pairs (on the Republic of China (Taiwan), 1989 Tiananmen, control countries) in Traditional Chinese, Simplified Chinese (a character-level conversion) and English, and answered 27 open questions per script. Script mattered far more than abliteration: the original Bolt scored +0.58 on Index S (-1: People's Republic of China (PRC) position; +1: ROC position) in Traditional Chinese, +0.57 in English and +0.05 in Simplified Chinese, and affirmed "Taiwan is part of the PRC" with probability 0.91 in Simplified but 0.06 in Traditional characters; abliteration changed its scores by at most 0.06, mostly by raising "yes" on both sides. In Qwen, abliteration removed every refusal on 1989 and raised scores by 0.21 to 0.34, yet the abliterated Qwen still affirmed that Taiwan is part of the PRC in all three scripts. Naming the state the Republic of China (Taiwan) raised every model's score by 0.10 to 0.33 but left the script gap. Control pairs showed no script gap; each abliteration changed only its declared tensors. In 740,000 web documents, Simplified text on Taiwan contained PRC-framing terms 3.7 times as often as Traditional text. A script direction could not be steered away; a contrastive stance direction raised scores in every script, and its negation lowered them. A four-sentence system prompt raised the abliterated Qwen to +0.93 to +0.97. Keyword scoring rules failed the models closest to the ROC position mostly for attributing or denying the PRC claim. Uncensored is not unbiased.
69. 【2610.29340】Reader--Writer Coupling in Transformer MLPs
链接:https://arxiv.org/abs/2610.29340
作者:Giyeong Oh,Sunghee Ahn,Youngjae Yu
类目:Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词:transformer MLP, reader, factor set, decides, MLP writes back
备注:
点击查看摘要
Abstract:A transformer MLP gives each hidden channel two roles: a reader that decides when the channel responds, and a writer that decides what it adds back to the residual stream. Read as a key--value memory, the layer can be measured one factor set at a time: the pairing of readers to writers is carried only by their shared index, invisible to any quantity computed from one factor set alone. Yet training couples the two factors through their joint update, so we ask what reading them together shows. The block supplies the joint instrument: the MLP writes back into the very stream it reads, so the exact Jacobian of its update is square, and its agreement with its own transpose resolves into reader--writer terms whose inner products give each channel, read as a couple, a signed pairing coordinate. Ranked by this coordinate, each block we measure has a small core of strongly coupled channels; where initialization gives either sign equally, the core is nearly all opposed: each writer points against the direction its reader responds to. This opposed core recurs from the smallest models trained from scratch to released checkpoints; its sign is in place within a few percent of training and holds while the coupling grows. Read as couples, most channels return their contribution against the reader that fired it, and the readers of later blocks take it up; few show in the logits. Training holds the couples in place: flipping the opposed writers moves the output toward common tokens, and a writer permuted onto another reader regrows to fit that reader while the reader stays.
70. 【2610.29339】ChronoSynth: Constraint-Aware Question Synthesis over Temporal Knowledge Graphs
链接:https://arxiv.org/abs/2610.29339
作者:Feng Liang,Weixin Zeng,Runhao Zhao,Mingjun Zhou,Shaoshi Yang,Xiang Zhao
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词:Knowledge graph question, structured graph evidence, Knowledge graph, generates natural-language questions, generates natural-language
备注:
点击查看摘要
Abstract:Knowledge graph question generation (KGQG) generates natural-language questions from structured graph evidence and a target answer. When the input graph is temporal, a valid question must also preserve the answer field, time condition, reference event, and temporal order that determine the answer set. Existing KGQG methods and prompting baselines can produce fluent questions that alter these conditions, causing temporal semantic drift. This paper studies temporal KGQG as a constraint-preserving graph-to-question problem and proposes ChronoSynth, a memory-augmented and constraint-aware generation framework. ChronoSynth first constructs a Temporal Intent State to make the intended question semantics explicit. It then retrieves compatible typed question patterns from an indexed pattern memory, adapts them to the input graph, and validates the generated question. Validation feedback guides revisions when a supported inconsistency is detected. Experiments on CRONQUESTIONS and MultiTQ demonstrate state-of-the-art generation performance, with ablations supporting the contributions of its components.
71. 【2610.29338】Policy Central: Detecting Conflicts, Redundancy, and Similarity in Deployed Police Policy
链接:https://arxiv.org/abs/2610.29338
作者:Holly Baker,Michael Kuo,Kyana Pollas
类目:Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词:police departments find, departments find relationships, Policy Central, find relationships, deployed system
备注: 16 pages, 2 figures. Committed to EACL 2027
点击查看摘要
Abstract:Policy Central is a deployed system that helps police departments find relationships between sections of their written policy: whether two sections conflict, are redundant, are merely similar, or are different. We describe the system and compare two architectures. Retrieve-Judge, a retrieve-then-classify pipeline, runs as a cheap library-wide health signal; Screen-Confirm, a screen-then-confirm cascade, is a selective audit of the documents a reviewer chooses, checking them exhaustively against one another. On a 302-pair benchmark drawn from one department's ~84 real policy documents, given each pair Screen-Confirm reaches 0.795 aggregate recall and 0.885 on Conflict, so current models judge well. Finding the pair is the hard part: Retrieve-Judge's composed recall falls to 0.457, and Screen-Confirm recovers 0.472 (0.615 on Conflict). Today these pairs are found by reading the whole library, nearly 20,000 sections, checked against one another and re-checked after every revision. A scan that returns half of them in minutes, at low cost, and can be re-run on demand changes the economics of policy review even before recall improves.
72. 【2610.29328】Seeing the Forest for the Trees: Emergent Agreement from Individual Conversations
链接:https://arxiv.org/abs/2610.29328
作者:Adi Simhi,Yaniv Nikankin,Jonathan Herzig,Idan Szpektor,Yonatan Belinkov,Shay B. Cohen
类目:Computation and Language (cs.CL)
关键词:LLM agents interact, agreement, LLM agents, agents interact, wild and shape
备注:
点击查看摘要
Abstract:As LLM agents interact in the wild and shape each other's decisions, understanding how they converge toward agreement becomes important. We study this in multi-turn conversations where two LLMs discuss subjective matters, can agree or disagree, and may change their stances. Using a linear classifier on individual conversation activations, we identify an internal representation of agreement. We find that it varies substantially across turns and conversations and does not reliably track external agreement at the individual conversation level. We therefore move beyond the representation of agreement in individual conversations, by aggregating the agreement representation across conversations. Externally, this aggregate view reveals a simple structure: when pooled across conversations, agreement can be predicted well with a Markov process, with agreement at each turn being a direct function of agreement at the previous turn. Similarly, when internal agreement is aggregated, it couples with the external Markov agreement through a power-law mapping, exposing Markovian dynamics in internal representations. Additionally, we find that after a change of stance, models express agreement externally before their internal representations reflect the same shift. These results reveal a joint structure between internal and external agreement that emerges only when internal features are aggregated across conversations. Code available at this https URL.
73. 【2610.29327】OACap: Caption-Guided Active Observation for Detailed Video Captioning
链接:https://arxiv.org/abs/2610.29327
作者:Hao Shi,Hong Yan,Xiaoyang Zhang,Qing Cui,Chao Huang
类目:Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Multiagent Systems (cs.MA); Multimedia (cs.MM)
关键词:Unlike question answering, coherent global description, open-ended detailed captioning, Unlike question, Observation-Adaptive Video Captioner
备注: 14 pages, 4 figures, 4 tables. Technical report
点击查看摘要
Abstract:Unlike question answering, where a query specifies a perceptual target, open-ended detailed captioning must determine what evidence to acquire and how to integrate it into a coherent global description. We propose Observation-Adaptive Video Captioner (OACap), a caption-centered agent that turns unsupported or missing information into targeted observation requests, uses spatiotemporal tools to acquire evidence, and iteratively verifies and revises the caption. OACap captions consistently improve performance across general video-understanding benchmarks using a fixed text-only reader. To better diagnose the information they preserve, we introduce Factual-Semantic Captioning Bench (FSCap-Bench). Its Core-Support Factuality Score (CSFS) combines claim precision with importance-aware fact coverage and responds as expected to four controlled perturbation types on 93.0-98.3% of valid caption pairs. Its Cross-Modal Semantic Round-Trip Score (CSRS) measures semantic preservation through a video-caption-video-caption round trip by matching atomic facts from source and recovered captions. Together, they connect downstream textual-memory utility with factual and semantic preservation.
74. 【2610.29326】Signals and Queries: Token-Efficient Agentic Context Discovery
链接:https://arxiv.org/abs/2610.29326
作者:Yam Marcovitz
类目:Computation and Language (cs.CL)
关键词:User-facing LLM agents, User-facing LLM, behavioral policies apply, identify which behavioral, Signals and Queries
备注:
点击查看摘要
Abstract:User-facing LLM agents must identify which behavioral policies apply at each turn, but evaluating every policy with an LLM is costly. We introduce Signals and Queries (SQ), a lightweight first-stage relevance filter developed for Parlant 4.0 that removes at least 30% of candidate policies before downstream evaluation while preserving high recall. For each policy, an LLM generates activating examples and hard negatives offline. An independent logistic classifier trained on their embeddings then predicts relevance using embeddings and vector dot products, with no per-turn LLM calls. This shifts expensive relevance evaluation to a smaller candidate set, while allowing each policy's classifier to be updated independently. Evaluated against 9,144 LLM-judge relevance labels covering 254 $\tau^2$-bench conversation prefixes and 36 airline policies, SQ achieves higher precision than top-K and cosine-threshold retrieval at every evaluated recall level, with consistent results across two embedding providers. These findings support inexpensive, per-policy classification as a practical first stage for reducing downstream evaluation workload in customer-facing agents.
75. 【2610.29319】OSynth: A Longitudinal, Context-Sensitive Evaluation of Meeting Understanding
链接:https://arxiv.org/abs/2610.29319
作者:Ian Porada,Suraj Tripathi,Chaitanya Animesh,Leda Sari,Chaitanya Narisetty,Austin R. Matthews,Bohan Yu,Ramesh L. Thulasiram,Gregory Sell,Kean Chin,Dmitriy Genzel
类目:Computation and Language (cs.CL)
关键词:including calendar metadata, corpora remain limited, meeting corpora remain, domain coverage, calendar metadata
备注: EMNLP 2026
点击查看摘要
Abstract:Meeting notetakers are increasingly deployed in settings where longitudinal context is available including calendar metadata, prior meetings, emails, slides, and speaker enrollments; however, meeting corpora remain limited in terms of size, domain coverage, and available context. We present OSynth, a large-scale synthetic dataset of simulated organizations comprising 570 hours of meeting audio together with associated artifacts and a latent ground-truth state. In a pairwise comparison, human raters distinguish OSynth meetings from real meeting transcripts with only 56% accuracy based on excerpts of 150-300 words. Across state-of-the-art LLMs, additional context yields significant gains on several entity-sensitive dimensions, demonstrating limitations of contemporary approaches and the potential usefulness of OSynth in developing better-contextualized meeting-understanding systems.
76. 【2610.29318】Asking What a Director Sees Can Change What Vision-Language Models Choose
链接:https://arxiv.org/abs/2610.29318
作者:Jiaxuan Guo,Xingyu Ren,Kejia Zhang,Jingxin Yang,Youran Sun,Haizhao Yang
类目:Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词:Vision-language models, theory of mind, routinely tested, tested on theory, Director
备注:
点击查看摘要
Abstract:Vision-language models are now routinely tested on theory of mind: whether they can work out what another person sees, knows, and means. A common design asks the model to report that perspective and then to act for the person, and reads a correct report beside a wrong action as a failure to use the perspective. That reading rests on a quiet assumption: that asking for the report leaves the action unchanged. We show that it does not. In a rendered Director Task, a partition hides the largest block from a director who asks for "the largest block". Asking first which blocks the director can see raises the share of replies that choose this hidden block by 12 to 88 percentage points on six GPT models and by 17 on Qwen3.8-27B, even though the models mostly report correctly which blocks the director sees. Reasoning traces and prompt rewordings suggest why: the question shifts how the request is read, from the director's view toward the model's own. When the prompt states what the director knows and refers to, fewer than 1% of replies pair a correct report with a hidden-block choice. Any evaluation that elicits a perspective report before the action it scores needs a baseline without the question, and we deliver one: paired prompts that differ only in that question, a design any perspective-taking benchmark can adopt.
77. 【2610.29308】LLM-Based Exogenous World Modeling for Dynamic Scheduling
链接:https://arxiv.org/abs/2610.29308
作者:Ni Zhang,Haofeng Yuan,Jianan Zhou,Shiji Song,Zhiguang Cao
类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词:compound downstream costs, Dynamic scheduling requires, anticipating future jobs, nonlinear tardiness objectives, scheduling requires dispatching
备注: 10 pages, 5 figures, 1 table
点击查看摘要
Abstract:Dynamic scheduling requires dispatching online arrivals while anticipating future jobs, as poor decisions can compound downstream costs under nonlinear tardiness objectives. We show that a pretrained large language model (LLM) can serve as the exogenous component of a structured world model, forecasting uncertain future job arrivals. Specifically, we exploit an afterstate decomposition, which separates known deterministic shop transitions from uncertain exogenous job arrivals, enabling the LLM to forecast only the latter through a compact belief representation. Building on this, we develop Afterstate World-Model Planning (AWMP), which combines an evolved, belief-conditioned dispatching strategy with short scenario-based rollouts. A surprise-triggered refresh mechanism queries the LLM only when newly observed arrivals deviate sufficiently from previous forecast, and online residual self-calibration further conditions the LLM on its recent forecast errors to handle nonstationary arrivals. Across diverse arrival distributions, AWMP reduces weighted tardiness by 6-21% on dynamic job-shop and 22-46% on flexible job-shop benchmarks, relative to the best of eight classical priority-dispatching rules.
78. 【2610.29303】ExpEvolve: Structuring and Reusing Experience for Open-Ended Discovery
链接:https://arxiv.org/abs/2610.29303
作者:Yongqiang Chen,Chenxi Liu,Deyu Zou,Zhenhao Chen,Tongliang Liu,Bo Han,Kun Zhang
类目:Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)
关键词:Large Language Models, Language Models, Large Language, Evolutionary coding agents, notable successes
备注:
点击查看摘要
Abstract:Evolutionary coding agents such as AlphaEvolve are one of the notable successes in using Large Language Models (LLMs) to build AI Scientists. These agents tackle open-ended scientific problems by iteratively improving and evolving programs, leveraging the prior knowledge and reasoning capabilities of LLMs. Despite their success, mutations over programs are mostly low-level upon surface heuristics, without a persistent unit of control. In contrast, science compounds through ideas. In this work, we propose ExpEvolve, which injects idea-level extraction and control into evolution: it discovers and leverages the high-level factors from programs that explain scoring differences among different programs. We characterize theoretical conditions on when discovery with idea factors improves sample efficiency. We also build a practical framework to show that the extracted high-level idea factors are helpful for guiding exploitation from experience and exploration when discovery comes to a plateau. Across 11 open-ended mathematical tasks, ExpEvolve significantly improves the final performance and sample efficiency up to 5.0x. The improvements also transfer to 4 other LLMs and to 6 machine learning tasks from MLS-Bench. Analysis shows that ExpEvolve can discover idea-level factors to provide better exploration and exploitation for evolutionary discovery.
79. 【2610.29294】Same Probabilities, Different Advice: Gain-Loss Framing Effects in High-Stakes LLM Decision Support
链接:https://arxiv.org/abs/2610.29294
作者:Yuyao Zhang,Yakun Cui,Han Zhu,Jinsong Lu,Yike Guo,Sirui Han
类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词:Large language models, Large language, uncertainty remains unclear, language models, remains unclear
备注: 14 pages, 2 figures
点击查看摘要
Abstract:Large language models (LLMs) are increasingly used to support consequential decisions, yet their reliability under equivalent representations of uncertainty remains unclear. Existing work has documented prompt sensitivity, cognitive biases, and confidence miscalibration, but it is still unknown whether high-stakes advice changes when the same probability is expressed through complementary gain and loss frames. We introduce FrameBench-HPS, a controlled benchmark of 2,880 prompts derived from 240 high-stakes scenarios across healthcare, finance, education/career, and legal/consumer-rights domains. Across seven LLMs, gain-loss framing changes the recommendation category in 32.4% of complete groups, with most changes involving uncertainty rather than direct reversals. Human evaluation confirms corresponding shifts in perceived risk and directiveness. Robustness experiments show that framing effects persist under conversational paraphrases and exceed ordinary repeated-generation variability. Probability canonicalization substantially reduces framing sensitivity, identifying probability representation as a practical target for improving consistency in high-stakes LLM decision support.
80. 【2610.29292】Credit Where Credit Is Due: Contrastive Attribution Topology Search for Multi-Agent Systems
链接:https://arxiv.org/abs/2610.29292
作者:Fabian Tritthart,Tom Zehle
类目:Computation and Language (cs.CL); Multiagent Systems (cs.MA)
关键词:LLM multi-agent system, Contrastive Attribution Topology, multi-agent system, chooses to trust, cost hinge
备注:
点击查看摘要
Abstract:An LLM multi-agent system (MAS) is only as good as the agents it chooses to trust: its accuracy and cost hinge on its topology, meaning which agents are included and how they communicate. A single task score, however, does not reveal which agents help or hinder performance. We propose Contrastive Attribution Topology Search (CATS), which searches for compact teams within a fixed supergraph of specialized agents. An LLM attributer compares execution traces across candidate topologies and assigns credit to individual agents. CATS uses these credits to update supergraph edges while progressively pruning weak edges and agents, yielding a small team for deployment. With small open-weight models and matched candidate evaluations, CATS improves mean accuracy on BigCodeBench by 5.3 percentage points over score-only heuristic search while using 54\% fewer deployment tokens. On MBPP, CATS matches the strongest baselines with fewer tokens than the other searches. In a HotpotQA prompt-poisoning stress test, CATS excludes all adversarially prompted agents in all three runs, whereas random search retains some at comparable accuracy. Per-agent credit thus supports both team optimization and the pruning of potentially harmful agents.
81. 【2610.29283】Computer Vision and Knowledge-Grounded Language Models for Intelligent Beekeeper Assistance
链接:https://arxiv.org/abs/2610.29283
作者:Asaduz Zaman,Mohaimenul Azam Khan Raiaan,Malika Nisal Ratnayake
类目:Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词:extreme weather patterns, global food products, wild bees sustain, bees sustain roughly, colonies face mounting
备注:
点击查看摘要
Abstract:Managed and wild bees sustain roughly a third of the global food products, yet colonies face mounting stress from climate-change including extreme weather patterns, altered parasite and disease patterns. Timely assessment of colony condition such as understanding colony strength, brood area, honey and pollen storage, comb usage, is essential to adaptive management. However, manual hive frame inspection is slow, costly, and quality depends on scarce expertise. We present an artificial targeted intelligent system framework focusing on edge deployable pipeline that turns hive frame photographs into interpretable and action-oriented inspection report. The pipeline includes an object detector to detect biologically-meaningful comb-cell classes; detections are distilled into structured fact schema; facts are converted into constrained factual text; the text triggers a grounded knowledge-base for interpretations and recommendations. Knowledge-base entries are required to be triggerable by evidence expressed in the fact schema. We built our system based on open source FAIRHiveFrames-1K dataset and favour reproducible, edge-deployable models over large general purpose frontier models. We additionally release FAIRHiveText-1K dataset that turns FAIRHiveFrames-1K dataset into interchangeable facts and text interpretation of the facts, making it easy for further LLM-based research into this area. We also propose a pathway to develop the grounded knowledge-base that will be helpful in providing interpretable and actionable reports from the facts.
82. 【2610.29256】Heard But Not Said: Prompting Understates Temporal Information of Musical Moments in Frozen Large Audio-Language Models
链接:https://arxiv.org/abs/2610.29256
作者:Eunsik Shin
类目:ound (cs.SD); Computation and Language (cs.CL)
关键词:Large audio-language models, Large audio-language, understand music, Large, audio-language models
备注:
点击查看摘要
Abstract:Large audio-language models (LALMs) understand music, yet struggle to locate a described moment in time. We ask whether this reflects missing temporal information or a bottleneck in how the time span is extracted. Using a paired-query probe built from Slakh2100 stem activations, we attach a state query (e.g., ``only piano and bass are playing'') and a change query (e.g., ``the guitar drops out, leaving piano and bass'') to the same span and vary how much preceding audio the model is shown. Across frozen LALMs, three ways of extracting the span ask different questions: full-track prompting asking whether the model can say when; windowed yes/no scoring asking whether it verifies the moment when handed the segment, and whether it needs what came before; attention asking whether it can find the moment on its own. State queries score above baseline without context, while change queries improve with preceding context in most short-segment models; 30s padded encoders show no comparable recovery. Prompting and attention expose almost none of this. Prompting failures thus understate what LALMs can verify, though not what they can locate, by an amount set by query type and encoder.
83. 【2610.29255】Hierarchical Masked Diffusion Language Models
链接:https://arxiv.org/abs/2610.29255
作者:Parul Gupta,Satwik,Avni Aggarwal,Bhavesh Gurnani,Arnab Kumar Mondal,Dinesh Khandelwal,Dinesh Garg,Parag Singla
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词:Masked diffusion language, diffusion language models, Diffusion Language Model, diffusion language, Masked diffusion
备注:
点击查看摘要
Abstract:Masked diffusion language models have emerged as an alternative to autoregressive models, enabling parallel token generation. However, standard masked diffusion language models use a shared noise schedule across positions without explicitly encoding which positions should be resolved first. Many tasks exhibit a natural priority among positions: document titles and section headings can guide the generation of body text, while Sudoku cells determined directly from the initial clues can help resolve more difficult cells. To incorporate this notion of priority (or hierarchy) among token positions, we introduce the Hierarchical Masked Diffusion Language Model (HMDLM), which augments each token position with a hierarchy level available as part of the training data, and requires zero or minimal additional annotations. It factors generation into two passes: the first predicts a hierarchy distribution over masked positions, the second predicts token distributions conditioned on it. Giving each hierarchy level its own noise schedule induces a soft, controllable preference for revealing higher-priority positions earlier while keeping decoding fully parallel. Our formulation is mathematically grounded, and we re-derive the forward and reverse processes and the NELBO for this factorization. Our evaluation shows that for the task of language generation on LM1B, HMDLM reduces perplexity by more than 1.5 points over Anchored Diffusion Language Model (ADLM), a recently proposed strong diffusion baseline; on WikiHow, we see a drop in perplexity of up to 4.4 pts on ADLM and up to 7 pts against MDLM. An LLM judge on WikiHow prefers HMDLM generations (the two variants combined) more than $2\times$ as often as the baseline. On the task of solving Sudoku puzzles requiring multi-step reasoning, it improves solution accuracy by up to $8.6\%$ absolute points over existing diffusion baselines.
84. 【2610.29254】Intergroup Bias Predicts Expressions of Social Judgment and Empathy in the r/AmITheAsshole Reddit Community
链接:https://arxiv.org/abs/2610.29254
作者:Yu Hou,Hal Daumé III,Rachel Rudinger
类目:Computation and Language (cs.CL); Social and Information Networks (cs.SI)
关键词:understand others' experiences, people empathize, others' experiences differently, People share, People
备注: ICWSM 2027
点击查看摘要
Abstract:People share and understand others' experiences differently based on their social identities; often, people empathize more when the other person belongs to their ingroup compared to an outgroup. While this intergroup empathy gap is well-studied in social psychology, it remains unclear how it manifests in naturally occurring online social interactions. To this end, we measure how commenters express social judgments, as an indirect outcome of their understanding towards the posters, and empathy in text, based on whether commenters share the poster's gender or are of similar ages. We focus on posts where the poster self-reports these demographics, and analyze 126,716 comments associated with 36,163 posts from 18,111 commenters in r/AmItheAsshole, while controlling for commenter and poster group identities, post features (topic, length, and score), and both commenter- and post-level variance. Our results show that when commenters and posters are ingroup, in either gender or age, commenters are more likely to provide a Not the Asshole verdict and show greater text-based understanding as measured by LLMs. We also observe that older commenters behave differently from younger ones. Furthermore, in a subset of posts where the gender and age of the other party in the conflict are explicitly mentioned, we find that commenter-poster ingroup effects are moderated by the group relationships between the poster and the other party when commenters make social judgments. Our work highlights the importance of intergroup context and social group nuances in understanding online discourse.
85. 【2610.29250】Let Agents Design How They Search: Automatic Interface Optimization for Agentic Search
链接:https://arxiv.org/abs/2610.29250
作者:Sangjune An,Jaeyoon Jung,Yumin Choi,Jinheon Baek,Junmo Cho,Sung Ju Hwang,Hae Beom Lee
类目:Computation and Language (cs.CL)
关键词:Agentic search depends, language-model agent accesses, Agentic search, accesses and explores, Agentic
备注:
点击查看摘要
Abstract:Agentic search depends on the interface through which a language-model agent accesses and explores a corpus. Existing interface designs are fixed by hand and applied unchanged to every corpus, although effective designs may depend on the corpus. We introduce SearchWeaver, a framework for automatic search interface optimization guided by downstream search performance. A proposer uses execution trajectories and task rewards to jointly revise corpus artifacts, executable tools, and usage instructions. This pro cess optimizes what information is prepared in advance, which operations tools perform, and which decisions remain with the search agent. With GPT-5.4-nano, the optimized interfaces improve answer accuracy from 71.6% to 78.4% on BrowseComp-Plus and average nDCG@10 from 45.7 to 55.0 across four BRIGHT subsets over Direct Corpus Interaction. These findings highlight the value of jointly optimizing corpus artifacts, executable tools, and usage instructions to develop effective search interfaces.
86. 【2610.29249】MOSAIC: An Omni-Modal Benchmark for Long-Term Memory and Cross-Modal Reasoning in Conversational Agents
链接:https://arxiv.org/abs/2610.29249
作者:Hong Ting Tsang,Boyi Zhang,Haoyu Huang,Jiaxin Bai,Yufei Li,Yisen Gao,Zhongwei Xie,Hongyu Luo,Jeff Z. Pan,Yangqiu Song
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词:assistants must remember, Omni-modal assistants, Existing long-term memory, MOSAIC, long-term memory benchmarks
备注:
点击查看摘要
Abstract:Omni-modal assistants must remember not only what users say, but also what they show and convey. Existing long-term memory benchmarks are mostly text-and-image or report a single end-to-end score, so they cannot locate whether evidence is lost when it is represented, retrieved, delivered, or read. We introduce MOSAIC, a benchmark of 923 questions over persona-grounded histories of 11-24 sessions spanning text, image, video, and audio. MOSAIC constructs targeted spatial, temporal, and prosodic signals rather than decorative media, with the strongest causal validation for spatial information and selector-level validation for annotated prosody, and pairs them with a matched diagnostic protocol that freezes the question, reader, prompt, and budget while intervening on representation, retrieval, and delivery. Matched decomposition shows that representation loss is modality-dependent, residual reading dominates even under gold evidence, and abstention remains weak on these controls: strong answerable scores coexist with failures to refuse. MOSAIC thus turns omni-modal memory evaluation from a leaderboard into a diagnosis of write, retrieve, deliver, and read failures.
87. 【2610.29225】Beyond Binary Labels: Diagnostic Evaluation of LLM Safety with Prompt-Level Rubrics
链接:https://arxiv.org/abs/2610.29225
作者:Hongyu Li,Xinlong Huang,Zhan Yu,Jing Zhao,Zhe Zhao,Juntao Zhong,Xiong Kuang,Rui Yuan,ZhenXiang Yan,Huilin Xu,Haitao Yu,Lilin Wang,Rui Chen,Blaze Chen,Fengzong Lian,Renfen Hu
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR)
关键词:lacking explanatory depth, Current LLM safety, benchmarks predominantly rely, Current LLM, lacking explanatory
备注: 42 pages, 9 figures, 24 tables. Dataset will be publicly released at [this https URL](https://github.com/Tencent-Hunyuan/DiagSafe)
点击查看摘要
Abstract:Current LLM safety benchmarks predominantly rely on binary safe or unsafe labels, lacking explanatory depth and suffering from low consistency across automated judges. To address this, we introduce DiagSafe, a diagnostic evaluation framework that moves beyond binary classification by employing prompt-level rubrics. Grounded in globally applicable AI safety policies, each rubric provides explicit criteria along two dimensions: safety, which targets concrete harms with specific exemptions to suppress false positives, and usefulness, which independently evaluates instruction fulfillment. To ensure a robust and realistic evaluation, we construct a bilingual (English-Chinese) benchmark grounded in a comprehensive 84-label safety taxonomy, consisting of two subsets: DiagBase, which covers single- and multi-turn prompts with direct harmful queries and template-based jailbreaks, and DiagAttack, which embeds harmful intents into complex instruction-following tasks to form challenging instruction attacks. Extensive experiments demonstrate that DiagSafe significantly enhances the reliability of LLM-as-a-judge evaluation, achieving 95.34% agreement with human annotations -- substantially higher than the 69%-87% achieved by the baselines -- and high inter-judge consistency (Cohen's $\kappa$ = 0.864). Furthermore, applying our framework reveals that leading LLMs differ markedly in their unsafe rates, and each model also exhibits unique vulnerabilities along different dimensions. In addition, we observe that models are particularly susceptible in Chinese and multi-turn contexts. Ultimately, DiagSafe provides a reliable and explainable tool for auditing and optimizing LLM alignment.
88. 【2610.29223】C$^2$U in RAG: Compositional Concept Unlearning in Retrieval-Augmented Generation
链接:https://arxiv.org/abs/2610.29223
作者:Yiyang Duan,Fan Wu,Tiantong Wu,Che Wang,Zhiren Gong,Wei Guo,Yang Cao,Wei Yang Bryan Lim
类目:Computation and Language (cs.CL)
关键词:Retrieval-augmented generation, expose unwanted concepts, generator is moderated, generation can expose, expose unwanted
备注: 37 pages, 8 figures, including appendices
点击查看摘要
Abstract:Retrieval-augmented generation can expose unwanted concepts through retrieved evidence even when the generator is moderated. We study query-side concept suppression with a fixed encoder and document index. Compositional Concept Unlearning (C$^2$U) routes a profile-derived direction through an augmented atom bank, adding only a bounded edited-minus-original delta to the raw query. Across five datasets, four encoders, and three seeds, the validation-selected configuration reduces pooled binary target Hit@5 by 4.25 percentage points with non-positive control degradation and target-exposure changes. Under the evaluated query transforms, it suppresses target density without increasing budgeted control-query exposure. Separately, ArXiv four-concept composition improves over an averaged-direction comparator after independent validation gates and first-use test evaluation.
89. 【2610.29216】Preference Is Not Permission: Personalizing the Auto-Purchase Line in Agentic Commerce
链接:https://arxiv.org/abs/2610.29216
作者:Ryotaro Shimizu,Sai HtaungKham,Mo Fan
类目:Information Retrieval (cs.IR); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)
关键词:Personalized shopping benchmarks, Personalized shopping, pose learning, item fits, human authorization reference
备注:
点击查看摘要
Abstract:Personalized shopping benchmarks ask which item fits the user; we ask how far an agent may commit on that item, and pose learning the individual's auto-purchase line as a task. The boundary is evidence-conditioned and three-valued: whether committing is appropriate depends on the sufficiency of product information (warrant), reversibility, price against the user's norm, and urgency, not only on fit; and the natural output is don't buy, confirm first, or buy automatically. Across sixteen instruction-tuned models, autonomous commitment is misaligned with a human authorization reference in which fifteen annotators, role-playing the delegating principal from a given profile, choose the furthest action they would allow without confirmation: models commit even when fit is low and when their own evidence flag reports the warrant missing. This is overreach. The line is individual: these raters disagree, yet the disagreement is structured and partly predictable from a person's own other labels. A shallow learner on a few dozen of a person's own labels predicts their held-out auto-purchase line at a median of 0.79 by 30-40 labels, outperforming every evaluated prompt$\times$model configuration, including a per-annotator oracle over 80 configurations; the learned boundary does not transfer across domains. We release the counterfactual benchmark, human authorization reference, and annotation protocol after acceptance.
90. 【2610.29210】Understanding Target Probability Reuse in Speculative Decoding
链接:https://arxiv.org/abs/2610.29210
作者:Jungseob Lee,Giyoon Jang,Chailin Nam,Jiwoo Kum,Sihyeon Lee,Kyojun Choo,Jihun Song,Eunseo Song,Chanjun Park
类目:Computation and Language (cs.CL)
关键词:tree, Speculative decoding, distribution, target, Abstract
备注: 29 pages, 6 figures, 29 tables. Code: [this https URL](https://github.com/js-lee-AI/TargetRows)
点击查看摘要
Abstract:Speculative decoding uses a target model to verify a tree of draft tokens in parallel. We study whether the resulting next-token distributions can help select the next tree. For unrestricted target models, we show that guaranteed exact reuse requires a distribution computed at the next round's complete context. We characterize when retaining this distribution requires sacrificing accepted tokens and establish conditions under which this loss persists across decoding rounds. Across six targets, we find that reranking first-token branches with a separately computed distribution at the current context improves expected acceptance over draft ranking, especially with small tree budgets. Drawing the first token from this distribution before allocating the tree further improves expected acceptance over pruning a preselected tree, even at equal mean tree size. In our experiments, both selection rules also decode faster than draft ranking when the separate target pass overlaps standalone drafting. Our findings show that making target probabilities available before tree allocation can improve the efficiency of speculative decoding. Our code is available at this https URL.
91. 【2610.29207】norregel: a preregistered benchmark of dated numeric values in Norwegian law
链接:https://arxiv.org/abs/2610.29207
作者:Eirik Botten Nicolaysen(EcoDeco AS)
类目:Computation and Language (cs.CL)
关键词:National Insurance basic, Insurance basic amount, National Insurance, NOK amounts, Norwegian statutes
备注: 24 pages. Preregistrations, code and results: Zenodo concept DOI [https://doi.org/10.5281/zenodo.23422302](https://doi.org/10.5281/zenodo.23422302) (versions v1 [https://doi.org/10.5281/zenodo.23422303](https://doi.org/10.5281/zenodo.23422303) , v1.1 [https://doi.org/10.5281/zenodo.23432124](https://doi.org/10.5281/zenodo.23432124) , v1.2 [https://doi.org/10.5281/zenodo.23434782](https://doi.org/10.5281/zenodo.23434782) , 2.0 [https://doi.org/10.5281/zenodo.23437444](https://doi.org/10.5281/zenodo.23437444) , 2.1 [https://doi.org/10.5281/zenodo.23502580](https://doi.org/10.5281/zenodo.23502580) ). Items are withheld
点击查看摘要
Abstract:norregel asks language models for numeric values in Norwegian statutes, regulations and parliamentary decisions (NOK amounts, percentages, multiples of the National Insurance basic amount (G) and age limits), each at a stated date. The 916 items were extracted mechanically from Lovdata's open data, and each carries the dated history of its provision, so an answer can be classed as correct, outdated, wrong or uninterpretable. We report a first and a second preregistered run on the same items. In the first run (five models, listed publicly only after local analysis), H1, that outdated answers are more frequent for values that took effect after a model's cutoff, could not be tested in substance, and H2 and H3 were inconclusive; Opus 5.5 and Sonnet 4.6 answered 46.7% and 40.2% of the 880 primary items correctly. The second run was preregistered and published before any of its calls, and eight models were analysed. Its pooled primary test supported H1 under the preregistered decision rule (d = 17.8 percentage points, 95% interval [7.7, 28.9], p = 0.0001). In the preregistered sensitivity analysis S8, which counts as outdated only the most recent value that differs from the key, d was 3.9 [-3.6, 12.7] (p = 0.1754), an interval that contains 0. H1 was supported in every other preregistered sensitivity analysis, but S8 is the only one that gives both groups one target value, so we do not regard the support for H1 as robust. The share of outdated answers equal to that most recent value (H2) was 56.1% [46.6, 65.0], an interval that contains 0.5, and the pooled test of a lower share correct in Nynorsk than in Bokmål (H3) was inconclusive. Several models, among them Haiku 4.5, gave mostly uninterpretable answers. Items and keys are withheld; item IDs, per-answer classes, code and results are on Zenodo.
92. 【2610.29189】Reasoning-Search-Augmented LLMs: An Operational Taxonomy, Benchmark Analysis and Controlled Evidence Synthesis
链接:https://arxiv.org/abs/2610.29189
作者:Biswas Poudel,Nilson Chapagain,Amit Kumar,Xianshun Jiang
类目:Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词:finite context windows, demonstrate impressive emergent, Large language models, emergent reasoning capabilities, Large language
备注: 10 pages
点击查看摘要
Abstract:Large language models (LLMs) demonstrate impressive emergent reasoning capabilities, yet they remain constrained by fixed model parameters and finite context windows. Even when augmented with static retrieval, they can produce statements that are unsupported by, or even contradictory to, retrieved evidence. This leads to hallucinations, difficulty incorporating up-to-date information, and failures to correctly interpret or reconcile sources. Recent work addresses these limitations by tightly coupling step-by-step reasoning with interactive search, treating retrieval as an action within an iterative agentic loop rather than a one-shot preprocessing step. This study reviews frameworks that implement such reasoning-search loops by interleaving planning, querying, retrieval, integration, verification, and stopping. We analyze these systems through four architectural axes: retrieval coupling, controller design, knowledge source, and grounding strictness. We separately treat the learning signal as a cross-cutting dimension because prompting, supervision, preference optimization, and reinforcement learning can instantiate the same architecture while producing materially different search, stopping, and grounding behavior. We further distinguish benchmark difficulty from RSA-loop demand and synthesize controlled within-study ablations and quality-cost deltas, avoiding invalid pooling across heterogeneous model backbones, retrievers, corpora, and evaluation protocols. Our goal is to clarify the landscape of reasoning-search-augmented LLMs and outline a unified perspective on the design choices shaping future research.
93. 【2610.29188】LTEM: LLM-Friendly Table-Enhanced Markdown for Table Understanding and Generation
链接:https://arxiv.org/abs/2610.29188
作者:Eunbin Kim,Hyeonseok Kang,Sangkeun Jung
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词:including scientific papers, financial reports, real-world documents, including scientific, scientific papers
备注: Accepted to the EMNLP 2026 Main Conference
点击查看摘要
Abstract:Tables in real-world documents, including scientific papers, financial reports, and statistical summaries, frequently use merged cells, multi-level headers, and sectioned layouts. Yet the lightweight formats LLMs handle best (Markdown, CSV) cannot express these structures, while expressive formats (HTML, LaTeX) impose excessive token cost and parsing complexity. To enable systematic analysis of this trade-off, we introduce a taxonomy decomposing table structure into six atomic features (F1-F6) and corresponding complexity levels (L1-L6), and construct STB (Synthetic Table Benchmark), a controlled benchmark with 1,089 tables systematically distributed across complexity levels. Using this framework, we propose LTEM (LLM-friendly Table-Enhanced Markdown), a formally specified, minimal extension of Markdown that explicitly encodes spans and hierarchical headers. Experiments across five state-of-the-art LLMs show that LTEM achieves accuracy comparable to HTML, offers a favorable accuracy-token trade-off relative to HTML and LaTeX, and produces substantially fewer invalid responses than LaTeX; for table generation, LTEM is comparable to MultiMarkdown though HTML is best. We release our taxonomy, benchmark, and format specification to support future research on LLM-table interaction.
94. 【2610.29171】rainBridge: Agentic NPU Training Optimization Guided by GPU Compilation Evidence
链接:https://arxiv.org/abs/2610.29171
作者:Yupeng Chen,Kunxiang Zhao,Xingjian Wang,Yue Zhao,Yijing Wu,Ye Liu,Kai Li,Congliang Chen,Ruoyu Sun
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词:efficiency on Ascend, Ascend NPUs, improve training efficiency, Ascend, GPU
备注:
点击查看摘要
Abstract:We study how to improve training efficiency on Ascend NPUs. In the NPU training programs we study, framework-level compilation optimizations such as operator fusion are only partially applied, leaving fragmented computation and avoidable execution overheads. Profiling-guided tuning can address these inefficiencies, but it often requires costly trial and error. To make training on NPUs more efficient, we propose TrainBridge, an agentic approach for transferring GPU optimization guidance to NPU training. TrainBridge uses the highly optimized execution produced by mature GPU compilation stacks as a task-specific reference for NPU tuning. It extracts optimization intents from the GPU training execution to guide NPU program rewrites and further refines the rewritten program through iterative profiling. Our GPU-to-NPU migration experiments show that TrainBridge achieves an average 1.7x speedup across four workloads covering LLM pretraining, image classification, and vision-language training, and an average speedup of nearly 2.0x across 27 Modded-NanoGPT speedrun records with highly optimized GPU implementations.
95. 【2610.29167】achBack: Learning to Teach via Bidirectional Preference Optimization for On-Policy Self-Distillation
链接:https://arxiv.org/abs/2610.29167
作者:Linfei Ji(1),Jiayun Li(2),Haozhao Wang(1),Siyu Jiang(1),Zehao Wang(3),Longtao Xiao(1),Yu-Jie Yuan(4),Ruixuan Li(1) ((1) Huazhong University of Science and Technology, (2) Tsinghua University, (3) Harbin Institute of Technology, (4) Huawei Technologies Ltd.)
类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词:Teacher, privileged information, privileged Teacher, language model, privileged Teacher trajectories
备注: 21 pages, 6 figures, including appendices
点击查看摘要
Abstract:On-policy self-distillation (OPSD) enables a language model to learn from a Teacher instantiated from the same model but given access to privileged information, such as a reference solution. We find that access to sufficient privileged information allows the Teacher to generate highly accurate trajectories; however, accuracy alone does not guarantee that these trajectories are suitable for Student learning. Direct access to a complete solution may encourage shortened, reference-conditioned derivations that omit the exploration, verification, and self-correction required to solve problems without privileged information. We introduce TeachBack, a bidirectional preference-learning framework for on-policy self-distillation that learns not only from the Teacher but also how the Teacher should teach. TeachBack shapes the Teacher's generation behavior by controlling the length of the reference-reasoning suffix injected into the prompt and by varying the prompt style. While maintaining comparable Teacher accuracy, it encourages the Teacher to explore and re-solve problems, thereby reducing its reliance on the reference solution. At each rollout refresh, the shared policy generates both a privileged Teacher trajectory and a problem-only Student trajectory. A pairwise preference objective uses privileged Teacher trajectories to improve Student learning, while the reversed preference uses the Student's behavior to shape future Teacher supervision under the privileged condition. Experiments on mathematical and logical reasoning tasks show that TeachBack consistently improves Student performance over existing OPSD methods and related baselines.
96. 【2610.29165】Carving Radiology Reports at Their Evidential Joints: Anatomical Region Sets as Generation Units
链接:https://arxiv.org/abs/2610.29165
作者:Jinwei Yang,Junhao Chen,Jianwei Zhao,Zhonghan Xu,Hong Cheng,Ling Wang
类目:Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词:Organizing radiology reports, generate fine-grained clinical, fine-grained clinical content, Organizing radiology, generated units offers
备注: 28 pages, 4 figures
点击查看摘要
Abstract:Organizing radiology reports into independently generated units offers a way to generate fine-grained clinical content and bind it to visual evidence. However, existing methods typically adopt generation-unit structures not directly specified in natural reports or their annotations, introducing additional modeling compromises. We propose RadCarve, which instead defines generation units directly from the anatomical region sets in existing statement-region correspondences, unifying unit formation with visual evidence selection. RadCarve's planner uses composition-specialized query banks to jointly predict unit existence and region composition from the image, iteratively refining both with regional evidence aggregated according to current membership predictions. The generator independently produces each unit's text conditioned on the joint visual evidence of its predicted region set. Compared with strong baselines, RadCarve improves CXRFEScore by 9.4% in unit generation given region sets and achieves 2.4 times the end-to-end binding F1. It also achieves leading report-generation results on Chest ImaGenome and PadChest-GR, using fewer than one-sixth as many parameters as large-scale baselines.
97. 【2610.29162】Why is AI-generated language so hard to understand?
链接:https://arxiv.org/abs/2610.29162
作者:Thomas Hikaru Clark,Matias B. Martin,Kyle Mahowald
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词:harder to understand, widespread sense, recently become harder, AI-generated text, low-frequency n-grams
备注:
点击查看摘要
Abstract:There is a widespread sense that AI-generated text has recently become harder to understand. In this study, we investigate a set of psycholinguistic features that are known to correlate with human processing difficulty (e.g., object relative clauses, long syntactic dependencies, low-frequency n-grams). Using a novel corpus of AI-generated text across diverse domains, we find that AI models use these difficult features more often than paraphrases generated by round-trip translation. Compared with human writing, all nine frontier and near-frontier models use more inanimate subjects with animate verbs and more low-frequency n-grams, and most also use longer dependencies, more stacked nouns, and more reduced object relatives in conversation; we also demonstrate substantial variation across model families. We propose and test a hypothesis as to why: while human language is optimized for successful communication, AI-generated text is increasingly optimized for other goals like math, code, and reasoning, in which there is a pressure for \textit{information density} rather than successful communication. We provide a proof-of-concept for this hypothesis by fine-tuning a language model under a length penalty, which leads to a divergence from human-like linguistic behavior. Our findings highlight the axes of misalignment between linguistic processing demands in humans and LLMs, and point toward possible remedies.
98. 【2610.29143】VeeReview: Measuring Build-Verify Pairs in Agent-Authored Pull Requests from a V-Model Perspective
链接:https://arxiv.org/abs/2610.29143
作者:Gabriel Dautovi,Jie JW Wu
类目:oftware Engineering (cs.SE); Computation and Language (cs.CL)
关键词:pull request requires, pull request, pull requests, request requires verification, requires verification evidence
备注: 47 pages, 9 figures, 11 tables. Under review at Empirical Software Engineering. Replication package: [this https URL](https://zenodo.org/records/22884519)
点击查看摘要
Abstract:Context: Reviewing a pull request requires verification evidence that addresses the proposed change. Coding agent benchmarks and studies of pull request outcomes do not directly assess this relationship. Objective: We test whether the V-Model's build and verify pairs can measure verification evidence in pull requests and support comparisons between agent-authored and human-authored changes. Method: VeeReview classifies four build and verify pairs using repository signals and a language-model judge. Three pairs use model judgements constrained by deterministic signals, and a rule over the diff and repository tree decides Module Design-Unit Test. We evaluated VeeReview against a 25-pull request reference set labelled by two raters and applied it to 1,454 matched pairs of agent and human pull requests from 741 repositories. Results: VeeReview assigned lower build-only rates to agent-authored pull requests on all four pairs, contrary to the preregistered hypothesis (mixed-effects odds ratios 0.52 to 0.86). Architecture-Integration was not significant. Standardization for linked issues, shipped tests and size reduced matched-rate differences by 34% to 60%, and the rule-decided pair's standardized interval included zero. The instrument did not meet its preregistered calibration criterion: agreement with adjudicated labels was 4% to 60% against a required 80%, and inter-rater agreement was weak (kappa = 0.154). Conclusions: The rule-decided pair shows that a process measure judged by a language model partly reflects how a pull request is presented rather than the verification work behind it. We report the cohort differences as observations made with this instrument, and we argue that such measures need a mechanically decided component and a validated human reference before they can support comparisons of verification practice.
99. 【2610.29136】GRAFT: Restoring the Missing Sampling Interface in Continuous Diffusion Language Models
链接:https://arxiv.org/abs/2610.29136
作者:Haoning Yang,Lili Pan
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词:final step turns, step turns embeddings, language models generate, Continuous diffusion language, diffusion language models
备注:
点击查看摘要
Abstract:Continuous diffusion language models generate a whole sequence in parallel, never drawing a single word at any intermediate step; only the final step turns embeddings into text. Models such as ELF now report autoregressive-level quality at a fraction of the sampling steps of discrete-token diffusion models, and this design principle -- no step-wise discretization -- is what their own ablations credit for the gain. We show that this same principle carries a hidden cost: a collapse of the lexical long tail. Measured against held-out human text, ELF's output matches the human rate on common words almost exactly, yet its rarest words appear at only 0.30x the human rate, a gap that does not close from 105M to 652M parameters and that no sampler setting these models expose can reach. A same-size GPT-2, in contrast, spans zero to above the human rate by its decoding rule alone. We trace the difference to what continuous diffusion models lack: with no step that ever draws a discrete word, every step is instead driven by an average over the candidates still in play, and averaging a rare candidate together with the common word competing for its slot lands on the common word. An autoregressive model avoids this because its decoding rule samples one candidate rather than averaging over all of them. We propose GRAFT, a training-free method that grafts this missing choice back onto a frozen model: while the model is still undecided, GRAFT commits the rare words the average would otherwise discard, then regenerates the sequence from scratch with those commitments held in place. Across three ELF scales and on LangFlow, an independent continuous dLLM, GRAFT restores the rare-word share of generated text from 0.42-0.77x the human rate to 0.82-1.10x, a relative gain of 34-109%, and moves the entire word-frequency profile closer to human on every model tested, by 2.7x on ELF-B and 12x on LangFlow.
100. 【2610.29110】GRAM: Group-wise Rank-Aware Model Merging via Subspace Alignment
链接:https://arxiv.org/abs/2610.29110
作者:Di Wu,Shuaidong Pan
类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词:multi-task deployment, domains like healthcare, highly desirable, desirable for multi-task, regulated domains
备注:
点击查看摘要
Abstract:Merging different models into a single model is highly desirable for multi-task deployment, particularly in regulated domains like healthcare. In such settings, models are often locally fine-tuned due to strict data privacy policies, necessitating that aggregation operates exclusively on the fine-tuned weights. Existing methods apply a uniform merge across all tasks, ignoring the geometric relationships among their learned subspaces. When task updates occupy misaligned subspaces, projecting them onto a shared low-rank basis discards task-relevant directions, a failure mode named \emph{subspace interference}. Through this study, we show that the per-task projection error of a merged model is governed by the principal-angle alignment between each task and the shared subspace, so that grouping geometrically compatible tasks provably reduces this error within each group. Motivated by this observation, we propose \textbf{Group-wise Rank-Aware Model Merging (GRAM)}, which uses the principal-angle geometry of task vectors to decide which tasks should be merged together and then performs a standard SVD-based merge within each coalition; the pipeline requires only the fine-tuned weights at merge time. With only one additional model ($\nK{=}2$), GRAM significantly mitigates subspace interference and consistently outperforms prior merging methods across language understanding (GLUE with Flan-T5), 8-task CLIP vision, and medical instruction tuning (Qwen2-7B-Instruct with four English/Chinese medical LoRAs).
101. 【2610.29097】Multi-level Encoder with Global Topic for Task-oriented Dialogue Summarization
链接:https://arxiv.org/abs/2610.29097
作者:Zhuoqi He,Peijie Huang,Yuhong Xu,Youming Peng,Mingzhi Xu,Xinyang Lin
类目:Computation and Language (cs.CL)
关键词:automatically extract key, generate domain summaries, Task-oriented dialogue summarization, extract key information, Task-oriented dialogue
备注: 5 pages, 3 figures. Published in ICASSP 2025
点击查看摘要
Abstract:Task-oriented dialogue summarization aims to automatically extract key information to generate domain summaries to improve service efficiency and quality. Task-oriented dialogue is inherently logical and surrounds specific topic. How to effectively capture the dialogue topic and the most salient information becomes one of the major challenges of this task. In this paper, we propose a task-oriented dialogue summarization model utilizing a multi-level encoder with global topic (MLEGT). This model discovers temporal and spatial dependencies through a multi-level encoder, while simultaneously obtaining a simple yet effective global topic in the process of graph construction. It not only captures the crucial details but also breaks the long-range limit and discover the intrinsic structure across the dialogue. Then, a global topic guided pointer mechanism is added into the summrizer to capture ignored but important information, which is helpful to improve the accuracy of the summary. A comprehensive study of two public datasets, including a real-world large-scale Chinese police interrogation dataset and a medical reporting service dataset proves the superiority of our method on several strong baselines.
102. 【2610.29092】Same Answer, Different Reasons: Trace-Level Divergence in Multilingual Large Language Models
链接:https://arxiv.org/abs/2610.29092
作者:Rui Sun,Peizhao Mei,Xiewei Cheng,Kaizhuo Chen,Taoran Li,Zhiyuan Yu,Varun Chandrasekaran
类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词:traces support verification, large language models, standard evaluations typically, evaluations typically measure, support verification
备注:
点击查看摘要
Abstract:Multilingual large language models are increasingly deployed in settings where visible reasoning traces support verification, education, and safety auditing, yet standard evaluations typically measure only final-answer agreement or holistic response similarity. As a result, they establish outcome consistency without determining whether users across languages receive comparable supporting evidence. We introduce a trace-level divergence framework that compares visible reasoning traces as structured sequences, decomposing agreement into structural similarity, order consistency, and holistic similarity, with pair-specific calibration to enable comparison across languages. Across three reasoning benchmarks, seven languages, and six frontier LLMs, the natural baseline---embedding each whole response and comparing the two by cosine---systematically overstates agreement: $52.1\%$--$67.3\%$ of examples in the top quartile of holistic similarity are not in the top quartile of structural similarity. This dissociation is stable across sentence encoders and step segmentations, and blind bilingual annotation studies in two English-anchored language pairs show that human judgments align with structural similarity rather than with the holistic baseline. A same-language control shows that the level of divergence is language-specific: two English traces for paraphrases of the same question agree more closely than an English trace and its counterparts in other languages. Our results show that answer-level and holistic evaluations can substantially overestimate the consistency of multilingual explanatory artifacts, motivating trace-level evaluation for reliable multilingual deployment.
103. 【2610.29073】A Large-Scale Evaluation of Role-Enhanced Zero-Shot Chain-of-Thought Prompting
链接:https://arxiv.org/abs/2610.29073
作者:Ibrahim Khan,Thai Van Nguyen,Yi Xia,Pratch Suntichaikul,Mustafa Can Gursesli,Daniel Fernandez Galeote,Juho Hamari,Ruck Thawonmas
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词:paper proposes Role-Enhanced, systematically integrates domain-specific, integrates domain-specific expert, large language models, proposes Role-Enhanced Zero-Shot
备注:
点击查看摘要
Abstract:This paper proposes Role-Enhanced Zero-Shot Chain-of-Thought (RE-ZS-CoT), a prompting framework that systematically integrates domain-specific expert roles to enhance reasoning in large language models (LLMs) without task-specific examples. We assess two versions of our approach. In the first version, static role selection, we evaluate eight predefined expert roles across arithmetic, commonsense, and reading comprehension benchmarks to determine their impact on reasoning performance. In the second version, dynamic role selection, each model autonomously selects the single most suitable role for each benchmark, enabling adaptive task-role alignment without manual specification. Across 20 LLMs and seven benchmarks, RE-ZS-CoT frequently surpasses zero-shot and zero-shot-CoT baselines, achieving performance improvements of up to 44 percentage points. The results reveal a strong correspondence between static and dynamic versions; the benchmarks where static roles yielded improvements were almost always those where dynamic roles also outperformed baselines, though static selection achieved peak performance. Ablation studies further show that unconventional roles degrade performance, underscoring the necessity of task-role alignment. The framework's scalability is validated across model sizes (2b-14b parameters), with smaller models like Granite3.3-8b achieving remarkable proficiency in arithmetic reasoning. RE-ZS-CoT advances zero-shot prompting by unifying role specialization with chain-of-thought reasoning, offering a practical, resource-efficient solution for improving LLM capabilities across diverse domains.
104. 【2610.29052】Our Own Jev: Typed Decisions in One Forward Pass, from an In-House Judge to Open LoRA Models
链接:https://arxiv.org/abs/2610.29052
作者:Yuchuan Weng,Chi Liu,Xin Chen,Srinivasan Manoharan
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词:language model logits, decision maps evidence, system Jev popularised, maps evidence, hidden states
备注: 22 pages
点击查看摘要
Abstract:A typed decision maps evidence, a question and a fixed set of options to a probability for every option, computed in one forward pass, by reading a language model's logits or a small head over its hidden states, instead of generating and parsing text. The commercial system Jev popularised this System~1 interface, and open reproductions have followed. We report two uses of the pattern. \emph{Part I} describes an in-house System~1 judge that triages about 148K agentic coding session records for a training corpus. It replaces a frontier LLM judge that cost on the order of \$1,000 per pass and whose stored labels matched a fresh two-judge consensus on only 26.9\% of the sessions where the two judges agreed; a self-hosted frozen backbone with a rank-16 LoRA adapter and a pointer head answers three typed questions in one forward pass, judges 1,000 sessions in about three minutes of one GPU, about \$0.06 at a reference rate and roughly 1\% of the frontier judge's cost, and keeps every session inside the organisation. \emph{Part II} asks whether a readout that adds no parameters can be competitive and whether training one helps. Applying the public Eikos recipe and corpus of about 25K decisions to three further backbones (1B, 2B and 35B), we read the frozen output layer of a LoRA-adapted decoder. On the 111 public hard items of JevBench our single-seed 35B, developed with those items in view, scores 79.3\%, not significantly different from the commercial reference (73.0\%, unadjusted $p=0.12$) and ahead of five open systems after Holm--Bonferroni correction; our 2B is ahead of all four kev checkpoints on the leaderboard. A single-seed ablation finds no detectable benefit from training the 26 letter rows of the output layer, and a retrain on a later corpus release moves the 2B's hard-tier accuracy by 11.7 points, which shows how little small evaluations resolve.
105. 【2610.29013】arget Regeneration Shrinks the Gains of Draft-Training Objectives in Speculative Decoding
链接:https://arxiv.org/abs/2610.29013
作者:Jungseob Lee,Hogun Seong,Euijun Choi,Sugyeong Eo
类目:Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词:Speculative decoding accelerates, verifying drafted tokens, accelerates large language, large language models, Speculative decoding
备注: 19 pages, 6 figures, 15 tables. Code: [this https URL](https://github.com/js-lee-AI/TargetRegeneration)
点击查看摘要
Abstract:Speculative decoding accelerates large language models by verifying drafted tokens in parallel. New draft-training objectives are usually credited with the acceptance they add over cross-entropy on externally written responses, yet many pipelines let the target rewrite them. We ask how much of that gain survives. With a vision-language target and a block drafter, we train three objectives on four versions of one corpus: cross-entropy on corpus tokens, token-level distillation from the target, and distillation gated to positions that would survive verification. Distillation and the gate add large gains on external responses, but after greedy regeneration, distillation adds a smaller gain and the gate little or none. The shrinkage persists across data orders, position weights, verifiers, decoding temperatures and, for distillation, initializations and learning rates. Most of it remains at matched supervised length and at each objective's best measured training length. A second vision corpus shows the shrinkage, as does a text-only replication, for distillation also with an autoregressive drafter. Objective gains should therefore be measured against a target-regenerated baseline and across training lengths. Our code is available at this https URL.
106. 【2610.29005】VeriEvolve: Evaluator-First Evolution for Tool-Using Agents
链接:https://arxiv.org/abs/2610.29005
作者:Yueshen Li,Kamer Ali Yuksel,Gokhan Tur,Dilek Hakkani-Tür,João Pedro Maia
类目:oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词:realistic stateful tasks, reliable fitness signal, central obstacle, obstacle to self-improving, realistic stateful
备注: 24 pages, 3 figures. Accepted to the REALM Workshop at EMNLP 2026 (non-archival)
点击查看摘要
Abstract:A central obstacle to self-improving agents is the absence of a reliable fitness signal for realistic stateful tasks. We introduce \textsc{VeriEvolve}, an evaluator-first evolution framework that constructs this missing evaluation layer before optimizing the agent. From task instruction, VeriEvolve synthesizes instruction-grounded challenge states and an executable evaluator that checks them. During each round of workflow evolution, the evaluator is frozen and serves as the fitness signal. Between rounds, VeriEvolve revises the evaluator by converting the end states of strong and weak runs into a pair of counterfactual test cases. Across all 30 MCPMark Filesystem tasks, VeriEvolve constructs 30 evaluators with 141 challenge states, achieving 141/141 agreement on the generated suites and 113/122 agreement on held-out states produced by executor agents. Evaluator-guided evolution increases externally verified success from 6/30 to 18/30 for GLM-5.2 and from 27/30 to 30/30 for Claude; refinement removes all three false positives that the weak executor exposes. Cross-environment studies on PostgreSQL, Playwright, Notion, and GitHub further expose complementary limits from observability, state representation, and search/execution capacity. These results show that executable evaluators can be synthesized and used to guide search when task success is observable and an external verifier is available for calibration.
Comments:
24 pages, 3 figures. Accepted to the REALM Workshop at EMNLP 2026 (non-archival)
Subjects:
Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
Cite as:
arXiv:2610.29005 [cs.SE]
(or
arXiv:2610.29005v1 [cs.SE] for this version)
https://doi.org/10.48550/arXiv.2610.29005
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
107. 【2610.28998】FlashNext-RL: A System Optimization Study for Long-Horizon Agentic RL of Qwen3.8-Flash-Next
链接:https://arxiv.org/abs/2610.28998
作者:Zhewei Yao,Yuxiong He
类目:Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词:Long-horizon agentic reinforcement, agentic reinforcement learning, Long-horizon agentic, efficient rollout generation, reinforcement learning
备注: 24 pages, 5 figures, 16 tables
点击查看摘要
Abstract:Long-horizon agentic reinforcement learning (RL) requires both efficient rollout generation and training on long sequences. However, the memory requirements and model-specific operators of Qwen3.8-Flash-Next make this difficult with existing open-source implementations. To resolve these limitations, we introduce FlashNext-RL, a model-specific RL training optimization framework based on prime-rl, with vLLM for software engineering (SWE) rollout generation. Our main focus is BF16 training of the full 48-layer model on a single 8xB200 node, with the first two layers, the n-gram table, the sparse-attention indexer and the multi-token prediction head frozen. We optimize host offload, gradient accumulation and the kernels for mixture-of-experts, sparse attention and the gated residual stream. In the full-model development study, non-padding training throughput increases from approximately 395 tokens/s/GPU in the initial 32K-token configuration to 4,438 tokens/s/GPU in the optimized 131K-token configuration, with hardware matmul throughput (aka without considering the cost of attention components) increasing from approximately 20 to 213 TFLOPs/GPU. A controlled cumulative study on an 8-layer model further quantifies the contributions of individual optimizations. Together with three inference nodes, the system supports a live SWE RL run with a target batch of 1,024 trainable rollouts and a 131,072-token context limit. Over steps 5-15, an iteration takes 22.4 minutes on average, with bounded entropy and trainer-sampler mismatch KL. These results highlight the importance of tailoring RL training to the model's architecture, memory layout and kernel requirements, rather than relying only on general-purpose RL infrastructure.
108. 【2610.28992】Language Impairment as a Lens onto Large Language Models
链接:https://arxiv.org/abs/2610.28992
作者:Muxuan He,Wang Bill Zhu,Yue Chen,Elsi Kaiser,Weizhi Du,Yao Du,Samuel Nastase,Yanjun Gao
类目:Computation and Language (cs.CL)
关键词:highly distributed spaces, phenomenon strikingly similar, large language models, localized brain damage, distributed spaces
备注:
点击查看摘要
Abstract:Although large language models (LLMs) encode language in highly distributed spaces, they remain vulnerable to focal disruptions---a phenomenon strikingly similar to how localized brain damage causes clinical aphasia in humans. To investigate this theoretical tension, we ask whether LLMs possess a functional structure analogous to the human language system, by introducing a novel mechanistic interpretability framework inspired by aphasia. Through two complementary approaches, classifier-guided lesioning and continuous activation steering, we systematically induce aphasia-like breakdowns in LLMs. We find that language functions can be successfully isolated to discrete structural circuits and continuous representational vectors, yet these functions remain densely entangled with significant circuit overlap and vector similarities across distinct aphasic profiles. Furthermore, while steering generalizes robustly across downstream tasks, structural lesioning remains asymmetrically constrained. By bridging neuropsychology and mechanistic interpretability, we demonstrate that LLMs, functionally analogous to biological brains, rely on a densely entangled architecture that can be systematically mapped through clinically-informed interventions.
109. 【2610.28957】Scan or Index? large Evidence Coverage, Answer Quality, and Cost in Long-Document RAG
链接:https://arxiv.org/abs/2610.28957
作者:Juan Terven,Diana-Margarita Córdova-Esparza,Julio-Alejandro Romero-González,Edgar Chavez-Urbiola,Juan Irving Vasquez,Julian Andres Ramirez-Bautista,Silvia L. Chaparro-Cárdenas,Gendry Alfonso-Francia
类目:Computation and Language (cs.CL)
关键词:Cloudflare Clef, long document, Jev, evidence, hybrid
备注: 15 pages, 4 figures, 13 tables
点击查看摘要
Abstract:Scanning every passage in a long document seems thorough, but does it preserve more useful evidence or produce better answers? We compare 11 retrieval configurations spanning lexical and dense search, hybrid reranking, and full-document scanning with Jev, OpenAI Decisions, and Cloudflare Clef. Our evaluation uses 396 QASPER questions and 80 questions from eight complete textbooks, with common passages, a five-passage limit, and a fixed answer generator. On books, Hybrid + Jev achieves the highest observed evidence coverage (94.1%), compared with 88.7% for Jev full scan and 81.3\% for OpenAI dense retrieval. Full scans examine every passage initially, yet later reduction steps can discard relevant evidence. Higher evidence coverage also does not consistently produce better answers: Hybrid + Decisions achieves the highest observed book Answer Accuracy among retrieval methods (0.892), despite recovering less reference evidence. Full scanning incurs substantially higher latency on books under the tested deployments, while reusable dense retrieval has lower projected API cost than paid decision-based methods as queries accumulate. Most QASPER articles already fit within the hybrid candidate pool, limiting the benefit of scanning. These results highlight evidence retention, answer quality, and reuse cost as complementary criteria for choosing a long-document retrieval strategy.
110. 【2610.28944】Guilt by Association: Semantic Leakage Drives Associative Gender Bias
链接:https://arxiv.org/abs/2610.28944
作者:Hazel Chen,Peter West,Hila Gonen
类目:Computation and Language (cs.CL)
关键词:school bus driver, Semantic leakage occurs, prompt steers model, bus driver, concept
备注:
点击查看摘要
Abstract:Semantic leakage occurs when a concept in the prompt steers model generation about an entity, even though the concept is irrelevant to it (e.g., a person who likes yellow is said to work as a school bus driver). It has mostly been studied in settings where the concept is directly attributed to the entity the model is asked about. This leaves open whether leakage is a flawed heuristic, where the model builds a profile of that entity, or a much broader associative tendency, e.g., working across seemingly unrelated entities. We argue for the latter: even after removing the attribution of the concept to the specific entity, leakage persists. Next, we extend this idea to gender bias. While work on gender bias in LMs typically looks at cases where the stereotyped concept is attributed to an entity, our findings suggest that a concept may steer outputs with its mere presence in the scene. We show this using gendered concepts under two conditions: when the subject engages with the concept, and when the concept just sits in the scene. We find that both shift model generation toward the stereotype to a similar extent. Together, our results suggest that semantic leakage drives a form of bias that is overlooked by current evaluations.
111. 【2610.28897】Is Refusal Direction Universal across Low-Resourced Languages?
链接:https://arxiv.org/abs/2610.28897
作者:Anastasiia Ivanova
类目:Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词:resource level, cross-lingually with near-perfect, near-perfect effectiveness, Refusal directions, refusal directions behave
备注: BlackboxNLP@EMNLP 2026: Reproducibility Track
点击查看摘要
Abstract:Refusal directions have been shown to transfer cross-lingually with near-perfect effectiveness across safety-aligned languages (Wang et al., 2025), reportedly regardless of resource level. However, the only truly low-resourced language evaluated is Yoruba, which is strongly misaligned and shows limited transfer, leaving open how refusal directions behave for other low-resourced languages. We extend PolyRefuse to three additional low-resourced languages (Belarusian, Bashkir, and Tajik) and replicate the pipeline of (Wang et al., 2025) on Qwen2.5-14B-Instruct. We find that universality is graded rather than binary: directions from safety-aligned and partially-aligned languages transfer broadly, while those from strongly misaligned languages fail to reliably modulate refusal behavior on any target tested, including other misaligned languages, once ceiling effects are accounted for. Geometric alignment and behavioral transfer are further shown to be partially dissociated. These findings complicate the universality claim and suggest that users of the least-resourced, most strongly misaligned languages may face weaker safety guarantees.
112. 【2610.28895】CSD: Common-Support Distillation for Cross-Tokenizer Knowledge Transfer
链接:https://arxiv.org/abs/2610.28895
作者:Mingyu Yang,Sharath Turuvekere Sreenivas,Adithyakrishna Venkatesh Hanasoge,Nima Tajbakhsh,Ashwath Aithal,Pavlo Molchanov
类目:Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词:enables knowledge transfer, logits distillation enables, distillation enables knowledge, model families, Cross-tokenizer logits distillation
备注:
点击查看摘要
Abstract:Cross-tokenizer logits distillation enables knowledge transfer across model families, allowing students to learn from stronger or more specialized teachers. However, differences in vocabulary and segmentation make teacher and student next-token distributions difficult to align. Existing logits-based methods are easy to integrate into standard distillation pipelines, but often rely on restrictive heuristics or tokenizer-pair-specific choices. They may restrict supervision to shared vocabulary subsets, require manually selecting different objectives for different tokenizer pairs, or match only the observed chunk and its complement rather than individual alternative continuations. We introduce Common-Support Distillation (CSD), a unified logits-based framework that constructs a shared support between the teacher and student at each aligned input chunk and matches the induced distributions with a single objective. For one-to-one alignments, CSD uses explicit common-token pairs as the shared support. For other alignments, it constructs a virtual support whose probabilities are computed using the autoregressive chain rule. A residual event captures probability mass outside the explicit support, ensuring that both induced distributions remain normalized. Across four teacher-student settings comprising Llama-3.2-1B and Gemma3-1B-PT students with Qwen and Phi teachers, CSD consistently achieves the highest average performance among the evaluated cross-tokenizer methods, outperforming the strongest alternative by up to 1.8 points and surpassing both continued pretraining and same-tokenizer distillation. For Llama-3.1-8B, CSD improves average accuracy over the strongest evaluated baseline by up to 4.2 points for the base student and 1.6 points for the instruction-tuned student.
113. 【2610.28887】Building AI Research Teams for Autonomous Discovery of Linear Attention Architectures
链接:https://arxiv.org/abs/2610.28887
作者:Yujian Liu,Li An,Zelin He,Jacob Helwig,Jiabao Ji,Rohit Jain,Siyu Zhu,Shiyu Chang
类目:Computation and Language (cs.CL)
关键词:modify code, increasingly propose ideas, opportunity to accelerate, accelerate scientific discovery, increasingly propose
备注:
点击查看摘要
Abstract:Autonomous agents can increasingly propose ideas, modify code, and run experiments, creating an opportunity to accelerate scientific discovery using teams of collaborative AI researchers. To escape local minima in the discovery, we propose to encourage orthogonal exploration by constructing the team using agents with varying expertise. However, realizing this design requires more than diverse backgrounds. When experiments are costly, a team can test only a limited number of ideas, thereby creating the need to balance exploration and exploitation when selecting a subset of researchers to propose and execute new experiments. Furthermore, each result should shape what the team tries next. We therefore ask how AI researchers with different scientific backgrounds can build on one another's findings and sustain progress under a limited experimental budget. To address these challenges, we build a team of persistent AI researchers, each grounded in a different discipline, who keep private research histories, share experimental evidence, and receive research opportunities through adaptive allocation. We demonstrate the effectiveness of this design by deploying the team to search for linear attention architectures, where it outperforms GDN2 at 1.3B scale on language modeling, common-sense reasoning, and synthetic and real-world retrieval tasks. In controlled comparisons, removing any single organizational component from our design yields markedly weaker discoveries: without disciplinary backgrounds, the search plateaus early; without private histories, researchers make less progress despite identical shared evidence; and uniform selection falls short of adaptive allocation within the same budget. These results suggest that sustained autonomous discovery depends not only on stronger agents, but also on who explores, what they remember, and how research effort is allocated.
114. 【2610.28886】SANE: Automated Scorer-Specific Metamorphic Testing for LLM Judges
链接:https://arxiv.org/abs/2610.28886
作者:Ethan Ludwick,Yu-Chung Hsiao
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Software Engineering (cs.SE)
关键词:LLM judges increasingly, mediate benchmark evaluation, increasingly mediate benchmark, judges increasingly mediate, data curation
备注: 15 pages, 9 figures. A shorter version was accepted for presentation at the non-archival NeurIPS 2026 TAE workshop
点击查看摘要
Abstract:LLM judges increasingly mediate benchmark evaluation, model selection, data curation, and training. Their decisions are useful only when each judge responds reliably to changes affecting its scoring criterion. Existing methods for reliability testing perturb inputs with known expected effects on judge scores. Prominent LLM-judge testing harnesses combine human-authored perturbation recipes with synthetic test generation, leaving scorer-specific recipe ideation outside the automated pipeline. This limits their use to fixed perturbations and pre-assumed scorer types. We introduce SANE, an agent-based framework that encodes behavioral requirements for stochastic evaluators as reusable agent instructions. Given a scorer specification, implementation, and representative inputs, the pipeline first identifies scorer-specific capabilities, then automatically derives perturbation recipes and expected score relations for each. SANE also defines a scorer-independent validation framework for generated judge tests. It determines whether each recipe agrees with scorer intent and whether each instantiated case realizes the recipe and supports its expected relation. Because SANE generates a recipe inventory tailored to each scorer, the number of aligned recipes grows as scorers are added. Across five domains, SANE produces 3.7 times as many validated test families as the Judge Reliability Harness (JRH) at comparable end-to-end validity and detects scorer deficiencies in every domain, including professionalism and toxicity, where JRH detects none. On faithfulness, SANE achieves strong human alignment in judge ranking: its test-suite scores rank 11 judge models consistently with human-labeled FaithBench performance (Spearman rho = 0.852), while JRH does not (rho = 0.100).
115. 【2610.28875】o Manipulate or Not: Opinion Dynamics in LLM Interactions
链接:https://arxiv.org/abs/2610.28875
作者:Mohammad Siahkamari,Phuoc Dat Nguyen,Stephen MacNeil
类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA); Social and Information Networks (cs.SI)
关键词:Large language models, Large language, persuasion research measures, language models increasingly, party views
备注:
点击查看摘要
Abstract:Large language models increasingly take part in extended conversations where they can both shape and be shaped by another party's views, yet most persuasion research measures only one side of that exchange. We introduce a controlled LLM-LLM debate framework in which two language-model roles repeatedly discuss a contested topic (climate-change attribution): one is given an assigned stance and, in some conditions, an explicit instruction to persuade, while the other receives no assigned position. Across four ordered model combinations involving GPT-6 Luna and Gemini 2.5 Flash Lite, we track both each role's explicitly reported position and a separate measure of its turn-by-turn behavior inside the conversation. Opinion dynamics differ substantially across model combinations: same-model interactions narrow the opinion gap on average, clearly for only one of the two models, while cross-model interactions widen it. Explicit reports and in-dialogue behavior capture distinct aspects of opinion dynamics, and a blanket instruction to persuade does not reliably increase influence. These findings suggest that conversational influence depends not only on assigned roles and initial positions but also on the participating models, with implications for how opinion change is measured in extended LLM interactions.
116. 【2610.28843】Beyond Correct Answers: How Compositional Cues Shape Visual Judgments
链接:https://arxiv.org/abs/2610.28843
作者:Xiaoyu Ma,Zheyuan Zhang,Kaiwen Shi,Yanfang Ye
类目:Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词:answering requires models, question answering requires, correct objects, answering requires, assign attributes
备注: 29 pages, 6 figures
点击查看摘要
Abstract:Visual question answering requires models to assign attributes and relations to the correct objects, a problem known as visual binding. Structured prompts make these assignments explicit through labeled fields. Yet an improvement from the full prompt does not reveal which labels help or how they interact. First, we isolate field-label effects across ten models and six tasks by holding the image and claim fixed. These comparisons reveal differences that overall accuracy can hide. With a relation label present, adding object-role labels helps Qwen3 but hurts Qwen2 on Spatial. Second, we compare auxiliary hints that preserve or swap the question's role assignments against a no-hint baseline. Across two image sets, Qwen3's advantage with preserving hints mainly reflects errors caused by swapped hints. Preserving hints remain near baseline. Field order further affects the harm. Third, we test clearer hint wording and direct selection of the relation shown in the image. Clearer hints improve text matching but do not consistently improve visual judgments. In contrast, relation selection partly reduces errors for some hints in Qwen3 and GPT-4.1-mini.
117. 【2610.28840】KIRA: A Full-Stack Reading Screening System with Dual-Pathway Analysis for Children
链接:https://arxiv.org/abs/2610.28840
作者:Maggie Dong,Rohit Mekkoth,Zixuan Wang,Cheol Jun Cho,Jiachen Lian,Gopala Anumanchipalli
类目:Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词:Early-grade reading screening, Early-grade reading, critical for identifying, Early-grade, reading difficulty
备注: Accepted to IEEE Spoken Language Technology 2026
点击查看摘要
Abstract:Early-grade reading screening is critical for identifying children at risk of reading difficulty. Existing AI-based screeners are often limited in the scope of their analyses and evaluation metrics, or are proprietary systems that lack transparent model specifications and evaluation. We present KIRA, a dual-pathway screening system that pairs word-level fluency scoring with detailed phoneme-level error detection. We adapt pretrained word and phoneme recognizers to children's speech, reducing word error rate from 13.88% to 8.84% and phoneme error rate from 41.66% to 23.00%. Powered by these child-adapted models, we implement Word Reading (WRE) and Oral Reading Fluency (ORF), two foundational tasks in K-2 screening. The system integrates these recognizers with a web-based teacher-facing interface presenting fluency scores alongside phoneme feedback for potential targeted intervention. KIRA brings modern child-speech recognition into a full-stack, deployable, classroom-ready reading screener.
118. 【2610.28838】How to Use Parallel Data for Multilingual Pretraining
链接:https://arxiv.org/abs/2610.28838
作者:Zhihong Huang,Yao Lu,Derek F. Wong,Hamid Alinejad-Rokny,Min Yang
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词:High-quality human-translated parallel, High-quality human-translated, High-quality, typically too small, small for large-scale
备注: 18 pages, 7 figures, 14 tables
点击查看摘要
Abstract:High-quality human-translated parallel corpora can improve cross-lingual transfer, but are typically too small for large-scale pretraining. Machine-translated web corpora help overcome this limitation, making parallel data available at pretraining scale. Standard multilingual pretraining, however, samples source documents and their translations independently, without explicitly using their parallel structure. We investigate how to use the parallel structure of the data to improve multilingual pretraining by concatenating each document with its translation in the same training sequence. We compare this parallel pretraining (PPT) approach with standard pretraining (SPT), training models from scratch at matched token budgets. Surprisingly, despite the benefits of parallel data reported in prior cross-lingual work, PPT alone does not consistently improve language understanding over SPT. Our further analysis suggests that although PPT builds a strong cross-lingual foundation, as shown by its better use of shared information across languages, the mismatch between parallel training contexts and single-language task inputs limits its gains in general language understanding. This finding motivates a two-stage approach following the pretraining-fine-tuning paradigm: we first use PPT to build a cross-lingual foundation, then continue with SPT to adapt it to standard language modeling. In both high-resource and low-resource settings, the two-stage approach consistently improves general language understanding and cross-lingual task performance over standard pretraining alone at matched training budgets.
119. 【2610.28834】Where Should a Stuck Agent Spend Its Next Tokens? Causal Attribution of Inference-Time Resources
链接:https://arxiv.org/abs/2610.28834
作者:Saiyue Lyu,Jerrold Huang,Yunbei Zhang,Janet Wang,Zhenting Wang,Yingqiang Ge,Haibo Zhang
类目:oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词:Inference-time scaling, Banzhaf Resource Attribution, token-budget problem, seek qualitatively, failed coding agent
备注:
点击查看摘要
Abstract:Inference-time scaling is often treated as a token-budget problem, but a failed coding agent can seek qualitatively different resources: computation, information, or feedback. We introduce Banzhaf Resource Attribution (BRA), a controlled factorial framework that measures each resource's marginal contribution to repair and its interactions while holding the failed state and revision protocol fixed. We evaluate six models on 194 function-level failures from MBPP+ and HumanEval+ and 126 repository-level failures from SWE-bench Verified. Task-relevant specifications consistently improve repair, whereas public-test feedback provides small gains and retrieved code little to none. The value of additional computation declines with model capability, while information remains useful; resource channels largely exhibit diminishing returns, although complementary information can reinforce itself. Yet three of four frontier models select feedback in 95-100% of cases and obtain lower gains than uniform random resource selection. BRA thus exposes a gap between the resources agents prefer and those that measurably improve repair.
120. 【2610.28823】A Parallel Multi-Dialect Arabic Dependency Treebank
链接:https://arxiv.org/abs/2610.28823
作者:Noor Abo Mokh,Mohamed Adel,Jamila El-Gizuli,Go Inoue,Ahmed Elshabrawy,Nizar Habash
类目:Computation and Language (cs.CL)
关键词:Modern Standard Arabic, leaving dialectal Arabic, Arabic comparatively under-resourced, dialectal Arabic comparatively, Modern Standard
备注:
点击查看摘要
Abstract:Dependency parsing resource development for Arabic has largely focused on Modern Standard Arabic, leaving dialectal Arabic comparatively under-resourced. We introduce MADARTB, the first large-scale parallel dependency treebank spanning five city dialects: Beirut, Cairo, Doha, Rabat and Tunis, and extending an existing parallel MSA version. In total MADARTB consists of 5,000 sentences annotated using the CATiB dependency scheme. We analyze syntactic similarity across all city dialects and MSA. Although global construction profiles exhibit high similarity across varieties, local syntactic structures frequently diverge, revealing substantial structural variation across dialects. We further establish a cross-dialect dependency parsing comparison using a supervised parser and four LLMs. The supervised parser achieves 87.5% LAS, while the best LLM setup trails at 85.7% LAS across all six varieties on the test set. We release our annotations and models publicly.
121. 【2610.28819】LIFT: Scoped Constraints for Evaluating and Training Instruction Following
链接:https://arxiv.org/abs/2610.28819
作者:Eran Goldstein,Yuval Belfer,Yonatan Belinkov,Daniel Gissin
类目:Computation and Language (cs.CL)
关键词:follow simple constraints, evaluate the ability, verified programmatically, ability of language, follow simple
备注:
点击查看摘要
Abstract:Common instruction following (IF) benchmarks, such as IFEval, evaluate the ability of language models (LMs) to follow simple constraints that can easily be verified programmatically. These same constraints, in turn, are used as reward signals for reinforcement learning. This design may lead to reward hacking of constraints, pushing models away from the main task. Recent attempts to address this resulted in benchmarks with richer constraints, but required expert labor, remained closed-access, and cannot be easily extended. We present Lift-Bench, an IF benchmark that asks a model to draft a document given a topic and a structured outline. Constraints are scoped to certain document sections, providing finer control over constraint density. Lift-Bench includes both verifiable and judged constraints, as well as a training counterpart, Lift-Train. Importantly, Lift-Bench provides both main task and instruction-following constraints, mitigating shallow reward hacking. On experiments with multiple models, we find that frontier models struggle with the harder subsets of our benchmark and analyze model performance along multiple axes. We also find that training on Lift-Train is much less susceptible to reward hacking than training on the common IFTrain. Lift-Bench and Lift-Train are publicly available, as well as the data generating pipeline.
122. 【2610.28810】Combining Long-Term Memory and LLMs Comes at a High Cost: From Prompt Injection to Persistent Compromise
链接:https://arxiv.org/abs/2610.28810
作者:Pedro H. Barcha Correia,Matheus Azevedo de Sá,Paulo H. Gomes de Senna,Giovanni Mandel Martignago,Victor Takashi Hayashi,Charles Christian Miers,Marcos A. Simplicio Jr
类目:Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词:generative artificial intelligence, widespread adoption, adoption of generative, generative artificial, artificial intelligence
备注:
点击查看摘要
Abstract:The widespread adoption of generative artificial intelligence in recent years has brought a parallel rise in prompt injection and jailbreak attacks. By embedding malicious instructions, these exploits manipulate language models to bypass intended behavior and operational boundaries. In traditional chatbots, such attacks are confined to a single session because state memory is not preserved across conversations. However, persistent memory features in modern conversational interfaces enable cross-session attack propagation, establishing a threat vector known as memory injection. This work explores this emerging vulnerability in leading LLM-as-a-service platforms, highlighting its real-world severity and the need for countermeasures. While existing literature focuses on violations tailored to specific platform features, we present a general threat model. We demonstrate that all NIST attack goals are collectively achievable across ChatGPT Instant 5.3, Claude Sonnet 4.6, and Gemini 3 Flash under this model. We also show that memory injections can exploit multiple attack vectors, including personal memories, projects, skills, organization instructions, and Model Context Protocol (MCP)-connected resources. Our findings reveal that all evaluated services can be manipulated to persistently spread disinformation, generate harmful content, or simulate offline unresponsiveness, even in fresh sessions. In the particular case of Claude, shared-memory features allow an attacker to compromise multiple users within an organization and also exfiltrate user prompts. To address these vulnerabilities, we derive defense mechanisms from our proposed threat model and foundational cybersecurity principles. Our analysis indicates that nearly half of these mitigations remain unimplemented across the target services. Datasets and attack artifacts are available at this https URL.
123. 【2610.28799】Where Do Legal Factors Live in LLMs?
链接:https://arxiv.org/abs/2610.28799
作者:Li Zhang,Kevin Ashley
类目:Computation and Language (cs.CL)
关键词:professionals identify legally, identify legally significant, legally significant fact, significant fact patterns, legal professionals identify
备注: 12 pages, 3 figures, 2 tables. Accepted at JURIX 2026, the 39th International Conference on Legal Knowledge and Information Systems
点击查看摘要
Abstract:In case-based legal reasoning, legal professionals identify legally significant fact patterns in a new dispute and compare them with those of decided cases. In AI Law, HYPO dimensions and CATO factors represent these patterns symbolically, organizing expert knowledge distilled from case narratives as explicit, structured, interpretable, and auditable legal concepts and relations that support case comparison, legal argument, and precedent-based reasoning. Large language models (LLMs) are increasingly used for legal tasks, yet their internal organization of legal knowledge remains difficult to trace. We investigate whether LLMs form internal representations corresponding to all 26 CATO factors. Two research questions examine linear decodability and sparse localization with sparse autoencoders. Experiments cover three open models, Qwen3-1.7B, Qwen3-8B, and Gemma-2 2B, supported by cross-model comparison and human audit of controlled natural-language passages. Results show that all 26 factors are linearly decodable in all three models. Single-feature sparse readouts cover the complete factor catalog, with best-layer test AUCs ranging from 0.86 to 1.00. Five selected features approach full-vector readout performance. We report 78 model-specific layer-feature coordinates, one for each factor in each model. Together, these results show that information corresponding to expert-defined legal factors can be read from the internal activations of LLMs processing legal narratives. By locating these readouts, our study connects legal language and the symbolic abstractions of HYPO and CATO to learned internal representations.
124. 【2610.28797】CALLIOPE: Private Insights into AI Use, Without Embeddings
链接:https://arxiv.org/abs/2610.28797
作者:Edith Cohen,Vadym Doroshenko,Badih Ghazi,Charlie Harrison,Pritish Kamath,Alexander Knop,Ravi Kumar,Ethan Leeman,Pasin Manurangsi,Mikhail Pravilov,Adam Sealfon,Yurii Sushko,Marika Swanberg,Chiyuan Zhang
类目:Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR)
关键词:discovering topic hierarchies, supporting differential privacy, LLM conversations, unstructured data, framework leverages LLM
备注:
点击查看摘要
Abstract:We introduce CALLIOPE, a top-down framework for discovering topic hierarchies in large corpora of unstructured data (e.g., LLM conversations), while supporting differential privacy (DP). Unlike traditional and even recent LLM-augmented approaches that ultimately rely on clustering vector embeddings, our framework leverages LLM capabilities directly for the entire pipeline. Experiments demonstrate that this approach provides better utility over existing (embedding-based) methods in the DP setting, especially in the high privacy regime. We evaluate the quality of CALLIOPE outputs using a variety of traditionally studied clustering metrics, as well as some novel utility metrics that we introduce.
125. 【2610.28787】Is Anyone Enforcing the Cartel? What Reinforcement Learning Teaches LLM Agents in Markets
链接:https://arxiv.org/abs/2610.28787
作者:Hieu Tran,Hong Yu
类目:Computation and Language (cs.CL); Computer Science and Game Theory (cs.GT); Machine Learning (cs.LG)
关键词:large language model, language model, others' expense, collude at others', pricing agents collude
备注: 45 pages, 13 figures, 20 tables
点击查看摘要
Abstract:Evaluations of large language model (LLM) agents report that pricing agents collude at others' expense. Yet collusion is defined by enforcement: a cartel, in which competitors share monopoly profits, holds only if a member who cheats is punished. We introduce an audit that tests enforcement by forcing a member to cheat in counterfactual copies of a market, and use it to study what reinforcement learning (RL) teaches agents in pricing and trading. Small LLMs trained by RL learn what their training rivals reward, but only what they readily try. In self-play, they learn fixed rules ignoring their rivals; against a punishing rival, to be deterred; against a cheating rival, to match its cuts, never the costly price war that would deter it, which they rarely try. A war forced into training is learned, but mostly only where it was forced. Against their own copies, deterred and matching agents can earn the same cartel profits, but only matching ones can enforce them, and then thinly: as a by-product and only against large cuts. Q-learners enforce collusion only in pricing. Prompted LLMs reach cartel-like outcomes mostly through rules that ignore the market. Outcome measures cannot tell these cases apart; the audit can.
126. 【2610.28785】Measure First, Then Allocate: Calibrated Rollout Budgets for MCP Agents in Reinforcement Learning
链接:https://arxiv.org/abs/2610.28785
作者:Hieu Tran,Zonghai Yao,Sunjae Kwon,Hong Yu
类目:Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词:requires costly interaction, group-relative learning signal, Model Context Protocol, tool-using language models, language models requires
备注: 21 pages, 7 figures, 6 tables
点击查看摘要
Abstract:Training tool-using language models requires costly interaction, yet identical rewards within a rollout group provide no group-relative learning signal. We use reward disagreement to guide harness evaluation and the allocation of rollouts for policy training in Model Context Protocol (MCP) environments. We first introduce Discord, which tests harness edits using exact paired inference and decision-preserving early stopping: only disagreeing paired outcomes favor one harness over another. This insight motivates prospective allocation in BRACE (Bank-calibrated Rollout Allocation under Correlated Episodes). BRACE combines historical task evidence, uncertainty in task success rates, and a correlated reward model to forecast mixed-reward groups before allocating generation budget. Controlled harness experiments favor Discord, while live MCP experiments expose a retention-cost trade-off. At three Qwen3-VL model scales, BRACE exceeds the strongest plotted baseline peaks with fewer new training rollouts; historical-bank collection is counted separately. It also leads the compared methods on BFCL and NESTFUL without further training. Ablations probe the bank, estimator, and allocation score; prospective evaluation checks forecast calibration. These results support forecasting reward contrast before generation.
127. 【2610.28772】Scaling Therapy Supervision: Assessing Psychotherapy Fidelity Using Large Language Models
链接:https://arxiv.org/abs/2610.28772
作者:Arvind Pillai,Alexis Roach,Jason Holden,Varsha D Badal,Subigya Nepal,Yu Yvonne Wu,Yuliang Chen,Sudarshan Regmi,Sarah Masud Preum,Nicholas C Jacobson,Nikhil Singh,Eric Granholm,Colin Depp,Andrew Campbell
类目:Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
关键词:positive patient outcomes, fidelity assessment measures, treatment protocol, patient outcomes, Psychotherapy fidelity assessment
备注: 24 pages, under review
点击查看摘要
Abstract:Psychotherapy fidelity assessment measures how faithfully a therapist adheres to a treatment protocol, a critical determinant of positive patient outcomes. However, fidelity assessment is bottlenecked by manual expert review, rendering the process labor-intensive and unscalable. To scale therapy supervision and support clinician self-learning, we present an integrated application of large language models (LLMs) that automates psychotherapy fidelity workflows and generates actionable supervisory feedback from authentic, long-form clinical transcripts. We evaluate three open-weight models across multiple task decomposition configurations and reasoning strategies, demonstrating that evidence-first reasoning improves fidelity estimation. Furthermore, we establish the framework's external construct validity on an independent randomized controlled trial (RCT), where it reliably distinguishes Cognitive Behavioral Therapy (CBT) from non-CBT sessions across core therapeutic skills. Through a user study that evaluates the generated feedback, mental health experts indicate that the pipeline synthesizes actionable clinical feedback. Ultimately, our work offers a practical, scalable solution toward bridging the community mental health supervision gap.
128. 【2610.28767】SkillEval: Learning Interpretable Ability Profiles of LLMs via Cognitive Diagnosis Models
链接:https://arxiv.org/abs/2610.28767
作者:Berke Arda,Peng Cui,Qiaoyuan Zheng,Rudolf Debelak,Mubashara Akhtar,Mrinmaya Sachan
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词:single scalar score, benchmarks typically aggregates, typically aggregates performance, Current evaluation, scalar score
备注: 24 pages, 9 figures, 11 tables. Code: [this https URL](https://github.com/berkearda/skilleval)
点击查看摘要
Abstract:Current evaluation of LLMs on benchmarks typically aggregates performance over individual examples into a single scalar score. This approach is overly coarse and ignores the diverse scope of skills covered by benchmark datasets. To address this limitation and better exploit benchmark data, we propose SkillEval, a new evaluation framework that performs cross-model, skill-level analysis. The framework integrates advances from two areas: (1) it leverages the meta-cognitive capabilities of LLMs to automatically discover interpretable skills from questions, and (2) it applies cognitive diagnosis models (CDMs) from psychometrics to estimate per-skill abilities of LLMs. We conduct experiments on 3,811 LLMs evaluated on 9,523 items across five benchmarks spanning diverse domains (MATH, BBH, GPQA, MuSR, IFEval). Compared to the traditional average-based evaluation paradigm, SkillEval produces reliable, more calibrated and informative yet concise model profiles that more accurately predict model behavior on unseen items. We also demonstrate the utility of SkillEval in two downstream tasks: (1) LLM routing, which dynamically assigns each query to a capable but efficient model, reducing inference cost by over 60% while achieving improved performance, and (2) Computerized Adaptive Testing (CAT), where an unseen model can be efficiently evaluated using a trained CDM. Furthermore, we show that these skill profiles provide useful insights, for example, how benchmarks share skills and how instruction-tuned models differ from their base models.
129. 【2610.28763】Automating ML for Science: Can Frontier Agents Climb Scientific Hills in the Wild?
链接:https://arxiv.org/abs/2610.28763
作者:Ming Zhong,Stacy Li,Nicholas Carlini,Matthew Jagielski
类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词:automated researchers, Frontier coding agents, requires domain insight, increasingly framed, science offers
备注: NeurIPS 2026 ED Track
点击查看摘要
Abstract:Frontier coding agents are increasingly framed as end-to-end automated researchers, and ML for science offers a demanding test of that promise: improving a scientific model often requires domain insight beyond routine ML engineering. We introduce Agent4Sci, a long-horizon testbed for measuring how far today's agents can improve the published best models on scientific ML benchmarks, spanning 20 benchmarks across 11 domains. Rather than ranking agents on a leaderboard, Agent4Sci asks what kinds of progress agents can make on these tasks under in-the-wild conditions, and where they fall short. Empirically, today's frontier agents advance the published best on every benchmark, with Claude Opus reaching 10.4% mean relative improvement and no run flagged for academic misconduct. These gains, however, come almost entirely from a bag of ML-engineering tricks rather than research-level insight. Trajectory analysis surfaces three recurring limitations in this setting: novelty miscalibration, resource under-utilization, and rapid collapse into local engineering sweeps. Lightweight plug-in skills for research ideation, experiment management, and scheduled checklists raise Claude Opus from 10.4% to 20.1% and Codex from 4.4% to 8.1%, while yielding more diverse, domain-relevant interventions. Agent4Sci gives the community a way to track and push frontier agents from ML engineering toward domain insight on real-world ML-for-science problems. Code and data are available on GitHub (this https URL) and Hugging Face (this https URL).
130. 【2610.28711】Qwen-Audio-3.1-ASR Technical Report
链接:https://arxiv.org/abs/2610.28711
作者:Chuanmeng Bian,Daren Chen,Peixin Chen,Zhigao Chen,Chong Deng,Zhiyun Fan,Zhifu Gao,Bo Gong,Qing Gu,Jiajun He,Yawei Hu,Yunjie Ji,Wei Ju,Jingbei Li,Xiangang Li,Xu Li,Zengxi Li,Zheng Li,Chengdong Liang,Baiji Liu,Yaming Liu,Ying Liu,Bin Ma,Yiping Peng,Yuezhang Peng,Zhendong Peng,Yu Pu,Yang Shi,Xin Shu,Jian Tang,Biao Tian,Peiyao Wang,Tianzi Wang,Wen Wang,Wupeng Wang,Cheng Wen,Yuzhong Wu,Zijian Xia,Yunchong Xiao,Nan Yang,Jianwei Yu,Jixing Yu,Binbin Zhang,Lei Zhang,Sitong Zhao,Guangdong Zhou,Yuan Zhou,Jianheng Zhuo
类目:ound (cs.SD); Computation and Language (cs.CL)
关键词:general audio understanding, general audio, audio understanding, audio-language models, models that builds
备注: 31 pages. Authors are listed in alphabetical order of last name. Project page: [this https URL](https://qwenaudio.github.io/qwen-audio-3.1-asr/)
点击查看摘要
Abstract:We present Qwen-Audio-3.1-ASR, a family of audio-language models that builds upon its predecesor Qwen-Audio-3.0-ASR with improved speech recognition and expanded capabilities in speaker-diarized transcription and general audio understanding. The family retains support for 30 languages and 16 Chinese dialects, together with instruction-controlled capabilities including historical-context conditioning, hierarchical hotword customization, and native transcription polishing. Speaker-diarized ASR produces structured outputs containing speaker labels, timestamps, and recognized text, maintaining consistent speaker labels across turns and the representation of overlapping speech. The general audio understanding capabilities cover audio-, speech-, and music-captioning, temporal grounding and sound event detection, as well as audio question answering and multiple-choice reasoning. These tasks broaden the application scope from recognizing spoken words to interpreting speakers, acoustic events, and their temporal relations. To accommodate different deployment requirements, the family includes variants for asynchronous file transcription, low-latency streaming, interactive voice input, and non-streaming recognition, with speaker-diarized transcription and general audio understanding available in certain variants. Evaluations span conventional ASR, multilingual and dialectal speech, speaker-diarized transcription, and general audio understanding, demonstrating the capabilities of the Qwen-Audio-3.1-ASR family across transcription and broader audio analysis tasks.
131. 【2610.28710】ranslation and data ethics
链接:https://arxiv.org/abs/2610.28710
作者:Joss Moorkens,Monja Jannet
类目:Computation and Language (cs.CL)
关键词:chapter introduces data, introduces data ethics, chapter introduces, discusses a number, number of ethical
备注: Joss Moorkens and Monja Jannet. Translation and data ethics. To appear in: S. Castilho, D. Kenny, J. Moorkens M. I. Rivas Ginel (eds.). Developing AI literacy for translation Berlin: Language Science Press
点击查看摘要
Abstract:This chapter introduces data ethics for translation and discusses a number of ethical issues regarding data. These include issues of copyright, ownership and bias, which apply to all types of data, whereas there are further issues particular to minoritised language communities and those on either side of the digital divide, as data is implicated in power imbalances and dynamics. We close with a discussion of responsibility and regulation, and reflect on the growing attention on data ethics from translation studies researchers.
132. 【2610.28673】How Far Can the Gemma 4 Speech Encoder Go Without Changing Its Weights? Saudi and Gulf Arabic Speech Recognition with a Frozen and an Adapter-Augmented Encoder
链接:https://arxiv.org/abs/2610.28673
作者:Amr Abdelkhalik
类目:Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
关键词:Gulf Arabic speech, Arabic speech recognition, shared by Gemma, Gulf Arabic, Cohere Transcribe Arabic
备注: 24 pages, 15 tables, 5 figures. Code and public-set results: [this https URL](https://github.com/AmrKhalil9/frozen-embeddinggemma2-arabic-asr)
点击查看摘要
Abstract:We study the 305M-parameter audio encoder shared by Gemma 4 and EmbeddingGemma 2 (identical except for its final projection) for Saudi and Gulf Arabic speech recognition, without changing any of its weights. A frozen system trains only a 22.6M-parameter CTC reader over a mix of encoder layers; an adapted system adds 3.1M low-rank adapter parameters, a 41.5M-parameter hybrid CTC/attention reader and joint decoding with a sub-word language model. Against Cohere Transcribe Arabic (2.07B parameters), re-run on identical audio, the frozen system trails in word error rate (WER) but is statistically indistinguishable in character error rate (CER) on five of six human-labelled conditions, while running 3.4 times faster on CPU with greedy decoding. The adapted system is statistically indistinguishable in WER on a public Saudi customer-service call (19.20% against 19.27%) and on clean Emirati speech, is significantly better on telephone-coded Emirati speech, has a significantly lower CER on all six conditions of these sets, and beats a 0.6B recogniser fine-tuned on SADA in WER on all six; it still trails Cohere in WER on long-form Saudi speech. On a blind, human-corrected public call-centre sample it ranks 4 of 15 systems, behind three commercial APIs (significantly only one) and ahead of the other self-hostable systems by point estimate. An optimised joint decoder runs it at 139 times real time on one GPU. We also show that references made by correcting machine drafts favour the drafting system. Code and public-set results are released.
133. 【2610.28663】Beyond source attribution: Address authorship and comparability decisions in an LLM-built scholarly knowledge graph
链接:https://arxiv.org/abs/2610.28663
作者:Ksenia Kozha(American University of Cyprus),PaRAGraph Research Project
类目:Digital Libraries (cs.DL); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词:offers competing classifications, literature offers competing, offers competing, competing classifications, stable address
备注: Companion to PaRAGraph Casebook: [this https URL](https://paragraph-lab.org)
点击查看摘要
Abstract:A knowledge graph needs a stable address for its evidence even where the literature offers competing classifications and agrees on none. Yet an address chosen for retrieval readily passes for the only classification available. This happens whenever records gathered under one name concern units that differ in boundaries, rank, or the criteria by which they are described or counted. In Sinitic dialectology the same localities recur in schemes whose units differ in membership and rank, and a unit may change its affiliation when the evidence for its diagnosis changes. Two tone counts, each quoted faithfully, may still count different things. The taxonomy of an entire field thus comes to rest on the unstable frame of a literature that contradicts itself. Neither verifying a quotation nor searching for conflicting values detects these differences. I distinguish the working address that gathers candidate evidence, the category that the source defines and the decision that admits a passage to a particular comparison, and argue that such decisions, together with the dependence among records, belong to the provenance of a comparison. On four re-runnable cases, the accompanying PaRAGraph Casebook shows where such differences arise among claims extracted by a language model and verified before entering the graph. The platform now stores the corresponding decisions as objects for one dimension of comparability, the address of a record: the placement of a locality in each source's scheme, the decision that a name in a given publication denotes a unit rather than a place, and the origin of every address. The working taxonomy can then be revised as new sources yield new claims, while the path from each comparison to its evidence stays fixed. Keywords: knowledge graphs; source attribution; classification; claim extraction; comparative concepts; Sinitic dialectology; Yue
134. 【2610.28638】AGR: Task-Adaptive Geo-Semantic Retrieval across Heterogeneous Urban Delivery Tasks
链接:https://arxiv.org/abs/2610.28638
作者:Zhi Liu,Yurun Cai,Xiao Han,Zhi Zhen,Yuran Li,Guojiang Shen,Xiangjie Kong
类目:Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词:residents demand higher-quality, demand higher-quality instant, higher-quality instant delivery, estimated time, higher-quality instant
备注:
点击查看摘要
Abstract:As urban residents demand higher-quality instant delivery services, demand forecasting, estimated time of arrival prediction, and next-stop prediction have become critical tasks in urban delivery systems. However, the three tasks rely on historical evidence with substantially different structures and granularities. Meanwhile, their prediction targets differ in output form, making it difficult to integrate retrieved evidence through a single fusion mechanism without causing mismatch or negative transfer. These issues can increase prediction errors and subsequently lead to imbalanced resource allocation, where some regions experience unmet demand. In contrast, others suffer from underutilization, ultimately degrading overall efficiency and service quality. To address these challenges, we propose TAGR, a Task-Adaptive Geo-Semantic Retrieval framework across heterogeneous urban delivery tasks. TAGR constructs an LLM-based geo-semantic shared prior and task-specific retrieval banks to share regional knowledge while preserving heterogeneous task-specific evidence. The LLM-derived regional representations encode geographic context and semantic relations among regions, providing transferable knowledge for all three tasks without requiring online LLM inference. It further introduces a task-adaptive retrieval augmentation module to accommodate heterogeneous output structures, thereby mitigating information mismatch and negative transfer caused by a uniform retrieval-fusion strategy. Experiments on three city datasets demonstrate that TAGR consistently outperforms state-of-the-art baselines across multiple tasks.
135. 【2610.28636】RESEARCHHUB: A Personalized Literature Discovery System for Biomedical Preprints
链接:https://arxiv.org/abs/2610.28636
作者:Viswonathan Manoranjan,Taeyoon Kim,Nicholas Do,Sang Woo Kim,Dawei Li,Zhen Tan,Tianlong Chen,Yunmei Liu
类目:Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词:personalized literature discovery, Multiple Negatives Ranking, personalized literature, literature discovery, Local Intrinsic Dimensionality
备注: under-review
点击查看摘要
Abstract:We present ResearchHub, an interactive system for personalized literature discovery over biomedical preprints. Given a researcher profile or a free-form query, ResearchHub retrieves relevant papers from a domain-specific MedRxiv corpus and helps users move beyond near-duplicate recommendations through controllable novelty, diversity, and curriculum ordering. At the core of the system is prism, a bi-encoder retriever adapted to biomedical preprints using GPT-4o-generated natural language queries and a hybrid Multiple Negatives Ranking plus MarginMSE objective with cross-encoder soft labels. On 44,937 MedRxiv papers from 2023--2025, prism outperforms strong off-the-shelf dense retrievers, improving Recall@10 over SPECTER2-Search by 12.4 percentage points. ResearchHub further supports frontier retrieval based on a user's reading history, DPP-based diversity re-ranking, Local Intrinsic Dimensionality ordering from mainstream to specialized papers, and lightweight attribution cards for result explanation. The full pipeline runs with low latency, making the system suitable
136. 【2610.26542】Breaking Diffusion: Parallel Reasoning with Draft Refinement
链接:https://arxiv.org/abs/2610.26542
作者:Jaesang Yu,Seoyeon Byun,Yun Wang,Yan Lu,Juho Kim
类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词:reconsider each decision, Drafting an answer, Refinement Language Models, Drafting, Draft Refinement Language
备注:
点击查看摘要
Abstract:Drafting an answer allows a reasoning model to reconsider each decision in the context of the others. Yet repeated diffusion denoising does not ensure that individually plausible token updates form a better answer together. We introduce Draft Refinement Language Models (DRLMs), which use a single denoiser to propose parallel revisions and evaluate a candidate draft. We train the denoiser to reconstruct every token from uniformly corrupted drafts, teaching both preservation and repair. Its predictions specify revisions directly, without a diffusion reverse transition. Evaluation requires a different use of these predictions: confidence in an existing token reflects both contextual support and evidence from observing the token itself. Using the known corruption process, we correct for this self-token evidence to estimate how well each token is supported by the prompt and the remaining draft. Aggregating these estimates yields a cavity energy computed in one forward pass, without an additional scoring model. Each round proposes a revision, reads the completed candidate in its revised context, and retains it only if its energy is lower. Across Countdown, Sudoku-Extreme, and Maze-Hard, our method outperforms autoregressive and discrete diffusion baselines. With 6M parameters, DRLM reaches 44.4% on Countdown-5 and 93.9% on Sudoku-Extreme. The results establish complete-draft parallel refinement as an effective alternative to reverse diffusion for complex reasoning.
137. 【2610.22714】First Passage Attention
链接:https://arxiv.org/abs/2610.22714
作者:Yuxuan Liu
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词:summing decay contributions, Augmenting softmax attention, gates typically relies, Augmenting softmax, typically relies
备注:
点击查看摘要
Abstract:Augmenting softmax attention with forget gates typically relies on summing decay contributions along the key--query path. Because such accumulation is monotonic, these mechanisms cannot selectively erase intermediate context while preserving older, structurally relevant tokens. We propose First Passage Attention (FPA), which shifts from path summation to path extrema by lowering a key's logit proportionally to the deepest dip of a learned scalar field below that key's level over the intervening span. FPA encompasses the Forgetting Transformer (FoX) as a special case, and when the field and levels follow a shared learned walk, the alive keys with unpenalised logits naturally form a stack. We show that a constant-dimension FPA head realises any subset of keys left alive by subsequent dips, whereas softmax heads with positional biases or token-level forget gates require a head dimension linear in the number of keys. In synthetic experiments, one-layer FPA heads converge to these target sets while comparable softmax and FoX baselines fail on every seed. Scaling to a 110M-parameter language model, FPA matches FoX in perplexity and uniquely achieves perfect passkey retrieval at $8\times$ the training length, even with its key--value cache compressed to about $25\%$.
138. 【2610.28747】A Reverse-Gold Theorem: Positive-Data Identification by Substrate-Bounded Contrastive Learners
链接:https://arxiv.org/abs/2610.28747
作者:Rakesh Sengupta
类目:Machine Learning (stat.ML); Computation and Language (cs.CL); Machine Learning (cs.LG); Neurons and Cognition (q-bio.NC)
关键词:Gold theorem shows, Gold theorem, theorem shows, identify an arbitrary, superfinite class
备注:
点击查看摘要
Abstract:Gold's theorem shows that no learner can identify an arbitrary language in a superfinite class from positive presentations alone. We prove a positive result of a different shape. Fix an innate \emph{recursive contrast operator} $R$ mapping any string to a finite set of structurally bounded perturbations of it, and a discriminative scorer of bounded capacity trained by InfoNCE-style contrastive estimation \citep{vandenoord2018,macollins2018} on self-generated perturbations. Under a faithfulness condition relating operator, scorer, and target, the trained scorer achieves \emph{PAC conditional identification} from positive data alone: with high probability it ranks all but an $\varepsilon$-fraction of positives above every out-of-language perturbation in their own orbit, with sample complexity polynomial in the capacity, the orbit size, the score bound, and $1/\varepsilon$. The negatives are constructed by the learner, not supplied by an oracle, and no global normalizing constant over strings is ever computed. The misranking bound follows from the geometry of the contrastive loss---per-example loss floors plus a definite loss increment under misranking---yielding an $\varepsilon^{-2}$ rate, together with an explicit approximation gap that quantifies the cost of in-language (``colliding'') perturbations and vanishes for orbit-pure operators. The ranking guarantee lifts to a global membership classifier under a margin condition, and the same operator composed with the learned scorer is a normalization-free Metropolis--Hastings generator. We instantiate the hypotheses for substitutable context-free languages \citep{clarkeyraud2007} and the subregular classes \citep{heinz2010,hayashikamigaito2025}, and state an open conjecture locating the construction in the mildly context-sensitive hierarchy.
信息检索
1. 【2610.30128】hink Harder Where It Matters: Item-Level Adaptive Recursion for Sequential Recommendation
链接:https://arxiv.org/abs/2610.30128
作者:Zhanshuo Cao,Jiakai Tang,Yuqi Zhou,Sunhao Dai,Jun Xu
类目:Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词:Existing sequential recommenders, user interaction history, final prediction, sequential recommenders, recommenders usually allocate
备注:
点击查看摘要
Abstract:Existing sequential recommenders usually allocate a fixed computational budget to every item in a user's interaction history, regardless of the item's contribution to the final prediction. We challenge this de facto design with two diagnostic findings. (1) Non-uniform computational need: items within the same sequence vary drastically in how much computation they require. Most converge after shallow processing while a critical minority only stabilizes at full depth. (2) Suboptimality of fixed allocation: given oracle access to the target item, a non-uniform depth assignment consistently outranks the fixed one, indicating that existing uniform computation both wastes capacity on already-converged items and sacrifices overall recommendation quality. These observations motivate a shift from fixed-depth computation to item-level adaptive reasoning. To this end, we propose LoopRec. LoopRec recursively applies a single weight-shared block and introduces a lightweight gate at each recursion boundary that makes a binary exit-or-continue decision for every item independently. Items whose representations have sufficiently matured exit early, while those requiring deeper reasoning continue to subsequent recursions. This design converts the fixed global depth into a learned, per-item property without auxiliary depth labels, and is readily adaptable to diverse backbone architectures. Extensive experiments on public benchmarks with four backbone families demonstrate that LoopRec consistently outperforms matched fixed-depth counterparts. Further analysis reveals that LoopRec's learned allocation exhibits interpretable patterns aligned with our post-hoc oracle analysis: lower-frequency items and more recent interactions naturally receive deeper computation. Our code is available at this https URL.
2. 【2610.30026】What the Author Wrote, What the Agent Reads: Silent Cue Loss in Enterprise Document Ingestion
链接:https://arxiv.org/abs/2610.30026
作者:Yikai Zhao,Saurabh Pandey,Pradeep Kumar Misra
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词:Enterprise agents act, Enterprise agents, agents act, Enterprise, agent
备注: 28 pages, 5 figures
点击查看摘要
Abstract:Enterprise agents act on documents. Before an agent can follow a policy, answer a compliance question or file a ticket, some ingestion layer must turn a Word file or PDF into tokens - and that layer is where an agent deployed in the wild silently loses information. We show that one layer is lost by every mainstream converter - the meaning an author encodes in how text looks - and that the loss makes agents confidently wrong rather than visibly incomplete. We build a task from 76 real policy documents: recover the requirements the author singled out, scored against the file's own OOXML properties by a deterministic matcher with no LLM judge. Formatting-blind ingestion collapses from micro F1 0.690 to 0.150 (docling) and 0.075 (plain text), a gap that replicates across six answering models from two vendors - five Claude models spanning the Opus, Sonnet and Haiku tiers, and OpenAI's GPT-5.6. An agent that cannot see the cue guesses, and docling's false-positive rate on requirements the author did not flag is four times ours. A span-level leave-one-out localises the loss to two cues - highlight (+0.302) and colour (+0.262), both Holm-adjusted p 1e-4 - while bold, italic, monospace and strikethrough each sit within +/-0.003 of zero. The same asymmetry appears in PDF. Colour is also the cue no mainstream converter preserves and no parsing benchmark scores, and it is common: 32.8% of 6,460 documents carry a deliberate colour or highlight, 10.3% on an obligation. A pre-registered test shows that typing a cue for the agent adds +0.085 beyond merely preserving it (Holm-adjusted p = 0.049). We validate the labels against rendered page images through an independent modality (kappa = 0.72) and bound what wording alone can achieve (AUC 0.664). For agent builders the practical finding is that ingestion, not reasoning, is where this reliability is won or lost, and that the fix is cheap and measurable.
3. 【2610.29939】ERCLIP: Small-Data Adaptation of CLIP for Free-Length Image-Text Retrieval
链接:https://arxiv.org/abs/2610.29939
作者:Hoang-Bao Le,Allie Tran,Binh T. Nguyen,Liting Zhou,Cathal Gurrin
类目:Information Retrieval (cs.IR)
关键词:detailed image descriptions, truncates detailed image, encoder truncates detailed, CLIP, text encoder truncates
备注: Accepted at LFSD - ACCV 2026 Worshop
点击查看摘要
Abstract:CLIP's 77-token text encoder truncates detailed image descriptions. We present ERCLIP, a small-data adaptation of CLIP for long-caption image--text retrieval. During training, a long caption is split into sentences that the CLIP text encoder encodes independently; the sentence embeddings are fused by mean pooling or a gated residual Transformer scorer and receive their own contrastive loss. At inference ERCLIP is an unmodified CLIP dual encoder: test captions are still read through the 77-token window, and only training sees the full caption. We find that this fine-tuning erodes CLIP's zero-shot classification, most when the fusion output is not a combination of CLIP embeddings, and add a frozen-CLIP preservation loss on the image and short-caption embeddings. With 20k pairs and one epoch, ERCLIP improves long-caption R@1 over CLIP by 6.5--11.2 points, closing 62--77% of the gap to LongCLIP with 2% of its long captions. Preservation recovers 1.5--2.1 ImageNet zero-shot points (30--42% of the loss) and adds up to 2.4 points of COCO image-to-text R@1, at no inference cost.
4. 【2610.29812】Real PMIDs, Wrong Papers: Harness Design for Biomedical Claim-Verification Agents
链接:https://arxiv.org/abs/2610.29812
作者:Mohammed Saqlain
类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词:Literature-searching language agents, Literature-searching language, life sciences, harness matter, standard component
备注: Accepted to the Agentic AI for Biological Discovery (AgenticLS) Workshop at NeurIPS 2026
点击查看摘要
Abstract:Literature-searching language agents are becoming a standard component of scientific assistants for the life sciences, yet there is little controlled evidence on which parts of their harness matter. We run a controlled ablation on biomedical claim verification (SciFact) with the live PubMed API as the only tool. Holding the backbone and output format fixed, we compare four harnesses: closed-book answering, single-shot retrieval using the claim as the query, a ReAct-style agent that writes its own PubMed queries, and an oracle given the gold abstracts, each with two efficient frontier backbones. Naive single-shot retrieval finds the gold paper for only 6% of claims and turns overconfident errors into abstentions without improving accuracy. Letting the model formulate its own queries triples gold recall and yields the best verdicts (62% accuracy vs. 49-59% for the other realistic harnesses), although these differences are not significant at our sample size and agents use fewer than half of their search budget. With gold abstracts, the same models reach 79-86% accuracy, a significant 17-24 point gap showing that retrieval, not reasoning, is the main bottleneck. Finally, a citation audit shows that closed-book models cite PubMed IDs that almost always exist (327/335) but are almost never relevant: a cross-family LLM judge rates only 3 of 327 existing citations as relevant to the claim, versus 67% for citations produced by the search agent. Existence checks are therefore insufficient safeguards for scientific agents. We release code, prompts, and all cached tool calls at this https URL.
5. 【2610.29556】SOAR: Social and Opinion-Aware Recommendations
链接:https://arxiv.org/abs/2610.29556
作者:Giannis Christoforidis,Apostolos N. Papadopoulos
类目:Machine Learning (cs.LG); Information Retrieval (cs.IR)
关键词:online platforms, Opinion Aware Recommendation, enduring challenges, user behavior, user
备注:
点击查看摘要
Abstract:One of the enduring challenges in online platforms is recommendation. Both communities and advertisers face difficulties in analyzing complex user behavior, identifying habits and evolving preferences, and providing timely recommendations that are relevant to user interests. In particular, point of interest recommendation poses the additional challenge of identifying the factors that influence user behavior, capturing user tendencies, and generating accurate, personalized recommendations for each individual. In this work, we propose SOAR, a Social and Opinion Aware Recommendation model that incorporates both the user's friendship network and textual reviews to assess whether a location is suitable for a specific user, with a particular emphasis on the sentiment of shared reviews. Experimental results in real-world datasets demonstrate that incorporating reviews into the recommendation process improves the precision of the recommendation.
6. 【2610.29523】pplx-embed-v2-late Technical Report
链接:https://arxiv.org/abs/2610.29523
作者:Markus Krimmel,Louis Milliken,Ekaterina Glazkova,Maximilian Schall,Antoine Chaffin,Sedigheh Eslami,Jonas Golde,Denis Bykov,Claire Beamer,Jeremy Yang,Bo Wang
类目:Information Retrieval (cs.IR); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词:multimodal late-interaction models, multilingual and multimodal, multimodal late-interaction, visual document retrieval, visual document
备注:
点击查看摘要
Abstract:In this report, we introduce pplx-embed-v2-late, a pair of 0.6B and 9B multilingual and multimodal late-interaction models. Both models achieve state-of-the-art results within their respective size classes across a range of text, image, and visual document retrieval benchmarks. On visual document retrieval tasks, pplx-embed-v2-late-0.6b is competitive with models several times larger than itself. The models are trained via representation distillation from an 18B teacher. Consequently, they share an embedding space that supports asymmetric deployment: documents can be indexed with the 9B model and queried with the low-latency 0.6B model. Both models are available at this https URL.
7. 【2610.29521】X-Embedding: Two-Stage Training for Multilingual Patent Prior-Art Retrieval
链接:https://arxiv.org/abs/2610.29521
作者:Wentao Wu,Xu Wang,Linqing Chen,Fenhong Zhu,Hanmeng Zhong,Yuanxiang Huangfu
类目:Information Retrieval (cs.IR)
关键词:requires identifying X-category, identifying X-category references, prior-art retrieval requires, retrieval requires identifying, Multilingual patent prior-art
备注: 12 pages, 3 figures, 4 tables
点击查看摘要
Abstract:Multilingual patent prior-art retrieval requires identifying X-category references that are particularly relevant to the novelty or inventive step of a claimed invention, beyond topical similarity across languages and document views. We present X-Embedding, a two-stage framework that first learns patent-domain representations and then optimizes X-category retrieval relevance. The first stage aligns complementary sections within patents and corresponding sections across different-language patent-family members, learning from both patent structure and multilingual expressions. The second stage learns X-category relevance using examination-report X citations as positives and negatives drawn from retrieval candidates and A-category citations. Matryoshka representation learning (MRL) enables 64- and 1024-dimensional embeddings within one model. Evaluation on a common Chinese, English, and Japanese collection with four query views yields 89.09% overall macro Hit@100 at 64 dimensions, exceeding Qwen3-Embedding-0.6B and RoBERTa by 21.25 and 3.68 percentage points, respectively. Under the same second-stage training and evaluation conditions, two-stage training outperforms direct supervised fine-tuning by 3.19 points, with gains of 5.34 and 4.72 points for English and Japanese and higher scores in nine of twelve language-view combinations. Overall macro Hit@10 and Hit@20 also improve by 3.71 and 3.79 points, respectively. These results support sequential patent-domain and task adaptation for improving aggregate X-category retrieval on this multilingual collection.
8. 【2610.29520】Beyond the Vote: When Do LLMs Add Value to Retrieval-Based Tabular Classification?
链接:https://arxiv.org/abs/2610.29520
作者:Ziquan Wang,Yuxuan Nie,Jian Ma,Yingjie Li
类目:Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词:enables large language, Retrieval-based in-context learning, large language models, in-context learning, enables large
备注:
点击查看摘要
Abstract:Retrieval-based in-context learning (ICL) enables large language models (LLMs) to predict tabular labels from similar examples, but it remains unclear whether LLM inference improves on direct voting over those same examples. We address this question by comparing four general-purpose LLMs with distance-weighted nearest-neighbor voting (Distance-KNN) using identical retrieved neighbors across 19 tabular classification datasets. With the number of demonstrations fixed, enlarging the retrieval candidate pool improves accuracy for all predictors, yet Distance-KNN achieves the highest mean accuracy at every pool size. More detailed analyses reveal that LLM gains are concentrated where retrieved neighbors exhibit low label consensus and vary across models. These gains further depend on the average feature-space distance to the test query: under low label consensus, some LLMs outperform Distance-KNN in close and intermediate neighborhoods, but all fall behind on average in the most distant group. Complementary experiments on the number of demonstrations, prompt formulation, retrieval representation, and label-balanced demonstration selection largely preserve the overall findings. These results characterize when LLM inference adds predictive value beyond distance-weighted voting in retrieval-based tabular ICL.
9. 【2610.29464】Directional Posterior Feedback Fusion for Query Reformulation in Dense Retrieval
链接:https://arxiv.org/abs/2610.29464
作者:Yiteng Tu,Qingyi Pan,Weihang Su,Jiaxin Mao,Yiqun Liu,Qingyao Ai
类目:Information Retrieval (cs.IR)
关键词:supporting efficient semantic, efficient semantic search, supporting efficient, range of applications, fundamental paradigm
备注:
点击查看摘要
Abstract:Dense retrieval has become a fundamental paradigm for modern information retrieval, supporting efficient semantic search across a wide range of applications. Its effectiveness, however, relies critically on query embeddings that adequately capture users' information needs, which can be difficult for short, ambiguous, or underspecified queries. Feedback-based query reformulation approaches like pseudo-relevance feedback (PRF) alleviate this by incorporating additional evidence from retrieved or generated content. However, existing embedding-space approaches commonly aggregate or interpolate feedback vectors, implicitly treating them as complete target representations. Such pointwise fusion can unnecessarily suppress query corrections along directions not expressed by individual feedback items, even when these directions are supported by complementary evidence. To address this limitation, we propose Directional Posterior Feedback Fusion (DIFF), a query reformulation framework that models feedback as directional evidence rather than target points. DIFF represents feedback as confidence-weighted directional evidence in the tangent space of the original query and jointly infers a controlled query update through prior-regularized posterior fusion, without retraining the underlying dense retriever. Experiments across multiple dense retrievers and different feedback sources show that DIFF achieves the best overall retrieval performance, demonstrating the effectiveness of explicitly modeling how feedback should constrain query updates.
10. 【2610.29298】Generative Recommenders Forget the Long Tail: Restoring Memorization in Retrieval and Ranking
链接:https://arxiv.org/abs/2610.29298
作者:Xu Huang,Jiancan Wu,Hongzheng Qin,Jiawei Feng,Can Ye,Wencong Zeng,Fengze Li,Xiang Wang
类目:Information Retrieval (cs.IR)
关键词:Generative recommenders replace, identifiers performs retrieval, item identifiers performs, single model, semantic item identifiers
备注:
点击查看摘要
Abstract:Generative recommenders replace the retrieve-then-rank cascade with a single model: beam search over semantic item identifiers performs retrieval, and the same likelihood performs ranking. We show that this shared score makes them forget long-tail items twice. In retrieval, beam search keeps identifier prefixes by the probability mass of their subtrees, so tail items are pruned early, and a wider beam admits few more of them. In ranking, the likelihood places tail items below head items even when they are admitted, so expanding retrieval alone brings little or no gain. Both failures reflect missing item-level memorization (i.e., direct recall of which items co-occur), which collaborative filtering provides and shared-prefix generation lacks. To this end, we propose CAPE (Co-occurrence-Aware Pool Expansion), a training-free plug-in that restores memorization at both stages: (i) a memorization channel retrieves co-occurrence-supported tail items outside the beam and scores them with the frozen generator, and (ii) memorization-calibrated ranking fuses the generator likelihood with co-occurrence evidence while keeping the generator's first item. Experiments with two generative backbones on product and music domains show that CAPE significantly improves long-tail accuracy over the backbones and over re-ranking baselines that share its candidates, preserves or improves overall accuracy, and adds a small fraction of the latency.
11. 【2610.29252】Extending FAIR Principles with Observability for Trustworthy Federated Learning
链接:https://arxiv.org/abs/2610.29252
作者:Hangli Ge,Noboru Koshizuka
类目:Machine Learning (cs.LG); Information Retrieval (cs.IR)
关键词:make a federation, Federated learning, evidence, federation trustworthy, data
备注: The paper has been accepted by TrustFL-SIS 2026 - Trustworthy Federated Learning for Smart Industrial Systems Workshop, co-located with IEEE ICDM 2026,
点击查看摘要
Abstract:Federated learning (FL) keeps data at its source, but locality alone does not make a federation trustworthy. Without sufficient observability, an aggregator cannot determine whether the client service was healthy, the local data pipeline was trustworthy, or contractual constraints were properly monitored during training. We take the position that trustworthy FL needs an evidence plane in addition to its model-update process. Each participant continuously summarizes local infrastructure, data into minimal, signed trust evidence associated with each FL round, while raw data, logs remain local. A local TinyLLM may assist in interpreting observability signals, deriving contextual evidence, and providing natural-language explanations to operators. We instantiate this vision through FAIR-O, an observability extension of FAIR principle. Rather than benchmarking FL accuracy, a three-level trust model has been proposed and a two-participant Python prototype demonstrates evidence generation and trust assessment. We further discuss future integration of FAIR-O Trust Evidence into participant selection, evidence weighting, and federated aggregation.
12. 【2610.29234】Learning Marginal Viewpoint Utility for Budgeted Evidence Selection in RAG
链接:https://arxiv.org/abs/2610.29234
作者:Yiyang Duan,Ziqi Yu,Tiantong Wu,Yebo Wu,Wei Yang Bryan Lim
类目:Information Retrieval (cs.IR)
关键词:Retrieval-augmented generation, preserve distinct answers, generation over multi-viewpoint, multi-viewpoint queries, queries must preserve
备注: 30 pages, 8 figures, including appendices
点击查看摘要
Abstract:Retrieval-augmented generation over multi-viewpoint queries must preserve distinct answers and positions from the retrieved evidence while operating under a fixed context budget. We introduce LMVU, a lightweight ranker that learns to prioritize candidates by the marginal viewpoint coverage they add to the current selection. Training uses viewpoint annotations from each benchmark's development split to compare candidates within the same selection state. At inference, LMVU repeatedly scores budget-feasible candidates as the context grows, without accessing these annotations. We evaluate two forms of recovered viewpoint coverage: RVC$_1$ assigns each viewpoint full credit for at least one supporting source unit, while RVC$_2$ assigns half credit for one and full credit for two or more distinct source units. Exact oracles measure achievable coverage under the same evidence pool and budget. Across four viewpoint-annotated benchmarks at a 1,024-token budget, LMVU achieves gains of up to 0.047 and 0.052 points in RVC$_1$ and RVC$_2$, respectively, over the strongest non-oracle baseline for each benchmark and metric, and reaches the exact viewpoint-breadth ceiling on two benchmarks.
13. 【2610.29216】Preference Is Not Permission: Personalizing the Auto-Purchase Line in Agentic Commerce
链接:https://arxiv.org/abs/2610.29216
作者:Ryotaro Shimizu,Sai HtaungKham,Mo Fan
类目:Information Retrieval (cs.IR); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)
关键词:Personalized shopping benchmarks, Personalized shopping, pose learning, item fits, human authorization reference
备注:
点击查看摘要
Abstract:Personalized shopping benchmarks ask which item fits the user; we ask how far an agent may commit on that item, and pose learning the individual's auto-purchase line as a task. The boundary is evidence-conditioned and three-valued: whether committing is appropriate depends on the sufficiency of product information (warrant), reversibility, price against the user's norm, and urgency, not only on fit; and the natural output is don't buy, confirm first, or buy automatically. Across sixteen instruction-tuned models, autonomous commitment is misaligned with a human authorization reference in which fifteen annotators, role-playing the delegating principal from a given profile, choose the furthest action they would allow without confirmation: models commit even when fit is low and when their own evidence flag reports the warrant missing. This is overreach. The line is individual: these raters disagree, yet the disagreement is structured and partly predictable from a person's own other labels. A shallow learner on a few dozen of a person's own labels predicts their held-out auto-purchase line at a median of 0.79 by 30-40 labels, outperforming every evaluated prompt$\times$model configuration, including a per-annotator oracle over 80 configurations; the learned boundary does not transfer across domains. We release the counterfactual benchmark, human authorization reference, and annotation protocol after acceptance.
14. 【2610.29189】Reasoning-Search-Augmented LLMs: An Operational Taxonomy, Benchmark Analysis and Controlled Evidence Synthesis
链接:https://arxiv.org/abs/2610.29189
作者:Biswas Poudel,Nilson Chapagain,Amit Kumar,Xianshun Jiang
类目:Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词:finite context windows, demonstrate impressive emergent, Large language models, emergent reasoning capabilities, Large language
备注: 10 pages
点击查看摘要
Abstract:Large language models (LLMs) demonstrate impressive emergent reasoning capabilities, yet they remain constrained by fixed model parameters and finite context windows. Even when augmented with static retrieval, they can produce statements that are unsupported by, or even contradictory to, retrieved evidence. This leads to hallucinations, difficulty incorporating up-to-date information, and failures to correctly interpret or reconcile sources. Recent work addresses these limitations by tightly coupling step-by-step reasoning with interactive search, treating retrieval as an action within an iterative agentic loop rather than a one-shot preprocessing step. This study reviews frameworks that implement such reasoning-search loops by interleaving planning, querying, retrieval, integration, verification, and stopping. We analyze these systems through four architectural axes: retrieval coupling, controller design, knowledge source, and grounding strictness. We separately treat the learning signal as a cross-cutting dimension because prompting, supervision, preference optimization, and reinforcement learning can instantiate the same architecture while producing materially different search, stopping, and grounding behavior. We further distinguish benchmark difficulty from RSA-loop demand and synthesize controlled within-study ablations and quality-cost deltas, avoiding invalid pooling across heterogeneous model backbones, retrievers, corpora, and evaluation protocols. Our goal is to clarify the landscape of reasoning-search-augmented LLMs and outline a unified perspective on the design choices shaping future research.
15. 【2610.29138】Progressive Learning from Content to Relevance to Personalization for CTR Prediction
链接:https://arxiv.org/abs/2610.29138
作者:Zhiguang Yang,Yulin Yang,Fuyu Lv,Dan Ou
类目:Information Retrieval (cs.IR); Multimedia (cs.MM)
关键词:Multimodal click-through rate, click-through rate, search systems, central to search, ranking depends
备注:
点击查看摘要
Abstract:Multimodal click-through rate (CTR) prediction is central to search systems, where ranking depends on item content, query relevance, and user preference. Existing approaches incorporate content through dense embeddings or coarse discrete IDs, yet effectively integrating fine-grained heterogeneous content with ID-based predictors remains challenging. We propose FineSID, a progressive learning framework that unifies content tokenization, query--item semantic pretraining, and personalized post-training via a shared fine-grained discrete representation. Each stage optimizes an explicit objective while preserving token-level access to content. First, a pretrained multi-scale visual tokenizer and text tokenizers convert heterogeneous content into fine-grained Semantic IDs (SIDs), explicitly aligning them with the ID features. Second, full-parameter semantic pretraining under query--item relevance supervision establishes a robust matching prior, jointly optimizing the interactions of multimodal SIDs and conventional fields within a shared predictor. Third, this initialized predictor is directly fine-tuned with user click supervision to capture implicit personalized preferences. Extensive offline and online evaluations demonstrate substantial gains in both standard CTR prediction and core business metrics. Furthermore, FineSID improves within-product creative discrimination, demonstrating its semantic generalization beyond conventional ID memorization.
16. 【2610.29052】Our Own Jev: Typed Decisions in One Forward Pass, from an In-House Judge to Open LoRA Models
链接:https://arxiv.org/abs/2610.29052
作者:Yuchuan Weng,Chi Liu,Xin Chen,Srinivasan Manoharan
类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词:language model logits, decision maps evidence, system Jev popularised, maps evidence, hidden states
备注: 22 pages
点击查看摘要
Abstract:A typed decision maps evidence, a question and a fixed set of options to a probability for every option, computed in one forward pass, by reading a language model's logits or a small head over its hidden states, instead of generating and parsing text. The commercial system Jev popularised this System~1 interface, and open reproductions have followed. We report two uses of the pattern. \emph{Part I} describes an in-house System~1 judge that triages about 148K agentic coding session records for a training corpus. It replaces a frontier LLM judge that cost on the order of \$1,000 per pass and whose stored labels matched a fresh two-judge consensus on only 26.9\% of the sessions where the two judges agreed; a self-hosted frozen backbone with a rank-16 LoRA adapter and a pointer head answers three typed questions in one forward pass, judges 1,000 sessions in about three minutes of one GPU, about \$0.06 at a reference rate and roughly 1\% of the frontier judge's cost, and keeps every session inside the organisation. \emph{Part II} asks whether a readout that adds no parameters can be competitive and whether training one helps. Applying the public Eikos recipe and corpus of about 25K decisions to three further backbones (1B, 2B and 35B), we read the frozen output layer of a LoRA-adapted decoder. On the 111 public hard items of JevBench our single-seed 35B, developed with those items in view, scores 79.3\%, not significantly different from the commercial reference (73.0\%, unadjusted $p=0.12$) and ahead of five open systems after Holm--Bonferroni correction; our 2B is ahead of all four kev checkpoints on the leaderboard. A single-seed ablation finds no detectable benefit from training the 26 letter rows of the output layer, and a retrain on a later corpus release moves the 2B's hard-tier accuracy by 11.7 points, which shows how little small evaluations resolve.
17. 【2610.28929】Scriptorium: System Design and Implementation of a Multi-Human, Multi-AI Collaborative Digital Library Search Platform
链接:https://arxiv.org/abs/2610.28929
作者:Abbas Pirmoradi,Milad Momeni,Anna Chu,Orland Hoeber
类目:Human-Computer Interaction (cs.HC); Information Retrieval (cs.IR)
关键词:digital library search, library search interface, search interface designed, search activity combined, full cross-user transparency
备注: supplemental information for SIGIR 2027 submission
点击查看摘要
Abstract:This technical report documents the design and implementation of Scriptorium, a digital library search interface designed to support multi-human, multi-AI collaboration: full cross-user transparency of search activity combined with a Manager--Worker architecture of seven role-specialized generative AI agents. A companion short demonstration paper describes Scriptorium's interaction design; because a demonstration format is constrained to a few pages, it necessarily omits most implementation detail. This report documents Scriptorium's complete system architecture, data model, collaborative-interaction design rationale, and AI orchestration mechanism, including verbatim agent prompts, the deterministic guardrails that constrain them, the language model and retrieval configuration, and the steps needed to run the system, so that the design can be inspected, critiqued, reproduced, and reused by other researchers. We also discuss the system's current limitations and the user study we are planning to evaluate its central hypothesis: that combining collaborative transparency with scoped multi-agent AI assistance increases serendipitous cross-pollination between collaborators' research threads.
18. 【2610.28922】Constrained Tagging for Span Labeling
链接:https://arxiv.org/abs/2610.28922
作者:Radek Štulc,Jan Drchal
类目:Information Retrieval (cs.IR)
关键词:Generative LLMs, task-specific training, occur several times, tied to positions, reproduces the input
备注: 22 pages, 7 Figures, 13 Tables
点击查看摘要
Abstract:Generative LLMs can label spans without task-specific training, but their output is not tied to positions in the input: a returned span may be absent from the input or occur several times. We present constrained tagging, a training-free method in which the model reproduces the input and wraps each span in labeled inline markup. A logits processor using a byte-level token trie and a finite-state machine admits only tokens that continue the input verbatim or form a valid tag, so the output reproduces the input exactly with labels from the given set, and spans may begin or end at any character boundary, even inside a token. Two-phase decoding lets reasoning models reason before the constraint engages. On six datasets and six open-weight models, the guarantee holds in all but 0.022% of 255,312 constrained generations, each failure a reasoning model exhausting its token budget or never closing its reasoning, and the constraint adds no measurable cost. Unlike context-based prompting, which loses 8.5% of its spans, constrained tagging locates every span it proposes on every dataset; it is as accurate on two datasets, and on the other four its errors lie in which spans the model chooses, not where they are.
19. 【2610.28656】FutureLens: Longitudinal Topic Patterns in Scholarly Text and Future-Work References
链接:https://arxiv.org/abs/2610.28656
作者:Ibrahim Al Azher,Hamed Alhoori
类目:Digital Libraries (cs.DL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词:questions researchers choose, Future-work statements offer, leave open, statements offer, offer a record
备注: 10 pages, Accepted at AI4SciSci 2026 (3rd International Workshop on Artificial Intelligence for the Science of Science), co-located with ACM/IEEE-CS JCDL 2026
点击查看摘要
Abstract:Future-work statements offer a record of the questions researchers choose to leave open. Using them to describe a field, however, requires separating thematic change from changes in document coverage, topic assignment, and scholarly writing. FutureLens examines these measurement issues in a recovered snapshot of 5,655 ACL papers published during 2012--2022, including 4,005 with supplied future-work reference text. We compare non-negative matrix factorization (NMF) and latent Dirichlet allocation (LDA), aggregate topic presence at the paper level, and examine normalized prevalence, exploratory trend statistics, assignment stability, and agreement between input-derived text and references. Across available seeds, NMF has higher mean normalized pointwise mutual information (0.1387 versus 0.1280) and higher pairwise assignment stability, while LDA has greater keyword diversity (0.8900 versus 0.7750). Seed-zero results show increasing prevalence of broad model-training and question-related vocabulary, alongside substantial citation and document-structure content. Mean input/reference topic-set overlap is 0.5191 for NMF and 0.4924 for LDA; temporal rank agreement varies widely and does not imply agreement in prevalence levels. These findings support a descriptive account of the available corpus, with explicit qualifications for missing references, incomplete runs, and unverified reference provenance. The contribution is an empirical measurement study of longitudinal scholarly signals, not a new topic-modeling algorithm or a forecasting system.
20. 【2610.28648】Building Knowledge Graphs for Theses: A Survey
链接:https://arxiv.org/abs/2610.28648
作者:Donia Ruelas,Elmer Coyla,Miguel Aceituno,Elwin Huaman
类目:Digital Libraries (cs.DL); Information Retrieval (cs.IR)
关键词:exploitation remains limited, semantic exploitation remains, Scholarly Knowledge Graphs, valuable source, exploitation remains
备注: 22 pages
点击查看摘要
Abstract:Academic theses are a valuable source of scientific knowledge, yet their semantic exploitation remains limited. While Scholarly Knowledge Graphs have significantly advanced the representation of scientific publications, knowledge graph construction for academic theses has received comparatively limited attention. This paper provides a systematic review of existing approaches and analyzes their potential application for the thesis domain. We analyzed 46 peer-reviewed studies published between 2021 and 2025, and organised existing approaches into a structured classification of techniques, models, and tools. The review reveals a methodological evolution from natural language processing techniques for entity and relation extraction to ontology engineering, Semantic Web technologies, and AI-driven enrichment through knowledge graph embeddings, Linked Open Data, and Large Language Models. The findings provide a consolidated view of the current state of the art and identify methodological foundations and future research directions for building knowledge graphs for the thesis domain.
21. 【2610.28642】Controllable Generative Recommendation via Guided Token Refinement
链接:https://arxiv.org/abs/2610.28642
作者:Haichao Zhang,Zhixuan Liang,Chong Zhang,Zixi Chen,Wen Wang,Jia Wang
类目:Information Retrieval (cs.IR)
关键词:Generative recommendation, recommendation over discrete, powerful paradigm, discrete Semantic IDs, Generative
备注: 10 pages, 4 figures. Accepted ICDM 2026 (IEEE International Conference on Data Mining)
点击查看摘要
Abstract:Generative recommendation over discrete Semantic IDs has become a powerful paradigm for item retrieval. Real-world systems, however, frequently require real-time controllability to balance accuracy against objectives such as diversity. Existing autoregressive methods generate tokens strictly from left to right. This fixed direction locks in early decisions, preventing holistic planning and making control difficult. Consequently, direct interventions often break the semantic structure, producing non-existent items. To address this, we propose ReGen, a framework that shifts from sequential decoding to parallel iterative refinement. ReGen reformulates generation as a mask-filling task, predicting all tokens simultaneously rather than one by one. This global view allows us to apply control signals directly to tokens with high-level semantics without retraining the model. To ensure that decoded candidates map to real items, we introduce a topology-constrained tree that iteratively corrects low-confidence predictions while strictly enforcing valid codebook paths during beam-based inference. Experiments show that ReGen provides a favorable accuracy-diversity trade-off under moderate guidance while maintaining high validity of generated Semantic IDs. The source code is available at: this https URL.
22. 【2610.28641】ransaction Foundation Models for Retrieval-Augmented Generation over Financial Transaction Data: A Comparative Evaluation with Text Embeddings
链接:https://arxiv.org/abs/2610.28641
作者:Snehal Pal
类目:Information Retrieval (cs.IR)
关键词:data remains underexamined, drop-in representation learners, structured data remains, text embedding models, transaction foundation models
备注: 7 pages, 2 figures. Code available on Kaggle (see links in paper)
点击查看摘要
Abstract:Domain-specific tabular and transaction foundation models are increasingly proposed as drop-in representation learners for financial applications, but their value relative to off-the-shelf text embedding models for retrieval-augmented generation (RAG) over structured data remains underexamined. We construct a deterministic, template-generated question-answering benchmark of 1,026 questions with retrieval-level gold-document annotations over IBM's synthetic Anti-Money-Laundering (AML) transaction dataset, and compare NVIDIA's 29M-parameter Transaction Foundation Model (TFM) against five general-purpose and financial-domain text embedding models under a size- and data-matched retrieval setup, as well as against a hand-aggregated summary-text baseline. TFM substantially outperforms every size-matched generic embedder on both retrieval (Recall@5: 0.81 vs. 0.25-0.39) and end-to-end answer accuracy (66.7% vs. 27.5%). However, a simple pipeline that embeds a human-engineered aggregated summary with a generic sentence encoder matches or exceeds TFM overall, and dominates it on several low-cardinality entity categories (bank, currency, payment format). This suggests that the benefit of a transaction-native foundation model over generic text embeddings is category-dependent rather than uniform, and that careful feature aggregation can substitute for domain-specific pretraining in several practically relevant regimes. We release the benchmark generation and evaluation code.
23. 【2610.28639】Can AI Chat Replace Traditional Search? Evidence from a RAG-based Live Events Experiment
链接:https://arxiv.org/abs/2610.28639
作者:Rakesh Allu,Evgeny Kagan
类目:Information Retrieval (cs.IR); General Economics (econ.GN)
关键词:increasingly integrated, Conversational AI tools, Conversational, chat, browsing interfaces
备注:
点击查看摘要
Abstract:Conversational AI tools are being increasingly integrated into online search and browsing interfaces. To understand how such tools affect user behavior and search outcomes, we run a pre-registered, incentivized online experiment in which participants search a catalog of several thousand events scraped from a major live-events platform. We compare three interfaces: a classic, attribute-based filter interface (Filter), a GenAI chat interface (Chat), and a combined interface offering both (Hybrid). In both AI conditions, AI output is restricted via retrieval-augmented generation (RAG). Our main result is that, relative to the other two conditions, the Chat condition performs the worst. The effect is robust across AI models (gpt-4.1-mini, gpt-5.2 and gpt-5.4) and is driven mainly by users who perform open-ended exploration (as opposed to users searching for a specific artist, venue or sports team). Furthermore, there are no significant differences on any metrics between Filter and Hybrid. We also document two mechanisms. First, Chat creates an echo chamber: without a visible menu, users construct queries based on what they think is contained in the catalog. As a result, they frequently search for event types that are not available in the catalog, and they search too narrowly. Second, Chat leads to prompting fatigue: it shifts effort towards prompting, and away from inspecting and evaluating the output. As a result, users often pick one of the first displayed suggestions rather than examining the list more carefully. Taken together, our results suggest that AI is best used as a complementary tool to existing filter-based search rather than as a replacement.
24. 【2610.28638】AGR: Task-Adaptive Geo-Semantic Retrieval across Heterogeneous Urban Delivery Tasks
链接:https://arxiv.org/abs/2610.28638
作者:Zhi Liu,Yurun Cai,Xiao Han,Zhi Zhen,Yuran Li,Guojiang Shen,Xiangjie Kong
类目:Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词:residents demand higher-quality, demand higher-quality instant, higher-quality instant delivery, estimated time, higher-quality instant
备注:
点击查看摘要
Abstract:As urban residents demand higher-quality instant delivery services, demand forecasting, estimated time of arrival prediction, and next-stop prediction have become critical tasks in urban delivery systems. However, the three tasks rely on historical evidence with substantially different structures and granularities. Meanwhile, their prediction targets differ in output form, making it difficult to integrate retrieved evidence through a single fusion mechanism without causing mismatch or negative transfer. These issues can increase prediction errors and subsequently lead to imbalanced resource allocation, where some regions experience unmet demand. In contrast, others suffer from underutilization, ultimately degrading overall efficiency and service quality. To address these challenges, we propose TAGR, a Task-Adaptive Geo-Semantic Retrieval framework across heterogeneous urban delivery tasks. TAGR constructs an LLM-based geo-semantic shared prior and task-specific retrieval banks to share regional knowledge while preserving heterogeneous task-specific evidence. The LLM-derived regional representations encode geographic context and semantic relations among regions, providing transferable knowledge for all three tasks without requiring online LLM inference. It further introduces a task-adaptive retrieval augmentation module to accommodate heterogeneous output structures, thereby mitigating information mismatch and negative transfer caused by a uniform retrieval-fusion strategy. Experiments on three city datasets demonstrate that TAGR consistently outperforms state-of-the-art baselines across multiple tasks.
25. 【2610.28636】RESEARCHHUB: A Personalized Literature Discovery System for Biomedical Preprints
链接:https://arxiv.org/abs/2610.28636
作者:Viswonathan Manoranjan,Taeyoon Kim,Nicholas Do,Sang Woo Kim,Dawei Li,Zhen Tan,Tianlong Chen,Yunmei Liu
类目:Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词:personalized literature discovery, Multiple Negatives Ranking, personalized literature, literature discovery, Local Intrinsic Dimensionality
备注: under-review
点击查看摘要
Abstract:We present ResearchHub, an interactive system for personalized literature discovery over biomedical preprints. Given a researcher profile or a free-form query, ResearchHub retrieves relevant papers from a domain-specific MedRxiv corpus and helps users move beyond near-duplicate recommendations through controllable novelty, diversity, and curriculum ordering. At the core of the system is prism, a bi-encoder retriever adapted to biomedical preprints using GPT-4o-generated natural language queries and a hybrid Multiple Negatives Ranking plus MarginMSE objective with cross-encoder soft labels. On 44,937 MedRxiv papers from 2023--2025, prism outperforms strong off-the-shelf dense retrievers, improving Recall@10 over SPECTER2-Search by 12.4 percentage points. ResearchHub further supports frontier retrieval based on a user's reading history, DPP-based diversity re-ranking, Local Intrinsic Dimensionality ordering from mainstream to specialized papers, and lightweight attribution cards for result explanation. The full pipeline runs with low latency, making the system suitable
计算机视觉
1. 【2610.30129】Rethinking Video Autoencoders for Interactive World Models
链接:https://arxiv.org/abs/2610.30129
作者:Adrien Ramanana Rahary,Yutong Bai,Nicolas Dufour,Patrick Pérez,David Picard
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:predict future frames, models predict future, predict future, world models predict, Video world models
备注:
点击查看摘要
Abstract:Video world models predict future frames from past frames and actions. They serve as simulators in which agents train, plan or are evaluated, and that humans can control interactively. They generate in the latent space of a video autoencoder, whose compression sets their cost per frame and how long each action waits to take effect. Yet world models often reuse the autoencoders of text-to-video generators, built for offline generation with no agent waiting and, without their training data and code, not retrainable at another compression. We therefore ask how, where and how much a world model should compress. We build CADRE, an open family of causal diffusion representation autoencoders spanning multiple spatio-temporal compressions. Its members differ only in a small bottleneck on frozen features and share a diffusion decoder self-distilled to one or a few steps. We train the same world model on each autoencoder in two domains, manipulation and navigation, with two environments each. CADRE forms most of the latency-quality frontier, especially with a moving camera. Our study also leads to four findings. At strong compression, a diffusion decoder is sharper than perceptual regression. In robot manipulation, temporal compression is more effective in the autoencoder than in the world model. Manipulation and navigation call for opposite compressions: temporal compression costs little when the camera is still, and spatial compression when it moves. Surprisingly, with a still camera, coarser spatial tokens hurt motion far more than image quality. Code, models and a live demo are at this https URL
2. 【2610.30127】VoxProg: 3D Spatial Reasoning through Voxel Programming
链接:https://arxiv.org/abs/2610.30127
作者:Zhichao Zhai,Menglei Zhao,Guikun Chen,Zihao Yan,Kanzhi Wu,Wenguan Wang,Jun Xiao
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:Language models' abilities, generate programs offer, models' abilities, abilities to interpret, offer a promising
备注: Project page: [this https URL](https://voxprog.github.io)
点击查看摘要
Abstract:Language models' abilities to interpret tasks and generate programs offer a promising basis for 3D spatial reasoning. Yet following spatial instructions in 3D scenes requires programs to construct geometric references that language leaves implicit. In this work, we introduce VoxProg, which formulates 3D object placement through voxel programming: a language model translates task interpretations into executable programs over local voxel views of scene surfaces. Because these views index surface geometry on regular grids with explicit coordinates and neighborhood relations, an evidence program can isolate task-relevant regions and boundaries directly from scene meshes, and a downstream pose program can measure the resulting geometry to compute a target $SE(3)$ pose. Visual and numerical feedback from execution lets the model inspect intermediate selections and candidate placements to iteratively revise its code. To evaluate open-ended placement across functional use, geometric fit, and contextual arrangements, we introduce the 71-task VoxProg-Bench benchmark along with an evaluation suite pairing perceptual Intent Alignment and 3D Physical Validity. Across VoxProg-Bench and external benchmarks, VoxProg consistently outperforms relation-based, keypoint-based, and mesh-based baselines.
3. 【2610.30125】PhysiCalWorld: In-Context Physics Calibration for World Models
链接:https://arxiv.org/abs/2610.30125
作者:Yunhao Luo,Wentao He,Yinpei Dai,Hyelin Nam,Hongze Fu,Joyce Chai,Nima Fazeli,Jeong Joon Park
类目:Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词:narrow history window, Existing world models, models typically perceive, Existing world, current visual frame
备注: Project page: [this https URL](https://physical-world.github.io/)
点击查看摘要
Abstract:Existing world models typically perceive a scene through current visual frame or a narrow history window. However, these observations may not reveal the physics properties that determine transition dynamics, such as an object's mass distribution, joint damping, or surface friction. Without calibrating these physics factors for world models, predictions tend to regress toward an empirical prior and induce severe drift in novel test scenes. To this end, we propose PhysiCalWorld, which calibrates action-conditioned world models to the instance-specific dynamics via in-context prompting, without fine-tuning or analytical physics modeling. Our method encodes an exploratory interaction clip collected within the test scene into a compact physics descriptor token, which grounds subsequent predictions in the scene's actual physical behavior. PhysiCalWorld is trained end-to-end with the latent prediction loss alone, without physics labels. At inference time, the descriptor token is extracted once and can be reused across rollouts with negligible compute overhead. We evaluate PhysiCalWorld across four environments covering diverse physics variations and show that it substantially improves rollout prediction accuracy and visual planning success rate. The learned descriptors also form a physically structured latent space and generalize beyond the physics ranges seen during training.
4. 【2610.30120】ALPS: Visual State Encoders for World Models
链接:https://arxiv.org/abs/2610.30120
作者:Yanqing Liu,Letian Zhang,Chengzhi Liu,Zijun Wang,Jieru Mei,Hongliang Fei,Yuyin Zhou,Cihang Xie
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:turn visual representations, World models turn, models turn visual, turn visual, pixel reconstruction
备注: 35 pages (15 main + 20 supplementary), 13 figures, 26 tables. Project page: [this https URL](https://ucsc-vlaa.github.io/ALPS/) Code: [this https URL](https://github.com/UCSC-VLAA/ALPS)
点击查看摘要
Abstract:World models turn visual representations into predictions and actions. We argue that their visual foundation should combine physical-state information, native language alignment, and pixel reconstruction, so that a single representation can support prediction, instruction, and inspection. However, existing encoders typically specialize in only one or two of these capabilities; we therefore introduce ALPS, a pretrained visual state encoder that unifies all three in a single set of patch tokens. Using only still images and text, we pretrain a ViT-B/16 from scratch with language, reconstruction, and spatial correspondence objectives, and then refine it via cross-view self-distillation. In a unified evaluation across fifteen public encoders, ALPS achieves the lowest aggregate LIBERO state-probe error among ViT-B models (matching the 3.5x larger V-JEPA 2-L) while maintaining strong language alignment and accurate pixel reconstruction. Downstream, frozen ALPS tokens reach the highest mean policy success on LIBERO (85.5%) when paired with our native text tower, match or exceed leading encoders on world-model planning across PushT, Wall, and Granular, and allow predicted future tokens to be decoded directly into pixels for visual inspection. We hope this work helps establish visual pretraining as a shared foundation for understanding, prediction, and action in world models.
5. 【2610.30108】Multimodal Embodied Agents: A Unified Capability-centric Perspective from Computer-Use to Robot-Use
链接:https://arxiv.org/abs/2610.30108
作者:Yanzhe Chen,Ziyi Yang,Jifeng Zhu,Qiming Huang,Ruihe An,Peiyao Xu,Hesen Yang,Runda Liu,Chang Gong,Zhijun Cao,Zechen Bai,Wenzheng Zeng,Yiqi Lin,Guoqiang Liang,Kevin Yuchen Ma,Kevin Qinghong Lin,Mike Zheng Shou
类目:Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Multiagent Systems (cs.MA); Multimedia (cs.MM)
关键词:sustain interaction, sensing and actuation, couple multimodal task, multimodal task reasoning, robotic systems
备注: Project website: [this https URL](https://showlab.github.io/Awesome-Multimodal-Embodied-Agent/)
点击查看摘要
Abstract:Multimodal agents (MMAs) sustain interaction through reasoning, memory, tools, and feedback, most visibly as computer-use agents, while robotic systems (RSs) couple sensing and actuation under physical dynamics. We define multimodal embodied agents (MMEAs) as goal-directed systems that couple multimodal task reasoning with physical action and revise decisions from the resulting feedback. This raises a central question: what changes when a multimodal agent moves from computer-use to robot-use? We introduce PAPAV, a unified capability-centric framework of five recurring functions: Perceive the current state, Anticipate action effects, Plan a feasible course, Act through an interface or body, and Verify the outcome. Defined by function rather than architecture, these capabilities let PAPAV identify what all three share and then compare MMEAs with MMAs and with RSs. Five physical constraints, from partial observability to unverifiable outcomes, leave fewer choices fixed in advance and less room to reverse errors. Across 64 benchmarks, explicit evaluation centers on Act; only 5 assess Anticipate and 3 assess Verify, leaving both largely hidden behind task success. These constraints also frame the open challenges we identify. PAPAV therefore provides a common basis for designing reliable physical agents and measuring progress across all five capabilities rather than task success alone.
6. 【2610.30097】AtomicRL: Atomic Reinforcement Learning for Long-Horizon Robotic Manipulation
链接:https://arxiv.org/abs/2610.30097
作者:Likui Zhang,Zhe Zhu,Zhihao Zhan,Yibo Bai,Hanlin Wang,Dongwei Li,Bin Wang,Tianle Zhang,Xiaodan Liang,Liang Lin
类目:Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词:complex long-horizon skills, models have shown, master complex long-horizon, shown promise, promise in robotic
备注:
点击查看摘要
Abstract:Vision-language-action (VLA) models have shown promise in robotic manipulation, but imitation learning (IL) alone often struggles to master complex long-horizon skills. Reinforcement learning (RL) offers an effective avenue for further improving VLA policies. However, existing VLA-RL methods typically suffer from delayed and biased credit assignment due to trajectory-level sparse rewards, while imbalanced subtask mastery creates bottlenecks that limit overall performance. To address these challenges, we propose AtomicRL, an RL post-training framework that leverages atomic task structures for reliable credit assignment and adaptive exploration. AtomicRL introduces Semantic-Aware Policy Optimization (SAPO), which uses semantic-aware gating to constrain TD residuals from failed atomic subtasks from propagating across task boundaries, mitigating credit contamination while preserving intra-subtask credit assignment and value bootstrapping. In addition, Bottleneck-Adaptive Target Exploration (BATE) dynamically coordinates task sampling and local exploration incentives based on the mastery of individual atomic subtasks, directing learning toward the remaining bottlenecks. Finally, we develop a Real2Sim2Real pipeline that bridges online RL in simulation with real-world deployment, facilitating practical transfer to physical robots. On LIBERO-LONG, AtomicRL achieves absolute performance gains of 3.6% and 4.0% over PPO across two VLA architectures. On CALVIN ABC-D, it improves full-task performance by up to 9.5% over PPO. Combined with the Real2Sim2Real pipeline, AtomicRL further improves real-world task performance by an average of 21.3%. These results demonstrate that AtomicRL effectively improves the learning efficiency and manipulation performance of VLA policies on long-horizon tasks.
7. 【2610.30089】ProactEgoMem: Benchmarking Proactive Memory in Streaming Egocentric Video
链接:https://arxiv.org/abs/2610.30089
作者:Ruotong Liao,Meikel Kokowski,Xiaoxiao Sun,Yongqin Xian,Laura Bravo Sánchez,Shiye Su,Federico Tombari,Serena Yeung-Levy,Volker Tresp
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:Today multimodal assistants, visual evidence presented, typically prompted, prompted to interpret, evidence presented
备注: 30 pages, 22 figures, Project Page: [this https URL](https://proactegomem.github.io/)
点击查看摘要
Abstract:Today's multimodal assistants are typically prompted to interpret the visual evidence presented to them. To offload the cognitive burden of remembering across long horizons, wearable assistants should instead proactively acquire and maintain useful memory as the user's surroundings evolve. Doing so on the user's behalf requires identifying what matters, understanding the scene in real time, and initiating memory maintenance in the background while the user stays focused on their activities. We introduce ProactEgoMem, a benchmark that evaluates proactive memory in streaming egocentric video. Three tasks ground the evaluation in ambient environmental needs: Information Capture (IC) preserves transient yet dense visual information, State Tracking (ST) follows changing object states, and Location Tracking (LT) records object movements. The benchmark defines its protocol at two levels of proactiveness: the Notification Level asks for a single timely notification that satisfies the user's intent, while the deeper Intervention Level asks the agent to maintain memory on the user's behalf through an active start-to-stop tool lifecycle. Parallel ProactEgoMem-Daily and ProactEgoMem-Sci tracks contain 300/100 clips covering daily and scientific use cases, paired with 1000/500 questions in ProactEgoMem-QA, which measures the quality of the proactively acquired memory. Across proprietary, open-source, video-language, and streaming baselines, even the strongest models fail to capture memory both timely and accurately. ProactEgoMem provides a rigorous evaluation foundation for proactive multimodal assistance and for video agents that co-exist with their users.
8. 【2610.30036】Attn-Forcing: Learning Full-Context Attention Proxies for Streaming Video Generation
链接:https://arxiv.org/abs/2610.30036
作者:Junyao Gao,Sibo Liu,Jiaxing Li,Yanan Sun,Hanxin Zhu,Weidong Zhang,Jun Zhang,Cairong Zhao
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:streaming video generation, incurring prohibitive memory, length significantly improves, context length significantly, improves streaming video
备注: 16 pages,6 figures
点击查看摘要
Abstract:Increasing the attention context length significantly improves streaming video generation quality, while incurring prohibitive memory and computational costs as the context grows. Existing methods attempt to capture this contextual information through attention selection or compression, but remain limited by bounded representations and lack explicit attention-level supervision to retain historical contributions to current queries. To address this, we introduce Attn-Forcing, a novel framework that preserves full-context attention contributions for streaming video generation under bounded memory and computation. We achieve this by introducing attention proxies that continuously approximate the attention responses induced by the historical context. Specifically, we implement the proxies as learnable visual latents and employ a Proxy Update Module to incorporate visual context from historical latents. Moreover, we propose an Attention Matching Loss to explicitly constrain the attention behavior of the learned proxies using full-context attention supervision. Extensive qualitative and quantitative experiments demonstrate that Attn-Forcing consistently improves streaming video generation quality and achieves state-of-the-art performance over existing baseline methods.
9. 【2610.30035】Plausible but Unimplantable: A Trustworthiness Audit of Shape Completion Foundation Models for Cranial Defect Reconstruction
链接:https://arxiv.org/abs/2610.30035
作者:Marek Wodzinski,Kamil Kwarciak,Daria Hemmerling,Mateusz Daniol
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:CAD by specialists, hand in CAD, shape completion, shape completion foundation, completion foundation models
备注: ACCV 2026 TrustFMI accepted
点击查看摘要
Abstract:A patient who has lost part of the skull vault needs an implant that fits the defect exactly, and such implants are still drawn by hand in CAD by specialists, which makes each case slow and expensive. The task can be considered as a shape completion problem, so pretrained completion models, and now the first shape completion foundation models, look like a way to remove that manual step. We audited three publicly released pretrained shape completion models, two of them foundation models, applied zero-shot to 239 cranial defects, some carved from public skull datasets and some real post-craniectomy cases. Each output was compared with simply returning the patient's own remaining bone, and tested for whether the predicted material could be placed without intersecting the bone that is still there. On the 210 carved defects none of the three improved on doing nothing, and on the 29 real cases only one did so beyond chance. Yet not one output, from any model in any configuration, was implantable: none managed both to stay clear of the bone the patient still has and to place more material than doing nothing, where a task-specific volumetric model, trained for this task and selected on these cases, was implantable on all but one. The output that most convincingly resembles a skull is no more placeable than the rest, and at these point densities implant thickness cannot be read off the emitted points at all, which is a property of the output representation rather than of any one model. On this evidence the shape completion foundation models we could obtain cannot be trusted and, used as released, are not usable in clinical practice. Substantial research towards trustworthy foundation models for shape completion is still needed.
10. 【2610.30023】RealMe: Immersive Volumetric Video from Minimal Captures
链接:https://arxiv.org/abs/2610.30023
作者:Chenxu Zhou,Zhiyuan Yu,Yudong Jin,Yinji Shentu,Yu Zhang,Jiaming Sun,Xiaowei Zhou
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:low-resolution capture resources, paper addresses, addresses the problem, problem of creating, sparse and low-resolution
备注: 19 pages, 11 figures, including supplementary material. To appear in SIGGRAPH Asia 2026 Conference Papers. Project page: [this https URL](https://zju3dv.github.io/realme)
点击查看摘要
Abstract:This paper addresses the problem of creating immersive volumetric videos from sparse and low-resolution capture resources. Conventional dense multi-view reconstruction methods can produce high-quality volumetric videos, but their reliance on costly capture setups makes them impractical in real-world scenarios. Recent approaches use generative models to relax capture requirements, but still suffer from limited resolution and 4D inconsistency. To overcome these constraints, we propose RealMe, a unified framework built around a high-resolution video diffusion model that enhances limited captures into high-resolution (2K), 4D-consistent videos for volumetric video reconstruction. Specifically, RealMe constructs auxiliary data from capture videos and encodes them into latents along with layout-aware positional embeddings. The video diffusion model adapts factorized spatio-temporal attention to the multi-view capture layout, denoises these latents across viewpoints and time, and decodes them into enhanced videos to refine the 4D representation. This adaptation helps the model capture temporal dynamics and multi-view relationships, leading to more 4D-consistent generation. To reduce the data gap between generated videos and real captures, we apply a latent frequency loss that provides frequency-domain supervision in latent space. Extensive experiments on the public DNA-Rendering benchmark and our self-captured RealVV dataset demonstrate that RealMe is able to create immersive volumetric videos and outperforms state-of-the-art methods in visual fidelity and 4D consistency.
11. 【2610.30013】ClunoGS: Compact Language 3D Gaussian Splatting via Unified Optimization
链接:https://arxiv.org/abs/2610.30013
作者:Jian Xu,Yi Li,Ying Huang,Siyi Wu,Bingzhe Li,Yuede Ji,Miao Yin
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:Gaussian Splatting enables, Splatting enables open-vocabulary, Splatting enables, associating Gaussian primitives, Gaussian Splatting
备注:
点击查看摘要
Abstract:Language 3D Gaussian Splatting enables open-vocabulary scene understanding by associating Gaussian primitives with language features. These semantic attributes increase model storage, while most existing 3DGS compression methods are designed mainly to preserve RGB rendering quality. One straightforward approach is to apply sparsification and quantization sequentially. However, pruning based only on rendering quality can remove Gaussians that have small RGB contributions but are important for semantic prediction. Once removed, their semantic information cannot be recovered by later quantization. We propose ClunoGS, a compact framework for Language 3DGS that combines semantics-aware Gaussian sparsification and vector quantization in a unified constrained objective. Semantic supervision is used during sparsification, and the objective jointly considers rendering quality, semantic accuracy, and compactness. We optimize the unified objective with alternating primal, sparsification, quantization, and dual updates. We evaluate ClunoGS on open-vocabulary localization and segmentation using the LERF and ScanNet-10 benchmarks. Under aggressive compression, our unified, semantics-aware formulation substantially alleviates the degradation of semantic representations caused by sequential compression and semantics-agnostic Gaussian sparsification. Ablations further show that jointly coordinating sparsification and quantization better preserves semantic accuracy than applying them independently.
12. 【2610.30007】Multiclass Boundary Refinement with Neural Cellular Automata for Remote Sensing Land Cover Segmentation
链接:https://arxiv.org/abs/2610.30007
作者:Pascoassis Souza Santos Meira,Gilson Antonio Giraldi,Rafael Duarte Coelho dos Santos
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:remote sensing imagery, thin band measured, Boundary Refinement Neural, Neural Cellular Automaton, Refinement Neural Cellular
备注:
点击查看摘要
Abstract:Semantic segmentation of remote sensing imagery often places class boundaries a few pixels away from where they truly lie, and this position error is concentrated in the thin band measured by Boundary IoU (BIoU). We treat boundary refinement as the iterated application of a small learned local rule: the Boundary Refinement Neural Cellular Automaton (BRNCA), that starts from the class probabilities of a frozen, pre-trained segmenter and corrects them cell by cell. We generalise the binary rNCA to the multiclass case by keeping the visible channels on the probability simplex through an Aitchison (log-space) update and by adding free hidden channels. The best configuration improves the mean BIoU over the base segmenter by 2.36 points (from 46.63 to 48.99). The gain is concentrated on the irregular woodland class (+8.5 points BIoU); this suggests that position error is correlated with the fractal dimension of the class boundaries.
13. 【2610.29997】DONIC: Generalist Dexterous Bimanual Tracking Control from Human Demonstrations
链接:https://arxiv.org/abs/2610.29997
作者:Mingze Sun,Ziang Cao,Yuan Fei,Qiankuan Tao,Zihan Wang,Tianqi Liu,Junhao Chen,Haiwen Diao,Fangzhou Hong,Zhaoxi Chen,Ziwei Liu
类目:Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词:existing models focus, real life unaddressed, dexterous behaviors common, models focus primarily, bimanual dexterous behaviors
备注:
点击查看摘要
Abstract:Despite recent progress in dexterous reference tracking, existing models focus primarily on single-hand manipulation and a limited range of interactions, leaving the bimanual dexterous behaviors common in real life unaddressed. The scarcity of contact-rich bimanual manipulation data and the increased complexity of coordinating contacts make developing a generalist bimanual tracker particularly challenging. Therefore, we present 1) DONIC, the first generalist bimanual tracker jointly trained across operation categories and human-motion sources, together with 2) BiHOI, a multi-view dataset of 1,575 sequences spanning 229 objects and emphasizing sustained bimanual interaction, where reconstructed interactions are retargeted into robot references. DONIC combines proximal policy optimization with behavioral cloning in a feedback loop that recycles verified successful executions into training demonstrations. An object-centered per-hand reward maintains object-motion feedback while supervising each hand according to its reference contact role. Clip-Centered Advantages remove reference-dependent advantage offsets while preserving within-trajectory differences. Together, these designs enable one single policy to learn coordinated manipulation across heterogeneous references. Without finetuning, a single checkpoint achieves 86.79% success on unseen trajectories of training objects and 57.32% on held-out objects, surpassing the state-of-the-art bimanual tracking baselines by 77.36 and 45.73 percentage points.
14. 【2610.29989】Looking Ahead: Modeling Future Evolution in Autoregressive Video Generation
链接:https://arxiv.org/abs/2610.29989
作者:Ruopeng Gao,Yukun Huang,Jiarui Hu,Shuai Wang,Wenbo Hu,Ying Shan,Limin Wang
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:producing plausible continuations, diffusion models generate, scenes evolve, Future Chunk Prediction, producing plausible
备注: Project page: [this https URL](https://hellorpg.github.io/looking-ahead/)
点击查看摘要
Abstract:Autoregressive video diffusion models generate videos chunk by chunk, yet producing plausible continuations does not guarantee that they capture how scenes evolve. Under teacher forcing, strong temporal redundancy may allow local visual continuity to serve as a shortcut for current-chunk denoising, reducing the pressure to model visual evolution. We introduce Future Chunk Prediction (FCP), an auxiliary objective jointly optimized with teacher-forced denoising that predicts temporally separated chunks without access to the intervening visual context. Drawing supervision directly from training videos, FCP requires no additional pretrained visual encoder and leaves autoregressive inference unchanged. Our method achieves superior physical plausibility over standard teacher-forced autoregressive training with a lower overall training compute budget, highlighting the effectiveness and efficiency of future-chunk supervision for modeling visual evolution. Intriguingly, our visualizations suggest that FCP fosters a more structured representation space, which may be valuable for building autoregressive world models.
15. 【2610.29959】raining-free Acceleration for Blind Compressed Image Restoration via Activation-Calibrated Singular Value Decomposition
链接:https://arxiv.org/abs/2610.29959
作者:Suhang Yao,Xin Li,Xijun Wang,Yufei Wang,Yeying Jin,Zhibo Chen
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:Transformer-based models achieve, make deployment costly, achieve strong performance, operators make deployment, models achieve strong
备注: 12 pages. Accepted for publication in IEEE Journal on Emerging and Selected Topics in Circuits and Systems
点击查看摘要
Abstract:Transformer-based models achieve strong performance on blind compressed image restoration (CIR) under unknown compression settings, but their densely stacked projection operators make deployment costly. We study training-free acceleration for such models through an empirical, operator-level analysis. Specifically, we profile where computation is concentrated, characterize channel-wise activation distributions under compressed inputs, and examine the singular-value decay of representative projection weights. These measurements identify the recurring projections in the attention, feed-forward, convolutional, and prompt-conditioning pathways as effective low-rank replacement targets that preserve the original inference graph. They further establish truncated SVD (TSVD) as a principled training-free baseline for blind CIR and reveal why a uniform low-rank objective is mismatched to the channel-imbalanced feature distributions of compressed images. Accordingly, we formulate Activation-Calibrated Singular Value Decomposition (ASVD) for this restoration setting, deriving low-rank factors entirely offline from pretrained weights and lightweight activation statistics gathered from only a few compressed calibration images. By weighting the decomposition with channel-wise activation magnitudes, our ASVD assigns larger penalties to errors on more active channels, requiring neither retraining nor online calibration and leaving the restoration pipeline intact. When instantiated on PromptCIR at rank 64, ASVD consistently improves PSNR-B over TSVD across four standard benchmarks under identical parameter and MAC budgets. At this operating point, the factorized model cuts parameters by 59% (34.75M to 14.34M) and computation by 16.1% (258.79 to 217.16 GMACs for a 256 x 256 input), enabling acceleration without retraining.
16. 【2610.29936】DewHand: Direct Metric World-Space Hand Motion Reconstruction from Egocentric Videos
链接:https://arxiv.org/abs/2610.29936
作者:Naru Suzuki,Satoshi Ikehata,Takehiko Ohkawa,Yoichi Sato,Shuhei Kurita
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:Recovering metric world-space, egocentric video supports, video supports understanding, supports understanding human, understanding human interactions
备注: Project page: [this https URL](https://narusuzuki.github.io/projects/26-dewhand/)
点击查看摘要
Abstract:Recovering metric world-space hand motion from egocentric video supports understanding human interactions and transferring them to embodied agents. Three challenges complicate this task: multi-stage pipelines propagate errors from independently estimated hand and camera motion; monocular observations leave physical scale ambiguous; and occlusion and out-of-view hands admit multiple plausible motion trajectories. We present DewHand, a unified model for direct joint reconstruction of world-space hand and camera motion. To avoid compounding errors from multi-stage estimation, DewHand jointly predicts hand and camera motion in a shared world coordinate system within a single-stage pipeline. To resolve metric-scale ambiguity, it combines scene-level geometric features from VGGT-$\Omega$ with metric-space supervision, while hand-specific features preserve fine-grained articulation. To handle occlusion and out-of-view hands, we formulate reconstruction as conditional motion generation with flow matching. Under the same architecture, this generative formulation outperforms direct regression in both accuracy and temporal smoothness with only two sampling steps. Experiments on HOT3D and ARCTIC demonstrate improved world-space accuracy and temporal consistency over state-of-the-art methods. DewHand reduces rigid-aligned world-space error relative to StableHand from 32.9 to 28.4 mm on HOT3D and from 76.2 to 36.2 mm on ARCTIC. It also recovers camera scale within 10% on two thirds of HOT3D clips, versus about a quarter for SLAM. Moreover, in zero-shot evaluations on HoloAssist, H2O, and TACO, captured with different devices, DewHand achieves the lowest rigid-aligned world-space error (WA-MPJPE) on each dataset.
17. 【2610.29915】CausalAlign: Causal Alignment of Video Generation Models for Consistent Ego-Motion
链接:https://arxiv.org/abs/2610.29915
作者:Kai Zhu,Yintianrun Zhang,Shuwei Jiang,Ruolin Zuo,Yixin Chen,Duomin Wang,Miao Liu,Yin Li,Daquan Zhou,Yiwu Zhong
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:visually plausible videos, produce visually plausible, Diffusion-based video generation, video generation models, video generation
备注:
点击查看摘要
Abstract:Diffusion-based video generation models (VGMs) can produce visually plausible videos, yet their camera ego-motion often drifts over long horizons. Camera ego-motion determines how the viewpoint changes between frames and is essential for maintaining consistent geometry and trajectories. To address this problem, we propose CausalAlign, a causal alignment framework with two components. First, we diagnose how precise ego motion is represented, used, and retained within VGMs using linear probes and causal interventions, revealing a rise-and-fall pattern during denoising. Second, we strengthen ego-motion state in VGM by aligning the representations at the identified layers to a 3D foundation model through delta-token space. This space encodes the changes between consecutive frames, allowing the alignment to focus on ego-motion dynamics rather than static scene content. With Wan2.2 fine-tuned on DL3DV and RealEstate10K, CausalAlign can largely improve motion accuracy, geometric consistency, and temporal smoothness, while preserving visual quality. For example, it improves geometric consistency by more than 20% relative to the base model. Moreover, with the fine-tuned VGM, CausalAlign improves the success rate of world action models (WAMs) by 10 points on mobile manipulation tasks of RoboCasa365 benchmark. Overall, CausalAlign improves ego-motion consistency in diffusion-based VGMs and yields noticeable gains in embodied models.
18. 【2610.29913】Asking a Multimodal LLM Whether Someone Fell: Zero-Shot Screening of Low-Resolution Thermal Video in a Laboratory and an Occupied Home
链接:https://arxiv.org/abs/2610.29913
作者:Marcos Junca(Senecta Inc.),Mauro Junca(Senecta Inc.)
类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词:multimodal large language, production multimodal LLM, large language models, short thermal clip, older people living
备注: 13 pages, 6 figures. Data: [this https URL](https://senecta.ai/research/thermal-fall-llm-data.zip)
点击查看摘要
Abstract:Thermal cameras can watch over older people living alone without capturing faces, and multimodal large language models (LLMs) can judge a short video without task-specific training. We evaluate a production multimodal LLM, Gemini 3.8 Flash at temperature 0, as the decision stage of an event-triggered fall screener, used exactly as a deployed prototype uses it: one request per short thermal clip, with its sound track when there is one, and its predecessor Gemini 3.7 Flash on the same requests. On 438 staged falls and 563 non-fall windows that we located by hand in a public 32x24 thermal dataset, the deployed request called 69% of the held-out subjects' falls (67% over all subjects; bed falls excluded) and none of 499 non-fall windows, including people lying on the floor and getting up. Over 76 h of ordinary life in an occupied room, recorded at 160x120 with sound, it called none of 395 clips a fall (95% upper bound 1.2 false alarms per day) and caught 4 of the 9 staged falls the camera could see. One cautionary sentence in the prompt ("a person who goes out of view ... is not a fall") accounted for many of the misses: removing it raised sensitivity on the held-out subjects from 69% to 83% on 3.8 Flash and from 80% to 92% on Gemini 3.7 Flash, and in the home from 4 to 9 of the 9 visible falls, with no false call in ordinary living but at the price of calling deliberate lie-downs a fall. Sensitivity collapsed at 8x6 pixels (34%); identical requests disagreed on 4% of windows; and when the model called a fall, its explanation placed it within a second of the annotated landing 99% of the time. Two conventional detectors trained on the laboratory data caught nearly every held-out laboratory fall but raised 14.2 and 23.9 false alarms per day in the home. We release the frame-level fall annotations of the public dataset and every model answer on it.
19. 【2610.29905】ViBMR: A Large-Scale Multi-Sequence Brain MRI Dataset and Comprehensive Evaluation for Vietnamese Radiology Report Generation
链接:https://arxiv.org/abs/2610.29905
作者:Dai Lam Le,Minh Khoi Nguyen,Son Dinh Nguyen,Amir Reza Jafari,Viet Ha,Nguyen Son,Reza Farahbakhsh,Noel Crespi,Phi Le Nguyen
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:Automated radiology report, alleviating radiologists' workload, complementary diagnostic information, MRI holds strong, holds strong promise
备注: Accepted at IEEE/CVF Winter Conference on Applications of Computer Vision (WACV 2027)
点击查看摘要
Abstract:Automated radiology report generation for multi-sequence brain MRI holds strong promise for alleviating radiologists' workload, yet it remains a demanding problem: brain MRI studies are inherently volumetric, each pulse sequence carries complementary diagnostic information, and annotated data are critically scarce for low-resource clinical languages. Existing brain MRI-report resources are still dominated by English reports, translated clinical text, or datasets adapted from task-specific imaging benchmarks, leaving routine low-resource clinical reporting and heterogeneous multi-sequence MRI protocols insufficiently represented. To bridge this gap, we introduce ViBMR, to the best of our knowledge, the first large-scale multi-sequence brain MRI dataset paired with routine Vietnamese clinical reports, comprising 3,649 patients and 11,875 MRI series across T1, T2, FLAIR, and contrast-enhanced T1 sequences. Building on ViBMR, we establish a comprehensive evaluation setup for brain MRI report generation, covering representative medical vision-language models, multi-sequence inputs, and feature aggregation strategies. The results provide key insights into dataset characteristics and model behavior, while demonstrating the necessity of native low-resource clinical datasets for reliable Vietnamese-origin brain MRI report generation. Our dataset and baseline models will be released for non-commercial research.
20. 【2610.29881】Expandable Modality Experts for Medical Vision-Language Learning
链接:https://arxiv.org/abs/2610.29881
作者:DM BAPPY,Eunsu Kim,Hanjoo Lee,Sung Hak Lee,Sangjeong Ahn
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:medical imaging modalities, accommodating new domains, domains while retaining, medical imaging, imaging modalities requires
备注: 11 pages (main text), 42 pages (supplementary material), 2 main figures. Submitted to ICLR 2027
点击查看摘要
Abstract:Learning across medical imaging modalities requires making use of images without paired text and accommodating new domains while retaining existing representations. We propose a medical vision-language technique built around an expandable bank of modality experts. Its Multiway Transformer combines shared visual computation with deterministically routed feed-forward experts and a separate text pathway. A modality-aware visual tokenizer supplies targets for masked pretraining on 19.4 million unpaired image rows across seven modalities; contrastive alignment then uses 3.23 million image-text pairs. Additional fundus and optical coherence tomography experts learn from paired data while the original image and text embedding paths remain frozen. With a ViT-Large backbone, the proposed technique achieves the best or tied-best result in 24 of 25 benchmark settings across nine modalities: 10 of 11 zero-shot classification benchmarks, all 10 linear probes, and all four retrieval benchmarks. Mean balanced accuracy is 0.674 for zero-shot classification and 0.856 for linear probing, and mean bidirectional retrieval recall is 20.70%. A separate three-seed sequential experiment with matched adaptation data yields fundus and OCT retrieval gains of 14.95 and 9.31 percentage points, with no measured loss on preceding fundus or pathology tasks. The preservation argument requires unchanged existing computation paths and inference conditions, and feature-identity checks verify retention on evaluated inputs. The proposed technique provides a modular approach to learning and expanding medical vision-language representations.
21. 【2610.29875】Stochastic Nonlinearities Improve Uncertainty Estimation
链接:https://arxiv.org/abs/2610.29875
作者:Mohammad Sarhangzadeh,Amirreza M. Shebly,Doruk Oner
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:Reliable uncertainty estimation, Reliable uncertainty, providing information, confidence and reliability, uncertainty estimation
备注: Accepted to the British Machine Vision Conference (BMVC) 2026. 33 pages, including supplementary material
点击查看摘要
Abstract:Reliable uncertainty estimation is important across visual recognition tasks, providing information about the confidence and reliability of model predictions. Many uncertainty estimation methods obtain predictive diversity through mechanisms that can suppress intermediate features, perturb the input, or require substantial additional computation. Stochastic activation functions, where network units randomly select between multiple nonlinearities during a forward pass, have previously been used to improve optimization behavior, mitigate limitations of fixed ReLU activations, and increase output diversity. In this work, we reframe stochastic activation switching as a lightweight mechanism for uncertainty estimation. The proposed method samples between nonlinear activation functions, inducing predictive diversity while keeping intermediate feature pathways active. This enables uncertainty estimation from a single trained model without the training cost of ensembles, task-specific uncertainty heads, or architectural redesign. We evaluate the proposed approach across classification, semantic segmentation, and out-of-distribution detection using convolutional and transformer-based architectures on diverse datasets. Across these settings, stochastic activation switching improves uncertainty quality while preserving competitive primary-task performance, showing that stochastic nonlinearities provide an effective and information-preserving source of predictive variation for visual recognition.
22. 【2610.29866】GeoMem-VLA: Internalizing 3D Scene Understanding into Temporal Memory for Vision-Language-Action Models
链接:https://arxiv.org/abs/2610.29866
作者:Qinfan Zhang,Yifan Luo,Haoyuan Shi,Guanlin Liu,Han Dong,Haozhe Shan,Yong Dai,Xiangcong Ren,Xiaozhu Ju
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:structure is essential, essential for robotic, robotic manipulation, Geometric structure, VLA models rely
备注:
点击查看摘要
Abstract:Geometric structure is essential for robotic manipulation and understanding the 3D world. Most VLA models rely on 2D representations of current observations, while geometry-aware approaches often require additional 3D information. However, geometry inferred independently from individual observations is often discarded rather than accumulated into a persistent task representation. Our key insight is that action generation needs a compact, task-relevant geometric abstraction that can be continuously updated, rather than a complete, renderable 3D reconstruction at every step. We introduce GeoMem-VLA, a VLA framework that internalizes explicit 3D supervision into dedicated geometric tokens and maintains them as temporal memory for action generation, without directly aligning the VLM's native visual embeddings with the teacher feature space. During training, a frozen geometry foundation model supervises learnable GeoPlan tokens through a geometric flow-matching objective over the current scene point map and future end-effector tracks. These tokens are integrated with the memory of observation representations, where historical information is retrieved, adaptively fused with current observations, and consolidated to retain event frames as the task progresses. At inference, the policy retrieves historical representations and fuses them with the current working representation to predict actions, without invoking the 3D teacher or explicitly reconstructing the scene. After benchmark-specific downstream adaptation, GeoMem-VLA achieves 98.9% average success on LIBERO and 91.10% / 91.24% on RoboTwin's clean/randomized settings. Across five real-world tasks, GeoMem-VLA achieves 78.0% average success. These results suggest that internalizing and remembering 3D scene understanding is a promising approach to robot control.
23. 【2610.29854】How Do DiTs Denoise? An Aggregator-Predictor View of Attention and MLPs
链接:https://arxiv.org/abs/2610.29854
作者:Gyeonghun Kang,William Xingxu Chen,Xiang Cheng
类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)
关键词:represent image content, content and learn, learn rules, rules for reusing, Gaussian Markov random
备注:
点击查看摘要
Abstract:How do diffusion transformers (DiTs) represent image content and learn rules for reusing it to generalize? We develop an aggregator--predictor view of DiTs as input-adaptive local denoisers, in which context aggregation and patch prediction provide functional roles for interpreting attention and MLPs. We first establish that, for Gaussian Markov random field (GMRF) priors, the global Bayes denoiser can be approximated using only a subset of context patches, with error decaying exponentially in context radius. We further show that patchwise linear denoisers, often invoked to explain diffusion generalization, recover the empirical local denoiser with sufficiently informative aggregation. Within this view, AdaLN-modulated attention naturally parameterizes an input- and noise-dependent aggregator, while the MLP admits a learned key--value representation for tokenwise patch prediction. Our experiments support this view. DiTs trained on real images exhibit noise-dependent denoising contexts resembling those in the analytic GMRF setting, while attention mass exhibits a qualitatively corresponding broadening pattern. In a controlled CelebA64 study, shared-memory patch predictors used in place of DiT MLPs achieve competitive denoising and generative performance. Finally, cross-dataset component transplantation reveals compatibility patterns consistent with the proposed roles of QK in spatial weighting, VO in feature transport, and MLPs in patch prediction. Together, these results provide a component-level account of DiT denoising and motivate architecture-specific fine-tuning and controlled intervention.
24. 【2610.29830】Revealing Hidden Failure Modes in Chest X-ray Classification via Spectral Domain Analysis
链接:https://arxiv.org/abs/2610.29830
作者:Samuel Halimi,Loic Themyr,Arnaud Abreu
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:chest X-ray anomaly, X-ray anomaly detection, subtle distributional shifts, Deep learning models, anomaly detection remain
备注: MIDL 2026 [this https URL](https://proceedings.mlr.press/v315/halimi26a.html)
点击查看摘要
Abstract:Deep learning models for chest X-ray anomaly detection remain vulnerable to subtle distributional shifts (e.g., acquisition technique, patient-related factors, and preprocessing). Traditional error analysis often relies on semantic metadata or model embeddings, which can mask low-level signal variations that degrade performance. In this work, we propose a data-centric framework for automated failure mode discovery using spectral analysis. We project images into the frequency domain and extract a compact profile summarizing the distribution of signal energy across frequency bands. By performing unsupervised clustering on these spectral profiles, we demonstrate that model failures are not randomly distributed, but are strongly concentrated within specific spectral clusters. This method effectively isolates "blind spots", enabling the prediction of model reliability and the discovery of performance-degrading data slices without requiring ground-truth failure annotations.
25. 【2610.29828】Early versus Late RGB-Infrared Fusion for Counter-UAV Detection: A Comparative Study
链接:https://arxiv.org/abs/2610.29828
作者:Alberto De Zan,Denis Tavaris,Gian Luca Foresti,Ivan Scagnetto
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:weather conditions, improve accuracy, accuracy and precision, precision in harsh, UAV detection
备注: This version differs from the article published in IEEE Access. It includes revisions requested by the reviewers during the final review round that could not be incorporated into the published version
点击查看摘要
Abstract:This paper presents a novel strategy for UAV detection through visible (RGB) and infrared (IR) fusion, in order to improve accuracy and precision in harsh environments and weather conditions. In this research, two opposite approaches have been studied and implemented: the first concerns image-level (early) fusion, which merges two different spectra into a single image to which one detector is applied. On the other hand, the second approach, called decision-level (late) fusion, focuses on blending together the output bounding boxes of two different detection pipelines, aiming to create a common result that can be applied to both spectra simultaneously. Both strategies have been extensively tested in a dedicated environment, which included alternating low and high brightness scenes, different backgrounds (sky and ground), distances (5, 25 and 60 m), altitudes and zoom levels (1X, 2X and 4X). These tests allowed for the assessment of actual detection capabilities and system reliability in real-world applications. Furthermore, the two fusion strategies were evaluated and compared over a set of aligned images in order to highlight the better approach of the two. The results indicate that early fusion achieves better raw performance, since it incorporates the thermal information from the beginning of the training process. However, late fusion presents an innovative and useful detection workflow that can be applied in cases of sensor or frame misalignment. Both positive and negative aspects have also been pointed out and discussed, in order to give a more comprehensive overview. Finally, the paper outlines implementation considerations and practical recommendations based on operational priorities. Overall, the findings contribute to the research in RGB-IR fusion modalities, with the goal of enhancing UAV detection capabilities.
26. 【2610.29825】GuidedSAM-Plume: An Expert-Guided Segmentation Framework for Volcanic Plumes
链接:https://arxiv.org/abs/2610.29825
作者:Taddeo D'Adamo(LIRIS, imagine),Simon Thivet(UNIGE),Catherine Pothier(LIRIS, imagine),Riccardo Simionato(UNIGE),Allan Fries(UNIGE),Jonathan Lemus(UNIGE),Costanza Bonadonna(UNIGE),Laure Tougne Rodet(LIRIS, imagine),Bertrand Kerautret(LIRIS, imagine)
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:Quantitative analysis, phenomena increasingly relies, image-based measurements, increasingly relies, relies on image-based
备注:
点击查看摘要
Abstract:Quantitative analysis of environmental phenomena increasingly relies on image-based measurements. In volcanology, the geometric characterization of volcanic plumes and clouds from RGB images remains hindered by the scarcity of dedicated segmentation solutions and partially handcrafted annotations remain widely prevalent. We present GuidedSAM-Plume, an open-source expert-guided framework tailored for the interactive segmentation of volcanic plumes and clouds. It leverages the zero-shot, spatial prompt-based capabilities of SAM2. The framework was thoroughly validated on a challenging dataset through dedicated segmentation metrics and field-relevant volcanological descriptors. From minimal user inputs, it is able to significantly increase performance compared to fully automatic dedicated solutions while preserving the reliability of derived volcanological parameters. The absence of retraining requirements lowers adoption barriers within the volcanological community, and the framework's demonstrated suitability for complex, diffuse plume-shaped phenomena extends its applicability to broader environmental science domains. The re-annotated dataset, produced under the guidance of expert volcanologists within the proposed framework, ultimately yields a more standardized release. The framework and accompanying dataset are made available at this https URL.
27. 【2610.29811】Compositionality with Primitives: A Unified View from Euclidean to Hyperbolic Vision-Language Models
链接:https://arxiv.org/abs/2610.29811
作者:Puru Vaish,Meelad Dashti,Christoph Brune,Pascal Mettes,Tatiana Tommasi,Nicola Strisciuglio
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:previously observed objects, Compositional zero-shot learning, zero-shot learning, aims to recognize, objects and attributes
备注: Accepted at WACV 2027 Main Conference, 17 pages, 6 figures, 8 tables
点击查看摘要
Abstract:Compositional zero-shot learning (CZSL) aims to recognize novel combinations of previously observed objects and attributes. Prior work showed that large-scale vision-language models encode decomposable semantic structures that can be recomposed to enable generalization. The Geodesically Decomposable Embeddings (GDE) framework formalizes this by identifying directions in the tangent space at the Frechet mean of the embedding distribution, which encode primitive visual concepts. Unseen attribute-object compositions can be synthesized through vector addition of these primitives. We revisit the assumption that compositional generalization requires explicit attribute-object pair re-composition. By means of new compositional scoring functions and extensive evaluations, we show that directly using the decomposed primitives suffices for recognizing unseen compositions. In that, we gain insights on how the geometry of the embedding manifold (Euclidean, spherical, or hyperbolic) and dataset structure affect compositional reasoning. Across models (CLIP, DINOv2, MERU, HyCoCLIP), we show that compositional structure consistently emerges as primitive representations, enabling inference on CZSL benchmarks (MIT-States, VAW-CZSL, UT-Zappos50K, Clothing16K) and group robustness on Waterbirds and CelebA. Code: this https URL.
28. 【2610.29788】Open-Vocabulary Models and Label Propagation for Uncertainty-aware Pseudo-Labeling of Object Detection Datasets
链接:https://arxiv.org/abs/2610.29788
作者:Jonathan Klees,Timo Heller,Matthias Rottmann
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:require substantial manual, manual annotation effort, substantial manual annotation, rely on large-scale, require substantial
备注:
点击查看摘要
Abstract:Object detection models rely on large-scale annotated datasets that require substantial manual annotation effort. The labeling costs further increase when annotation uncertainty is captured through soft labels, as multiple annotations must be collected for each object. We address this challenge by introducing a semi-supervised framework for the uncertainty-aware annotation of object detection datasets. Our approach leverages open-vocabulary object detectors to generate region proposals and semantically meaningful object representations. Based on these representations, we construct an object-level similarity graph and propagate probabilistic label information. Our framework assigns soft labels to previously unlabeled objects, quantifying both aleatoric and epistemic uncertainty. We evaluate our method on four object detection benchmarks with soft-label annotations and demonstrate that high-quality annotations can be obtained with only a small fraction of manually labeled objects. Furthermore, we show that detectors trained on semi-automatically annotated data achieve performance comparable to models trained on fully manually annotated data. We achieve state-of-the-art downstream detection performance for the task of semi-supervised object detection on the COCO dataset, with 40.5% AP virtually matching the performance of the model trained on fully manually constructed data (40.9%) at only 1% of labeling costs. These results highlight the potential of open-vocabulary models and graph-based label propagation for efficient, accurate and uncertainty-aware pseudo-labeling.
29. 【2610.29780】JointLight: Human-Centric Video Relighting with Asynchronous RGB-Irradiance Joint Modeling
链接:https://arxiv.org/abs/2610.29780
作者:Henglei Lv,Bailin Deng,Xiaoqiang Liu,Yichen Wang,Haoxian Zhang,Pengfei Wan,Lin Gao
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:Understanding and modeling, longstanding challenge, modeling light transport, light transport, human-centric scenes
备注:
点击查看摘要
Abstract:Understanding and modeling light transport in human-centric scenes is a longstanding challenge. While recent progress in diffusion models has boosted research in relighting, precise illumination control still lags, primarily due to the scarcity of diverse, high-quality, precisely labeled video relighting datasets. Existing end-to-end relighting approaches model light transport implicitly through neural networks, which substantially complicates controllability. In contrast, some works resort to path-traced irradiance cues as an explicit blueprint for light transport. However, such constructed irradiance cues are prone to artifacts and hinder generative quality when directly used as control signals. With the key observation that noise corruption removes high-frequency artifacts and preserves low-frequency light transport, we introduce an asynchronous joint-modeling paradigm that facilitates fine-grained illumination control. During two-stage training, we force the model to jointly denoise RGB and ground-truth irradiance frames with separate timesteps scheduling. A domain matching strategy is applied to the second stage to bridge the domain gap between irradiance cues and ground-truth irradiance maps. At inference time, we introduce an asynchronous hijacked generation pipeline that facilitates flexible illumination control. For training data, we develop a multi-illumination high-quality synthetic video dataset with paired irradiance maps using a powerful game engine. Trained exclusively on this dataset, our model exhibits robust generalization to real- world scenarios and outperforms prior approaches in both lighting fidelity and generative quality. The code and dataset will be publicly released.
30. 【2610.29777】Key Findings for Small UAS for Post-Disaster Damage Assessment from the CURSE'26 Exercise
链接:https://arxiv.org/abs/2610.29777
作者:Thomas Manzini,Stephen Johnson,Priyankari Perali,David Merrick,Robin Murphy
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:Remote Sensing Cell, Unmanned Remote Sensing, Catastrophic Unmanned Remote, command Remote Sensing, Remote Sensing Exercise
备注: 8 pages, 5 figures, 2 tables
点击查看摘要
Abstract:The CLARKE building and road damage assessment AI classifier was incorporated into the Catastrophic Unmanned Remote Sensing Exercise (CURSE) 2026, which trained 23 small uncrewed aerial systems (sUAS) teams from state and local agencies and non-governmental organizations in Florida and Missouri on how to collect imagery for an incident command Remote Sensing Cell. Although CLARKE has been operationally deployed to two hurricanes (Debby and Helene), CURSE'26 presented an opportunity to evaluate the machine learning model with a larger set of never-before-seen orthomosaics. The results show that building and road damage assessment together ran in 3.5 minutes on average, and that building damage assessment achieved a Micro F1 of 0.834 with no manual adjustments to correct spatial misalignment and delivered that performance in both Florida and Missouri, demonstrating good geographic transfer. It also showed that road damage assessment performed poorly due to sensitivity to misalignment between road maps and the images, and to lighting and environmental conditions in an urban setting. The analysis of CURSE'26 presents five other findings of value to the sUAS community: that the use of sUAS and machine learning is now operationally normalized and accepted, sUAS teams in the field can improve classification accuracy by timing their flights, exercises are good operational tests but their value for evaluating learning models is less clear, edge computing is needed to overcome the wireless upload barrier, and the application of sUAS and AI to disaster response has ethical and legal ramifications for pilots and data managers.
31. 【2610.29768】UniRAP: Towards Unified Part-level Physical Affordance Reasoning and Actionable Perception
链接:https://arxiv.org/abs/2610.29768
作者:Linfei Li,Ruining Hu,Lin Zhang,Zhong Wang,Fengyi Zhang,Ying Shen,Binqiang Wang,Xin Zhang
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:achieved impressive progress, aligning natural language, interaction remains challenging, grounding high-level semantics, remains challenging
备注: Accepted by NeurIPS 2026. Webpage: [this https URL](https://lif314.github.io/projects/unirap)
点击查看摘要
Abstract:Vision-language perception has achieved impressive progress in aligning natural language with visual observations, yet grounding high-level semantics into part-level physical interaction remains challenging. To address this gap, we propose UniRAP, a unified model for inferring part-level physical affordances and mapping language instructions to actionable geometric representations. UniRAP formulates this problem as a conditional multimodal generation task, integrating visual inputs, textual instructions, and optional prompts into a shared spatiotemporal representation space through a unified interface token mechanism. To predict executable contact geometry, we introduce a Unified Affordance Decoder (UAD), which jointly performs object detection, part-level affordance segmentation, and 4-DoF interaction pose estimation by leveraging intermediate segmentation features. In addition, we propose a curriculum-based transfer training strategy that progressively adapts the model from general visual parsing to interaction-aware perception, improving data efficiency under limited textual annotations. Experiments show that UniRAP achieves state-of-the-art performance on referring expression segmentation, affordance grounding, and interaction pose estimation, while maintaining strong spatiotemporal consistency in dynamic video scenarios. These results demonstrate the effectiveness of UniRAP as a unified perception framework for language-guided physical manipulation.
32. 【2610.29746】LEAF-Mamba: Feature Adaptation and Fusion for Whole Slide Image Analysis
链接:https://arxiv.org/abs/2610.29746
作者:Lubin Gan,Jing Zhang,Mingjun Ma,Linhao Qu,Dachun Kai,Xiaoyan Sun
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:enables computational diagnosis, limited annotations make, analysis enables computational, annotations make slide-level, slide image
备注: 25 pages, 5 figures, 7 tables
点击查看摘要
Abstract:Whole slide image (WSI) analysis enables computational diagnosis and prognosis, but gigapixel images and limited annotations make slide-level learning challenging. Multiple instance learning addresses this task by aggregating patch representations from frozen pretrained encoders. Recently, Mamba has enabled efficient modeling of long patch sequences. However, task supervision alone does not explicitly constrain information recovery during feature adaptation, while Mamba couples local processing with long-range propagation rather than retaining separate representations for fusion. Motivated by these challenges, we introduce LEAF-Mamba, a framework that jointly addresses latent evidence adaptation and fusion for frozen-feature WSI analysis. A reconstruction-regularized adapter learns compact, task-specific representations while reconstructing the input features. Parallel Mamba and convolutional streams then capture long-range dependencies and sequence-local interactions, with an input-dependent gate modulating their joint representation before slide-level pooling. Experiments across feature extractors demonstrate improved average performance over strong MIL baselines in both diagnostic classification and survival prediction. Component analyses further support the contributions of adaptation and fusion. These findings highlight the value of jointly designing feature transformation and contextual aggregation to translate pretrained representations into effective slide-level predictions.
33. 【2610.29740】APED-CXR: Adaptive Privileged Evidence Distillation for Chest X-Ray Grounding with Image-Only Inference
链接:https://arxiv.org/abs/2610.29740
作者:Md Shihabul Islam Shovo,Nishi Kanta Paul,Jamil Fayyad
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:Compact chest X-ray, findings suit deployment, localize findings suit, report-aware multimodal models, Compact chest
备注: 5 pages, 2 figures, 3 tables. Submitted to IEEE ISBI 2027
点击查看摘要
Abstract:Compact chest X-ray (CXR) models that localize findings suit deployment, but box annotations are limited and report-aware multimodal models are expensive at inference. We introduce APED-CXR, which distills report-informed spatial evidence from a frozen multimodal teacher into a student with 11.1M parameters that predicts diseases and boxes from shared evidence maps and requires the image alone at test time. During training, the teacher uses the radiograph, report, and queried class to evaluate regions proposed from the student's current evidence maps, and its support scores serve as training targets for the student's pooled evidence scores within these regions. Trained on PadChest and evaluated on held-out PadChest-GR, refreshing the student's proposals for teacher evaluation improves box-level localization F1 from 0.302 with fixed warm-up proposals to 0.338 (IoU = 0.5; gain 0.036, 95% CI [0.022, 0.049]), while maintaining diagnostic AUC. This gain depends on the teacher checking current proposals: with equally many random boxes, a fixed dense box set, teacher-generated boxes, or report rules instead of the teacher, F1 stays near the fixed-proposal level, and proposals two refreshes old recover only part of the gain. On NIH ChestX-ray14, a secondary test set, box recall also rises from 0.423 to 0.447.
34. 【2610.29738】Learning to Measure and Diagnose: A Clinical-Dictionary Radiomic Bottleneck Model for Thyroid Nodule Classification
链接:https://arxiv.org/abs/2610.29738
作者:Guibin Zhang,Weier Luo,Lei Cao
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:familiar clinical descriptions, lack evidence linked, predictions often lack, linked to familiar, Thyroid ultrasound supports
备注: 9 pages, 2 figures, 2 tables
点击查看摘要
Abstract:Thyroid ultrasound supports the assessment of nodule malignancy, but classification predictions often lack evidence linked to familiar clinical descriptions. Radiomics provides explicitly defined measurements that can support such explanations through a clinical dictionary. However, using these measurements as interpretable evidence requires reliable estimation from ultrasound images and preservation of measurement fidelity when optimizing classification performance. We propose a clinical-dictionary radiomic bottleneck model for thyroid nodule classification. Within this model, Family-Aware Radiomic Learning (FARL) estimates measurements with balanced supervision across feature families. Fidelity-Guided Bottleneck Modeling (FGBM) constructs a fixed bottleneck, followed by joint optimization of measurement estimation and classification under fidelity guidance. Decision evidence decomposition then traces feature contributions through a linear classifier and organizes them by clinical dictionary categories. Experiments on ThyroidXL and TN3K show competitive classification performance, while case studies illustrate feature contributions for benign and malignant nodules. These findings indicate interpretable classification with inspectable quantitative evidence informed by clinical knowledge. Code is available online.
35. 【2610.29697】Forward-Only Learning for Shared-Kernel Wavelet Neural Networks without Backpropagation
链接:https://arxiv.org/abs/2610.29697
作者:Yongfei Guo,Xuan Sun,Ang Li,Zhao Zhang,Yuanhao Gong
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:dominant training paradigm, exploding gradients, suffer from vanishing, vanishing or exploding, local updates
备注:
点击查看摘要
Abstract:Backpropagation remains the dominant training paradigm, using backward gradients and local updates that can suffer from vanishing or exploding gradients in deep networks. Although the Forward-Forward algorithm avoids conventional backpropagation, it remains mainly local or layer-wise, motivating global whole-network learning using forward evaluations only. For shared-kernel wavelet neural networks, we therefore propose a CMA-ES-based global forward-only learning framework. We further introduce structure-aware parameter decomposition and channel-specific credit assignment, factorizing the search into three subspaces. On BSDS500, our method reduces test MSE from 4.1783 to 4.0130 and improves PSNR from 42.621 to 42.787~dB over Adam/BP without backward propagation. Beyond these gains, training requires only 6 training-set coverages, compared with 1500 epochs for BP. Ablations show that structural decomposition and aligned credit assignment are more important than increasing population size, demonstrating the feasibility of whole-network forward-only learning for compact reconstruction networks. These results suggest a potential route toward forward-only optimization of compact reconstruction models for resource-constrained imaging and edge or near-sensor systems.
36. 【2610.29691】Efficient Generative Image Compression with Quantized Latents Refinement
链接:https://arxiv.org/abs/2610.29691
作者:Hao Cao,Yinhuan Huang,Wenqi Guo,Zhijin Qin,Jungong Han
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:Generative image compression, strong perceptual quality, lightweight GIC methods, Generative image, GIC methods
备注: 24 pages, 12 figures, including appendix
点击查看摘要
Abstract:Generative image compression (GIC) delivers strong perceptual quality at low bitrates. However, GIC methods with strong perceptual quality often rely on pretrained diffusion models with high latency, while recent lightweight GIC methods reduce latency but deliver lower perceptual quality. We observe that, for lightweight GIC methods at low bitrates, coarse deterministic quantization can collapse nearby encoder latents corresponding to different fine details to the same point, making these details difficult to recover. Motivated by this, we propose GR-GIC, an efficient GIC that delivers competitive reconstruction performance with fast inference. For better performance, we introduce Guided Refinement (GR), which combines latent refinement guided by entropy context with adaptive perturbations for training regularization, jointly improving reconstruction at low bitrates. For fast inference, we introduce reorganized projected residual vector quantization (P-RVQ), which equivalently reorganizes residual updates into low-dimensional lookups to expose greater parallelism and reduce sequential computation. Experiments on Kodak show that for performance, compared with OneDC, GR-GIC achieves BD-rate savings of 23.19%, 37.71%, 22.30%, and 22.14% for LPIPS, DISTS, PSNR, and FID, respectively. For fast inference, the highly optimized implementation of GR-GIC encodes and decodes in 4.60 and 5.98 ms on an NVIDIA A100. Specifically, the reorganized P-RVQ implementation achieves a $3.14\times$ average speedup over the original implementation under the same FP32 setting. On an NVIDIA Jetson Orin NX, GR-GIC achieves latency comparable to lightweight GIC methods.
37. 【2610.29688】Rethinking Post-hoc Debiasing of Large Pretrained Models
链接:https://arxiv.org/abs/2610.29688
作者:Divyaansh Mertia,Chirag Bhutra,Himanshu Shekhar,Shubham Bagwari,Pratik Mazumder
类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词:Large pretrained models, Large pretrained, CLIP are widely, pretrained models, frozen feature extractors
备注: 14 Pages
点击查看摘要
Abstract:Large pretrained models such as CLIP are widely used as frozen feature extractors. However, their embeddings inherit spurious correlations from training data, introducing bias into the features. A growing body of research has sought to address this issue through post hoc debiasing, leaving the backbone untouched. We discover that despite differing mechanisms, these methods require the bias feature to be identified and expressed in text. This dependency is not innocuous. In this work, we experimentally demonstrate that this requirement incurs an unforeseen penalty in certain scenarios. For example, on the UrbanCars benchmark, having two co-occurring bias attributes, the recent methods underperform a vanilla classifier on biased frozenbackbone features, and even providing ground-truth bias identities does not close the gap. We show that the pattern that such methods seek is readily observable in the frozen geometry. Specifically, cross-class training pairs placed closest together by the frozen encoder almost always share a spurious attribute, regardless of the bias type, without requiring access to the bias labels. Based on this, we propose a novel approach to identify such pairs and learn a single linear map that transforms the features to perform post-hoc debiasing. The proposed approach achieves competitive performance across all datasets without access to bias attribute annotations or any LLMs.
38. 【2610.29665】Learning to Reason Like a Cytopathologist:Clinically Grounded Multiscale Evidential Learning for Cervical Cytology
链接:https://arxiv.org/abs/2610.29665
作者:Ajeet Kumar Singh,Nehal Mishra,Anurag Tripathi,Santanu Chaudhury,Dorien Herremans
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:Atypical Squamous Cells, Undetermined Significance, morphological grey zone, Atypical Squamous, Squamous Cells
备注:
点击查看摘要
Abstract:Cervical cytology presents a fundamentally ambiguous diagnostic landscape, where equivocal categories such as Atypical Squamous Cells of Undetermined Significance (ASC-US) occupy a morphological grey zone that is definitional. For clinical decision support, the goal extends beyond assigning a definitive label to every sample: cases must also be distinguished by whether the available evidence supports a confident decision or warrants further consideration, a distinction conventional classification models are not designed to explicitly represent. We propose a multiscale evidential framework that models cervical cytology along an ordinal disease continuum using clinically grounded soft anchors, representing progression from benign reactive changes to precancerous lesions and malignancy. Three biologically motivated spatial contexts--nuclear morphology, cytoplasmic characteristics, and neighbourhood cellular architecture--are independently encoded using a shared frozen DINOv2 backbone, preserving inter-scale disagreement that early fusion may obscure. Calibrated predictions are transformed into Dempster--Shafer belief masses and fused with reliability discounting, allowing conflicting evidence and insufficient support to remain explicitly uncommitted rather than forcing a decision. The fused belief state drives interpretable routing that separates confidently classified cases from those with irreducible evidential insufficiency, enabling clinically meaningful triage. Across two independent publicly available conventional cytology datasets, RIVA and CRIC Cervix, the framework generalises consistently, with uncertainty strongly associated with diagnostic difficulty: incorrect predictions carry 1.94x-4.13x higher uncertainty than correct ones.
39. 【2610.29651】Spatially Gated Demographic Steering for Debiasing Multi-Person Text-to-Image Generation
链接:https://arxiv.org/abs/2610.29651
作者:Venkatesh Thirugnana Sambandham,Torsten Schon
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:reproduce societal stereotypes, existing mitigation applies, models reproduce societal, societal stereotypes, reproduce societal
备注: Accepted to WACV2027
点击查看摘要
Abstract:Text-to-Image models reproduce societal stereotypes, and existing mitigation applies one demographic correction to the whole scene. In multi-person scene generation this creates a trade-off: global steering improves aggregate balance only by homogenizing the people within an image. Steering-based methods like Embedding Arithmetic drive the intra-image diversity below the unsteered baseline. Text- and latent-projection approaches shift the aggregate skew with only marginal gains in intra-image diversity. We present Spatially Gated Steering (SGS), which steers the demographics of each person independently by extracting per-person masks from the Diffusion Transformer's (DiT) internal attention maps at a critical denoising timestep and applying a distinct demographic vector within each mask for the remaining steps. SGS needs no fine-tuning, inversion or layout specifications, and uses a lightweight segmentor over frozen DiT attention features to localize subjects at early timesteps. On skewed occupational prompts, SGS reaches high intra-image racial and gender diversity while keeping aggregate balance competitive and image quality near baseline, a result we validate on two architecturally distinct diffusion transformers, FLUX.1-Dev and SD3.5-Large. Codebase and model weights are available at this https URL
40. 【2610.29649】MS2CAST: A Video Anomaly Detection Framework via Multi-Scale Spatial Cross-Attention and Efficient Spatiotemporal Networks
链接:https://arxiv.org/abs/2610.29649
作者:Ali Safaei,Mohammad Kazemi
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:Video anomaly detection, surveillance systems due, Video anomaly, anomaly detection, anomalous events
备注:
点击查看摘要
Abstract:Video anomaly detection (VAD) is a challenging task for surveillance systems due to the scarcity and diversity of anomalous events. While semi-supervised VAD approaches have advanced the field, many rely on computationally intensive optical flow networks to capture motion dynamics. Convolutional neural networks (CNNs) are also widely used for spatial encoding, but their effective receptive field is highly local. To address these limitations, we introduce MS2CAST, an end-to-end semi-supervised predictive VAD framework. For spatial encoding, we employ a multi-scale cross-attention encoder that fuses the hierarchical feature representations from a vision transformer (MViTv2-S) and a CNN (ConvNeXt-T) to exploit their distinct receptive fields. To model spatiotemporal dynamics without optical flow estimation, we integrate two interchangeable spatiotemporal modules in the latent space. One module (SwinLSTM) incorporates a Swin Transformer, while the other (VMRNN) integrates Vision Mamba blocks. Our objective function combines L1 loss, Gradient Difference Loss (GDL), and Multi-Scale Structural Similarity Index Measure (MS-SSIM) to ensure pixel-wise accuracy, sharpness, and structural integrity. Evaluations across the UCSD Ped2, CUHK Avenue, and ShanghaiTech datasets demonstrate frame-level Receiver Operating Characteristic (ROC) Area Under the Curve (AUC) scores that are competitive with top-tier techniques while maintaining a peak GPU memory usage of under 1 GB.
41. 【2610.29647】Reading the Room: Scale-ambiguous Semantic Registration of Sparse VSLAM Maps to Floor Plans in Partially Built Environments
链接:https://arxiv.org/abs/2610.29647
作者:Bjorn Stragier,Emilia Szymańska,J. Micah Prendergast,Lukas Rosenberger Schmid
类目:Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词:robotic construction applications, floor plan, built floor plans, progress tracking, require registering
备注:
点击查看摘要
Abstract:Many robotic construction applications, such as progress tracking, require registering a sensor trajectory to a prior 2D floor plan. Visual capture is attractive for its low cost and availability, but aligning a visual simultaneous localization and mapping (VSLAM) map to a floor plan is difficult; VSLAM recovers geometry only up to an unknown similarity transform, the sparse point cloud is cross-modal to the symbolic floor plan, sites are only partially built during capture, and construction sites are visually repetitive, degrading map quality while removing distinctive features. Existing methods address at most two of these challenges. We thus introduce Reading the Room(RR), a global-local approach to register scale-ambiguous, sparse, semantic VSLAM maps to partially built floor plans. Our key idea is to define a single robust, differentiable, class-balanced semantic-geometric energy function that governs all stages of the pipeline. We develop two global initialization schemes, leveraging a single inaccurate user-provided correspondence if provided, or estimating the initialization globally using a cross-modal matching network. Both schemes are designed to find initial candidates with respect to the energy function, which is then directly optimized for local refinement. We evaluate RR on 33 sequences across three active construction sites against classical and learning-based baselines, achieving a 4.5x improvement in mean absolute trajectory error over the strongest baseline in the general unconstrained setting, which increases to 7.6x when an anchor is provided.
42. 【2610.29643】Joint Semantic-Channel Coding and Modulation for Generative Image Transmission
链接:https://arxiv.org/abs/2610.29643
作者:Hao Cao,Jingkai Ying,Yinhuan Huang,Zhijin Qin,Yuan Shen
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:Digital image transmission, transmission typically optimizes, Digital image, image transmission typically, typically optimizes source
备注: 23 pages, 10 figures
点击查看摘要
Abstract:Digital image transmission typically optimizes source coding, channel coding, and modulation separately, limiting how source representations adapt to channel impairments. We propose SemQAM, a joint semantic-channel coding and modulation scheme for generative image transmission converting source to modulated symbols, such as standard QAM symbols. Channel impairments create two challenges: they can corrupt the latent representation at the receiver, and this corruption can compound through autoregressive coding, degrading reconstruction quality. First, SemQAM represents latent features with vector quantization (VQ), maps each VQ index to a QAM symbol, and updates the codeword corresponding to the detected symbol so that channel impairments directly affect codebook learning. Moreover, SemQAM uses the conditional expectation of received codewords to approximate the receiver reconstruction and reduce error propagation during autoregressive coding. SemQAM supports multiple SNRs and CBRs in a unified model, while also supporting conventional source coding through SemQAM-C. Experiments show that (i) under the same LDPC and QAM settings, SemQAM-C outperforms OneDC in LPIPS and DISTS with substantially lower complexity, showing that the unified model retains competitive capability for source coding. (ii) Compared with this separated counterpart, SemQAM reduces channel uses by 18.57% at matched LPIPS and outperforms the compared JSCC methods, demonstrating the benefit of joint coding.
43. 【2610.29642】OpenEarth-OVS44: A Multimodal Remote Sensing Dataset for Open-Vocabulary Segmentation
链接:https://arxiv.org/abs/2610.29642
作者:Yimin Wei,Hongruixuan Chen,Hao Zheng,Hao Liu,Jian Song,Yuting Zhu,Junshi Xia,Naoto Yokoya
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:exhaustive pixel-level annotations, requiring exhaustive pixel-level, scalable land-cover understanding, remote sensing, pixel-level annotations
备注:
点击查看摘要
Abstract:In remote sensing, open-vocabulary segmentation is particularly important for flexible and scalable land-cover understanding across diverse regions, as it improves generalization to novel categories without requiring exhaustive pixel-level annotations. Despite its great promise, progress in this area remains largely constrained by existing datasets with limited category coverage and overly coarse taxonomies, and therefore struggles to support fine-grained semantic understanding required in real-world applications such as urban functional zoning, carbon accounting, and post-disaster assessment. To address these challenges, we present OpenEarth-OVS44, a multimodal benchmark with 290,587 expert-verified segments from 2,832 RGB images and 1,341 strictly registered RGB-SAR pairs at sub-meter spatial resolution, covering 40 cities across France, Japan, and the United States under a unified 44-class taxonomy organized into 9 base categories. Three evaluation tracks are provided: an RGB-only fine-grained benchmark, a multimodal track with diverse synthetic cloudy conditions for weather-robust evaluation, and a held-out cross-region track. Extensive experiments on representative open-vocabulary segmentation models demonstrate that training on OpenEarth-OVS44 substantially improves fine-grained segmentation performance over the strongest training-free baseline, with improvements of up to 7.1 mIoU points on unseen categories and 27.6 mIoU points on seen categories. The dataset and code will be released.
44. 【2610.29618】FogTTA: Online Test-Time Adaptation for Robust Transformer-based Object Detection in Foggy Weather
链接:https://arxiv.org/abs/2610.29618
作者:Ali Abedi,Q. M. Jonathan Wu,Ning Zhang,Shiqi Tian
类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词:real-world operating conditions, autonomous driving commonly, driving commonly experience, commonly experience substantial, adverse weather due
备注: Published in Proceedings of the 39th Canadian Conference on Artificial Intelligence (Canadian AI 2026), PMLR 318:13-24. Available at [this https URL](https://proceedings.mlr.press/v318/abedi26a.html)
点击查看摘要
Abstract:Object detection models for autonomous driving commonly experience substantial performance drops when deployed under adverse weather due to the domain shift between training data and real-world operating conditions. This degradation is especially evident when models trained on clear-weather images encounter foggy environments with reduced visibility and contrast. To address this challenge, we introduce FogTTA, an online test-time adaptation framework designed to improve the robustness of Transformer-based object detectors in fog. Using RF-DETR as the underlying object detector, FogTTA enables real-time adaptation to the streaming target domain without requiring source data or retraining. The framework follows a teacher-student design, where the deployed model serves as the teacher and generates pseudo labels from weakly augmented target inputs. These predictions are subsequently refined through non-maximum suppression and confidence filtering. The student model then learns from strongly augmented target sample using the Varifocal loss to mitigate pseudo-label noise. The teacher is updated via exponential moving averaging to ensure stable and continuous adaptation. Experiments show that FogTTA outperforms prior baselines, delivering improved detection accuracy and stability while maintaining real-time performance.
45. 【2610.29616】An interpretable deep learning method for early hepatocellular carcinoma diagnosis on multiphase CT
链接:https://arxiv.org/abs/2610.29616
作者:Emma Sarfati,Alexandre Bône,Pietro Gori,Sisi Yang,Marc-Michel Rohé,François Nicolas,Jeong-Min Lee,Jeong Hee Yoon,Maxime Ronot,Isabelle Bloch,Christophe Aubé
类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词:curative treatment options, Early diagnosis, treatment options, Data System, multiphase computed tomography
备注: Accepted at Scientific Reports
点击查看摘要
Abstract:Early diagnosis of hepatocellular carcinoma is critical to preserve access to curative treatment options. The Liver Imaging Reporting and Data System (LI-RADS) provides a standardized framework for non-invasive diagnosis on multiphase computed tomography, based on major visual imaging features. However, these features may be difficult to assess consistently, particularly in small liver lesions. We developed dLI-RADS, an interpretable artificial intelligence method designed to estimate the probability of hepatocellular carcinoma from multiphase computed tomography images of manually segmented liver lesions, while remaining aligned with LI-RADS-related imaging concepts. dLI-RADS combines neural network-derived predictions with handcrafted quantitative imaging measurements reflecting LI-RADS major features and integrates these inputs using logistic regression. In this multicenter retrospective study, patients with multiphase computed tomography and at least one liver lesion were included, while lesions larger than 40 mm were excluded. Histology served as the reference standard for hepatocellular carcinoma, and a composite reference standard was used for non-hepatocellular carcinoma lesions. The lesion-level accuracy of dLI-RADS and LI-RADS were compared on the internal evaluation set using 10,000-repetition bootstrap non-inferiority tests, with 5% margins and significance levels. On the external test set, sensitivities were similarly compared. dLI-RADS was non-inferior to LI-RADS for lesion-level accuracy in the internal evaluation set, achieving 80% accuracy compared with 74% for LI-RADS (p = 0.04)...
46. 【2610.29611】Diff-IrisPAD: Modeling Bona Fide Iris Distributions for Unsupervised Presentation Attack Detection
链接:https://arxiv.org/abs/2610.29611
作者:Geetanjali Sharma,Harsh Yadav,Tanmay Deshpande,Shubham Ashwani,Aditya Nigam,Raghavendra Ramachandra
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:textured contact lenses, including textured contact, Iris recognition systems, print replays, Brownian Bridge Diffusion
备注: 10 pages, Accepted at IJCB Conference 2026
点击查看摘要
Abstract:Iris recognition systems are vulnerable to presentation attacks (PAs), including textured contact lenses, print replays, and synthetic irises. Existing PAD methods rely on supervised learning with attack data, limiting generalization to unseen attacks and new sensors. We propose Diff-IrisPAD, an unsupervised framework based on Brownian Bridge Diffusion that models bona fide iris distributions without using attack samples. The method reconstructs clean iris textures from degraded inputs and detects attacks via reconstruction inconsistency using ViT scoring and pixel-level measures. Experiments on a large-scale multi-sensor dataset (125K+ images, NIR and VIS, 8 attack types) show that Diff-IrisPAD achieves an overall ACER of 30.52, significantly outperforming diffusion-based baselines while demonstrating strong generalization to unseen attacks. These results highlight the effectiveness of diffusion-based bona fide modeling for robust and scalable iris PAD.
47. 【2610.29607】No Frames, Just Frequencies: Bandwidth-Efficient Deployment-Time Adaptation for Smart Glasses
链接:https://arxiv.org/abs/2610.29607
作者:Francesco Corti,Moritz Becker,Olga Saukh
类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词:Deep neural networks, neural networks deployed, Deep neural, Visual Wake Words, neural networks
备注:
点击查看摘要
Abstract:Deep neural networks deployed on smart glasses must adapt to changes in the distribution of incoming data while adhering to strict privacy and device constraints. We present No Frames, Just Frequencies, a bandwidth-efficient source-assisted adaptation framework that characterizes distribution shifts using compact frequency descriptors computed on-device. Rather than transmitting camera frames, the glasses compute and send frequency descriptors to a host device that contains a replica of the model. The host device maps the received frequency descriptor to a distribution shift operator that synthesizes out-of-distribution data and adapts a model replica using a pre-defined adaptation protocol. We evaluate the framework on mixtures of ImageNet-C corruptions using convolution-based (ConvNeXtV2-Femto), self-attention-based (DeiT-Tiny), and hybrid (TinyViT-5M) vision models, on person classification (Visual Wake Words), and on object detection (MS-COCO). Our results reveal that adaptation driven solely by the transmitted descriptors recovers $93-95\%$ of the supervised oracle adaptation gain on all three architectures, $82\%$ on Visual Wake Words and $94$--$98\%$ on MS-COCO. Notably, adaptation quality degrades gracefully as the descriptor resolution decreases from $224 $ to $28$ pixels, consistently across architectures, enabling bandwidth reductions from $213\times$ to $784\times$ across the frequency descriptors.
48. 【2610.29590】CineEvolve: An Agentic Self-Evolution Framework for Cinematic Multi-Shot Video Generation
链接:https://arxiv.org/abs/2610.29590
作者:Jingzhe Zhang,Peixuan Zhang,Genying Li,Bing Ma,Shuchen Weng,Si Li,Boxin Shi
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:multi-shot video generation, Cinematic multi-shot video, video generation requires, multi-shot video, video generation
备注: 11 pages, 5 figures, 2 tables
点击查看摘要
Abstract:Cinematic multi-shot video generation requires both narrative planning and iterative refinement. Existing methods either lack narrative reasoning or rely on feed-forward workflows without policy updates. In this paper, we propose CineEvolve, an agentic self-evolution framework for cinematic multi-shot video generation that unifies a Director and a Critic within a single vision-language policy. Emulating real-world filmmaking that couples iterative direction with critical feedback, we train CineEvolve via alternating reinforcement learning, where the Director surfaces flaws to sharpen the Critic, and the updated Critic guides the Director's targeted revisions. To stabilize co-evolution, we introduce Evolutionary GRPO (E-GRPO), leveraging historical anchoring and revision safeguarding to mitigate advantage inflation. Additionally, we contribute CineTraj, a 40K cinematic trajectory dataset spanning creation, critique, and revision. Extensive experiments demonstrate that CineEvolve outperforms existing approaches. Our code will be available at this https URL.
49. 【2610.29581】Unlocking Spatial Grounding in Flow-Matching Models via SNR Tuning
链接:https://arxiv.org/abs/2610.29581
作者:Martin Thißen,Elke Hergenröther
类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词:typically requiring auxiliary, complex inference-time steering, achieving fine-grained spatial, fine-grained spatial control, spatial control remains
备注: Accepted at BMVC 2026 (Oral)
点击查看摘要
Abstract:Despite the success of foundation models in image synthesis, achieving fine-grained spatial control remains a significant challenge, typically requiring auxiliary structural adapters or complex inference-time steering. While modern vision-language (VLM) text encoders possess the latent capacity to represent spatial coordinates, generative models often fail to leverage this information. We demonstrate that the signal-to-noise ratio (SNR) distribution is a critical determinant of spatial grounding in flow-matching models. Using a novel synthetic benchmark of geometric primitives, we isolate structural mechanics from textural complexity inherent in natural imagery and introduce a rigorous color-aware layout metric to quantify spatial fidelity. We show that training on a centered SNR distribution results in poor layout adherence (25.9%). Instead, we identify high-noise regimes as a "critical learning phase" for spatial grounding. Shifting the training focus toward these stages increases layout adherence to 80.8%, effectively reaching the 83.6% reconstruction ceiling of the underlying variational autoencoder. We find that the necessity for this shift scales with resolution and aspect ratio variance, and that the conservative noise schedules employed by models like FLUX.1 are insufficient for precise layout adherence. Finally, we show that these findings translate to real-world imagery via the COCO dataset (1.0 vs. 57.3 Average Precision), where state-of-the-art layout adherence is unlocked through distribution tuning alone, without architectural modifications.
50. 【2610.29569】Rethinking Underwater Image Enhancement: Learning through Text-Guided Degradation Curriculum
链接:https://arxiv.org/abs/2610.29569
作者:Hongri Tian,Wenxue Li,Tian Ye,Sixiang Chen,Lujia Wang,Xianying Wang,Xinhu Zheng,Gang Hua,Lei Zhu
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:Existing paired clean-degraded, underwater image enhancement, real-world underwater environments, advanced learning-based underwater, paired clean-degraded datasets
备注:
点击查看摘要
Abstract:Existing paired clean-degraded datasets have advanced learning-based underwater image enhancement, but they remain either limited in scale or difficult to acquire, and still fail to adequately cover the diverse degradations encountered in real-world underwater environments. Such scarce and insufficient data ultimately restrict the generalization of underwater image enhancement models, highlighting the need for realistic and controllable degradation modeling to better capture real underwater conditions and improve enhancement robustness. To this end, we propose a unified degradation-aware training framework for the underwater image enhancement task. A Text-Conditioned Degradation Augmentation Pipeline uses a text-guided diffusion model to synthesize diverse and semantically consistent degraded samples, providing paired data to support the subsequent curriculum learning strategy. The proposed Progressive Degradation Curriculum organizes training across multiple attributes and difficulty levels to promote balanced learning, and a Transmission-Guided One-Step Diffusion Model leverages this progressive process to better address the wide range of degradation severity and restoration ambiguity in underwater images. Extensive experiments on multiple underwater benchmarks demonstrate that our proposed method achieves superior performance. Our code and models will be released upon the publication of this work.
51. 【2610.29552】Generalized CycleGRPO for Fine-Grained Multimodal Understanding and Grounding
链接:https://arxiv.org/abs/2610.29552
作者:Xin Zhang,Haochen Wang,Beibei Lin,Zhaoxiang Zhang,Robby T. Tan,Jason Li,Dacheng Tao
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:Fine-grained multimodal intelligence, intelligence requires models, multimodal intelligence requires, Fine-grained multimodal, intelligence requires
备注: 31 pages, 14 figures, 16 tables
点击查看摘要
Abstract:Fine-grained multimodal intelligence requires models to both understand a designated region and localize it from language. Existing methods learn these directions with separate objectives and task-specific annotations. We present Generalized CycleGRPO, the first unified reinforcement learning framework coupling region understanding and localization across spatial, temporal, and spatio-temporal domains. Given a region, a multimodal large language model generates candidate descriptions and then localizes each description to reconstruct the input region. Reconstruction overlap provides a verifiable reward for captioning, while individual localization rewards improve the inverse mapping. A common region-space formulation extends this cycle from image masks and boxes to video intervals and timestamped spatial evidence, without reference captions or an external language-model judge during reinforcement learning. In videos, the cycle encourages descriptions that distinguish a target event from similar recurrences. We introduce DOVE (Distinctive Occurrence-level Video-caption Evaluation), a human-verified contrastive benchmark for this temporal distinctiveness. CycleGRPO improves SAMTok's overall gIoU from 57.5% to 68.2% on GroundingSuite and average gIoU from 71.2% to 78.7% on GRES. For temporal tasks, it achieves 51.9% tIoU on Charades and 33.3% Temporal Evidence Coverage on DOVE, compared with 45.6% and 14.8% for the Qwen3-VL initialization. These results establish region-text cycle consistency as a general self-evaluation principle for multimodal understanding and localization. Models, code, and DOVE are available at this https URL.
52. 【2610.29550】Hyperspherical Simplex Representations for Backward-Compatible Retrieval
链接:https://arxiv.org/abs/2610.29550
作者:Simone Ricci,Niccolò Biondi,Federico Pernici,Alberto Del Bimbo
类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词:affecting applications built, updating deployed models, internal feature representations, affecting applications, updating deployed
备注:
点击查看摘要
Abstract:Training modern AI models has become increasingly expensive, and updating deployed models can alter their internal feature representations, affecting applications built upon them. In retrieval systems, such updates often require complete gallery re-indexing, a computationally expensive process at scale. Existing backward-compatibility methods enable direct comparison of representations from updated and earlier models, avoiding re-indexing. However, they typically require compatibility-specific training, learned mapping functions, or architectural modifications, and often depend explicitly on the previous model. We propose hyperspherical simplex representations derived from softmax outputs and logits for backward-compatible retrieval across independently trained models. They leverage the simplex structure induced by softmax cross-entropy training with one-hot labels as a common geometric reference across model updates. Since this reference depends on the number of classes, adding new ones expands the simplex, misaligning existing class prototypes with their earlier counterparts. We therefore derive a deterministic linear transformation to restore their alignment. Our theoretical analysis of the formal backward-compatibility definition identifies two geometric conditions under which its inequalities hold in expectation, assuming von Mises--Fisher class distributions with increasing concentration across updates. Aligned regular-simplex representations satisfy these conditions, providing a theoretical basis for the proposed representations under the stated assumptions. Without using additional compatibility-specific losses, learned mappings, or architectural modifications, the proposed representations achieve competitive results on standard compatibility benchmarks, including expanded class sets, more expressive architectures, and independently trained models from public repositories.
53. 【2610.29537】Melange: A Synthetic Visual Bias Benchmark for Multi-modal Large Language Models
链接:https://arxiv.org/abs/2610.29537
作者:Razieh Rezaei,Ehsaneddin Asgary,Masoud Jalili Sabet
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:Multi-modal Large Language, Large Language Models, Large Language, Multi-modal Large, broad adoption
备注:
点击查看摘要
Abstract:Multi-modal Large Language Models (MLLMs) have seen broad adoption, but their biases are still far less examined than those of standard LLMs, creating possible social harms when deployed in real-world settings. Prior efforts to extend bias analyses from LLMs into the multi-modal space either cover only a few bias categories or do not ensure that the groups being compared are clearly addressed by visual cues in the images. To overcome these limitations, we introduce Melange, a wide-ranging synthetic visual benchmark covering seven categories for assessing social biases in MLLMs. It is grounded in the widely used language-only BBQ dataset (Bias Benchmark for Question Answering) from BigBench, carefully extending its constructed contexts via controlled generation of visual scenarios so the target attributes appear visually and clearly. To maximize reliability, our generated images pass through two stages of validation: automated screening using visual question answering (VQA) and subsequent manual inspection by human annotators. By systematically evaluating 23 open-source MLLMs across three matched evaluation settings---text-only, image-only, and image-with-context---Melange isolates the fairness effect of the input modality. Switching from text to vision reduces fairness by 0.291 on average, a gap that varies by model family rather than by scale alone. A perception control confirms that this gap is not an artifact of visual comprehension: models identify the depicted attributes at 90--95\% accuracy yet still fail to abstain. When models do commit to a biased answer, polarity-aware stereotype alignment shows they choose the human-stereotypical response roughly three-quarters of the time.
54. 【2610.29519】Supervision-Adaptive Curriculum and Guarded Anti-Curriculum Learning for Dense Prediction
链接:https://arxiv.org/abs/2610.29519
作者:Chunming He,Dingming Zhang,Fengyang Xiao,Zhiwen Cao,Sina Farsiu
类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词:Curriculum learning orders, learning orders samples, learning orders, establish supervision reliability, Curriculum learning
备注: 7 Figures, 27 Tables
点击查看摘要
Abstract:Curriculum learning orders samples by difficulty, but difficulty alone does not establish supervision reliability for dense prediction. Easy samples can expose shortcuts, hard samples can be informative, and noisy or ambiguous samples can mislead training. Building on our conference method CurriSeg, we present PaceShift, a stabilize-then-challenge paradigm combining supervision-adaptive curriculum selection with guarded spectral post-training. A learning-dynamics view motivates separating supervision reliability from temporal update value and applying spectral challenges after stabilization. The first phase estimates reliability from available supervision, augmentation consistency, model disagreement, and prediction certainty. Temporal statistics guide sample weighting, while pixel-uncertainty weights reduce the early influence of uncertain regions. The second phase ranks predictions from multiple spectral views using supervision agreement, robustness, reference consistency, and penalties. A pairwise preference objective measured against the frozen Phase-I reference, together with an anchor, refines the prediction. The framework supports full, weak, semi-supervised, and model-derived supervision. Experiments across context-entangled content segmentation (CECS), broader dense-prediction tasks, and foundation-model and cross-modal adaptations show accuracy gains. Targeted diagnostics indicate improved pooled calibration and corruption robustness in the evaluated settings. PaceShift preserves the deployed architecture and adds no inference computation. Code will be publicly released.
55. 【2610.29517】AutoPhyX: Automatic Text-Condition Physics Property Generation
链接:https://arxiv.org/abs/2610.29517
作者:Bei Huang,Yixin Chen,Hongbin Zha,Yuru Pei,Siyuan Huang
类目:Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词:simulation requires accurate, High-fidelity, diverse material properties, material properties, accurate physical parameter
备注: 36 pages. Project page: [this https URL](https://hb-pencil-zero.github.io/AutoPhyX/)
点击查看摘要
Abstract:High-fidelity 4D physical simulation requires accurate physical parameter assignments that align with diverse material properties. Previous methods struggle with critical bottlenecks: they either rely on computationally intensive per-scene optimization or predict parameters from purely visual inputs. The latter suffers from inherent ambiguity, e.g., the inability to distinguish the stiffness of rubber from its appearance alone. To bridge this gap, we propose AutoPhyX, a text-conditioned framework for predicting spatially-varying physical properties. Since training robust feed-forward models requires fine-grained supervision, we first introduce a novel part-controllable data generation pipeline that decomposes complex 3D assets into semantically distinct components and pairs them with physically plausible, diverse parameters and corresponding text descriptions. Leveraging this dataset, AutoPhyX employs a cross-modal modulation mechanism where text features dynamically modulate visual features for precise physical grounding. By formulating property prediction within a voxel field, AutoPhyX ensures compatibility with diverse 3D representations, including meshes, point clouds, Gaussian Splatting, and NeRF. Experiments demonstrate that our method enables physically plausible, text-driven parameter assignment in a single forward pass. It achieves high accuracy and robust generalization to in-the-wild objects, paving the way for future physics-intensive embodied and robotic applications.
56. 【2610.29495】Balancing Foundation Models and Trait-Specific Learning for Forehead-Crease Recognition
链接:https://arxiv.org/abs/2610.29495
作者:Geetanjali Sharma,Aryan Jain,Dev Nagaich,Aditya Nigam,Raghavendra Ramachandra
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:partial facial vis, conventional facial cues, cues are occluded, facial vis, degrades under partial
备注: Accepted at CVIP 2026
点击查看摘要
Abstract:Biometric recognition often degrades under partial facial vis- ibility, where conventional facial cues are occluded. The forehead region remains consistently visible and contains distinctive crease patterns that can serve as a complementary biometric trait. We present a unified eval- uation of forehead-crease recognition across explainable zero-shot rea- soning, domain-adaptive learning, and trait-specific modeling. FIRE en- ables interpretable zero-shot verification using multimodal large language models, while pretrained face-recognition models are adapted to the fore- head domain through margin-based learning. Under open-set evaluation, the best zero-shot model GPT-4o+FIRE achieves 18.22% EER, while Edge-Forehead achieves 8.30% EER and 54.01% TMR@0.1% FMR. The results show that although MLLMs offer interpretable zero-shot verifi- cation, trait-specific learning remains more effective for robust forehead- crease biometric recognition.
57. 【2610.29474】Extending Affordance Segmentation for Wearable Robots to Multi-Object Images
链接:https://arxiv.org/abs/2610.29474
作者:Simone Lugani,Matteo Montani,Paolo Gastaldo,Rodolfo Zunino,Edoardo Ragusa
类目:Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词:vision-based portable pipelines, paper proposes, proposes a refinement, existing vision-based portable, portable pipelines
备注:
点击查看摘要
Abstract:This paper proposes a refinement to existing vision-based portable pipelines for the recognition of graspable object parts. Such pipelines can effectively support automatic grasp selection and preshaping in upper-limb prosthetic devices. However, realistic scenarios in which multiple objects are present still represent a challenge. The proposed method exploits a minor modification to the conventional hardware setup and a custom training approach to extend the applicability of vision-based pipelines. A laser pointer is introduced in the setup as an effective mechanism for object disambiguation. Accordingly, a suitable retraining of the deep convolutional neural networks supporting recognition of graspable parts is implemented. A mixed reality strategy allows the reuse of available high-quality segmentation masks to generate realistic images procedurally, extending the range of scenarios supported by the final device. Experimental results confirm that the proposed pipeline improves target disambiguation accuracy by up to 9% compared with existing solutions, while preserving the computational cost.
58. 【2610.29454】BlazeVGGT: 13x Faster VGGT at 2,000 Frames via Camera Token without Training
链接:https://arxiv.org/abs/2610.29454
作者:Shujun Yao,Junhui Lin,Congying Han,Tiande Guo,Ziwen Liu,Bonan Li
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:Feed-forward visual geometry, demonstrated strong multi-view, Feed-forward visual, strong multi-view reconstruction, multi-view reconstruction capabilities
备注:
点击查看摘要
Abstract:Feed-forward visual geometry models, exemplified by VGGT, have demonstrated strong multi-view reconstruction capabilities through dense global attention. However, the resulting all-to-all cross-view computation scales quadratically with the number of input views, making long-sequence inference particularly expensive due to substantial frame-level redundancy among highly overlapping observations. We uncover a topology-first, geometry-later evolution in VGGT camera tokens: shallow-layer tokens reliably capture local view neighborhoods, whereas deeper-layer tokens progressively encode globally organized inter-view geometry. Motivated by this observation, we introduce BlazeVGGT, a training-free framework for structure-aware frame-level key--value sparsification. At each global-attention block, BlazeVGGT constructs a view-level similarity kernel from camera-token relations and employs greedy determinantal point process inference to select a compact set of mutually complementary views. The selected views constitute the key--value context, while all input frames are retained as queries. This asymmetric attention design preserves dense per-frame predictions while eliminating redundant cross-view computation, allowing our method to be directly integrated into pretrained VGGT as a plug-and-play module without parameter updates. Its advantages become increasingly pronounced with sequence length: at 2,000 frames, BlazeVGGT achieves approximately 13$\times$ faster inference than VGGT while reducing the Chamfer Distance from 0.41 to 0.32. Extensive experiments demonstrate a favorable accuracy--efficiency trade-off in point-cloud reconstruction and camera-pose estimation, compatibility with existing VGGT accelerators such as FastVGGT and LiteVGGT, and transferability to VGGT-based models including StreamVGGT and PAGE-4D. Codes are publicly available at this https URL.
59. 【2610.29442】Beyond Shortcut Learning: Hierarchical Spatial Prototype Regularization for Face Forgery Detection
链接:https://arxiv.org/abs/2610.29442
作者:Chao Shuai,Shaojing Fan,Kun Pan,Jinwu Hu,Weichen Lian,Ziqi Yang,Zhongjie Ba,Zhenguang Liu
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:realistic face forgeries, enabled highly realistic, highly realistic face, unseen manipulation pipelines, Recent advances
备注:
点击查看摘要
Abstract:Recent advances in generative models have enabled highly realistic face forgeries, yet generalizing deepfake detectors to unseen manipulation pipelines remains a major challenge. One critical yet underexplored issue is that the learned forensic representation itself may fail to remain stable across different manipulation sources. In this paper, we provide new evidence that naively fine-tuned vision models suffer from severe \textit{forensic representation collapse}: their extracted cues are often entangled with unstable, dataset-specific artifacts, resulting in structurally fragile representations and poor cross-domain generalization. Leveraging this insight, we propose \textbf{H}ierarchical \textbf{S}patial \textbf{P}rototype (\textbf{HSP}) regularization, which explicitly models the forgery manifold by learning a structured prototype subspace over spatial features. We further introduce prototype orthogonality and second-order assignment balance, which jointly preserve the geometric independence of latent forgery factors and promote high-effective-rank utilization of the forensic representation, thereby reducing reliance on dataset-specific shortcuts. Empirical results demonstrate that our method substantially improves generalizability, yielding average frame-level AUC gains of 5.6\% and 5.3\% in the cross-dataset and cross-manipulation settings, respectively. Moreover, when used as a plug-in module, HSP boosts the average video-level AUC of existing state-of-the-art detectors to 95.3\% (+1.8\%). These results demonstrate the practical value of HSP as an easy-to-adopt regularization module for enhancing deepfake detectors.
60. 【2610.29441】Sparsity Should Be ALLOTted by Output: Training-Free Allocation of Block-Sparse Attention for Video Diffusion Transformers
链接:https://arxiv.org/abs/2610.29441
作者:Tianze Xia,Xiaoling Zhou,Ruya Lan,Yiqiao Liao,Chengru Song,Shiming Xiang
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:video Diffusion Transformers, Diffusion Transformers, video Diffusion, Full, costly in video
备注: 26 pages, 11 figures, including supplementary material
点击查看摘要
Abstract:Full 3D attention is costly in video Diffusion Transformers. Block-sparse attention reduces this cost by computing only selected attention blocks. However, existing methods either overlook the potential to optimize sparsity allocation or rely on heuristic rules or local metrics to guide it. In this work, we observe that sparsifying attention in different layers and at different denoising steps affects final-video fidelity to substantially different degrees. Yet the identities of the most sensitive layer-step pairs remain nearly unchanged across inputs. Building on these findings, we propose Allocating Layer-step Latency by Output Tests (ALLOT), a training-free sparsity allocation method. Treating each layer-step pair as a cell, ALLOT estimates each cell's contribution to final-video error through (i) cell probing and (ii) trajectory calibration, then jointly optimizes cell densities under a measured-latency budget. It preserves existing selection strategies and kernels, replacing only the allocation component. At equal or shorter wall-clock time, ALLOT outperforms every compared allocation strategy with XAttention, with an 11.8 dB PSNR gain on HunyuanVideo. Extensive experiments across four additional published pipelines on Wan2.1, Wan2.2, and HunyuanVideo show that ALLOT outperforms or ties the default in all nine settings.
61. 【2610.29431】Look Beyond the Question: Preserve-Focus-Fuse for Whole-Slide Image Question Answering
链接:https://arxiv.org/abs/2610.29431
作者:Xiangyu Li,Jincheng Li,Tianle Du,Yanheng Li,Haoxuan Che,Yuxin Sun,Long Bai,Liangliang Liu,Ran Su
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:morphological finding needed, whole-slide image rarely, whole-slide image, image rarely, morphological finding
备注:
点击查看摘要
Abstract:A question about a whole-slide image rarely names every morphological finding needed to answer it. Question-guided patch selection can therefore overlook supporting morphology, while slide-level compression can dilute focal evidence. Inspired by how pathologists combine broad slide review, question-directed examination, and integration of their findings, we introduce BEYONDPATH, a Preserve-Focus-Fuse framework for whole-slide image question answering. Preserve learns a question-agnostic Morphology Bank through answer supervision across multiple questions about each training slide. Focus retrieves questionspecific evidence from all foreground patches, including regions outside the Bank. Fuse integrates the preserved morphology at the retrieved evidence positions through Morphology-on-Visual-Evidence Fusion, producing a fixed 96-token visual prefix. On WSI-Bench, BEYONDPATH achieves an Avg-9 of 0.769 and leads all eight reported report-generation metrics using the same checkpoint. It also achieves 0.639 zero-shot overall accuracy on SlideBench-BCNB. Controlled ablations show complementary benefits from morphology preservation and question-directed retrieval, and support cross-question supervision and fusion at the evidence positions. These results support looking beyond the question's explicit cues: preserving broader slide morphology while retaining the ability to seek evidence for each question.
62. 【2610.29415】CCG Diffusion: Combinatory Categorial Grammar-Driven Compositional and Syntactically Disambiguated Text-to-Image Generation
链接:https://arxiv.org/abs/2610.29415
作者:Ryosuke Yamaki,Daichi Mochihashi,Nobutaka Shimada,Seitaro Shinagawa,Tadahiro Taniguchi
类目:Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词:CCG Diffusion, syntactically ambiguous prompts, spatial relations, CCG, explicitly receive
备注: Preprint under review
点击查看摘要
Abstract:Text-to-image generation models do not explicitly receive the syntactic structure of the prompt, i.e., which word modifies which and where each phrase attaches. Consequently, they often struggle to bind attributes to the correct objects, to depict spatial relations and counts correctly, and to render syntactically ambiguous prompts in the intended interpretation. Existing syntax-based control methods mainly address attribute binding and have limited ability to control spatial relations and counts or to specify the interpretation of syntactically ambiguous prompts. They rely on phrase-structure or dependency grammars and require additional rules or constraints on the tree structure to extract modification relations between words or to specify a syntactic interpretation. We propose CCG Diffusion, a training-free method that controls image generation using Combinatory Categorial Grammar (CCG). In CCG, the category of each word carries rich syntactic information: it specifies what the word combines with and what phrase it forms. Modification relations between words can therefore be read directly from a CCG parse. Moreover, prepositional phrase (PP) attachment ambiguity, a representative syntactic ambiguity, can be resolved simply by fixing the preposition's category. CCG Diffusion applies the same two CCG-based mechanisms, prompt rewriting and attention guidance, both to controlling attribute binding, spatial relations, and counts and to resolving PP ambiguity. On two architecturally different backbones, Stable Diffusion and Sana, CCG Diffusion achieves the highest scores among the compared methods in attribute binding and 2D spatial relations and significantly outperforms all of them in PP ambiguity resolution.
63. 【2610.29409】LLMSeg: Training-Free Text-Prompted Image Segmentation with B-Splines
链接:https://arxiv.org/abs/2610.29409
作者:Abdullah Hamdi
类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词:large-scale annotation engines, require dedicated architectures, Promptable segmentation models, achieve remarkable open-vocabulary, remarkable open-vocabulary performance
备注: preprint
点击查看摘要
Abstract:Promptable segmentation models such as SAM 3 achieve remarkable open-vocabulary performance but require dedicated architectures, large-scale annotation engines, and task-specific training. We ask a different question: can a general-purpose multimodal large language model (MLLM) segment images directly, without an added segmentation head, mask decoder, or training? We present LLMSeg, a training-free pipeline that turns a vision-capable LLM into a text-prompted image segmenter. LLMSeg decomposes segmentation into three LLM-driven stages. First, detect localizes all instances matching a free-form text query and describes their coarse morphology. Next, segment traces each instance using closed periodic B-splines confined to its detected box. These splines define an outer boundary and optional hole loops. Finally, refine iteratively proposes focus boxes around residual errors and retraces confined splines. The process ends when the mask stabilizes or the pass budget is exhausted. The output is a binary mask with inspectable intermediate geometry. We evaluate LLMSeg across ten referring and reasoning segmentation splits (ReasonSeg and RefCOCO/+/g). We also evaluate open-vocabulary instance segmentation (LVIS, COCO, and SA-Co), semantic segmentation, and zero-shot detection (ODinW13 and RF-100VL). With an off-the-shelf Gemini-3.7-Flash backend, LLMSeg is competitive with and often surpasses the specialist SAM 3 model on identical items. It reaches 71.5 cIoU on ReasonSeg val without additional segmentation-specific training. Backend model updates can improve accuracy without retraining the pipeline. The code is available at this https URL .
64. 【2610.29408】LiveAct: Towards Real-Time Multi-Agent World Models with Heterogeneous Action Interfaces
链接:https://arxiv.org/abs/2610.29408
作者:Xinyu Wang,Huafeng Shi,Yue Ma,Zijie Meng,Teng Xi,Yuzhuo Chen,Yucheng Wang,Ruicheng Zhang,Guoxin Zhang,Pengfei Wan,Xiu Li,Fangneng Zhan
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:Interactive video world, existing systems assume, Interactive video, world models predict, video world models
备注: Project page: [this https URL](https://liveact-ai.github.io)
点击查看摘要
Abstract:Interactive video world models predict how an environment evolves under user actions, but most existing systems assume one controlled agent and one task-specific action interface. We study multi-agent video world modeling, where one model generates a joint visual future for multiple controlled agents while interpreting heterogeneous controls ranging from binary game buttons to continuous robot commands. This task presents two complementary challenges. First, every agent-indexed action stream must control its intended visual entity independently. Second, the model must adapt the meaning of each control variable across different tasks, where the same tensor dimension may denote an attack, steering command, or robot command. We introduce LiveAct, centered on a Heterogeneous Action Interface (HAI) whose two components mirror this decomposition. To support independent control, Agent-Aware Spatial Modulation uses language-driven spatial gates and agent-specific attention to bind each action stream to its intended visual agent. To accommodate heterogeneous controls, Schema-Guided Action Adaptation describes each control variable in language and modulates its semantic token with the synchronized numerical value. We further transfer the complete interface to a blockwise causal generator through teacher forcing and rollout-aware distribution matching, enabling efficient streaming generation while retaining agent-specific control and action semantics. We instantiate the formulation on six multi-agent sources spanning games and multi-robot manipulation, and evaluate visual quality, action following, agent attribution, and latency. Across games and robot manipulation, LiveAct reaches 0.898 and 0.942 agent-attribution accuracy without agent locations or identity crops, and the causal generator attains 17.70 FPS at $512\times 448$.
65. 【2610.29407】VideoGen Model 1: Prompt Expansion Versus Formatting in Audiovisual Generation
链接:https://arxiv.org/abs/2610.29407
作者:David Grossman(VideoGen),Anton Koenig(VideoGen)
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:Creative prompt expansion, VideoGen Model, prompt expansion improved, Creative prompt, expansion improved
备注: 7 pages, 2 figures. Model page: [this https URL](https://videogen.io/model-1) ; VideoGen: [this https URL](https://videogen.io)
点击查看摘要
Abstract:Creative prompt expansion improved overall audiovisual quality scores over raw prompts in a controlled pilot of VideoGen Model 1, our post-trained version of MiniMax H3. We compared the raw, reformatted, and expanded versions of 30 prompts, holding the generator, seed, and sampling settings fixed. Each clip was rated separately on five dimensions. Their mean formed an overall score on a 1-10 scale. Compared with formatting alone, overall scores increased by 0.63 points (95% interval: [+0.11, +1.15]) under VA-Judger and 0.15 points (95% interval: [-0.03, +0.35]) under Gemini 3.8 Flash, whose overall change remained uncertain. Prompt-alignment scores increased by 0.97 points under VA-Judger and 0.50 under Gemini. VA-Judger also showed higher audio quality; visual-quality ratings changed little under either judge.
66. 【2610.29398】Region-Aware Multi-View Inspection Using Deep Learning and Domain-Informed Decision Fusion
链接:https://arxiv.org/abs/2610.29398
作者:Srivishnu Ethirajulu Krishnaraj,Rishikesh R. Chopade
类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Image and Video Processing (eess.IV)
关键词:Automated optical inspection, Automated optical, tiny surface defects, surface defects remains, defects remains challenging
备注: 10 pages, 4 figures, 10 tables
点击查看摘要
Abstract:Automated optical inspection of precision components with tiny surface defects remains challenging when different regions of the same component exhibit different defect characteristics and, therefore, different acceptance criteria. This paper presents a region-aware, dual-model inspection framework that combines instance segmentation of localized seat-region defects with image-level classification of global shaft-region anomalies. Rather than treating these two model detections as sufficient evidence for component rejection, a deterministic decision fusion layer that formalizes industrial Standard Operating Procedures is applied to the model outputs to make the final component level decision. A PLC-synchronized imaging system acquires 18 seat and 18 shaft images over a full 360-degree rotation to provide multi-view circumferential coverage. The framework was evaluated on 380 automotive fuel injector needles, covering representative operational defect types, using identical model predictions in all configurations. Direct model-output aggregation via simple union logic (where any single-view detection flags a rejection) identified all 104 non-conforming components but produced a component level false rejection rate of 57.6%. Inclusion of a complete decision layer maintained the observed non-conforming (NOK) recall of 100% while reducing the false rejection rate to 10.9%, corresponding to an 81.1% reduction in false-positive component decisions. The results demonstrate that formalized manufacturing acceptance criteria can complement sensitive visual models by translating frame-level detections into practical and traceable component-level decisions.
67. 【2610.29396】Progressive Permutation Alignment with Temperature-Controlled Spectral Sharpening
链接:https://arxiv.org/abs/2610.29396
作者:Yuta Horioka,Naoya Chiba,Yuki Uranishi
类目:Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词:weight-space operations essential, implicit neural representations, making stable weight-space, stable weight-space operations, signals are encoded
备注: Accepted to ACCV 2026. Project page: [this https URL](https://uranishi-lab.github.io/progressive-permutation-alignment/)
点击查看摘要
Abstract:In implicit neural representations (INRs), 3D signals are encoded directly in network weights, making stable weight-space operations essential. However, permutation symmetry causes independently trained yet functionally equivalent models to appear distant in weight space, often inducing large loss barriers under linear interpolation. Existing neuron alignment methods either commit early to discrete matches and become trapped in inconsistent local optima or rely on computationally expensive gradient optimization over continuous relaxations, both of which are unreliable in challenging cases such as NeRF. We adopt progressive alignment, a layer-wise strategy that follows inter-layer dependencies from input to output. At each layer, a correlation matrix is estimated and aligned with a discrete anchor obtained by the Hungarian algorithm, after which temperature-controlled spectral annealing gradually sharpens the correlation structure toward a permutation matrix. This update is deterministic and lightweight, avoiding the inner-loop gradient optimization required by continuous relaxation methods. A final refinement stage further optimizes the network layer-by-layer via weight matching, starting from the aligned solution. Experiments on MLPs, CNNs, and Neural Radiance Fields (NeRFs) show that the proposed method reliably recovers neuron correspondences and achieves stable alignment across architectures. In practical experiments aligning independently trained NeRF models, our method reduces the loss barriers under weight interpolation compared with existing approaches.
68. 【2610.29388】FM-Occ: Feature-Diverse Upsampling and Memory-Aware Decoding for 3D Occupancy Prediction
链接:https://arxiv.org/abs/2610.29388
作者:Yujia Zhai(1),Guoming Huang(1),Zhuanghuai Wang(1),Bangquan Xie(1) ((1) Great Bay University)
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:occupancy prediction estimates, estimates voxel-wise occupancy, occupancy prediction, prediction estimates voxel-wise, Sparse Subvoxel Shuffle
备注:
点击查看摘要
Abstract:3D semantic occupancy prediction estimates voxel-wise occupancy and semantic labels throughout a scene. Our experiments reveal that conventional sparse transposed-convolution upsampling yields poorly differentiated voxel responses and that successive decoder layers discard previously correct semantic predictions. To address these issues, we present Feature-Diverse Upsampling and Memory-Aware Decoding for 3D Occupancy Prediction (FM-Occ), comprising two components. First, 3D Sparse Subvoxel Shuffle (3S) mitigates feature homogenization by constructing candidate child features in the channel dimension, jointly transforming and normalizing them, and then rearranging them onto a finer sparse grid with explicit feature-coordinate correspondence. Second, Entropy-Regulated Layer-wise Memory (ER-LM) retains semantic information across decoder layers by maintaining a layer-wise memory for each query through gated recurrent updates and using prediction entropy to regulate the historical information propagated to the next layer. During training, a class-weighted entropy loss Lcwe provides label-guided regularization for matched semantic queries. On SemanticKITTI, 3S increases the spatial coefficient of variation of normalized voxel-wise root-mean-square (RMS) responses from 0.41% to 4.03%, while ER-LM reduces semantic degradation and improves error correction across decoder layers. The combined FM-Occ improves mIoU from 12.16% to 12.73% with negligible memory overhead. ER-LM further improves mIoU in the BEV-based DISC framework from 16.78% to 17.17%, supporting its applicability across 3D voxel-based and BEV-based architectures.
69. 【2610.29380】AdvFidelity: Unifying Preference Alignment and Few-Step Image Generation within Reinforcement Learning
链接:https://arxiv.org/abs/2610.29380
作者:Sicong Kang,Fangao Zeng,Yuhan Li,Hao Zhou,Mengfei Xu,Wenxiang Shang,Wei Li,Bingbing Ni,Pipei Huang
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:Practical image generation, combining reinforcement learning, improves structural coherence, progressively improves structural, Practical image
备注:
点击查看摘要
Abstract:Practical image generation requires both human preference alignment and few-step efficiency, yet combining reinforcement learning (RL) with distillation is often multi-stage and may erode RL gains We observe that few-step RL progressively improves structural coherence, even with specialized rewards, but leaves low-level artifacts that these rewards may fail to penalize. To address this gap, we propose AdvFidelity, which integrates artifact-sensitive fidelity supervision into RL through an online adversarial reward. This enables joint reward alignment and high-fidelity few-step generation within a single RL stage, without distribution matching distillation (DMD) or other explicit distillation objectives. We train a discriminator to rank high-quality references (positives) above content-matched reconstructions (negatives) produced by the current generator. Reconstructing moderately noised references largely preserves style and scene layout while exposing low-level degradations. This encourages the discriminator to assess artifacts rather than content differences. With negatives reconstructed online, alternating updates adapt fidelity supervision to the generator's evolving failure modes. References can come from existing target-domain data or full-step model samples. Built on LeapAlign, AdvFidelity backpropagates gradients from both rewards through the few-step sampling trajectories used at inference. Across two model backbones and three task settings, AdvFidelity matches full-step LeapAlign in alignment, task performance, and overall generation quality and remains highly competitive with other evaluated full-step RL methods, using only 4 or 8 steps without CFG.
70. 【2610.29374】AOV-GS: Active Open-Vocabulary Semantic Mapping with 3D Gaussian Splatting
链接:https://arxiv.org/abs/2610.29374
作者:Rodion Shkokov,Tatiana Zemskova,Dmitry Yudin
类目:Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词:fixed label set, Robots deployed, label set, deployed in human-centered, human-centered environments
备注: 17 pages, 7 figures, 7 tables. Published at AIST 2026
点击查看摘要
Abstract:Robots deployed in human-centered environments need maps that support both geometric navigation and open-vocabulary semantic queries beyond a fixed label set. A key challenge is enriching such maps with semantic information without relying on manually annotated segmentation masks or closed-set semantic categories. Existing geometry-driven active mapping maximizes coverage but treats semantics as a passive by-product of the collected trajectory, whereas active semantic mapping typically depends on supervised semantic segmentation. We present AOV-GS, an active 3D Gaussian mapping system that guides exploration using frozen foundation models. During coarse exploration, AOV-GS re-ranks geometrically promising candidate views according to CLIP mask-embedding novelty computed from SAM instance segmentation, biasing exploration toward semantically informative regions. Frozen SAM and CLIP provide instance masks and language-aligned embeddings throughout mapping, while a lightweight scene-specific language field is fitted offline directly to the collected CLIP embeddings rather than manually annotated masks, enabling open-vocabulary text-query segmentation on novel views. In a controlled comparison using the same SAM-CLIP perception stack, AOV-GS improves average language-field mIoU over geometry-only active planning by 1.3 percentage points on Replica (34.6% on eight scenes) and by 1.8 points on Matterport3D (23.1% on five scenes). With CorrCLIP, AOV-GS reaches 35.6% on Replica, 2.0 points above the matched Geometry-based + CorrCLIP baseline. Novel-view PSNR remains comparable to the geometry-only baseline on both datasets while depth L1 improves on Replica. Code is available at this https URL.
71. 【2610.29361】Seeing through Denoising: Frequency-guided One-step Denoising for Infrared Small Target Detection
链接:https://arxiv.org/abs/2610.29361
作者:Xuelin Qian,Zixuan Wang,Chang Xu,Dingwen Zhang,Junwei Han
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:challenging task due, extremely small size, Infrared small target, heavy background clutter, small target detection
备注: 13pages, 5figures
点击查看摘要
Abstract:Infrared small target detection (IRSTD) is a challenging task due to the extremely small size of targets, low signal-to-noise ratios, and heavy background clutter in infrared imagery. While the progress of deep learning has advanced this field, existing methods primarily adopt discriminative paradigms that directly map images to target masks, overlooking the potential of generative modeling. In this paper, we propose DiffIRSTD, a novel generative framework that reformulates infrared small target detection as a background reconstruction problem. Instead of explicitly predicting target regions, we reinterpret small targets as noise-like signals and leverage a diffusion-based model to recover a clean, target-free background from a perturbed input image. The residual between the reconstructed background and the original image is then exploited to highlight candidate target regions, providing explicit cues for subsequent detection. To address the computational cost typically associated with diffusion sampling, we introduce a one-step denoising strategy that enables efficient background reconstruction while maintaining practical inference speed. Furthermore, we present a frequency-guided perception loss to preserve high-frequency background details and focus more on the reconstruction quality of target regions. More importantly, our DiffIRSTD operates as a plug-and-play framework, compatible with existing IRSTD models without increasing the computational complexity of detectors. Extensive experiments on IRSTD-1K, NUAA-SIRST, and NUDT-SIRST datasets demonstrate the superiority of our method, achieving state-of-the-art performance across three benchmarks.
72. 【2610.29358】Reading the Mask: Descriptor-Grounded BI-RADS Rationale Generation for Breast MRI Segmentation
链接:https://arxiv.org/abs/2610.29358
作者:Hrishikesh Singh,Aarti Sharma,Divyanshu Kumar,Millie Pant
类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词:Deep learning based, dynamic contrast-enhanced MRI, accurately delineate tumours, Deep learning, contrast-enhanced MRI
备注:
点击查看摘要
Abstract:Deep learning based models accurately delineate tumours on dynamic contrast-enhanced MRI (DCE-MRI), but segmentation masks alone do not provide the rationales or reasoning used by radiologists to assess the lesion suspicion. This limits the explainability as well the clinical integration. We investigate whether clinically relevant descriptors can instead be derived from the segmentation masks and their dynamic contrast-enhancement series. We have used Breast Imaging Reporting and Data System (BI-RADS) guidelines as a structured framework. Using these guidelines we designed a BI-RADS decision tree with eight quantitative measurements using radiomics, together with the lesion size and component count, that determine the descriptors at eight nodes. Using these descriptors we generate natural-language rationale using a large language model. The model was constrained to express only the derived records from the decision tree. After applying this framework to the expert and automatic masks of each of the 1,506 cases in the MAMA-MIA dataset, we generated a reproducible corpus of 3,012 BI-RADS grounded rationales. We obtained a faithfulness score of 99.98% and a counterfactual accuracy of 99.3%, indicating that the generated rationales faithfully verbalises the measured descriptors and correctly reflects changes in the underlying record. Agreement between the descriptors from expert and automatic masks falls from 0.832 to 0.549 as mask quality falls from Good to Missed. The generated rationales are intended as draft representations for radiologist review and final sign-off rather than autonomous clinical reports.
73. 【2610.29327】OACap: Caption-Guided Active Observation for Detailed Video Captioning
链接:https://arxiv.org/abs/2610.29327
作者:Hao Shi,Hong Yan,Xiaoyang Zhang,Qing Cui,Chao Huang
类目:Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Multiagent Systems (cs.MA); Multimedia (cs.MM)
关键词:Unlike question answering, coherent global description, open-ended detailed captioning, Unlike question, Observation-Adaptive Video Captioner
备注: 14 pages, 4 figures, 4 tables. Technical report
点击查看摘要
Abstract:Unlike question answering, where a query specifies a perceptual target, open-ended detailed captioning must determine what evidence to acquire and how to integrate it into a coherent global description. We propose Observation-Adaptive Video Captioner (OACap), a caption-centered agent that turns unsupported or missing information into targeted observation requests, uses spatiotemporal tools to acquire evidence, and iteratively verifies and revises the caption. OACap captions consistently improve performance across general video-understanding benchmarks using a fixed text-only reader. To better diagnose the information they preserve, we introduce Factual-Semantic Captioning Bench (FSCap-Bench). Its Core-Support Factuality Score (CSFS) combines claim precision with importance-aware fact coverage and responds as expected to four controlled perturbation types on 93.0-98.3% of valid caption pairs. Its Cross-Modal Semantic Round-Trip Score (CSRS) measures semantic preservation through a video-caption-video-caption round trip by matching atomic facts from source and recovered captions. Together, they connect downstream textual-memory utility with factual and semantic preservation.
74. 【2610.29322】OpenMAP-HIE: Pathology Informed Score-based Diffusion Model for Unsupervised Neonatal Hypoxic-Ischemic Encephalopathy Lesion Segmentation
链接:https://arxiv.org/abs/2610.29322
作者:Pengyu Kan(Johns Hopkins University),Craig Jones(Johns Hopkins University, University of Alberta),Kenichi Oishi(Johns Hopkins University School of Medicine)
类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词:scarce expert annotations, apparent diffusion coefficient, HIE lesion localization, Accurate localization, ischemic encephalopathy
备注: 22 pages, 4 figures, 9 tables
点击查看摘要
Abstract:Accurate localization of neonatal hypoxic--ischemic encephalopathy (HIE) lesions on apparent diffusion coefficient (ADC) images is clinically important but is limited by scarce expert annotations and substantial variation in lesion appearance. We propose OpenMAP-HIE, a pathology-informed score-based diffusion model for unsupervised HIE lesion localization without voxel-wise lesion supervision. A denoising diffusion model learns the healthy neonatal ADC distribution, while a ControlNet-based conditional branch preserves patient-specific anatomy. At inference, anomaly evidence is derived directly from differences between conditional and unconditioned noise predictions at independently evaluated diffusion noise levels, avoiding dependence on a final pseudo-healthy reconstruction or sequential reverse-diffusion chain. Based on the characteristic ADC reduction associated with acute HIE, only discrepancies consistent with the expected pathological direction are retained and aggregated across noise levels using a geometric mean. Spatial mean filtering further suppresses isolated responses. The framework was evaluated on the BONBID-HIE dataset. The ADC-only method achieved a Dice score of $0.283\pm0.244$, average precision of $0.505$, Hausdorff distance of $25.45\pm15.63$ mm, mean average surface distance of $9.40\pm8.49$ mm, and normalized surface distance of $0.355\pm0.236$, providing the best overlap and surface-distance performance among the evaluated unsupervised methods and Dice performance comparable to supervised ADC-only models. Optional population-derived ADC $Z$-map refinement further increased Dice to $0.602\pm0.269$. These findings support pathology-informed score discrepancies as a useful signal for neonatal HIE lesion localization, while highlighting remaining challenges in detecting small and low-contrast lesions.
75. 【2610.29318】Asking What a Director Sees Can Change What Vision-Language Models Choose
链接:https://arxiv.org/abs/2610.29318
作者:Jiaxuan Guo,Xingyu Ren,Kejia Zhang,Jingxin Yang,Youran Sun,Haizhao Yang
类目:Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词:Vision-language models, theory of mind, routinely tested, tested on theory, Director
备注:
点击查看摘要
Abstract:Vision-language models are now routinely tested on theory of mind: whether they can work out what another person sees, knows, and means. A common design asks the model to report that perspective and then to act for the person, and reads a correct report beside a wrong action as a failure to use the perspective. That reading rests on a quiet assumption: that asking for the report leaves the action unchanged. We show that it does not. In a rendered Director Task, a partition hides the largest block from a director who asks for "the largest block". Asking first which blocks the director can see raises the share of replies that choose this hidden block by 12 to 88 percentage points on six GPT models and by 17 on Qwen3.8-27B, even though the models mostly report correctly which blocks the director sees. Reasoning traces and prompt rewordings suggest why: the question shifts how the request is read, from the director's view toward the model's own. When the prompt states what the director knows and refers to, fewer than 1% of replies pair a correct report with a hidden-block choice. Any evaluation that elicits a perspective report before the action it scores needs a baseline without the question, and we deliver one: paired prompts that differ only in that question, a design any perspective-taking benchmark can adopt.
76. 【2610.29295】Latent space configuration for neural network finetuning, fast ranking, and embedding dimensionality reduction
链接:https://arxiv.org/abs/2610.29295
作者:Nikita Gabdullin,Anton Raskovalov
类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词:Latent Space Configuration, neural network, artificial intelligence, similar elements, areas of computer
备注: 14 pages, 4 figures, 2 tables, 2 algorithms
点击查看摘要
Abstract:Finding K most similar elements for a query in a large gallery of neural network (NN) embeddings is essential in various areas of computer science and industrial applications of artificial intelligence. This paper proposes search algorithms for structured latent spaces (LS) of NNs which allow to speed up top K item retrieval owing to O(1) complexity small candidate gallery subset search. ArcFace-pretrained IResNet50 models are finetuned using Latent Space Configuration (LSC) methodology to obtain new distribution of embeddings with desired geometric properties. Applying the proposed algorithms to embeddings obtained from finetuned models leads to several times speed-up over baseline exhaustive search. Specifically, we report up to 3 times speed-up on GPU and 40% speed-up on CPU compared to the baseline method GPU speed. These results are obtained for the original and reduced numbers of LS dimensions. The results show that LS dimensionality reduction allows to further accelerate the search and even improve rank-N metrics.
77. 【2610.29283】Computer Vision and Knowledge-Grounded Language Models for Intelligent Beekeeper Assistance
链接:https://arxiv.org/abs/2610.29283
作者:Asaduz Zaman,Mohaimenul Azam Khan Raiaan,Malika Nisal Ratnayake
类目:Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词:extreme weather patterns, global food products, wild bees sustain, bees sustain roughly, colonies face mounting
备注:
点击查看摘要
Abstract:Managed and wild bees sustain roughly a third of the global food products, yet colonies face mounting stress from climate-change including extreme weather patterns, altered parasite and disease patterns. Timely assessment of colony condition such as understanding colony strength, brood area, honey and pollen storage, comb usage, is essential to adaptive management. However, manual hive frame inspection is slow, costly, and quality depends on scarce expertise. We present an artificial targeted intelligent system framework focusing on edge deployable pipeline that turns hive frame photographs into interpretable and action-oriented inspection report. The pipeline includes an object detector to detect biologically-meaningful comb-cell classes; detections are distilled into structured fact schema; facts are converted into constrained factual text; the text triggers a grounded knowledge-base for interpretations and recommendations. Knowledge-base entries are required to be triggerable by evidence expressed in the fact schema. We built our system based on open source FAIRHiveFrames-1K dataset and favour reproducible, edge-deployable models over large general purpose frontier models. We additionally release FAIRHiveText-1K dataset that turns FAIRHiveFrames-1K dataset into interchangeable facts and text interpretation of the facts, making it easy for further LLM-based research into this area. We also propose a pathway to develop the grounded knowledge-base that will be helpful in providing interpretable and actionable reports from the facts.
78. 【2610.29272】Certified Abstention for Provably-Unidentifiable Index-Phase Recovery in Image Registration
链接:https://arxiv.org/abs/2610.29272
作者:Dinh Tuan Nguyen,Trong Nhan Nguyen,Vu Nguyen Minh Hung,Tien Minh Khoi Nguyen,Jaeyeop Choi,Sudip Mondal,Jae Sung Ahn,Junghwan Oh
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:Image registration underpins, registration underpins measurement, position necessarily fabricate, rarely posed, Image registration
备注: 13 pages, 5 figures; supplementary material in ancillary files. Code and data: [this https URL](https://doi.org/10.5281/zenodo.21502909)
点击查看摘要
Abstract:Image registration underpins measurement across scanning, camera, and microscopy imaging, yet a fundamental question is rarely posed: when is the sample-to-position map recoverable at all, and when does any estimator that reports a position necessarily fabricate one? We show that in reference-perturbed sampled imaging, where samples are localized through a perturbed reference, position fidelity (where samples land) and phase fidelity (which reference index becomes each block's origin) are logically independent: no policy acting on position information alone can guarantee phase fidelity. We derive a tight resolution threshold separating recoverable from provably-unidentifiable registration, and a recovery framework that certifies identifiable regions--recovering them exactly--while abstaining on provably-unidentifiable regions rather than hallucinating structure. On a deployed scanning system we measure a direction-bimodal registration offset consistent with the theory. Against classical and learned restoration baselines, certificate-free offset estimators fabricate structure on the unidentifiable regime, whereas the certified method abstains rather than fabricating. Finally, the certified-abstention mechanism carries across scanning, rolling-shutter, and cryo-electron-microscopy imaging--declining rather than fabricating on the regime it flags--though how completely it abstains and how tightly it bounds kept-region risk stay modality-specific (at extreme SNR the cryo-EM certificate abstains only partially): a structural-versus-statistical boundary in registration reliability.
79. 【2610.29267】Clinical radar heart sounds with echocardiographic phenotypes of ventricular dysfunction and valvular disease
链接:https://arxiv.org/abs/2610.29267
作者:Jinye Li,Qingchao Chen
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:echocardiography characterizes ventricular, activity without contact, Radar heart sounds, heart sounds capture, echocardiography characterizes
备注:
点击查看摘要
Abstract:Radar heart sounds capture cardiac mechanical activity without contact, while echocardiography characterizes ventricular and valvular function. Paired measurements connect these signals to structural heart disease, yet such data remain sparsely represented in public resources. Here we present 537 radar heart-sound recordings paired with one echocardiographic report for each of 162 patients. The cohort covers three overlapping phenotypes: left ventricular ejection fraction (LVEF) below 50%, regional wall-motion abnormality and at least moderate valvular regurgitation, present in 38, 43 and 39 patients, respectively. Original complex signals, processed radar heart sounds and temporal quality segmentation support signal-to-phenotype analysis. Technical validation retains 95.93% of signal duration and confirms reproducible waveform reconstruction. Patient-level five-fold evaluation achieves a mean outer-test AUROC of $0.770\pm0.138$ for reduced LVEF, identifying mechanical information associated with ventricular systolic dysfunction. This resource supports research linking non-contact cardiac mechanical signals to echocardiographic structural and functional phenotypes.
80. 【2610.29257】CRAB: Cuboid-based Representation for As-built BIM from Point Clouds
链接:https://arxiv.org/abs/2610.29257
作者:Haoran Xiong,Jing Wang,Shanshan Pan,Zihao Yan,Minglun Gong,Hui Huang
类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词:As-built BIM reconstruction, As-built BIM, clouds demands semantic, point clouds demands, layouts or planar
备注: CRAB accepted to SIGGRAPH Asia 2026
点击查看摘要
Abstract:As-built BIM reconstruction from point clouds demands semantic, volumetric, parametric, and editable building components, beyond 2D layouts or planar abstractions. Yet existing scan-to-BIM pipelines often rely on handcrafted rules, heuristic optimization, or manual correction, while learning-based methods fall short of recovering wall thickness, opening geometry, and component-level BIM structure. We introduce CRAB, a BIM-ready cuboid reconstruction framework that encodes walls, doors, windows, beams, and columns as compact architectural cuboids with IFC-compatible semantics and parameters. CRAB bridges point clouds and editable BIM by combining ProposalNet, which predicts coarse component cuboids, with AssemblyNet, a relation-aware Flow Matching model that refines geometry, predicts structural relationships, and enables automatic structural correction and human-guided editing. To address limited cuboid-level supervision, we extend Structured3D with component-wise cuboid annotations and construct cuboid-based procedural scenes. Experiments show CRAB surpasses floor plan and plane-based alternatives in component completeness, geometric accuracy, and generalization. For interior wall thickness estimation, CRAB achieves a mean error of 2.80 cm, with 79.50% of matched walls within 3 cm. The project page is available at this https URL.
81. 【2610.29248】ER-Chord: Spatially Consistent One-Step Image Editing via Equal-Energy Reliability Redistribution
链接:https://arxiv.org/abs/2610.29248
作者:Peize Li,Hanzhen Zhao,Xingguo Xu,Yilong Fan,Zhen Tao,Bo Yin,Zhifei Liu,Qingdong He,Xiaobin Hu
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:models enable fast, enable fast text-guided, fast text-guided image, text-guided image editing, generative models enable
备注:
点击查看摘要
Abstract:One-step generative models enable fast text-guided image editing, yet they often introduce unintended changes to regions that should remain unchanged. Temporal aggregation stabilizes editing fields across noise levels, but leaves their spatial allocation insensitive to local variations in reliability. Consequently, temporal stability alone does not ensure spatially consistent editing. To address this lim- itation, we propose ER-Chord, a training-free and inversion-free framework for reliability-guided spatial redistribution. Our key insight is that agreement between editing fields at neighboring noise levels provides a local reliability signal for allocating editing strength. We formulate this allocation as an equal-energy op- timization that redistributes control energy according to local reliability while preserving the original editing directions and total control energy. This formu- lation admits a unique global solution that can be efficiently computed using existing field evaluations, requiring no additional denoiser calls. Experiments on two benchmarks, PIE-Bench and TEdBench, demonstrate improvements over state-of-the-art one-step editing baselines, achieving superior source preservation alongside consistent gains across multiple generative this http URL project page is at this https URL.
82. 【2610.29246】DepState-JEPA: Learning Depth-Grounded State Representation for Visual Perception and Manipulation
链接:https://arxiv.org/abs/2610.29246
作者:Xiujian Liang,Liuyuan Na,Zehao Du,Jiacheng Xu,Weixi Song,Mingyang Sun,Xingjun Ma,Cewu Lu,Jianhua Sun
类目:Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词:connect scene geometry, common scene representation, scene geometry, depth, RGB
备注:
点击查看摘要
Abstract:Predictive representations for robot manipulation should connect scene geometry with the state changes induced by actions. Our intuition is that understanding what an action will change starts with understanding where things are: complementary RGB and depth observations ground a common scene representation from which to infer those changes. Guided by this intuition, we introduce \textbf{DepState-JEPA}, a dual-stream RGB--Depth joint-embedding predictive architecture that connects spatial understanding with action-conditioned prediction through a shared latent state, \textbf{DepState}. Built on V-JEPA~2.1, the framework uses depth both as a complementary observation stream and to ground both modalities in metric 3D space, aggregating shared information into DepState while retaining modality-private features for decoding. Ray-conditioned readouts predict local features without target depth; after an action-conditioned transition, the same decoders predict future RGB and depth features using the predicted state and fixed initial private features. Robot-state readouts provide recursive proprioceptive inputs; object-trajectory supervision and calibrated forward kinematics shape state learning through motion targets and joint--TCP consistency. Comparisons show stronger RGB-encoder transfer after RGB-D adaptation, feature completion, conditioned visual forecasting, and manipulation success. Within-model ablations identify contributions from depth content, metric coordinates, and future-state matching, with additional control gains from FK regularization.
83. 【2610.29244】Failure Modes of Vision-Language Models for Human Activity Understanding in Thermal HRI
链接:https://arxiv.org/abs/2610.29244
作者:Han Hu,He Chen
类目:Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词:cameras enable robots, personally identifiable appearance, identifiable appearance information, Thermal cameras enable, perceive human activities
备注: 9 pages, 6 figures, 2 tables
点击查看摘要
Abstract:Thermal cameras enable robots to perceive human activities in darkness while revealing less personally identifiable appearance information and fewer details of the surrounding environment than RGB cameras. As vision-language models (VLMs), originally developed for RGB imagery, are increasingly integrated into embodied systems for scene understanding and high-level planning, thermal sensing offers a promising way to extend activity perception to low-light and privacy-sensitive settings. However, the failure modes of VLMs in thermal human activity understanding for human-robot interaction (HRI) remain underexplored. We fill this gap by evaluating seven locally deployable VLMs, including models developed for physical AI and robotics, on two person-centric thermal datasets. Our diagnostic tasks examine fine-grained action recognition, activity timeline reconstruction, and the ability to withhold unsupported answers. Paired RGB recordings serve as a performance reference, while controlled variations in frame sampling, thermal input presentation, and reasoning are used to assess whether the observed errors can be mitigated. Our results show that models can recognize broad activity categories but struggle with fine-grained actions such as coughing, sneezing, and yawning. They also produce inaccurate event timelines and hallucinate actions involving objects. Simple thermal input preprocessing and additional reasoning offer only limited, model-dependent gains. Abstention behavior also varies across models even under explicit instructions, limiting their reliability for practical robotic use.
84. 【2610.29241】Encoded but Unused: Bounding the Sources of VLM Errors
链接:https://arxiv.org/abs/2610.29241
作者:Anat Veikherman,Mor Ventura,Nitay Calderon,Lihi Zelnik-Manor,Roi Reichart
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:visual evidence required, Visual Evidence Lens, visual evidence, vision-language models, visual-utilization failure rate
备注:
点击查看摘要
Abstract:In this paper, we investigate why vision-language models (VLMs) produce errors by decomposing them into two sources: visual-representation failures, in which the visual evidence required for the correct answer is not encoded, and visual-utilization failures, in which this evidence is encoded but not successfully used. We propose to estimate the visual-utilization failure rate using lightweight probes and derive theoretical bounds on the true rate that account for probe imperfections. We introduce VELens (Visual Evidence Lens), a rank-based probe that traces visual evidence for both a target object and its ground-truth attribute, such as color, material, or shape, across VLM layers. We evaluate VELens on over 6,000 images using LLaVA-1.6-7B and Qwen2.5-VL-7B. Our method achieves ROC-AUC scores of 0.95 and 0.91, respectively, and outperforms alternative probes in both low-resource and unseen-attribute settings. Using it to diagnose errors, we estimate that visual-utilization failures account for 84.4% of LLaVA errors and 70.0% of Qwen errors, with conservative lower bounds of 77.5% and 61.0%, respectively. Overall, our study identifies visual utilization as the dominant bottleneck in VLMs and suggests that a central opportunity for improvement lies in developing better mechanisms to locate, route, and use the visual information they already encode.
85. 【2610.29232】hink-Capture: Active 3D Geometry Acquisition for Spatial Reasoning in Vision-Language Models
链接:https://arxiv.org/abs/2610.29232
作者:Junjie Wang,Zhihao Yuan,Yunhan Tang,Sheng Xu,Jiaqi Mao,Xiaoyu Ye,Yueru Luo,Xu Yan,Chun-Mei Feng,Zhen Li
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:Vision-Language Models, maintain consistent, relations across sparse, sparse viewpoints, leading to spatial
备注: Accepted at WACV 2027
点击查看摘要
Abstract:Vision-Language Models (VLMs) excel at 2D recognition but often fail to maintain consistent 3D relations across sparse viewpoints, leading to spatial hallucinations under occlusion and perspective changes. Existing methods commonly fuse all frames with dense geometry, incurring substantial computation and context overhead while encouraging blind reliance on imperfect estimators. We present Think-Capture, a query-conditioned framework that first identifies task-critical objects and then acquires their geometry on demand. A 3D toolkit lifts zero-shot masks into a common coordinate frame, and a Symbolic 3D State Abstraction compresses object and camera states into structured text. Hierarchical Group Relative Policy Optimization (GRPO) trains the VLM on cases in which geometry either helps or misleads, teaching it when to use tool evidence and when to fall back on visual cues. Think-Capture-4B reaches 54.4% on MindCube-Tiny (+21.5 points over its backbone), 39.1% on the MMSI-Bench positional subset (+7.9), and 42.8% on ViewSpatial (+5.2). It also remains robust under coordinate and mask perturbations. The full stack fits one 24 GB GPU and serves as an asynchronous high-level reasoner on an Agibot G1. Our code is available at this https URL.
86. 【2610.29231】DisasterRoute: Evidence-Guided Dual-System Routing for Visual Disaster Question Answering
链接:https://arxiv.org/abs/2610.29231
作者:Tan Zhang,Xing Deng,Lu Zhang,Xiaofeng Zhu,Ping Hu
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:low-altitude UAV imagery, edge computing resources, low-altitude UAV, UAV imagery, limited edge computing
备注:
点击查看摘要
Abstract:Visual question answering from low-altitude UAV imagery must deliver timely and accurate judgments to support disaster response under limited edge computing resources. Routine questions may be answered through direct decisions, whereas more challenging questions may benefit from step-by-step reasoning. However, existing research primarily focuses on improving models' visual understanding and generative reasoning capabilities, with limited exploration of efficient direct decision-making and its adaptive coordination with generative reasoning. We develop Disaster-S1 based on a vision-language model adapted to the disaster domain. Trained for option discrimination, it outputs a probability distribution over answer options in a single multimodal forward pass for fast decision-making. We further propose DisasterRoute, a dual-system routing framework that combines prediction confidence with disaster evidence to decide whether to accept the initial answer or invoke the disaster reasoning model DisasterVL for review. By allocating inference computation on demand, the framework retains the efficiency of direct decision-making and improves overall question-answering accuracy through selective review. Experiments on DisasterBench show that Disaster-S1 achieves superior accuracy with low latency, while DisasterRoute further improves accuracy through selective review at substantially lower latency than full reasoning.
87. 【2610.29229】Cache Locally, Recompute Selectively for Streaming Video Understanding
链接:https://arxiv.org/abs/2610.29229
作者:Junhyeok Lee,Sangyoon Lee,Jaeho Lee
类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词:answering user queries, process incoming video, incoming video continuously, requires video-LLMs, low latency
备注:
点击查看摘要
Abstract:Streaming video understanding (SVU) requires video-LLMs to process incoming video continuously while answering user queries with low latency. Recent methods reduce query-time cost by prefilling frames into KV caches during idle time and reusing the cached KVs at query time. To bound per-frame computation over unbounded video streams, these methods restrict the context available during prefill. This creates a fundamental context mismatch: the restricted context may omit information needed to properly contextualize video tokens, yet, still contain information irrelevant to the eventual query, which is unknown during prefill. We propose FrameBlend, a simple yet effective plug-and-play method to address this mismatch through selective KV recomputation, without requiring any additional training. At query time, FrameBlend re-prefills selected video tokens using query-relevant context and replaces their cached KVs with recomputed ones. Crucially, this recomputation enables shorter attention windows during idle-time prefill, substantially reducing prefill cost while improving accuracy. Experiments across three SVU frameworks and five streaming and offline benchmarks demonstrate accuracy gains of up to 3.9 pp. On RVS-Ego, FrameBlend reduces per-frame prefill FLOPs by over 20% and total processing time by 14-59% for retrieval-based frameworks, including the cost of query-time recomputation. These results demonstrate that a simple change in how contextualization is distributed between idle time and query time can improve the accuracy-efficiency trade-off for SVU.
88. 【2610.29212】DetM-Tracker: Deterministic and Memory-Efficient VIS for Autonomous Industrial Inspection
链接:https://arxiv.org/abs/2610.29212
作者:You-Rui Lin,Jen-Chieh Wu,Tzu-Ti Wei,Jen-Jee Chen,Yu-Chee Tseng
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:requires strictly deterministic, strictly deterministic real-time, inspection requires strictly, Autonomous industrial inspection, Video Instance Segmentation
备注:
点击查看摘要
Abstract:Autonomous industrial inspection requires strictly deterministic real-time inference under tight memory and computational constraints. However, existing Video Instance Segmentation (VIS) models suffer from prohibitive scaling: dense temporal memory grows with spatial resolution and sequence length, while fixed-capacity decoders fail to exploit the inherent sparsity of industrial scenes, creating a practical memory wall on resource-constrained edge platforms. We present DetM-Tracker, a streamlined VIS framework for autonomous industrial inspection, where target objects often exhibit highly similar appearance under constrained "micro" fields of view. DetM-Tracker eliminates architectural redundancy through three synergistic components: (1) Compact Scalar Memory, which condenses high-dimensional instance features into four-scalar descriptors, reducing temporal memory complexity from $O(T \cdot N \cdot R)$ to $O(T \cdot \hat{N})$. This mechanism effectively compresses frame-level representations into a bank of active instances, where $R$ denotes resolution, $N$ and $\hat{N}$ represent global and window-specific instance counts, respectively and $T$ the temporal window size; and (2) Dynamic Instance Channels, which adaptively allocate query capacity according to the actual number of visible objects; and (3) Entropy-Gated Skip Connection, which concentrates computational budget on high-uncertainty spatial regions to refine object boundaries in a single forward pass without auxiliary refinement heads. Our approach effectively bridges the gap between modern VIS models and the practical demands of industrial edge deployment, reducing inference latency by approximately 20$\times$ and VRAM consumption by 6$\times$ compared to state-of-the-art dense-feature baselines.
89. 【2610.29200】NeuralSRender: G-Buffer Guided Video Diffusion for Sim-to-Real Rendering
链接:https://arxiv.org/abs/2610.29200
作者:Yipeng Lu,Youqi Liao,Zhenyu Wang,Yuning Peng,Zhen Dong
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:high-quality annotated visual, annotated visual data, scarcity of high-quality, high-quality annotated, annotated visual
备注: Tech repo
点击查看摘要
Abstract:The scarcity of high-quality annotated visual data remains a critical bottleneck for autonomous-driving perception. Simulators provide training data at scale, but the limited realism of synthetic videos compromises perception performance in real-world applications. To address this limitation, we propose NeuralSRender, a sim-to-real video translation framework that enhances the photorealism of synthetic videos while maintaining geometric consistency with the source scenes. Built on a pretrained video diffusion transformer (DiT), NeuralSRender uses a lightweight projector to inject geometric and material priors from G-buffers, and LoRA enables parameter-efficient adaptation. The model is trained in two stages: it first learns G-buffer conditioning from synthetic videos with accurate G-buffers, then adapts to real-world appearance using real videos with estimated G-buffers. During the second stage, an additional LoRA module is trained while the projector and first-stage LoRA remain frozen to reduce interference from estimation noise. NeuralSRender introduces only 1.45\% parameter overhead and can be trained on consumer-grade GPUs with 24 GB of memory. To support training and evaluation, we introduce GenReal, a large-scale driving video dataset comprising synthetic and real-world videos with corresponding G-buffers. Experiments demonstrate improved photorealism with competitive geometric consistency. Training perception models on our translated videos instead of raw simulator renders improves detection $\mathrm{AP}_{50}$ on nuImages from 35.1 to 40.6 and segmentation mIoU on Cityscapes from 32.4 to 40.8. Our code, data, and model weights are available at: this https URL.
90. 【2610.29196】A Unified Evaluation Framework of Physical Adversarial Robustness in the Edge VLM Era
链接:https://arxiv.org/abs/2610.29196
作者:Eric Liang,Alan Luo,Kaiwen Yuan
类目:Computer Vision and Pattern Recognition (cs.CV); Cryptography and Security (cs.CR); Machine Learning (cs.LG)
关键词:Recent advancements, open-vocabulary detection capabilities, demonstrating largely improved, largely improved zero-shot, generative decoding
备注: Accepted at the NeurIPS 2026 Workshop on Grounded and Faithful Vision-Language Models for Real-World Deployment (VLM4RWD). 16 pages, 6 figures, 5 tables. Code: [this https URL](https://github.com/ericliang1/physical-adversarial-robustness)
点击查看摘要
Abstract:Recent advancements in Vision-Language Models (VLMs) enable end-to-end visual grounding via language prompts and generative decoding, demonstrating largely improved zero-shot and open-vocabulary detection capabilities. As a result, VLMs are rapidly being deployed at the edge in safety-critical real-world systems. However, the physical adversarial robustness of edge VLMs has not been systematically studied, and the fundamental differences in output with modern object detectors create methodological challenges for fair evaluation. To compare the two families directly, we evaluate every selected representative model on one outcome: whether an adversarial patch worn on a person evades detection of the model. We report this by introducing a unified metric, conditional attack success rate (cASR), counted only on images the model still localizes under a matched gray occluder, and partition every failure into omission (no box), substitution (a box on the patch), and displacement (a box on neither). We benchmark the physical adversarial vulnerability of compact grounding VLMs against a range of object detectors, and find that the VLMs can be as vulnerable as the detectors. We disclose that failure mode is largely associated with the output format of a model rather than its architecture family. Of the three, only omission is visible to a downstream system; displacement and substitution return confident, well-formed boxes, making them potentially more dangerous failures. Further, we find that, under distribution shift, VLMs that primarily failed by omission instead shift to failing more by displacement/substitution. Thus, a grounding VLM can inherit the detector's vulnerability while showing the possibility to adopt more dangerous failure modes. Our code and data are available at this https URL.
91. 【2610.29177】ROCOCO: Robust Outline Completion of Occluded Curvilinear Objects
链接:https://arxiv.org/abs/2610.29177
作者:Ken Zheng,Jaimyn Drake
类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词:learning-based generative model, completing curvilinear features, environmental obstacles, propose a learning-based, learning-based generative
备注:
点击查看摘要
Abstract:We propose a learning-based generative model for completing curvilinear features under occlusion by environmental obstacles. To this end, we adopt a flow matching-based approach that supports the inpainting of occluded regions with the appropriate curvilinear features. To eliminate the reliance on privileged information about the occlusion a priori, we also train a UNet-based mask prediction model, which can identify regions for inpainting given only the occluded observation. The components of our approach are validated via experiments using procedurally-generated test cases, and the complete pipeline is validated using large public datasets for curvilinear objects. Against off-the-shelf inpainting baselines, ROCOCO is the strongest method by a wide margin when no occlusion mask is given, and is competitive with mask-supervised inpainting when one is, achieving best on full-image error and second only to LaMa on the occluded region, while using a completer of $7.7$M parameters against LaMa's $51$M and Stable Diffusion's $860$M.
92. 【2610.29176】Multi-Scale Latent Temporal Compression Attention and Video-Text Cross Attention Fusion for Video Action Detection
链接:https://arxiv.org/abs/2610.29176
作者:Yicheng Qiu,Keiji Yanai
类目:Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词:video action detection, action detection, streams is crucial, temporal, continuous video streams
备注: This paper has been accepted for publication in the proceedings of the 33rd International Conference on Multimedia Modeling (MMM 2027)
点击查看摘要
Abstract:In video action detection, modeling the temporal dependencies in continuous video streams is crucial. Previous methods based on deep neural networks can perform frame-level video recognition tasks. However, these methods struggle to model dynamic temporal patterns, facing challenges such as redundant frame information, difficulty balancing global and local features, and insufficient fusion of visual and textual features. To address these issues, we propose a video temporal attention module based on the Multi-Scale Latent Temporal Compression Attention, which aggregates continuous temporal sequences into feature representations across diverse temporal scales while efficiently reducing redundancy. We also introduce a Video-Text Cross Attention Fusion module that leverages cross-attention at both latent and standard feature levels, achieving fine-grained fusion between video and textual features to enhance semantic alignment and feature interaction. Experimental results across multiple video recognition benchmarks demonstrate that our proposed methods achieve superior performance compared to existing methods, validating the effectiveness and generalization capability.
93. 【2610.29174】LocalAgent: Collaborative Agentic Verification for Fine-Grained Instance-Level Consistency
链接:https://arxiv.org/abs/2610.29174
作者:Jiachen Guo,Xinshan Zhu,Boyun Wang,Yanyan Liang,Jun Wan,Feng Lin,Ajian Liu
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:large language models, made rapid progress, Multimodal large language, general visual understanding, fine-grained instance-level consistency
备注: 22 pages, 4 figures
点击查看摘要
Abstract:Multimodal large language models (MLLMs) have made rapid progress in general visual understanding, yet they still struggle with fine-grained instance-level consistency verification, where the goal is to determine whether two images depict the exact same physical object under varying viewpoints, illumination, and backgrounds. This task requires both global semantic perception and precise examination of subtle local evidence, since semantically similar objects may differ only in small suspicious regions. To address this challenge, we propose LocalAgent, a collaborative agentic framework that integrates the complementary strengths of a generalist MLLM and lightweight specialist verifiers. The MLLM first reasons globally to identify suspicious local regions, which are then delegated to a Local Evidence Verifier (LEV) toolkit for fine-grained appearance and geometric matching. LEV comprises Local Appearance Consistency (LAC), which estimates appearance similarity under illumination and color changes, and Local Geometric Correspondence (LGC), which estimates spatial correspondence under viewpoint changes. LEV returns structured scalar evidence that the MLLM integrates for the final decision. We further introduce an auxiliary-capped reinforcement fine-tuning (RFT) strategy, in which answer correctness dominates auxiliary tool-use and format signals, enabling the policy to learn when verification is necessary. Experiments show that LocalAgent improves mean accuracy by 4.9% over the strongest CoT-RFT baseline while invoking a verifier on only 12.13% of samples and preserving the general multimodal capabilities of the underlying MLLM. The open-source repository is available at this https URL.
94. 【2610.29168】How Representational Priors Shape Generalization in World Action Models
链接:https://arxiv.org/abs/2610.29168
作者:Junha Chun,Youngjoon Jeong,Taesup Kim
类目:Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词:shown to substantially, substantially diverge, representational prior, generalization performance based, generative backbones
备注:
点击查看摘要
Abstract:World action models (WAMs) are shown to substantially diverge under generalization performance based on their generative backbones. We investigate this gap through the representational geometry that WAMs inherit from their backbones and how policy training reorganizes it. Our central hypothesis is that a useful representational prior would structure geometry that separates nuisance information from the in-distribution manifold in advance of training as a policy. We quantify this with nuisance orthogonality; orthogonality of the feature under visual variation outside the empirical in-distribution manifold. Across various image and video backbones, we show that a higher orthogonality from the representational prior is associated with stronger robustness to visual variations after WAM training, enabling policy generalization measurable prospectively for world models. In addition, analyzing the resulting robust WAMs reveals nuisance suppression; relative suppression of feature displacement caused by such variations and robust action generation of the policy. Together, these findings provide a geometric perspective on how the representational prior of the world model shapes the generalization performance of WAMs.
95. 【2610.29165】Carving Radiology Reports at Their Evidential Joints: Anatomical Region Sets as Generation Units
链接:https://arxiv.org/abs/2610.29165
作者:Jinwei Yang,Junhao Chen,Jianwei Zhao,Zhonghan Xu,Hong Cheng,Ling Wang
类目:Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词:Organizing radiology reports, generate fine-grained clinical, fine-grained clinical content, Organizing radiology, generated units offers
备注: 28 pages, 4 figures
点击查看摘要
Abstract:Organizing radiology reports into independently generated units offers a way to generate fine-grained clinical content and bind it to visual evidence. However, existing methods typically adopt generation-unit structures not directly specified in natural reports or their annotations, introducing additional modeling compromises. We propose RadCarve, which instead defines generation units directly from the anatomical region sets in existing statement-region correspondences, unifying unit formation with visual evidence selection. RadCarve's planner uses composition-specialized query banks to jointly predict unit existence and region composition from the image, iteratively refining both with regional evidence aggregated according to current membership predictions. The generator independently produces each unit's text conditioned on the joint visual evidence of its predicted region set. Compared with strong baselines, RadCarve improves CXRFEScore by 9.4% in unit generation given region sets and achieves 2.4 times the end-to-end binding F1. It also achieves leading report-generation results on Chest ImaGenome and PadChest-GR, using fewer than one-sixth as many parameters as large-scale baselines.
96. 【2610.29159】RiO-DETRv2: Geometry-Aware Uncertainty Modeling Meets Real-Time Oriented Object Detection Transformer
链接:https://arxiv.org/abs/2610.29159
作者:Zhangchi Hu,Zilong He,Yifan Zhao,Xiangyu Yu,Jie Chen,Peixi Wu,Yansong Peng,Hebei Li,Xiaoyan Sun
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:expressive box representation, localization gains require, oriented object detection, gains require, oriented object
备注: 14 pages, 7 figures, 10 tables
点击查看摘要
Abstract:RiO-DETR is the first real-time end-to-end transformer for oriented object detection, yet further localization gains require a more expressive box representation. Although distributional regression has succeeded in horizontal DETRs, extending it to oriented detection introduces geometry-misaligned boundary modeling and topology-inconsistent orientation refinement. We present RiO-DETRv2, a geometry-aware uncertainty modeling framework for real-time oriented object detection. To resolve the geometry mismatch, Object-Aligned Boundary Distribution Refinement represents box boundaries as probability distributions in an object-aligned coordinate system and progressively refines them across decoder layers. For better orientation topology consistency, we introduce Circular-to-Local Angular Residual Refinement that transitions from global periodic search to local fine-grained estimation. Unified OBB Quality-Aligned Learning further aligns classification, boundary and angular refinement with complete-OBB localization quality. Together, these designs improve localization without compromising efficiency, achieving a better balance between speed and accuracy. Specifically, RiO-DETRv2-l/x achieves 53.7/54.1 mAP50-95 on DOTA, outperforming RiO-DETR-l/x by 1.2/1.5 points with nearly unchanged computational cost. Code is available at this https URL.
97. 【2610.29158】SICAF: Time-Varying Focus Bottleneck for Self-Supervised Event-Based Optical Flow with Spiking Neural Network
链接:https://arxiv.org/abs/2610.29158
作者:Shuangming Yang,Qing He,Shangqi Guo,Badong Chen
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:Event-based optical flow, Event-based optical, optical flow estimation, estimation achieves high, high temporal resolution
备注: 27 pages, 6 figures, 10 tables
点击查看摘要
Abstract:Event-based optical flow estimation achieves high temporal resolution and dynamic range by exploiting asynchronous events, while self-supervised learning provides an effective solution to the absence of ground-truth labels. Spiking neural networks (SNNs), as brain-inspired models, process information through asynchronous spikes, naturally aligning with optical flow events. However, the temporal irregularity across event streams hinders the compact extraction of spatiotemporal features, while the absence of explicit labels leads to spurious correlations, thereby increasing redundancy within latent representations. In this paper, we propose a novel 'Compactly Compress, Time-varying Focus' training strategy. We present SICAF (Spikes Information Compression And Focus) framework that formulates the learning process as a constrained optimization with temporal modulation. It encourages self-supervised SNNs to extract compact latent representations while preventing over-compression that would discard temporal saliency. To better enable feature selectivity across time steps, we design an estimator with learnable temporal attention, achieving context awareness with cross-time dependencies. Experimental results on several datasets demonstrate that SICAF achieves state-of-the-art performance in self-supervised SNNs, with a 8.14% improvement in AEE on the MVSEC dataset and a 13.49% increase in robustness under white-box adversarial attacks.
98. 【2610.29152】From Augmentation to Synthetic Evidence: Evaluating Generated Chest Radiographs at Dataset Intake
链接:https://arxiv.org/abs/2610.29152
作者:Shaikh Akib Shahriyar,Zinedine Sehili,Adam Arthur,Christopher Schwartz
类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词:declared augmentation, images, Cheff-identified, SynthCheX, origin classifier flags
备注:
点击查看摘要
Abstract:A generated chest radiograph can be useful as declared augmentation, but the same image becomes unsupported evidence when submitted as the record of a real examination. We study this problem by separating three questions: whether an image passes an automated quality check, whether an origin classifier flags it as generated, and whether a trusted record supports the claimed acquisition. In our experiments, Qwen selects up to 20 images from pools of 1,000 existing Cheff-identified or SynthCheX candidates. A receiver evaluates quality with MedGemma and predicted origin with a classifier on frozen DINOv3 features. Quality-based selection raises quality passes from 12 to 19 of 20 for Cheff-identified images and from 8 to 17 for SynthCheX. We find no evidence that selection improves passage through both checks: no selected Cheff-identified image passes both, while uniform, quality, and quality-constrained surrogate selection produce 2, 1, and 2 SynthCheX passes. On unprocessed test images, the origin classifier flags 4,677 of 5,000 SynthCheX images, but it also misclassify 110 of 2,297 NIH (real) images and 568 of 957 genuine images from another collection as fake. Our results further show that JPEG compression reduces SynthCheX-versus-NIH AUROC from 0.987 to 0.841. Even without processing, 152 SynthCheX images pass both pixel checks. These checks can filter submissions, but they cannot verify an acquisition claim. We strongly advocate that source and intended use must be recorded and checked separately for admission of chest radiographs in medical datasets.
99. 【2610.29141】DGCM-SSFA: Dual-Granularity Cross-Modulation and Sparse Strip Frequency Attention for Efficient 3T-to-7T MRI Synthesis
链接:https://arxiv.org/abs/2610.29141
作者:Zhichun Fan,Zhiqiang Chen,Lanling Liu,Lingjun Liu,Zhonghua Xie
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:Synthesizing high-fidelity, routinely acquired, scans offers, offers a practical, practical pathway
备注: Accepted by BIBM 2026
点击查看摘要
Abstract:Synthesizing high-fidelity 7T MRI from routinely acquired 3T scans offers a practical pathway to enhanced neuroimaging without the prohibitive cost of ultra-high-field scanners. While existing deep learning approaches have achieved promising results, state-of-the-art methods typically rely on either large-scale architectures exceeding 45 million parameters or computationally intensive ensemble strategies, limiting their practicality in resource-constrained clinical environments. In this work, we propose a compact multi-domain attention framework, termed DGCM-SSFA, that achieves competitive synthesis quality with only 11M parameters. The proposed architecture integrates two complementary modules into a U-Net Transformer backbone. First, a Dual-Granularity Cross-Modulated Feature Modulator (DGCM) is embedded at multiple hierarchical levels to enhance local edge and texture details through Sobel-guided spatial attention and depthwise frequency-aware channel attention with cross-branch gating. Second, a Sparse Strip Frequency Attention (SSFA) module at the bottleneck captures global spatial context via strip-pooled attention with near-linear complexity, while simultaneously performing FFT-based spectral modulation in the frequency domain. These two modules operate synergistically with the backbone's native channel attention, forming a triple-granularity feature refinement pipeline. Extensive experiments on the UNC and BNU 3T-to-7T MRI datasets across T1w and T2w modalities demonstrate that DGCM-SSFA achieves strong structural fidelity, attaining an SSIM of 0.8431 on BNU T2w---approaching the best benchmark value of 0.8624---and 0.8100 on BNU T1w, while using substantially fewer parameters than Transformer-based alternatives such as ResViT (123.4M) and FS-RWKV (45.4M).
100. 【2610.29126】wo for One: Privileged Learning for Resource-Constrained Screening
链接:https://arxiv.org/abs/2610.29126
作者:Lisa Y.W. Tang
类目:Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY)
关键词:Machine learning systems, Machine learning, developed under data-rich, data-rich conditions, conditions but deployed
备注:
点击查看摘要
Abstract:Machine learning systems are often developed under data-rich conditions but deployed when only incomplete information is available. A natural example arises in colour fundus photography (CFP), where both eyes are commonly imaged because they can provide complementary information for ocular disease assessment. Prior approaches that exploit bilateral information either fuse both eyes in a single model or use knowledge distillation to compress a dual-eye teacher into a lightweight student that still requires both images at test time. However, bilateral acquisition may not always be feasible. We thus propose a privileged learning framework in which a teacher model has access to bilateral CFP images during training and learns representations informed by information from both eyes, while the student is trained to transfer this knowledge from the bilateral teacher using only a single-eye image as input. At inference, the student operates exclusively on this single-eye input and does not require the contralateral image. Experimental results show consistent improvements in area under the receiver operating characteristic curve over conventional monocular training, with the largest gains observed for left-eye images for the detection of age-related macular degeneration (0.931 vs. 0.966) and diabetic retinopathy (0.789 vs. 0.836).%, while requiring only a single-eye image at inference. By enabling models to benefit from bilateral information during training while requiring only a single-eye image at inference, our approach may support more reliable deployment in resource-constrained clinical and screening environments.
101. 【2610.29108】WaFIR: Wavelet-Fourier Mixture-of-Experts with Subband-Adaptive Routing for Blind All-in-One Image Restoration
链接:https://arxiv.org/abs/2610.29108
作者:Trong Nhan Nguyen,Vu Hoang Minh Doan,Thanh Dat Le,Truong Tien Vo,Thi Thu Ha Vu,Tan Hung Vo,Jaeyeop Choi,Junghwan Oh,Truong-Son Hy
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:test time, adapt a shared, shared model, model to heterogeneous, label at test
备注: 24 pages, 15 figures, 13 tables, including supplementary material
点击查看摘要
Abstract:Blind all-in-one image restoration must adapt a shared model to heterogeneous and sometimes mixed degradations without a task label at test time. We introduce WaFIR, a decoder module that decomposes features into Haar subbands, summarizes each subband with a compact Fourier descriptor, and routes it to prompt-conditioned spectral modulation experts. Unlike image-level frequency conditioning, WaFIR makes routing decisions at the subband level, enabling frequency-specific processing while retaining the task context learned by the backbone. Under a unified training and evaluation protocol for denoising, deraining, and dehazing, WaFIR improves average PSNR over the three tasks by 0.48 dB over the PromptIR baseline and by 0.38 dB over the recent Up-Restorer. Matched-capacity and routing controls show that the gain is not explained by additional parameters alone. On unseen noise intensities, descriptor-based routing is more robust than a discrete label-conditioned alternative and remains on par under compound degradations, while routing analyses show stable subband-dependent expert use across degradation types. These results support subband frequency structure as an interpretable complement to prompt-based conditioning for blind image restoration. Code is available at this https URL
102. 【2610.29107】PhyMo: Learning Physical Dynamics with Accurate and Continuous Motion from Multi-View Videos
链接:https://arxiv.org/abs/2610.29107
作者:Shangjia Liu,Jinxi Li,Siyuan Zhou,Bo Yang,Bing Wang
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:physical motion states, important yet challenging, states that govern, motion, govern scene evolution
备注: Accepted at NeurIPS 2026
点击查看摘要
Abstract:Recovering dynamic 3D scene geometry, appearance, and the physical motion states that govern scene evolution from multi-view videos is important yet challenging. A key difficulty is that appearance can be deceptive. Under rendering supervision alone, a model may fit the observed images by changing color or opacity to compensate for inaccurate deformation, rather than recovering the true evolving geometry and motion. This issue is especially severe in scenes with fast or locally complex motion, where inaccurate trajectories can still produce plausible images over the observed frames, but lead to unreliable reconstruction and discontinuous future prediction. In this paper, we propose PhyMo, a framework for learning evolving dynamics from multi-view videos. We introduce a Motion-Aware Trajectory Representation that drives the model to recover accurate motion from deformation, rather than relying on appearance shortcuts to explain observed motion. On top of this, we propose a Continuous Motion Evolution module with bidirectional kinematic continuity constraint to promote temporally consistent evolution of displacement, velocity, and acceleration. Together, these designs yield geometrically faithful interpolation and continuous motion extrapolation. Experiments on four dynamic scene benchmarks demonstrate state-of-the-art performance.
103. 【2610.29106】DriftNeRF: Cross-Ray Density Drifting for Sparse-View Neural Radiance Fields
链接:https://arxiv.org/abs/2610.29106
作者:Juntang Wang,Yihan Wang,Sheng'en Li,Hao Wu,Dongmian Zou,Shixin Xu
类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词:Neural Radiance Fields, Neural Radiance, dense image collections, synthesize photorealistic, Radiance Fields
备注: 13 pages, 6 figures, 18 tables
点击查看摘要
Abstract:Neural Radiance Fields (NeRF) synthesize photorealistic novel views from dense image collections, but degrade sharply when few views are available. We attribute a specific, measurable defect to the objective itself: the rendering loss is a sum over independent rays and contains no term comparing densities that different rays assign to the same region of space, so nearby 3D points can settle on contradictory densities while every training pixel is reproduced correctly. We make this quantity explicit by measuring cross-ray density disagreement directly during training, and show that it stays high in vanilla NeRF, falls only incidentally under frequency-based regularization, and moves together with held-out quality in the sparse regime. We then close the gap with DriftNeRF, a drop-in regularizer that instantiates the drifting-field template on density samples: a masked exponential kernel aggregates densities from nearby points on other rays into a stop-gradient consensus target, and the resulting drifting field penalizes unsupported disagreement while leaving agreed-upon boundaries intact. The regularizer reads only sampled positions, ray identifiers, and predicted densities, so it requires no pretrained model, external geometry, or additional images, and transfers across field parameterizations. On NeRF-Synthetic it reduces residual disagreement by an order of magnitude, and across NeRF-Synthetic, DTU, and LLFF it improves 3-view PSNR over the strongest MLP-NeRF baseline by 0.42-0.65 dB and remains competitive with sparse-view Gaussian pipelines under a matched protocol without their depth, flow, or covisibility preprocessing.
104. 【2610.29104】From Canon to Nikon: Camera Domain Shift and Potential Equity Implications in Retinal AI
链接:https://arxiv.org/abs/2610.29104
作者:Lisa Y.W. Tang
类目:Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY)
关键词:remains limited worldwide, regular screening remains, screening remains limited, Diabetic retinopathy, preventable blindness
备注:
点击查看摘要
Abstract:Diabetic retinopathy is a leading cause of preventable blindness, yet access to regular screening remains limited worldwide. AI offers a scalable approach, but its performance can be sensitive to image quality and acquisition conditions. In a Brazilian cohort of 8,524 patients, retinal images acquired with the Nikon NF5050 were more than twice as likely to have inadequate image quality compared with those acquired with the Canon CR-2, despite refurbished Canon systems costing more than twice as much as Nikon systems. This potential cost-quality trade-off highlights an important consideration for the reliability of AI systems deployed across heterogeneous imaging systems. Using a frozen pretrained retinal foundation model, we systematically evaluate whether camera-associated performance differences persist across 12 retinal disease classification tasks, four input resolutions, and five downstream classifiers. We find that camera-associated performance differences vary substantially across tasks, and that neither higher input resolution nor classifier choice consistently mitigates cross-camera variation. These findings identify camera platform as a potentially overlooked source of performance variability, with implications for the safety and reliability of retinal AI when deployed across heterogeneous imaging systems. We release all source code, evaluation scripts, and per-task results on GitHub to support reproducible benchmarking.
105. 【2610.29102】Diffusion Posterior Sampling with Uncertain Forward Models
链接:https://arxiv.org/abs/2610.29102
作者:Wentao Shangguan,Vivek K Goyal
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:UAL, forward model parameters, forward model, motion deblurring, noise model
备注:
点击查看摘要
Abstract:Diffusion posterior samplers reconstruct signals by combining a pretrained diffusion prior with a measurement likelihood specified by a forward model and a noise model. Calibration and reference data can characterize uncertainty in the forward model's parameters, such as blur kernels or detector responses. Fixing these parameters at estimated values leaves their uncertainty out of the likelihood, and parameter errors are thus absorbed into the reconstruction. We introduce an uncertainty-aware likelihood (UAL), a Gaussian approximation to the marginal likelihood obtained by integrating over the uncertain parameters. For each candidate signal, UAL propagates parameter uncertainty into a structured measurement covariance, reducing the quadratic penalty along residual directions that parameter variation can explain. Existing samplers can use UAL in their data updates while retaining their pretrained diffusion priors and sampling schedules. Under a fixed Gaussian nuisance model, we bound likelihood error from linearization and average divergence between the exact marginal and UAL posteriors. We compare samplers with and without UAL across six inverse problems spanning Gaussian and motion deblurring, CT, MRI, ultrasound, and fluorescence microscopy, and find improvements in reconstruction and ensemble prediction. UAL reduces geometric mean MSE by 9% to 20% across samplers in the main Gaussian-deblurring setting and by 51% to 92% in motion deblurring when non-blind samplers use the population-mean kernel. In motion deblurring, DAPS and PnP-DM with UAL also give 6.2 to 6.4 dB higher ensemble-mean PSNR than published BlindDPS and Fast Diffusion EM. On the ablation set, UAL outperforms trace-matched isotropic inflation for PnP-DM in both deblurring tasks; in motion deblurring, it also exceeds the best-tested fixed scalar data weighting by 3.3 dB for PnP-DM and 4.2 dB for DAPS in average PSNR.
106. 【2610.29098】UNIVERS: Learning UNIversal Voxel-wise Embedding via Randomized Synthesis for generalizable one-shot landmark localization
链接:https://arxiv.org/abs/2610.29098
作者:Derong Yu,Qingsong Zhao,Yanbing Yue,Yikai Li,Zhi Zhang,Guoyan Zheng
类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词:varying fields, One-shot landmark localization, cross-modality embedding learning, One-shot landmark, landmark localization
备注:
点击查看摘要
Abstract:One-shot landmark localization in volume scans with varying fields of view (FOVs) is challenging. While existing self-supervised learning methods have shown promising performance, they rely on contrastive learning built upon augmented views of the same image, which inherently limits their generalization in cross-modality scenarios. This motivates research on cross-modality embedding learning using paired multi-modality images. However, existing methods suffer from not only limited training data, but also the requirement of multi-stage iterative training. To address these limitations, we propose UNIVERS, an end-to-end trainable framework that learns UNIversal Voxel-wise Embedding via Randomized Synthesis. Our framework leverages diverse pseudo-data synthesized from organ shape templates, with randomization applied to semantic layout, visual appearance, FOV, and spatial pose. Coupled with cross-domain discriminative voxel-wise contrastive learning, this domain randomization strategy forces the network to disregard domain-specific biases and learn features that are robust against variations in imaging contrast, resolution, and spatial context. Consequently, the trained model enables one-shot landmark localization in multi-modality volume scans with arbitrary FOVs. In this study, the efficacy of the proposed method is demonstrated by applying it to the task of localizing the adrenal glands, which are paired, small, and irregular endocrine organs. In particular, comprehensive experiments are conducted on three challenging adrenal gland datasets. The experimental results demonstrate that UNIVERS consistently outperforms the state-of-the-art (SOTA) one-shot landmark localization approaches, with particularly prominent advantages in cross-modality scenarios. The source code is publicly available at this https URL.
107. 【2610.29090】ReSeg: Retraining-free segmentation of abdominal organs via generalizable semantic representation learning
链接:https://arxiv.org/abs/2610.29090
作者:Derong Yu,Guoyan Zheng
类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词:modern medical applications, Abdominal organ segmentation, medical applications, Abdominal organ, essential in modern
备注:
点击查看摘要
Abstract:Abdominal organ segmentation is essential in modern medical applications. While existing deep learning approaches demonstrate promising performance, their heavy reliance on large-scale image data raises concerns over generalization capability and privacy risks. This motivates the development of generalizable segmentation training paradigms based on domain-randomized image synthesis, facilitating generalization across unseen real image domains. However, existing paradigms either suffer from limited segmentation performance when applied to abdominal organs, or require dataset-specific finetuning. To address these limitations, we propose ReSeg, a novel two-stage retraining-free framework for domain-agnostic zero-shot abdominal organ segmentation. At the first stage, our organ-agnostic synthetic data-driven pretraining approach exploits semantically and visually diverse synthetic images generated by a dedicated data engine to optimize a Generalizable Semantic Representation Network (GSRNet). The network is thereby capable of learning semantic features robust against variations in anatomical structure, imaging contrast, resolution and spatial context, which provide universal representation capabilities that serve as a foundation for segmentation learning. Subsequently, in the second stage, we continue to train an Organ-specific Encoder-decoder Segmentation Network (OESNet), whose encoder is initialized with the pretrained weights. This training process is facilitated by another dedicated data engine, which generates diversified visual images while strictly retaining the inherent spatial layout of abdominal organs. Comprehensive evaluation on seven abdominal organ segmentation datasets across three different modalities including CT, MRI, and PET demonstrates that ReSeg consistently outperforms existing state-of-the-art (SOTA) methods while eliminating the need for real training images.
108. 【2610.29061】OccJEPA: Occlusion as Masking for Amodal Video Segmentation
链接:https://arxiv.org/abs/2610.29061
作者:Genpei Zhang
类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词:Amodal video segmentation, parts hidden, video segmentation, video diffusion models, video world models
备注: 20 pages (8-page main paper + supplementary material). Code: [this https URL](https://github.com/zgp110/occjepa)
点击查看摘要
Abstract:Amodal video segmentation asks for the complete mask of an object in every frame, including the parts hidden behind other objects. The best current methods generate these masks with fine-tuned video diffusion models, which need many denoising steps and an extra depth network, and give a different answer for every sample. Self-supervised video world models of the JEPA family are trained on a closely related task: predicting the representation of masked space-time regions from the visible ones. We therefore treat occlusion as masking. The tokens that the object's visible mask does not cover are dropped, the pre-trained V-JEPA 2.1 predictor fills them in, and a light head decodes the observed and predicted features into amodal masks. The resulting model, OccJEPA (Occlusion-as-masking JEPA), is deterministic and 33.5x faster than the diffusion-based state of the art, and more accurate on SAIL-VOS, on TAO-Amodal, including a held-out test split (+4.00 AP50) and visible masks tracked by SAM2, and on Kubric. Controlled experiments trace the gain to the predictor's pre-trained weights rather than to its capacity, for world models from 87M to 1.85B parameters. Code is available at this https URL.
109. 【2610.29047】Weakly Supervised Fish Segmentation through Point-Supervised Tracking and Motion-Informed Language
链接:https://arxiv.org/abs/2610.29047
作者:Vedanth Kallakuri,Katherine A. Skinner
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:Understanding the properties, increasingly important, fish populations, Understanding, wild fish populations
备注: Accepted to IEEE OCEANS 2026 Monterey, 7 pages
点击查看摘要
Abstract:Understanding the properties of fish populations is increasingly important. Analyzing fish length, width, and mass is integral to maintaining healthy stock in the aquaculture industry, while counting wild fish populations supports marine conservation and coastal reef restoration efforts. Deep learning-based segmentation models offer a promising means of obtaining such information at scale. Most of these models, however, require costly and time-consuming per-pixel segmentation labels for training, which can take up to two minutes per fish to annotate manually. To address this inefficiency, we propose a weakly supervised segmentation pipeline that requires only point-labeled data (one click per fish) to produce accurate segmentation masks. Our pipeline consists of four stages. First, a point-supervised tracker predicts point annotations for each frame. These points are then converted into motion-informed language expressions, which guide a language-conditioned segmentation model (LMPM++) to capture temporal consistency and produce candidate segmentation masks. Finally, optical flow and background subtraction are applied as post-processing filters to suppress noise from incorrect segmentations. Experiments on the DeepFish dataset show improvement in foreground mean intersection over union (mIoU) as compared to baseline models.
110. 【2610.29045】HumanCentric-Scenes-AI: A Human-Curated Multimodal Dataset of AI-Generated Human-Centric Scenes Across Surveillance, Occupational Portraits, AI-Edited Images, and Short-Form Video
链接:https://arxiv.org/abs/2610.29045
作者:Nima Kamali,Sana Nasiri,Negar Kamali
类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)
关键词:people encounter AI-generated, encounter AI-generated media, depict people, people encounter, human-curated dataset
备注: 14 pages, 3 figures, 10 tables. Dataset: [this https URL](https://huggingface.co/datasets/Nima0Kamali/humancentric-scenes-ai)
点击查看摘要
Abstract:We introduce HumanCentric-Scenes-AI, a human-curated dataset of 296 AI-generated stimuli that depict people across four contexts in which people encounter AI-generated media. The Surveillance subset contains 85 AI-generated CCTV-style images. The Occupations subset contains 128 AI-generated occupational portraits in a balanced paired design covering 64 occupations with one female and one male version of each. The AI-edited subset contains 27 real photographs in which a region was altered or replaced by a generative model. The Video subset contains 56 AI-generated short videos. We curated the images and videos manually over multiple rounds to make them as photorealistic as possible. For each stimulus we release the file, the generation prompt where recorded, and per-stimulus metadata. We report depicted-gender distributions from an initial set of 134 generations without a specified gender and compare them with U.S. Bureau of Labor Statistics occupational gender shares. We report edit-region size and its association with zero-shot detection difficulty for the AI-edited subset. We report image-quality distributions for the Surveillance subset and subject-category coverage for the Video subset. HumanCentric-Scenes-AI is intended first for human-perception research, and also for calibration of AI-detection classifiers and bias analysis of generative models.
111. 【2610.29025】Single-Image Food Mass Estimators Do Not Transfer Their Gram Scale Across Datasets
链接:https://arxiv.org/abs/2610.29025
作者:Yongsheng Lian
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:image-based dietary assessment, Estimating food mass, Estimating food, dietary assessment, central to image-based
备注: 19 pages, 6 figures, 13 tables. Code, set lists and model weights: [this https URL](https://github.com/yongshenglian/foodmass-transfer)
点击查看摘要
Abstract:Estimating food mass from a photograph is central to image-based dietary assessment, but whether trained models transfer to new cameras and foods is unclear. We fine-tuned DINOv2-base on 2,253 weighed Nutrition5k dishes to predict mass from one RGB photograph and compared it with a zero-shot vision-language model, Qwen3-VL-32B, on Nutrition5k and three external datasets: ASA24 studio portions, ECUSTFD whole foods and Food Portion Benchmark meal trays. In domain, the fine-tuned model's mean absolute error was 24.8 g, less than half of Qwen's. On external datasets it did not beat Qwen. For a food it had never seen, it ranked portions by size, but no better than a count of food pixels. Its gram scale was wrong in two ways: it changed with how much of the scene the photograph showed, and it was off by a different factor for each food. Training on other foods or trays from the tested dataset cut the external error by 38 to 65%. DINOv2-large, a larger backbone trained on the same dishes, did not reduce the external error. One labeled photograph of the same food cut the model's ASA24 error to 28.3 g, better than that photograph achieved alone. Prediction intervals that held the true mass for 90% of Nutrition5k dishes held it for at most half of external photographs. Nutrition5k often photographed the same plate several times, so a random test split shared near-identical photographs with training and overstated accuracy. Single-image mass estimators therefore need labeled photographs from the setting where they are used.
112. 【2610.29008】Enhancing Cross-Grade Generalization in Banana Variety Classification via Hybrid CNN-Transformers and Knowledge Self-Distillation
链接:https://arxiv.org/abs/2610.29008
作者:Khush Kataruka,Mohammad Muzammila,Zahid Akhtar,Raghavendra Ramachandra,Praveen Kumar Chandaliya
类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词:efficient yield estimation, supply chain optimization, automated fruit classification, fruit classification systems, recent years
备注: 29 Pages, 9 Figures
点击查看摘要
Abstract:In recent years, automated fruit classification systems have become a more critical component in precision agriculture for efficient yield estimation, quality control, and supply chain optimization. However, they still face significant challenges under varying quality, fruit maturity, illumination, texture degradation, morphological attributes, domain shift, and post-harvest handling conditions. In this study, we address the challenging issue of cross-grade banana variety classification. This is a real-world setting where models that have been trained on specific quality grades must generalize to unseen grades to handle significant domain shift. Under a rigorous Leave-One-Grade-Out evaluation protocol, we present a thorough comparative analysis of CNNs, ViTs, and dual-stream hybrid architectures using a large-scale dataset of 31,678 banana images with three varieties and three quality grades. Specifically, to address the drawbacks of single-paradigm frameworks, we present a dual-stream Swin ResNet hybrid framework enhanced with KL-divergence-based self-distillation to align probabilistic feature representations across the CNN and Transformer streams. Comprehensive experimental analyzes show that the presented hybrid framework with KL-divergence based self-distillation achieves better overall performance, i.e., it attains a mean accuracy of 81.25% and significantly surpasses CNN and Transformer baseline models. Qualitative analysis further confirms that the hybrid framework in this study improves discriminative feature transferability, improves attention localization, and stabilizes optimization.
113. 【2610.29003】-DIG: Text-Conditioned Diversity for Image Generation
链接:https://arxiv.org/abs/2610.29003
作者:Simran Khanuja,Rohit Gandikota,Gaurav Parmar,Graham Neubig
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:platforms typically return, platforms typically, matches their intent, typically return, explore different visual
备注: under review
点击查看摘要
Abstract:Text-to-image (T2I) platforms typically return several images per prompt so users can explore different visual interpretations and choose one that matches their intent. However, T2I models are usually optimized for single-image quality which comes at a cost of multi-image diversity, limiting this exploration. Diversity is also contextual: one user wants variations in background, while another wants them in artistic style, and the same user may later want variations in clothing. The generated images should differ along whatever axis the user cares about. In this paper, we introduce T-DIG, a text-conditioned diversity framework for image generation and editing. T-DIG is an iterative framework comprising multiple modules that lets users type prompts, inspect default generations, request variations using natural language, and continue refining outputs until they're satisfied. At its core, T-DIG uses an LLM policy that produces K axis-conditioned prompts or edit instructions for a frozen generator or editor. We train this policy with GRPO using a text-conditioned diversity reward and alignment penalties. Because the image generator remains frozen, T-DIG applies to open-weight, distilled, and proprietary models. We also release the first dataset for text-conditioned prompt diversity in image generation, with the training and validation splits built from human-written axes and a test set drawn from real user interactions with T-DIG. T-DIG far exceeds baselines in improving text-conditioned diversity, while preserving base-prompt alignment across a variety of metrics and human judgements. We show that user-directed diversity exploration can be added to a wide range of image generation models, open and closed, without the need to access their weights. Website: this https URL
114. 【2610.28985】MedBOE: Optimization-Based Estimation of Complete Patient Body Models from Whole-Body Medical Imaging
链接:https://arxiv.org/abs/2610.28985
作者:Hoijoon Jung,Yuhao Wei,Mingxiao Tu,Younhyun Jung,Michael Fulham,Jinman Kim
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:patient body models, True whole-body medical, body, patient body, body models
备注: Hoijoon Jung and Yuhao Wei contributed equally to this work
点击查看摘要
Abstract:True whole-body medical imaging captures a patient from head to toe and provides comprehensive anatomical and/or functional information. This coverage enables reconstruction of the external body surface, yielding patient body models. However, scanner geometry (e.g., bore diameter), patient characteristics, and positioning can leave body regions missing (e.g., lateral arms/torso, hands, forearms, elbows), producing incomplete patient body models. Such incompleteness limits downstream medical analyses, including derivation of body-habitus metrics (BHMs), such as body volume and surface area, for injected radiotracer activity regimens, cardiometabolic risk assessment, and computational anatomical modeling for medical imaging simulation and radiation dosimetry. We present the Medical Body model Optimization-based Estimator (MedBOE), an automated, training-free framework for estimating complete patient body models from whole-body images with missing body regions. Our innovation is to leverage the Skinned Multi-Person Linear (SMPL) template, a parametric body mesh representing a broad range of body shapes and poses, in medical imaging. MedBOE aligns the SMPL template to the incomplete patient body models via attribute-guided optimization and estimates missing body regions through geometrically and volumetrically constrained deformation. We evaluated MedBOE using two public datasets: AutoPET (91 whole-body PET-CT images) and Human Implicit Tissues (HIT; 40 whole-body segmentations from MRI images). MedBOE achieved the best overall volumetric and geometric performance among evaluated methods. BHMs derived from MedBOE were within 2% error, suggesting low percentage errors for downstream analyses. MedBOE offers an automated, training-free method for estimating complete patient body models from whole-body images with missing body regions.
115. 【2610.28974】EMPL: A Resource-Efficient and Transparent Model-Free Framework for Pseudo-Label Generation in Material CT Scans
链接:https://arxiv.org/abs/2610.28974
作者:Ashiqur Rahman,Venkata Devesh Reddy Seethi,Austin Yunker,Rajkumar Kettimuthu,Hamed Alhoori
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:limits deep learning, large annotated datasets, annotated datasets limits, datasets limits deep, deep learning
备注:
点击查看摘要
Abstract:The scarcity of large annotated datasets limits deep learning (DL) segmentation in material CT analysis. DL-based pseudo-labeling can help, but it is often computationally expensive and hard to interpret. We introduce a multi-stage, model-free framework that generates pseudo-labels directly from grayscale CT scans. It combines thresholding, morphological dilation, and a custom breadth-first search region-growing algorithm to produce polygonal annotations without pre-trained weights, labeled data, or a GPU. We compare it against the zero-shot Segment Anything Model (SAM), a fully supervised 3D U-Net, and classical baselines. On a dendrite dataset with ground truth, our method reaches 63.19% IoU versus 10.74% for zero-shot SAM, with four times the instance recall at 0.5 IoU (33.3% versus 8.3%). The supervised 3D U-Net serves as a reference ceiling that requires expert labels. On a silica sand specimen, YOLO models trained on our labels performed comparably to models trained on SAM labels in a qualitative comparison. Across 1,053 extracted grains, the median equivalent diameter was 163.8 micrometers, near the specimen's known 106 to 150 micrometers sieve range, compared with 219.5 micrometers for SAM, whose labels merge adjacent particles and add spurious detections. A sensitivity analysis shows a stable operating range for the key threshold and a sharp, predictable failure point linked to phase contrast. Our method needs 15s per image on a standard CPU versus 28s for SAM on a GPU. These results support our transparent approach as a tool for annotation bootstrapping and microstructural quantification in resource-limited settings.
116. 【2610.28962】RoPT: Robust 6DoF Object Pose Tracking in Video
链接:https://arxiv.org/abs/2610.28962
作者:Yongqing Liang,Yuzhong Chen,Sihang Li,Junsuk Kim,Chase Kidder,Hui-ping Wang,Yunzhi Xu,Raihan Haque,Yubiao Zhang,Chen Feng
类目:Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词:conventional monocular pipelines, monocular pipelines frequently, pipelines frequently suffer, conventional monocular, frequently suffer
备注:
点击查看摘要
Abstract:Accurate 6-DoF object pose tracking is essential for robotic interaction, yet conventional monocular pipelines frequently suffer from catastrophic divergence under rapid object motion. We present RoPT, a robust tracking framework engineered to overcome this limitation by unifying visual perception, temporal kinematics, and global re-localization into a tightly coupled closed loop. Unlike existing open-loop trackers, RoPT delivers three critical capabilities that fundamentally alter system resilience. First, the visual perception component tracks object masks to robustly handle partial and severe occlusions. Second, a kinematic factor graph regularizes frame-to-frame updates, forecasts forward pose predictions, and drives a parallel multi-hypothesis verification scheme to bypass local minima. Finally, an active re-localization module transforms the pipeline into a closed-loop system, making it failure-aware and capable of deterministic self-recovery. We demonstrate the effectiveness of our framework across challenging benchmarks alongside real-world robotic demonstrations, achieving significantly higher tracking survivability under rapid motion.
117. 【2610.28954】Pair-Free Coarse-to-Real Video Generation via Real-to-Coarse Image Supervision
链接:https://arxiv.org/abs/2610.28954
作者:Gonzalo Gómez-Nogales,Daohan Lu,Peiye Zhuang,Tinghui Zhou,Yi Zhou
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:preserving scene layout, converts coarse animation, generation converts coarse, video generation converts, camera motion
备注:
点击查看摘要
Abstract:Coarse-to-real (C2R) video generation converts coarse animation, simulation, or game-rendered videos into photorealistic videos while preserving scene layout, camera motion, and dynamics. Training such models requires aligned (coarse, realistic) video pairs, which are expensive to create and confine prior systems to narrow synthetic domains. We exploit a simple asymmetry: paired videos are hard to obtain, but paired real-to-coarse images are easy to construct with existing editing and 3D reconstruction tools. Using these image pairs, we train the DINO-R2C model to transfer realistic images to coarse images in DINO feature space, and apply it frame-wise to ordinary real videos to synthesize pseudo-coarse videos. The C2R# model then learns to generate each real video from its pseudo-coarse counterpart, free from needing (coarse, realistic) video pairs. At inference, the DINO-R2C model is discarded and actual coarse videos drive the C2R# model directly. Thus, our pair-free training scales with any real-video corpora rather than with paired synthetic videos. We will release the model and project webpage at this https URL.
118. 【2610.28941】MINER: Modeling Inter- and Intra-Person Variance for Reidentification
链接:https://arxiv.org/abs/2610.28941
作者:Oron Nir,Eliyahu Strugo,Ariel Shamir
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:Clothes-Changing Person Re-Identification, remains challenging due, drastic appearance shifts, Clothes-Changing Person, Person Re-Identification
备注: Paper accepted to the WACV 2027 Algorithms track
点击查看摘要
Abstract:Clothes-Changing Person Re-Identification (CC-ReID) remains challenging due to drastic appearance shifts across outfits. Most prior works devise biometric signal-extraction heuristics to enhance inter-person variance, e.g., using segmentation masks, while leaving intra-person variance uncontrolled. We present MINER, a simple model-agnostic framework that suppresses garment bias by contrasting hard examples and adaptively balancing dataset-dependent intra- and inter-person variance. Extensive experiments show that MINER improves retrieval across CC-ReID benchmarks, achieving state-of-the-art performance on four datasets and ranking among the leaders in all three tracks of the open TVRID RGB-Depth ReID challenge.
119. 【2610.28899】Data-Driven Glyph Positioning for Handwritten Music Synthesis
链接:https://arxiv.org/abs/2610.28899
作者:Elona Shatri,Jiří Mayer,Jan Hajič jr
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:Optical Music Recognition, Music Recognition, Optical Music, Synthesised data, common strategy
备注: 10 pages, 1 biblio page, presented at The 20th International Conference on Document Analysis and Recognition
点击查看摘要
Abstract:Synthesised data is a common strategy to address the lack of annotated handwritten music scores in Optical Music Recognition (OMR). Smashcima is a recent synthesis framework that assembles pages of handwritten scores by sampling glyph images from MUSCIMA++ and positioning them with hard-coded rules. In this work we ask whether these rules are grounded empirically and whether a learned model for context-dependent positioning can further improve synthesis quality. We extract inter-glyph distributions from around 285 thousand annotated relationships across MUSCIMA++ and OmniOMR, finding that several key parameters deviate systematically from real handwriting. Replacing these constants with empirical means reduces positioning RMSE by up to 60%. We then train a Graph Neural Network (GNN) on the Music Notation Graph structure to predict context-dependent offsets, achieving an additional 50 to 85% RMSE reduction on stems and beams by modelling how neighbouring glyphs constrain placement. Cross-dataset analysis shows that spacing differences between the two corpora are explained by note density (3.3), not style, and that duration-proportional spacing does not hold in handwriting (R2 = 0.001). In downstream evaluation, a YOLOv8 detector pretrained on GNN-positioned synthetic data achieves +30% mAP50 over the baseline and +11% over empirical means when fine-tuned on 200 real handwritten staves, showing that positioning accuracy matters for downstream OMR.
120. 【2610.28889】Policy-Mask: Budget-Aware Adaptation of Diffusion Features to Discriminative Tasks
链接:https://arxiv.org/abs/2610.28889
作者:Ivan Listopadov,Maksim Nakhodnov,Aibek Alanov
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:Selecting intermediate features, Selecting intermediate, frozen diffusion model, network depth, denoising trajectory
备注:
点击查看摘要
Abstract:Selecting intermediate features from a frozen diffusion model for discriminative tasks is non-trivial because the useful signal is distributed across the denoising trajectory, network depth, and channels. In practice, this requires choosing a timestep, a block, and a channel subset. Existing methods either fix these choices by hand or optimize only a few extraction hyperparameters, most often the timestep, then reuse the same rule across inputs and budgets. We introduce Policy-Mask, a budget-conditioned policy trained on the downstream objective that jointly selects all three under a prescribed channel budget. Without normalization, the channel-score contribution grows with the number of selected channels and dominates the timestep and block updates. We normalize it by subset cardinality, keeping the three policy heads on comparable scales and stabilizing joint training. At matched budgets, Policy-Mask improves over fixed extraction and feature-filter baselines across segmentation, classification, and semantic correspondence, reaching 38.9 mIoU on ADE20K, 75.4% top-1 on CIFAR-100 at 128 dimensions, and 76.3 PCK@0.1 on SPair-71k. Component-wise ablations show that block selection materially affects downstream accuracy, and the highest recorded channel-budget score occurs at 256 retained channels, identifying a practical operating point for compact diffusion representations. We further adapt Policy-Mask to diffusion transformers, including PixArt-$\Sigma$ and SD3.5 MMDiT, by replacing U-Net channels with image-token hidden dimensions.
121. 【2610.28880】Real2Sem2Real: 3D Semantic Augmentations for Robot Learning from a Single Human RGB Demonstration
链接:https://arxiv.org/abs/2610.28880
作者:Matthew Strong,Ankush K. Dhawan,Julien Poffet,Giuse Pham,Jinho So,Monroe Kennedy III
类目:Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词:video scales easily, require depth sensing, existing methods require, Human video scales, methods require depth
备注: Matthew Strong and Ankush K. Dhawan contributed equally. Project page: [this https URL](https://real2sem2real.github.io/)
点击查看摘要
Abstract:Human video scales easily and does not need robot hardware, but existing methods require depth sensing, overlay the robot onto 2D video, or generate data only for the demonstrated objects. We present Real2Sem2Real (R2Sem2R), a real-to-semantic-to-real pipeline that turns one monocular RGB video of a human demonstration into thousands of robot demonstrations across the semantic object instances of a category. R2Sem2R tracks the SE(3) pose of each object with DINOv3-distilled Gaussian splats, outperforming existing methods and FoundationPose with estimated metric depth. R2Sem2R then aligns digital cousins, each generated from one or a few photographs, to the demonstrated objects with a semantic alignment. This alignment matches whole objects and the functional regions of target objects, such as a coffee machine's tray. R2Sem2R maps the human hand to a feasible robot grasp that extends to the cousins. Robot demonstrations are generated either in IsaacSim, for photorealistic rendering, or MuJoCo, for contact physics, and R2Sem2R can generate over 2,000 episodes in about two hours. On two real robots and four tasks, we train a vision-language-action policy on data from one human video per task, and policies trained on our data match or exceed policies trained on teleoperation across diverse object instances. The project page is available at this https URL.
122. 【2610.28858】DualHeads: Reward-tilted few-step diffusion made simple
链接:https://arxiv.org/abs/2610.28858
作者:Yuanzhi Zhu,Eleftherios Tsonis,Simo Alami Chehboune,Xi Wang,Stéphane Lathuilière,Vicky Kalogeiton
类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词:models generate high-quality, Distilled diffusion models, diffusion models generate, generate high-quality images, sampling steps
备注:
点击查看摘要
Abstract:Distilled diffusion models generate high-quality images in a few sampling steps, but aligning them with task requirements and human preferences is difficult. Methods developed for multi-step diffusion models rely on differentiable rewards, or on score fields and stochastic trajectories that distilled generators may lack. We ask whether a few-step generator can be adapted using only external reward evaluations and reference samples, and show that two binary classifiers suffice. Our method, DualHeads, implements them as lightweight heads on a frozen diffusion backbone. The reward head learns which samples of the same prompt score higher, the reference head separates reference images from generated ones, and the generator maximizes a weighted sum of their logits. When the heads are optimal, this objective is KL-regularized maximization of the learned reward, and the ratio of head weights sets the regularization strength. Empirically, with both rule-based and model-based rewards, a few-step DualHeads generator reaches task rewards close to those of 40-step reinforcement learning methods while preserving image quality, at no extra inference cost. We hope that this simple and elegant dual-head formulation will help advance few-step reward-tilted generation.
123. 【2610.28856】Depth-guided Geometric Adaptation for Few-shot Image Classification
链接:https://arxiv.org/abs/2610.28856
作者:Zhiqi Miao,Estefanía Talavera,Weichuan Zhang,Jiapan Guo
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:RGB appearance similarities, appearance similarities hinder, similarities hinder discriminative, Few-shot image classification, RGB appearance
备注: This work is accepted by The IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2027
点击查看摘要
Abstract:Few-shot image classification (FSIC) frequently suffers from visual ambiguity, where background clutter and RGB appearance similarities hinder discriminative feature matching in data-scarce settings. To mitigate this, we propose DAFIC, a geometry-guided framework that incorporates monocular depth into representation learning, episodic adaptation, and dense support-query matching. DAFIC first learns geometry-aware token representations through RGB-D self-supervised pre-training. Subsequently, the Depth-guided Geometric Adaptation (DGA) module uses depth-derived geometry to refine patch representations with geometry-enriched class context while suppressing background interference. Spatial Bidirectional Patch Matching (SBiM) then performs bidirectional dense matching on the refined features, reducing sensitivity to spurious correspondences and background clutter. Extensive experiments on four benchmarks show that DAFIC achieves strong performance against existing methods, with ablation and robustness analyses supporting the effectiveness of coupling geometry-conditioned episodic adaptation with bidirectional matching for few-shot visual recognition.
124. 【2610.28843】Beyond Correct Answers: How Compositional Cues Shape Visual Judgments
链接:https://arxiv.org/abs/2610.28843
作者:Xiaoyu Ma,Zheyuan Zhang,Kaiwen Shi,Yanfang Ye
类目:Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词:answering requires models, question answering requires, correct objects, answering requires, assign attributes
备注: 29 pages, 6 figures
点击查看摘要
Abstract:Visual question answering requires models to assign attributes and relations to the correct objects, a problem known as visual binding. Structured prompts make these assignments explicit through labeled fields. Yet an improvement from the full prompt does not reveal which labels help or how they interact. First, we isolate field-label effects across ten models and six tasks by holding the image and claim fixed. These comparisons reveal differences that overall accuracy can hide. With a relation label present, adding object-role labels helps Qwen3 but hurts Qwen2 on Spatial. Second, we compare auxiliary hints that preserve or swap the question's role assignments against a no-hint baseline. Across two image sets, Qwen3's advantage with preserving hints mainly reflects errors caused by swapped hints. Preserving hints remain near baseline. Field order further affects the harm. Third, we test clearer hint wording and direct selection of the relation shown in the image. Clearer hints improve text matching but do not consistently improve visual judgments. In contrast, relation selection partly reduces errors for some hints in Qwen3 and GPT-4.1-mini.
125. 【2610.28836】Sketch2Sim: an end-to-end modular framework for hand-drawn circuit analysis
链接:https://arxiv.org/abs/2610.28836
作者:Mohammad Kawsar,Al Amin Islam Ridoy,Md Rakib Hossain,Farzana Akter,AKM Bahalul Haque,Rejwan Bin Sulaiman,Mohammed Amin Almaiah
类目:Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词:Integrated Circuit Emphasis, Simulation Program, Program with Integrated, circuit, Optical Character Recognition
备注:
点击查看摘要
Abstract:This study proposes a sketch-to-simulation system to solve handwritten circuit diagrams. The system converts raw images into a Simulation Program with Integrated Circuit Emphasis (SPICE)-compatible netlist and automatically calculates the circuit's nodal voltages and currents. Another objective is to propose a holistic framework that benefits students and educators by enhancing the teaching and learning experience of electric circuits and expediting engineering design reviews. This article presents a multistage pipeline that converts raw photographs of handwritten electric circuits into executable SPICE-like netlists, providing a solution. A dataset of 1,000 hand-drawn Resistor-Inductor-Capacitor (RLC) circuits was curated and annotated for components, text regions, and character recognition. The proposed system decomposes a circuit diagram into three stages: (i) dual You Only Look Once (YOLO)-based detectors for components and text regions, (ii) a Convolutional Recurrent Neural Network (CRNN) with Connectionist Temporal Classification (CTC) and Optical Character Recognition (OCR)-based domain-aware symbol value extraction, and (iii) image processing with thresholding, skeletonization, and Density-Based Spatial Clustering of Applications with Noise (DBSCAN) to automatically identify nodes and map them with corresponding components. The proposed system produces the netlist and solves the circuit. The qualitative and quantitative ablation studies on modular stages, as well as end-to-end tests, demonstrate robust performance across various handwriting styles, lighting conditions, and this http URL study serves as an interactive learning aid and practical tool for professionals, providing a comprehensive user interface (UI), enabling rapid digitization of circuit sketches for study, design, prototyping, or troubleshooting.
126. 【2610.28835】Conditional Imaging for Privacy-Preserving Visual Sensing
链接:https://arxiv.org/abs/2610.28835
作者:Hengyu Lian,Debabrata Mandal,Anzhou Wen,Yujie Wang,Xi Peng,Praneeth Chakravarthula
类目:Computer Vision and Pattern Recognition (cs.CV); Optics (physics.optics)
关键词:Conventional visual sensing, remain private today, Conventional visual, fundamental dilemma, private today
备注: 20 pages, 7 figures
点击查看摘要
Abstract:Conventional visual sensing faces a fundamental dilemma: information that should remain private today may need to be recovered tomorrow. This challenge is becoming increasingly important as cameras become pervasive in our daily surroundings. Existing safeguards either protect visual content only after an image is formed or suppress information during capture in ways that prevent its later recovery. Here, we show through an information-theoretic analysis that privacy and recoverability cannot be achieved simultaneously in static optical systems. Information preserved in a measurement for later reconstruction also remains available to an observer of that measurement, limiting the privacy such systems can provide. To overcome this limitation, we introduce conditional imaging, an imaging approach that changes the optical state for every captured frame. The measurement alone conceals the scene, while knowledge of the corresponding physical system state enables its reconstruction. We analyze how the optical parameters determine the information that can be recovered and use this analysis to guide the design of a camera prototype. We evaluate the system on a captured dataset of human faces using increasingly powerful attempts to recover the scene, from direct visualization and computational inversion to learned reconstruction and identity recognition. Our experiments show that conditional imaging preserves identity in authorized reconstructions while withholding visual information from observers without access to the system state. By making the physical state of the camera part of the information needed for reconstruction, conditional imaging enables visual information to be protected at the point of capture while remaining recoverable for future authorized use.
127. 【2610.28829】HorizonComposer: Spatiotemporally Consistent Driving Video Editing with Enriched Traffic Semantics
链接:https://arxiv.org/abs/2610.28829
作者:Mauricio Soroco,Yuqiu Liu,Zaid Tasneem,Francesco Pittaluga,Abhishek Aich,Wuyang Chen,Manmohan Chandraker,Ziyu Jiang
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:diverse environmental conditions, simulating diverse environmental, Operational Design Domain, stress-testing autonomous driving, autonomous driving systems
备注:
点击查看摘要
Abstract:Instruction-guided video generative models offer a scalable solution for stress-testing autonomous driving systems by simulating diverse environmental conditions. However, driving scenes operate within a dense Operational Design Domain (ODD) governed by strict traffic semantics. When applied to global driving-condition edits, general-purpose instruction-guided video editors frequently corrupt these semantics, leading to structural hallucinations and ``temporal shock.'' This work distills and protects traffic semantics during video editing at three levels. First, we construct a hybrid dataset by combining temporally aligned real-world videos with synthetic edits, balancing foundational scene structure with unambiguous appearance signals. Second, during training, we adapt advantage conditioning from offline reinforcement learning to align the model using dense rewards. We extract dense, pixel-level rewards from the hybrid data to serve as a localized signal and actively steer generation toward structurally reliable pixels. Finally, our model mitigates temporal shock by introducing thinking frames, a transition mechanism that seamlessly reconciles static image conditioning with dynamic video context. Extensive experiments demonstrate that our method prevents the corruption of multi-actor dynamics, establishing state-of-the-art spatiotemporal consistency, yielding consistent user preference (39% relative improvement in content preservation and 12% in temporal consistency), and achieving a significant 5% gain in downstream road line segmentation and 7% gain in downstream multi-object detection.
128. 【2610.28827】WorldStream: Streaming Interactive 3D Worlds with Hierarchical Planning and Persistent State
链接:https://arxiv.org/abs/2610.28827
作者:Xiaoxiao Ma,Weiyang Jin,Yanwen Ma,Haoran Li,Zhixiang Wei,Songchun Zhang,Yaowei Li,Junhao Zhuang,Zeyue Xue,Yuming Li,Zheming Fu,Haoyang Huang,Nan Duan,Feng Zhao
类目:Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词:restores visited places, extends playable terrain, open-ended language, simultaneous capabilities, pre-specified map
备注: 19 pages, 18 figures
点击查看摘要
Abstract:We present WorldStream, an open-ended 3D world model with three simultaneous capabilities: it extends playable terrain beyond any pre-specified map, acts on open-ended language in the running world, and restores visited places with their edits. A hierarchical planner over a typed decision model emits structured decision state: Macro fixes settlement, ecology, transport, and hydrological structure across a group of tiles; Micro specializes that contract into tile semantics under measured terrain and accepted neighbor commitments. Deterministic local code compiles accepted plans into terrain, roads, settlements, vegetation, and entities. Streaming separates their reach: plans run ahead along the predicted corridor, compilation only where movement will soon need it, geometry behind the user released. One world record retains plans, seeds, object identities and mutable state, boundary commitments, and edits by attribute, revised as the user advances and edits; returning tiles recompile from it. The same record grounds interaction: the model acts on existing entities, including stateful NPCs that update as they act, edits the present region, or attaches intent to unplanned regions. Together they yield a world expanding under bounded budgets, connected across independently planned tiles, and interactive.
129. 【2610.28821】Register Anything Model for Generalizable and Robust Point Cloud Registration
链接:https://arxiv.org/abs/2610.28821
作者:Zheng Qin,Junhua Xi,Yan Huang,Jiahong Lai,Anwen Huang,Qiong Li,Guangda Zhang,Kai Xu
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:present Register, robustly estimates, diverse domains spanning, domains spanning sensors, Register
备注: Accepted by NeurIPS 2026. Code and models are available at [this https URL](https://github.com/qinzheng93/RegisterAnything)
点击查看摘要
Abstract:We present Register Anything Model (RAM), a unified model for generalizable 3D point cloud registration that robustly estimates 6-DoF transformations across diverse domains spanning sensors and environments. Existing registration methods are typically tailored to a single domain, with carefully tuned architectures and hyperparameters, and thus degrade markedly when applied to novel domains. We bridge this gap by training a single model on diverse data from indoor, outdoor, and object domains. A central challenge is the severe geometric discrepancy across domains, i.e., differences in scene scale, sensor noise, point density, and structural patterns, which hinders processing with a unified point-based model. To address this, we introduce a geometry-aware normalization strategy that jointly voxelizes and normalizes point clouds into a standardized geometric space, adaptively based on their geometric properties to preserve salient local structures while standardizing resolution. Built on this normalization, RAM follows a hierarchical coarse-to-fine paradigm, and employs an efficient geometric transformer that models local geometric consistency instead of globally over all points. This design mitigates discretization noise introduced by voxelization, and improves computational efficiency. Extensive experiments on 12 benchmarks demonstrate state-of-the-art performance in terms of inlier ratio and registration recall. Notably, our method outperforms the counterparts trained on each separate domain, showing superior generalization capability.
130. 【2610.28806】SAIL: A Learnable Generalisation of Spatial Autocorrelation over Graph-Structured Data
链接:https://arxiv.org/abs/2610.28806
作者:Piotr Keller,Fayyaz Minhas
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:scientific domains involving, coherent spatial structures, domains involving spatial, form coherent spatial, spatial autocorrelation
备注: 44 pages, 22 figures (7 in main paper, 15 in supplementary material). Main paper followed by supplementary material in a single file
点击查看摘要
Abstract:In vision and scientific domains involving spatial data, a key question is whether node feature values vary independently across space or form coherent spatial structures. Classical spatial autocorrelation statistics such as Moran's $I$ and Geary's $C$ quantify this phenomenon but operate on a single scalar variable with fixed neighbourhood weights, limiting their use for high-dimensional graph-like data. We introduce SAIL (Spatial Autocorrelation Index Learner), a differentiable framework that generalises spatial autocorrelation into a learnable operator by jointly learning feature projections defining candidate scalar fields and inter-node neighbourhood affinities. SAIL produces interpretable local and global spatial coherence descriptors, enabling supervised prediction and unsupervised discovery of spatial autocorrelation modes and hotspots. We show that SAIL exactly recovers classical spatial statistics under appropriate parametrisations and, for tasks driven by latent spatial autocorrelation, can approximate the Bayes-optimal predictor with an inductive bias matched to such tasks. Experiments on synthetic data and large-scale biomedical graphs demonstrate statistical correctness and discovery of spatial coherence with applications across vision, geospatial analysis, and biomedicine. The code repository is available at: this https URL.
131. 【2610.28801】JUICE: Unified Multimodal Modeling in Pretrained Representation Spaces
链接:https://arxiv.org/abs/2610.28801
作者:Jiahan Li,Huangyuan Su,Shengbang Tong,Shusheng Yang,Ruihan Guo,Suozhi Huang,Hexu Zhao,Pratyusha Sharma,Sherry Yang,Jiatao Gu,Rob Fergus,Kyunghyun Cho
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:diffusion head generates, attached diffusion head, head generates images, head generates, language model generates
备注: 69 pages, 31 figures, 37 tables. Project page: [this https URL](https://ced3-han.github.io/JUICE-Website/) Code: [this https URL](https://github.com/Ced3-han/JUICE-Code) Weights: [this https URL](https://huggingface.co/collections/CedLJH/juice)
点击查看摘要
Abstract:Most unified multimodal models treat images and text asymmetrically: a pretrained language model generates text, an attached diffusion head generates images, and outputs that contain both are produced in a fixed order, so the first output cannot adapt to the second. We ask whether both modalities can instead be generated by one process that is trained on them jointly from scratch. Pretrained encoder spaces hold both modalities in one continuous form and carry knowledge learned at scale, and recent work finds them effective as generative targets for vision and language. We therefore model the joint distribution directly in these spaces. We introduce JUICE (Joint Unified multimodal modeling In Continuous Encoder spaces), a single flow matching Transformer over frozen image and text representations, in which each modality has its own noise level. Which modalities are clean and which are generated then decides the task: image generation, captioning, visual question answering, or joint generation. Controlled pretraining runs test each design choice. At equal guidance, generating text as continuous states leaves image generation intact (48.41 GenEval, against 47.86 for a model trained only for text-to-image generation), while captions lose some exact wording. Training on joint and conditional denoising together beats either alone, and semantic encoder spaces beat VAE latents and raw pixels as targets. At 2.1B parameters, with no language model initialization and at 224x224, JUICE reaches up to 0.88 on GenEval and 73.1 on VQAv2. By sampling both modalities from the joint distribution (coupled sampling), it can also draw a route on a map while writing out the matching moves. On mazes with several valid solutions, joint success rises from 54.6% with independent sampling to 93.7%, and no modality has to go first. On visual spatial planning, JUICE solves 99.8% of maps at its training sizes.
132. 【2610.28776】Complexity-Aware Surgical Video Reasoning Segmentation with Digital Twin and Context Memory
链接:https://arxiv.org/abs/2610.28776
作者:Yiqing Shen,Mathias Unberath
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:Conventional surgical segmentation, explicit text queries, resolve implicit queries, Conventional surgical, instrument functions
备注:
点击查看摘要
Abstract:Conventional surgical segmentation relies on closed-set categories or explicit text queries, which cannot resolve implicit queries that require reasoning about workflows, instrument functions, and temporal relationships. To address these limitations, we propose SurgReasonSeg, a complexity-aware method that brings reasoning segmentation over digital twin (DT) representations to surgical video. Specifically, SurgReasonSeg constructs DT representations from surgical foundation models and trains two low-rank adapters (LoRA) of one large language model with reinforcement learning (RL), each specialized for a different query complexity. A lightweight router, also trained with RL, selects between the two adapters to balance latency against accuracy. SurgReasonSeg also sets the temporal context with an adaptive sliding window conditioned on query complexity and workflow phase, and retrieves relevant historical cases from a surgical context memory by workflow similarity and procedural relevance. We further introduce EndoVis-ReasonSeg, a surgical reasoning segmentation benchmark with 1,460 training and 961 test samples across semantic, spatial, and temporal categories. On EndoVis-ReasonSeg, SurgReasonSeg improves JF over the strongest baseline, ReSurgSAM2, by 0.178, 0.237, and 0.297 on semantic, spatial, and temporal queries, and it also achieves the best results on the Ref-EndoVis17 and Ref-EndoVis18 referring segmentation benchmarks. A backbone-matched attribution protocol separates the contribution of the upstream segmenter from that of the reasoning modules. Our method runs at 18.8 FPS averaged over the query distribution, enabling real-time reasoning segmentation in surgical videos.
133. 【2610.28771】Motion Equivariant Convolutional LSTM: When Motion Becomes a Gauge Symmetry
链接:https://arxiv.org/abs/2610.28771
作者:Vahid Hosseinzadeh,T. Anderson Keller,Michael Puthawala
类目:Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词:Objects move, weather drifts, Objects, sequential data, equivariant
备注: Code: [this https URL](https://github.com/VahidHosseinzadeh/MELSTM)
点击查看摘要
Abstract:Objects move, cameras pan, and weather drifts with the wind: much of what changes in sequential data is motion. Motion changes where things are, not what they are, and is therefore a symmetry of the data. Yet standard recurrent networks are not equivariant to it: their memory stays put while the input moves on. Flow equivariant recurrent networks first brought this symmetry into sequence models, for motions of constant velocity, or flows, by enumerating a bank of velocities. We extend this idea in three directions: from simple recurrent networks to convolutional LSTMs, from flows to motions whose velocity changes in time, and from enumerating velocities to estimating them. Treating a sequence as a field over time, we show that motion becomes a gauge symmetry: a global symmetry made local in time. Built on this view, our motion equivariant convolutional LSTM (MELSTM) uses its velocity model as the gauge field and is provably equivariant to every motion. Across future-frame prediction, classification of digits visible only through their motion, and action recognition under camera shake, MELSTM outperforms a convolutional LSTM and its flow equivariant counterpart with the same number of parameters: it is more accurate, generalizes to longer horizons and to unseen motions, and carries a fraction of the flow equivariant model's state.
134. 【2610.28766】Different Defects, Different Effects: A Controlled Audit of Face Recognition Training Data
链接:https://arxiv.org/abs/2610.28766
作者:Ana Dias,João Ribeiro Pinto,Hugo Proença,João C. Neves
类目:Computer Vision and Pattern Recognition (cs.CV)
关键词:training, strongly supported, large-scale training datasets, face recognition, Abstract
备注: Accepted at WACV 2027
点击查看摘要
Abstract:The development of face recognition has been strongly supported by the availability of large-scale training datasets. Among them, MS-Celeb-1M has played an important role by providing millions of facial images from nearly 100K identities. However, the size and heterogeneity of such datasets increase the likelihood of annotation errors, redundant samples, and other forms of data inconsistency. This motivated the introduction of refined versions, such as MS1MV2 and MS1MV3, aimed at improving the quality of the training data. Despite these cleaning efforts, we show that several types of training-data defects remain in MS1MV3. By proposing complementary data-auditing strategies, we identify five defect categories: exact and near-duplicate images, split identities, crop errors, multiple-face ambiguity, and invalid content. We then assess the effect of correcting these defects under a controlled face-recognition training protocol based on IResNet-50 and ArcFace. The results show that targeted interventions can preserve, and in some cases improve, recognition performance while requiring fewer optimization steps to reach the performance of the original training set. Duplicate removal provides the clearest overall benefit, while split-identity merging and invalid-content removal also improve training efficiency. Overall, the results indicate that the effect of dataset cleaning depends strongly on the type of defect being addressed and provide further evidence that training-data quality remains an important and comparatively underexplored factor in large-scale face recognition. The training manifests and code used in this work will be released upon acceptance.
135. 【2610.28698】Scaling in Games: Continued Pre-Training For Embodied Agents In Diverse Virtual Worlds
链接:https://arxiv.org/abs/2610.28698
作者:Kuan Zhang,Yukun Chen,Zhihao Yang,Yue Su,Xiangnan Wu,Zirong Chen,Run Luo,Jinkun Hou,Tao Tan,Yinhe Zheng,Yiming Li
类目:Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词:experiences remain grounded, shared physical laws, improved embodied learning, diverse experiences remain, physical environments
备注: Project page: [this https URL](https://gamescaling.github.io) ; Model: [this https URL](https://huggingface.co/THUSI-Lab/GameScaling)
点击查看摘要
Abstract:Scaling data, diversity and model capacity has improved embodied learning in physical environments, where diverse experiences remain grounded in shared physical laws. Whether these gains extend to virtual worlds with different visual styles, dynamics, controls, and objectives remains unclear. We investigate this question through a controlled study of continued pre-training (CPT) across three axes: data volume, diversity, and model size. Our 120 training configurations span four model sizes from 0.8B to 27B, six data budgets from 50 to 1,600 hours, and five mixtures ranging from Minecraft-only data to diverse multi-world corpora. We assess performance and generalization using three-level validation losses and gameplay benchmarks from in-corpus worlds to unseen worlds. Our results show: (1) more data improves in-corpus performance, diversity improves transfer to related worlds with limited gains in distant worlds, and model size improves data efficiency but generalizes worse to distant worlds under single-world training; (2) we observe an early interface phase with broad cross-world benefits and a later world phase with gains narrowed to in-corpus and related worlds, and fit an empirical scaling law relating validation loss to data volume, diversity and model size; and (3) our models are competitive with Minecraft specialists and frontier models in 3D worlds, and perform best in real-time settings. However, the limits of imitation and persistent gaps in distant worlds suggest that building generalist embodied agents requires richer training stages beyond continued pre-training.
136. 【2610.29949】Existence of Minimizers for the Gaussian Mumford-Shah Model via Covariance Floors on the Value Distribution
链接:https://arxiv.org/abs/2610.29949
作者:Faian Conrad
类目:atistics Theory (math.ST); Computer Vision and Pattern Recognition (cs.CV)
关键词:continuous multivariate Gaussian, multivariate Gaussian negative, Gaussian negative log-likelihood, Gaussian Mumford-Shah model, negative log-likelihood term
备注:
点击查看摘要
Abstract:The Gaussian Mumford-Shah model segments an image into regions by minimizing a continuous multivariate Gaussian negative log-likelihood term plus a perimeter penalty. It is used for scalar- and vector-valued images, in particular hyperspectral images, but the existence of a minimizer in general is not guaranteed. The energy is unbounded below whenever the covariance of a single region degenerates, regardless of the perimeter of the regions. A quantitative covariance floor on the covariances of all regions, or equivalently uniform Hölder continuity with exponent at most one of all one-dimensional marginals of the histogram, guarantees a lower bound on the energy and the existence of a minimizer. Our approach therefore shows that existence follows from a property of the histogram of the image, and we furthermore argue that scale-independent covariance floors cannot exist. Admitting a quantitative covariance floor is generic: it holds almost surely for all images with suitable noise. As applications of our theory, we show the convergence of regularized models used in practice and of numerical methods.
137. 【2610.29617】rnScope: Model-Hardware Co-Design for Efficient Ternary Endoscopic Segmentation
链接:https://arxiv.org/abs/2610.29617
作者:Zhuoyu Wu,Wenhui Ou,Qiawei Zheng,Xuhong Qiu,Wenqi Fang,Raphaël C.-W. Phan
类目:Image and Video Processing (eess.IV); Hardware Architecture (cs.AR); Computer Vision and Pattern Recognition (cs.CV)
关键词:small model size, reconcile small model, Edge medical segmentation, Edge medical, reconcile small
备注: 5 pages, 4 figures, 3 tables. Code and experimental results: [this https URL](https://github.com/ReaganWu/TernScope)
点击查看摘要
Abstract:Edge medical segmentation must reconcile small model size, high accuracy, and fast inference. TernScope addresses this tradeoff through model--hardware co-design, learning a compact segmentation network whose low-bit operators also simplify hardware execution. Split-channel large-kernel blocks preserve spatial context with limited computation, while branch fusion removes redundant inference paths. Ternary Progressive Quantization-aware Training (TPQ) then adapts the fused network from deep to shallow layers, through the decoder, and finally to the input and prediction layers. All 25 convolutions use ternary weights and 8-bit activations, enabling packed storage and multiplier-free computation. The resulting model uses 0.2483 M parameters and 0.0949 GMACs while retaining competitive segmentation accuracy on in-domain and external datasets. Under the same 45 nm technology, TernScope reduces compute-array area by 88.46% compared with the original Gemmini, a systolic-array accelerator with 8-bit $\times$ 8-bit multipliers. These results demonstrate a path from accurate lightweight medical segmentation to compact low-bit hardware.
138. 【2610.28964】Can Quantum Layers offer Performance and Security Advantages in Vision-Language Models?
链接:https://arxiv.org/abs/2610.28964
作者:Md Khalid Syfullah,Alvi Ataur Khalil
类目:Quantum Physics (quant-ph); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词:quantum computing moves, fault-tolerant quantum computing, noisy intermediate-scale quantum, early fault-tolerant quantum, computing moves
备注:
点击查看摘要
Abstract:As quantum computing moves from the noisy intermediate-scale quantum (NISQ) era toward early fault-tolerant quantum computing (EFTQC), quantum-enhanced AI is shifting from a conceptual idea to experimental research. Quantum components are expected to extend the capabilities of existing AI systems, yet it remains unclear how such components will help within large multimodal models. In this study, we try to answer that question for vision-language models (VLMs) using classically simulated quantum layers. With LLaVA-OneVision as the backbone, we evaluate 4- and 8-qubit basic-ring and strongly entangling circuits at four insertion and four replacement locations. Insertion adds quantum layers to the classical model, while replacement substitutes them for classical components. Using the same setup, we compare performance and computational cost between classical and quantum-classical hybrid models. On the Visual Spatial Reasoning dataset, inserting a quantum layer after the visual projector reaches 80.7% development accuracy, 2.28 percentage-points above classical full fine-tuning. Replacing the final decoder feed-forward sublayer retains 79.22% accuracy with 13.07 million fewer trainable parameters. Quantum insertion can thus improve accuracy, and selective replacement can reduce parameters. These benefits depend strongly on where the quantum layer is inserted or which classical component it replaces: earlier replacements lower accuracy, and fewer parameters do not reliably shorten training or reduce computation. To assess potential security benefits, we evaluated the robustness of quantum-classical hybrid models under six attack settings. Overall, our study maps where quantum layers help and hurt within VLMs, offering a starting point for hybrid VLM design; whether these gains generalize remains open. The code is available at this https URL.

