本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。
统计
今日共更新701篇论文，其中：
- 自然语言处理106篇
- 信息检索17篇
- 计算机视觉134篇
自然语言处理
1. 【2610.32982】he Language of Instruction: Genre and Generative AI
链接：https://arxiv.org/abs/2610.32982
作者：James E. Dobson
类目：Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：article argues, understood as implementing, instructional-conversational genre, Abstract, massive neural networks
备注：
点击查看摘要
Abstract:This article argues that instruction-fine-tuned language models should be understood as implementing a genre, what is proposed as the instructional-conversational genre. This genre is an amalgamation of discursive language from prior conversations between generative models and humans recursively run through these massive neural networks. It is instantiated in applications through instruction fine-tuning, the inclusion of a pretext known as a system prompt, and the formalization of inputs in mark-up languages characterized by the use of special tokens and role assignment in turntaking structures.
2. 【2610.32955】Measure Before You Train: Typed Decision Models vs. a Classical Baseline vs. a Generative LLM for Routing a Personal Multilingual Inbox
链接：https://arxiv.org/abs/2610.32955
作者：Federico Lucca
类目：Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)
关键词：email agents decide, create a task, Personal email agents, draft a reply, personal inbox agent
备注： 8 pages, 7 tables. Single-user case study. Code and protocol: [this https URL](https://gitlab.com/federicolucca/foyer-measure) . The emails are private and not released
点击查看摘要
Abstract:Personal email agents decide, for every message, what it is, whether it is urgent, whether to draft a reply, create a task, or ignore it. Their error rate is rarely measured: the stored labels were written by the system itself. We present Foyer, a self-hosted personal inbox agent in daily use, and a measurement protocol (stratified sampling, frozen snapshots, thread-grouped splits, pre-registered hypotheses, human labels in the agent's review loop) that yields ground truth before any training. On 739 real Italian/English emails labelled by the owner (231 unbiased, 500 adversarially sampled), we compare nine systems under thread-grouped cross-validation: the production keyword rules, a TF-IDF + logistic-regression baseline, local typed decision models (Tev1, Nimble), a hosted decision model (Nimble v4-max), and hosted generative LLMs (Qwen2.5-7B, Gemma 4 26B/31B). Four results. The production rules score 28% on message type against a 58% majority class: the field shown most prominently carried no information. With ~200 labels, logistic regression has the highest accuracy on every field (type 0.79, urgency 0.74, needs-reply 0.83, is-noise 0.90), though it never predicts the two rarest classes and is statistically tied with Gemma 4 on type; few-shot prompting does not close the gap. The sender's relationship (client, supplier, service) is recovered from other emails of the same contact with 98.6% accuracy where the contact has been seen, and is not inferable from a single message by any model: it belongs in the contact graph, not the prompt. Finally, accuracy is not the product metric: composed into actions, the most accurate system most often ignores emails needing action (18% vs 4% for the best LLM); a cost-chosen threshold on its noise probability halves that rate and makes it the cheapest system.
3. 【2610.32933】Yalda-Embedding: Open Development of a Competitive Persian Retrieval Model
链接：https://arxiv.org/abs/2610.32933
作者：Yalda Taheri,Mohammad Hassan Heydari,Armon Rasooli
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Persian remains constrained, multilingual text representations, effective dense retrieval, compact embedding models, present Yalda Embedding
备注：
点击查看摘要
Abstract:Despite advances in multilingual text representations, effective dense retrieval for Persian remains constrained by the limited availability of language-specific training resources and compact embedding models. We present Yalda Embedding, a 595.8-million-parameter Persian retrieval model adapted from Qwen3-Embedding-0.6B using more than one million query-document pairs. On eight Persian retrieval tasks from FaMTEB, the model achieves the highest macro-average among the evaluated 0.6B models, scoring 0.5488 and outperforming Qwen3-Embedding-0.6B and F2LLM-v2-0.6B on every task. It also approaches Qwen3-Embedding-4B, winning on four tasks, tying on one, and trailing by 0.0075 in macro-average. An incremental ablation study examines contrastive batch size, optimization stabilization, and relational knowledge distillation from F2LLM-v2-8B. Under the one-epoch training setup, contrastive fine-tuning alone yields a modest mean improvement over initialization and regressions on two tasks. The final distilled configuration improves all eight tasks over the non-distilled model, raising the mean from 0.4813 to 0.5488 without increasing inference-time model size. These gains include hard-negative evaluation tasks despite training without explicitly mined or supplied hard negatives. We release model weights, training and evaluation code, the pairwise dataset, and its teacher-embedded counterpart, enabling inspection of data composition and training procedures, independent evaluation, and reuse without repeating expensive teacher inference.
4. 【2610.32921】Adaptive Frequency Threshold Byte Pair Encoding for Mixed Natural Language and Structured Symbolic Corpora
链接：https://arxiv.org/abs/2610.32921
作者：Pietro Di Nicco,Lucio La Cava,Andrea Tagarelli
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：fixed semantic boundary, Byte Pair Encoding, Modern language models, Threshold Byte Pair, Byte Pair
备注：
点击查看摘要
Abstract:Modern language models rely on subwording tokenization to define the discrete units of input processing, typically using methods like Byte Pair Encoding (BPE) that treat whitespace as a fixed semantic boundary. This design is inherently limited, as many meaningful concepts---including multiword expressions and the structured environments of formal languages like LaTeX---frequently span across whitespaces. While recent superword tokenization methods attempt to address this by relaxing whitespace constraints, they often rely on greedy frequency-driven merging that fails to account for token length or the specific needs of underrepresented domain-specific languages. In this paper, we introduce Adaptive Frequency Threshold Byte Pair Encoding (AdaBPE), a new tokenization method that leverages an adaptive frequent-pattern mining approach. AdaBPE features a twofold dynamicity: it adapts minimum frequency thresholds based on both the length of a candidate token, to prevent favoring frequent short patterns, and its type, to distinguish between general and formal language patterns, using LaTeX as case in point. This allows the model to efficiently allocate vocabulary capacity to domain-specific notations, such as LaTeX, even when they represent a small fraction of the training data. We evaluate AdaBPE across five datasets spanning LaTeX and natural language, showing consistent gains in encoding efficiency and downstream language-model performance on domain-specific content without compromising general-language performance.
5. 【2610.32874】Do "True" and "False" Add Up to One? Complement Consistency in LLM-Agent Opinion Simulations
链接：https://arxiv.org/abs/2610.32874
作者：Anouar Imel,Jin Qi
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA); Social and Information Networks (cs.SI)
关键词：LLM-agent opinion simulations, LLM-agent opinion, previous probability, opinion simulations, Qwen paired reports
备注：
点击查看摘要
Abstract:In LLM-agent opinion simulations, each agent reports the probability that a claim is true after seeing its own previous probability and the probabilities reported by its neighbors, and that number becomes its state in the next round. If the number describes the agent's position rather than the sentence it was shown, then rewriting the claim as its complement and replacing every probability p with 1 - p should return the complementary answer, so the two reports should sum to one. We test this with three small open models: Qwen3-4B, Llama-3.2-3B and Gemma-3-4B. On 2,304 agent states taken from a running network simulation, Qwen's paired reports sum to 1.18 on average, and on 48 real fact-checking claims from AVeriTeC they again exceed one. A controlled benchmark of 24 worlds, each with exactly two possible outcomes, shows the same failure in all three models. The discrepancy is two to ten times larger than the change produced by a same-meaning paraphrase, and it persists under repeated sampling and across peer group sizes and report strengths. When the reports are fed back into two populations that start from complementary states, the populations do not remain mirror images: their divergence is positive after five rounds for every model. Averaging each answer with the complement of its paired answer restores consistency by construction and lowers Brier loss averaged over the two wordings, but at the final round it beats the better of the two original wordings for only one of the three models. A schedule-by-targeting experiment on the same model gives a small, stable interaction because such sweeps keep the claim wording fixed. Consistency under rewording therefore needs its own test before simulated probabilities are read as beliefs
6. 【2610.32871】J-Comm: Jacobian-Guided Latent Communication between LLM Agents
链接：https://arxiv.org/abs/2610.32871
作者：Xiangwei Wang,Wei Wang,Sachith Seneviratne,Ken Chen,Yu Xia,Peng Wang,Saman Halgamuge
类目：Computation and Language (cs.CL); Multiagent Systems (cs.MA)
关键词：Latent communication requires, effective continuous reasoning, continuous reasoning process, reasoning process, Latent Reasoning
备注：
点击查看摘要
Abstract:Latent communication requires both an effective continuous reasoning process and an interface through which an external model can leverage its intermediate computation. We present J-Comm, a framework comprising two core components. First, a training-free Geometric Agreement for Latent Reasoning (GEAR) reweights token candidates over existing model embeddings, which monotonically optimizes geometric consensus among candidate tokens in embedding space at each step. Second, we introduce an H+J (Hidden-and-Jacobian) communication interface that gives the Receiver two complementary views of the Sender's reasoning. The H channel supplies continuous inputs derived from feedback distributions, while the J channel conveys intermediate-state cues in vocabulary-indexed Jacobian-lens coordinates. Intuitively, H provides inputs for the Receiver to reason from, while J offers additional guidance within its computation. The Receiver reconstructs these cues using its own dictionary and injects them into intermediate layers during prefill, enabling communication without sharing key-value caches or requiring identical model widths. In Qwen3-8B to Qwen3-4B communication, J-Comm achieves the highest mean score across seven benchmarks, including 94.80% on MATH500, 54.55% on GPQA-Diamond, 73.33% on AIME2024+2025, and 62.93% success on ALFWorld. Compared with TextMAS, it improves performance by 1.29-8.59 percentage points and reduces generated text tokens by 19.2-74.8%.
7. 【2610.32866】Interpretable sparse fine-tuning with TopKLoRA enables faithful circuit discovery
链接：https://arxiv.org/abs/2610.32866
作者：Marek Masiak,Andrzej Szablewski,Nicola Cancedda,Constantin Venhoff
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：data includes poisoned, unknown origin, data includes, Fine-tuning, includes poisoned
备注： 29 pages, 10 figures
点击查看摘要
Abstract:Fine-tuning on datasets of unknown origin can create a backdoor in the trained model when the data includes poisoned examples. Difficult to localise and remove, backdoors can persist through safety training. While parameter-efficient fine-tuning methods capture the full parameter changes introduced during training, they are not easily interpretable. We present the full method of TopKLoRA, extending the preliminary proposal of Masiak et al. (2025), an interpretable-by-design LoRA variant in which only the $k$ largest adapter latents are active at each token. Unlike SAEs, TopKLoRA is trained purely on downstream loss, where optimisation pressure incentivises learning functionally causal latents. We demonstrate this sparse LoRA adapter in a sleeper-agent backdoor case study where we create model organisms by fine-tuning gemma-2-2b, Qwen2.5-1.5B, and Qwen2.5-7B on a poisoned instruction-following dataset. For each organism, we identify and ablate a circuit that is both necessary and sufficient to implement the backdoor. Furthermore, our new fine-tuning method produces sparse circuits that are up to an order of magnitude smaller than a dense LoRA baseline, allowing surgical ablation of the malicious capability without sacrificing instruction-following performance. Finally, we propose a technique to construct model organisms with localised circuits using TopKLoRA latents and gradient-routing, which we use to validate the findings of our circuit search algorithm. We consider these findings as a step toward interpretable-by-design architectures that provide faithful units of analysis without compromising model performance. We share our code: this https URL.
8. 【2610.32842】Communicating with the Entire Population: Machine Translation of Emergency Alerts and Warnings
链接：https://arxiv.org/abs/2610.32842
作者：Jen Wilson,Vipasha Bansal,William D. Lewis
类目：Computation and Language (cs.CL)
关键词：region dominant language, dominant language, affected population, speak a region, region dominant
备注： In Proceedings of the Language Technologies for Crisis Preparedness and Response (LT4CPR Workshop), Hengqin, Zhuhai, China. Association for Computational Linguistics. Nov 2026
点击查看摘要
Abstract:It is essential that we communicate with the entirety of an affected population during a crisis, including those who do not speak a region's dominant language(s). Commercial Translation tools offer a tempting solution to broaden access and can provide a lifeline when no other resources are available. However, Emergency response managers often operate in the dark regarding the quality and adequacy of these automated outputs. In this paper, we conduct a nationwide survey of emergency managers to understand their current workflows, perspectives, and operational challenges. We then evaluate commercial translation tools against these needs, shedding light on their utility and offering practical guidance on how and when these tools can be safely used in emergency response.
9. 【2610.32835】SPOOK: Sparse Pixel Optimization for Off-Manifold Knowledge in Vision Encoders
链接：https://arxiv.org/abs/2610.32835
作者：Ankit Gupta,Akshat Pandya,Christoph Adami,Emily Dolson
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
关键词：natural-image manifold, relationship between embedding, embedding similarity, similarity and human-visible, Modern vision encoders
备注： 12 pages, 3 figures, 3 tables, and 14 pages of Supplementary Material with 8 figures
点击查看摘要
Abstract:Modern vision encoders are widely used as semantic representations, but the relationship between embedding similarity and human-visible semantics can become unclear far from the natural-image manifold. We probe this regime in a black-box setting by applying sparse pixel edits to blank canvases with a simple pixel-level hill-climbing procedure. Across ImageNet and Flickr30k, we evaluate whether these edited blank canvases can retrieve chosen targets in multimodal contrastive encoders and self-supervised visual encoders. On OpenCLIP, inputs optimized toward class prompts achieve strong top-1 and top-5 targeted retrieval performance; on DINOv3, inputs optimized toward class prototypes achieve high target alignment and near-top prototype ranks. These results show that sparse edits on otherwise blank, visually non-semantic inputs can enter target semantic basins in both language-aligned and self-supervised visual representation spaces. Our findings identify a shared off-manifold failure mode of modern vision encoders and suggest sparse blank-canvas optimization as a simple probe of representation geometry.
10. 【2610.32817】KrishokTech: A Bengali Agricultural Advisory System with Explicit Authorization Controls
链接：https://arxiv.org/abs/2610.32817
作者：Khan Raiyan Ibne Reza,Sanjana Aktar Maria,Shakil Ahmed,Faiyad Hossain,Sumaiya Tabassum Nimi
类目：Computation and Language (cs.CL)
关键词：Bengali agricultural advisory, accommodate changing guidance, agricultural advisory system, generating an answer, work with limited
备注：
点击查看摘要
Abstract:For agricultural advisory, generating an answer is only part of the problem: the system must also control unsafe requests, work with limited connectivity, and accommodate changing guidance. KRISHOKTECH is a Bengali agricultural advisory system built around an explicit authorization boundary around generation. Before retrieval, normalization and rule-based admission checks refer policy-covered high-risk requests and ask for a crop when treatment intent is underspecified. The system then binds retrieval to a single crop and asks for confirmation when the text and image indicate different crops. After generation, a narrow verifier removes dosage claims not supported by retrieved BARI/BRRI evidence. Agricultural guidance is kept in an external evidence index that can be updated without retraining the generator, while browser-side vision and local retrieval reduce connectivity requirements. The interface makes these decisions visible as ASK, CONFIRM, REFER, and DROP, together with their evidence. On 200 farmer queries and 400 stress queries, the controls halted underspecified requests and reduced cross-crop retrieval violations from 36.5% to 0% under the tested alias filter. Mismatch detection caught 453 of 454 text-image conflicts, while the verifier caught 114 of 118 inserted dosage errors. The demonstration shows how these controls govern the path from request to delivered advice.
11. 【2610.32802】Frontier-OPD: Discovering the Edge of Agent Capability and Teaching Agents to Go Beyond
链接：https://arxiv.org/abs/2610.32802
作者：Zheng Jiang,Yiming Chen,Houde Qian,Ling Li,Chaoyang Li,Lifeng Sun
类目：Computation and Language (cs.CL)
关键词：multi-turn agents requires, agents requires identifying, aligns teacher feedback, On-policy distillation aligns, student current behavior
备注：
点击查看摘要
Abstract:On-policy distillation aligns teacher feedback with a student's current behavior, yet acquiring useful supervision for multi-turn agents requires identifying both where guidance is needed and whether the student can sustain the interaction afterward. We introduce Frontier-OPD, which addresses this problem through the student's learning frontier: decision situations that remain challenging but admit useful autonomous continuation after brief teacher guidance. To operationalize this frontier, Frontier-OPD organizes on-policy experience into a shared-state trajectory graph, where trajectory-balanced aggregation of teacher-student disagreement identifies distinct intervention candidates while preserving the histories needed for replay. Short teacher bridges are then assessed by comparing agreement over the bridge and the ensuing student continuation with an equally long segment of the original trajectory, providing a behavioral proxy for guidance that the current student can build on. Accepted teacher responses augment ordinary distillation data, and fresh rollouts renew the frontier estimate as the policy changes. Experiments on ALFWorld, WebShop, and ScienceWorld report higher mean autonomous performance than the compared distillation baselines across the evaluated student scales and teacher configurations, with ablations indicating complementary effects of candidate selection and guidance filtering. In one ALFWorld timing setting, the additional collection cost is offset by a shorter time to a target success rate.
12. 【2610.32801】Multiplicative vs. Additive State Coupling in Learned Optimizer Schedules
链接：https://arxiv.org/abs/2610.32801
作者：M. Harper Langston,Pierre-David Letourneau,Dalton Jones,Roland Memisevic,Peter Scott,Mingu Lee,Richard A. Lethin,Christopher Lott,Fatih Porikli,Harris Teague
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Numerical Analysis (math.NA); Optimization and Control (math.OC)
关键词：continuous penalty relaxation, relaxation of MAX-CUT, MAX-CUT by backpropagating, unrolled classical solver, continuous penalty
备注：
点击查看摘要
Abstract:We learn schedules for a continuous penalty relaxation of MAX-CUT by backpropagating through an unrolled classical solver. A state-blind schedule generalizes to instances substantially larger than those used for training. A state-adaptive bilinear schedule also generalizes out of distribution, outperforming its untrained baseline across 15 seeds ($t=4.1$). By contrast, an additive ablation with identical inputs and output heads is statistically indistinguishable from the bilinear model in distribution but performs worse than its own baseline out of distribution ($t=-11.7$). This separation appears without regularization and persists across a $30$ round weight-decay sweep: the bilinear advantage remains significant at every tested value, whereas the additive model never recovers. The results in this setting isolate how solver state enters the schedule, rather than state adaptivity alone, as the architectural distinction associated with out-of-distribution transfer.
13. 【2610.32796】ParaTaxe: a Suite of Tools for Processing and Publishing Multi-parallel Corpora
链接：https://arxiv.org/abs/2610.32796
作者：Olivier Kraif(LIDILEM),Cyrille François(UNIL),Elnaz Jalilian(LIDILEM),Natacha Rimasson-Fertin(ILCEA4),Pascale Roux(XXI)
类目：Computation and Language (cs.CL)
关键词：past fifteen years, digital humanities, fifteen years, past fifteen, ACR Grimm Tradalign
备注：
点击查看摘要
Abstract:Over the past fifteen years, digital tools for parallelizing and aligning textual corpora have developed significantly within the field of digital humanities. Several projects and software tools have been created to compare different translations or versions of texts. Despite these technical advances, many parallel corpora produced in academic contexts quickly become inaccessible online due to the lack of maintenance or funding. To address this gap, we present a suite of open-source tools developed within the ACR Grimm Tradalign and ParaTaxe projects. This suite includes the AIlign aligner, based on multilingual embeddings, a Python processing pipeline for converting and aligning corpora, a web interface called ParaTaxe for managing collections of parallel corpora, and a web interface for exploring aligned corpora built with TEI-Publisher.
14. 【2610.32781】Every Edge Needs a Quote: Building a Quote-Grounded Knowledge Graph of Healthcare Software Adoption with Language-Model Agents
链接：https://arxiv.org/abs/2610.32781
作者：Juan Felipe Duran,Arthur Tobler,Martin Vallières
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Hospitals regularly buy, regularly buy software, Hospitals regularly, regularly buy, buy software
备注： 19 pages, 3 figures, 9 tables. Code: [this https URL](https://github.com/MEDomicsLab/healthcare-agentic-kg)
点击查看摘要
Abstract:Hospitals regularly buy software that clinicians and patients depend on. Because these purchases are costly, hard to reverse and can affect patient care, buyers look for evidence of which peer institutions already use a product and which systems it connects to. This evidence is public but scattered across vendor websites, press releases and third-party pages. Language-model agents can now collect it at low cost, but the correctness of the extracted claims is difficult to establish, and a wrongly listed customer can mislead buyers and misrepresent an organisation. We present a pipeline that builds a knowledge graph of customer and integration relations from the open web under one rule: every edge must be supported by a verbatim quote from its source page. Pages come from a deterministic crawl of each vendor's site and a budgeted ReAct agent that searches the rest of the web. A permissive extractor proposes relations with quotes, and a layered grounding stage decides which to keep, using a referent step that reads the whole page when a quote names only one side, deterministic checks, and a panel of five model calls voting on nine criteria. On 61 vendors, the pipeline reaches 0.94 precision and 0.71 recall against a page-level key covering the 6,428 candidate relations proposed by its extractor, whose verdicts were drafted by one model and re-checked with a second. Against the golden reference, the marketplace's own curated list, it scores lower, but 89% of the relations it keeps that the reference lacks are stated on a page. A confidence score built from the panel's votes keeps more correct relations than the fixed rule at the same precision, and reaches 0.90 precision at 0.90 recall. We also discuss how narrow, bounded model calls, string-matched evidence and voting address long-context degradation and run-to-run variance.
15. 【2610.32770】On-Policy Self-Training: Data-Free Self-Improvement in Large Language Models
链接：https://arxiv.org/abs/2610.32770
作者：Leon Sick,Lukas Hoyer,Yannick Strümpler,Christian Reisswig,Timo Ropinski,Federico Tombari
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：stronger external teachers, relying on stronger, On-policy self-distillation, self-distillation enables post-training, enables post-training foundation
备注：
点击查看摘要
Abstract:On-policy self-distillation enables post-training foundation models without relying on stronger external teachers. However, existing approaches rely on ground-truth question-answer pairs, human-curated problem sets, or other supervised signals. In this work, we reformulate on-policy self-distillation as a self-training framework, driven by self-generated question-answer pairs and privileged reasoning demonstrations. We push supervision to the limit: guided solely by coarse, high-level topic descriptions, the model synthesizes its own curriculum of queries and privileged reasoning traces without access to any human-curated prompts or answers. We find that self-distillation on fully synthetic privileged information enables a model to improve across multiple domains while retaining its capabilities on domains it is not self-trained on. We demonstrate the generality of this framework across text and multimodal domains, achieving consistent self-improvement on standard language benchmarks and Visual Question Answering. Our findings demonstrate that foundation models possess rich latent capabilities that can be amplified without external task supervision or curated problem distributions.
16. 【2610.32752】ActionRAG: Evidence-Refining Graph Diffusion for Long-Term Memory in LLM Agents
链接：https://arxiv.org/abs/2610.32752
作者：Navyansh Mahla,Sashank Vandrangi
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：growing interaction histories, isolated semantic matches, LLM agents, mutually consistent evidence, interaction histories
备注：
点击查看摘要
Abstract:LLM agents need long-term memory that can recover precise and mutually consistent evidence from growing interaction histories, particularly when answers depend on relations among facts rather than isolated semantic matches. Current memory pipelines remain vulnerable at two stages: indexing errors can fragment repeated entities or merge distinct ones, and online retrieval often treats initial similarity scores as final even when the surrounding graph provides evidence for revising them. We introduce ActionRAG, a graph memory architecture that couples cautious indexing with query-time graph retroevaluation. Its indexing pipeline reconciles type labels and applies tiered entity resolution. Given a query, dual-channel entity and triple retrieval forms an initial evidence set and induces a bounded local graph. Query-conditioned receiver-normalized diffusion refines triple scores using local path structure. Seed protection, hub-penalized flux, and triple materialization preserve direct evidence while recovering missed connections. We evaluate ActionRAG on MemoryAgentBench (MAB), which tests accurate retrieval, conflict resolution, long-range understanding, and test-time learning. Across its eight deterministic-scoring columns, ActionRAG achieves 55.1 average accuracy, improving over the strongest retrieval-based memory baseline by 5.4 points. Under MAB's query-time cost accounting, mean synthesis cost stays below \$0.001 per query on the four reported cost columns, and the sum of separately measured retrieval-side p99 components is 440.7 ms on our consumer Apple Silicon setup.
17. 【2610.32725】Ontology-Guided Knowledge Graph Construction from Structured Metadata and Climate Science Publications
链接：https://arxiv.org/abs/2610.32725
作者：Aayush Acharya,Qi Zhang,Eduard Dragut,Longin Jan Latecki
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：extracting structured knowledge, manual curation, creating a fundamental, rapid expansion, literature far outpaces
备注：
点击查看摘要
Abstract:The rapid expansion of scientific literature far outpaces the speed of manual curation, creating a fundamental bottleneck in extracting structured knowledge from scientific texts. To address this, we introduce an agentic, ontology-guided framework for knowledge graph (KG) construction. Our framework utilizes specialized agents for document understanding, information extraction, ontology conformance, and entity linking. First, an LLM extracts factual knowledge in the form of triples with explicit textual evidence from research papers. Then the triplets undergo a multistage verification process to ground the triplets in the ontology. By enforcing schema constraints and requiring evidence in the form of text fragments, we ensure the data is both semantically consistent and traceable. In an agreement study over 1,000 extracted triplets, Gemini-2.5-flash achieves Cohen's $\kappa$ scores of 0.640--0.700 against three human annotators, matching the human--human agreement range of 0.616--0.689. We applied this framework to 2,000 scientific publications and construct a novel, ontology-grounded KG for climate science with 133,990 nodes and 755,308 relations; of the 23,327 triplets that the publications contribute after validation, 98.96\% are judged correct. The pipeline code and KG is publicly available this https URL.
18. 【2610.32702】CounselPlex: A Stressor-Aware Full-Duplex Counseling Model
链接：https://arxiv.org/abs/2610.32702
作者：Yeonju Kim,Bella Godiva,Yong Man Ro
类目：Computation and Language (cs.CL); Sound (cs.SD)
关键词：enabling natural, low-latency interaction, Full-duplex speech models, listen and speak, speech models
备注： 21 pages, 4 figures, 29 tables
点击查看摘要
Abstract:Full-duplex speech models can listen and speak at the same time, enabling natural, low-latency interaction. In counseling, however, these models often focus on the latest utterance and lose track of the seeker's underlying problem. We call this failure Stressor Blindness. We propose CounselPlex, a stressor-aware full-duplex framework that uses two operations. CounselPlex updates a short stressor state during seeker silence and injects this state into PAD positions while listening. We also introduce RoPE Position Shift Augmentation (RPSA), which broadens positional coverage during training and improves performance at longer turn depths in our evaluation. LLM-judge evaluations show improved counseling quality and stressor grounding over strong baselines.
19. 【2610.32691】Natural Language Autoencoders Identify Without Explaining
链接：https://arxiv.org/abs/2610.32691
作者：Kristina Šekrst,Barbara Geld
类目：Computation and Language (cs.CL)
关键词：Natural Language Autoencoders, Natural Language, Language Autoencoders, model internal activations, express a model
备注： ISPSM 2026
点击查看摘要
Abstract:Natural Language Autoencoders (NLAs) express a model's internal activations in the form of readable text. The verbalizer turns an activation into an English explanation; the reconstructor then converts that explanation back into an activation, and the explanation is considered successful if the round trip brings back the original activation. We claim that this criterion evaluates whether the information is sufficient and does not address descriptive faithfulness. A sentence can contain sufficient information to make it possible to identify an activation even if it wrongly explains what the activation does: in the case of reconstruction, the primary aim is to accurately identify the activations and not to describe them. This issue has the same structure as the chain-of-thought faithfulness problem, in which verbal output that has been trained to go with a process is taken as a report on that process, and it parallels the dissociation between an individual's introspective report and the actual governing process as documented in human psychology. Although proposed as interpretability tools for the purpose of alignment, NLAs reintroduce, through unverified explanations, the epistemic problem that they were intended to resolve.
20. 【2610.32679】When is more search useful? An Empirical Study of Search Utility in Quality-Aware Decoding for Machine Translation
链接：https://arxiv.org/abs/2610.32679
作者：Javier Garcia Gilabert,Rico Sennrich,André F. T. Martins
类目：Computation and Language (cs.CL)
关键词：improves machine translation, Quality-Aware Decoding, multiple candidate translations, quality-aware decoder, scaling gain
备注：
点击查看摘要
Abstract:Quality-Aware Decoding (QAD) improves machine translation through test-time scaling, generating multiple candidate translations and selecting the final output with a quality-aware decoder. Usually the same candidate budget N is spent on every source sentence, assuming that all inputs require the same amount of search. We show that this assumption does not hold and that the quality gain obtained from additional candidates varies across sentences. We study search utility through three quantities: total scaling gain, how much quality a sentence can gain from a much larger candidate pool; marginal scaling gain, the expected gain from generating one additional batch of candidates; and the sampling saturation point, the candidate budget required to realize most of the total scaling gain. We investigate two sources of information for predicting these quantities: signals available before candidate-set expansion, and statistics computed from the candidate pool accumulated during search. We find that sentence-level signals correlate with total scaling gain but are less informative about the sampling saturation point. In contrast, properties of the current candidate pool provide useful signals of marginal scaling gain. Finally, we show that these signals can identify sentences that obtain larger gains when additional search is selectively applied.
21. 【2610.32637】Residual Expert Routing for Text-Only Domain Adaptation of Factorized Transducer ASR
链接：https://arxiv.org/abs/2610.32637
作者：Shashi Kumar,Esaú Villatoro-Tello,Thibault Bañeras-Roux,Sergio Burdisso,Petr Motlicek,Kadri Hacioglu,Andreas Stolcke
类目：Computation and Language (cs.CL)
关键词：text improves recognition, Fine-tuning the non-blank, target-domain text improves, adapted predictor, factorized transducer
备注： Paper submitted to ICASSP 2027 (Under review)
点击查看摘要
Abstract:Fine-tuning the non-blank predictor of a factorized transducer on target-domain text improves recognition on that domain but degrades performance on the source domain. A single interpolation weight between base and adapted predictors cannot resolve this: the adapted predictor helps at some prefixes and hurts at others, often within one utterance. We propose conservative residual routing: the adapted predictor becomes a residual correction to the base, and a 16k-parameter gate decides at each prefix how much of it to admit. Closing the gate reproduces the base exactly. On a 40-hour conversational corpus, routing retains essentially all of the text-only gain on two held-out domains (19.89 to 16.74, 20.91 to 16.21 WER) while leaving source-domain WER unchanged (12.90 to 12.93); the adapted predictor alone costs 1.08 WER. Routing needs no per-domain tuning on target-domain audio. Analysis reveals the gate does not behave as a simple domain-level switch: it modulates intervention through the disagreement between the two predictors, suppressing it in-domain and amplifying it out-of-domain.
22. 【2610.32575】PHYRD: A Living Benchmark for Reproducing and Extending Theoretical Physics Research
链接：https://arxiv.org/abs/2610.32575
作者：Qituan Zhang,Guo Chen,Linfeng Zhang,Wenlong Zhang
类目：Computation and Language (cs.CL)
关键词：advanced physical research, Large language models, shown significant power, Large language, physical research
备注：
点击查看摘要
Abstract:Large language models and agents have shown significant power in advanced physical research. In this paper, We introduce PHYRD, a living benchmark for theoretical-physics reasoning with 63 Reproduce and 43 Discover problems. Reproduce tests derivation of published results; Discover tests consequences of modified theoretical conditions. FormulaForest constructs the tasks with reference solutions and subquestion-level rubrics. Across five models, whole-problem accuracy ranges from 49.21% to 68.25% on Reproduce and from 18.60% to 74.42% on closed-book Discover. With tools, four models complete more Discover problems, but conceptual errors and missing arguments persist. Besides, our experimental results demonstrate the value of FormulaForest as synthetic data. On FrontierScience, a benchmark developed by OpenAI, it raises the accuracy of a Qwen-35B-A3B model from 61% to 72%.
23. 【2610.32572】Pseudo-Labels as Rewards, Not Targets: Group-Relative Policy Optimization for Semi-Supervised ASR
链接：https://arxiv.org/abs/2610.32572
作者：Shashi Kumar,Yanis Labrak,Sergio Burdisso,Esaú Villatoro-Tello,Petr Motlicek,Kadri Hacioglu,Andreas Stolcke
类目：Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
关键词：Adapting ASR, untranscribed audio typically, audio typically relies, strong teacher transcribes, untranscribed audio
备注： submitted to ICASSP 2027
点击查看摘要
Abstract:Adapting ASR to a domain with only untranscribed audio typically relies on pseudo-labeling, a strong teacher transcribes the audio and a student is fine-tuned on it. Because supervised fine-tuning (SFT) treats every pseudo-label token as a target, the student inherits the teacher's errors. We show that using the same pseudo-labels as a reward reference for Group Relative Policy Optimization (GRPO) is more robust to label noise. In the banking domain, GRPO yields 29.3% to 56.2% relative WER improvements over SFT on Whisper-generated labels, and the advantage holds across four Whisper sizes, four teacher families, three domains and four languages. While SFT reproduces almost 100% of teacher errors verbatim, GRPO passes through only 27%. Rollout statistics explain why, erroneous pseudo-label words rarely appear in on-policy rollouts, so group-relative advantages stay aligned with the clean transcript, whereas SFT forces them into the policy's support and collapses the reward variance GRPO relies on.
24. 【2610.32516】Principled Nonlinear Concept Erasure and Steering
链接：https://arxiv.org/abs/2610.32516
作者：Idan Simai,Shauli Ravfogel,Uri Shaham
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：gender or race, unsafe to retain, Learned representations, undesirable or unsafe, Learned
备注：
点击查看摘要
Abstract:Learned representations often encode sensitive attributes, such as gender or race, that may be undesirable or unsafe to retain. Concept erasure aims to remove this information while preserving task-relevant content. Existing methods remain incomplete: linear methods provide guarantees only against linear probes, while nonlinear methods achieve stronger empirical erasure but lack formal guarantees and often sacrifice utility. In this work, we introduce a principled conditional autoencoder framework for nonlinear concept erasure. We follow the principle that erasure should remove only the sensitive attribute and nothing else, and we show that, under the stated assumptions, perfect reconstruction together with population-level independence is sufficient for perfect nonlinear guardedness, with preservation guarantees in the imperfect-reconstruction regime. Empirically, we attain a superior utility-erasure trade-off across multiple datasets, sensitive attributes, and language models, surpassing even the supervised variants of competing methods despite using no target-task labels, while being simpler to optimize and converging substantially faster. Beyond erasure, our framework yields concept conversion (representation steering) as a by-product: by changing only the target concept at inference time, it produces representations corresponding to different concept values - at no additional training cost - a capability no prior erasure method provides, and on which we likewise demonstrate strong empirical performance.
25. 【2610.32515】Analysing Austrian Parliamentary Speeches by Predicting Party Affiliations
链接：https://arxiv.org/abs/2610.32515
作者：Sarah Sulollari,Vanja Karan,Benjamin Roth
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Machine Learning (cs.LG)
关键词：Austrian National Council, National Council members, paper examines speech, Austrian National, paper examines
备注： KONVENS 2026
点击查看摘要
Abstract:This paper examines speech characteristics of the Austrian National Council members (CMs). We introduce analysis methodology based on a fine-tuned BERT-Model which assigns to every speech a probability distribution over Austrian parties. These are then aggregated at the speaker and party level. We perform an extensive evaluation to ensure the quality of the generated distributions prior to further analysis. Instead of considering mis-assignments of predicted parties as a performance issue, we leverage them to derive insights about the CMs and political developments. Our findings show that parties that govern together become more similar in their speech characteristics, while, analogously, parties that are in opposition move further away from governing parties. Moreover, CMs who switch party usually adapt their speech characteristics only after the switch occurs. Finally, we publicly release a data set containing party affiliation predictions for the speeches of the Austrian National Council from 1996 to 2018.
26. 【2610.32513】he Punjabi Geet Toxicity Dataset (PGT-FG): Fine-Grained Multimodal Annotations for Toxic Content in Punjabi Songs
链接：https://arxiv.org/abs/2610.32513
作者：Lakhjeet Kaur,Jaspreet Kaur,Komal Rani,Yougal Attri,Ramakant KumarJaydeep Kishore,Pravin Kumar
类目：Computation and Language (cs.CL)
关键词：Punjabi remain limited, Punjabi Geet Toxicity, Punjabi, remain limited, Punjabi toxicity detection
备注：
点击查看摘要
Abstract:Resources for toxicity detection in Punjabi remain limited, particularly for musical content that combines linguistic and multimodal information. We present the Punjabi Geet Toxicity Dataset (PGT-FG), a segment-level resource developed to support research on toxicity detection in Punjabi musical content. The dataset was constructed from publicly available Punjabi songs collected from YouTube. An initial collection of 620 songs resulted in 465 successfully downloaded songs and 3,402 preliminary segments from 450 songs. After quality control and annotation, the final dataset contains 2,396 unique segments from 392 songs. Four native Punjabi annotators produced 2,870 annotation records, including a shared subset of 158 segments annotated by all four. Each annotation includes binary toxicity, eight fine-grained toxicity categories, severity, sentiment, mode, and an uncertainty flag. Inter-annotator agreement was measured with Fleiss' kappa on the shared subset, and majority-based resolution produced the final segment-level labels. Of the 2,396 segments, 705 (29.42%) were labelled toxic and 1,691 (70.58%) non-toxic. Violence was the most frequent category, occurring in 539 toxic segments (76.45%), followed by gang references (227, 32.20%) and drug references (133, 18.87%). The overall toxicity label achieved substantial agreement (kappa = 0.6521). PGT-FG provides a fine-grained resource for Punjabi toxicity detection and multimodal content analysis. The resolved dataset, with one final record per segment, is publicly available on Zenodo (this https URL). Original lyrics, lyric excerpts, and copyrighted audio or video content are not redistributed.
27. 【2610.32492】Accordion: Elastic-Depth Inference via Fixed-Prefix Layer Looping
链接：https://arxiv.org/abs/2610.32492
作者：Yudong Zhang,Wei Ding,Kaili Zheng,Yuchen Ding,Zhenyu Zhang
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Large language models, incurs substantial costs, Large language, budget incurs substantial, Recent Looped Transformers
备注：
点击查看摘要
Abstract:Large language models serve applications with diverse inference budgets, but training and maintaining separate models for each budget incurs substantial costs. Recent Looped Transformers enable flexible inference computation through parameter reuse, but maintaining strong performance across different inference budgets remains an open challenge. We introduce Accordion, a mixture-of-experts-based model that supports five inference budgets through fixed-prefix layer looping. Each budget follows a pre-defined execution path, while the minimum budget retains the unlooped model. Joint pretraining samples one budget per micro-batch and optimizes its next-token prediction loss without additional cross-budget consistency objectives. We further preserve these inference budgets through supervised fine-tuning and reinforcement learning, where parameter-group merging and budget-matched multi-teacher on-policy distillation integrate three domain experts into one model. After 3.6T tokens of pretraining, increasing inference depth improves Accordion-6B-A0.5B's five-category macro-average across 37 tasks by 3.01 percentage points, with the middle budget capturing 89% of this gain using half as many additional layer executions. The final model surpasses each domain expert on its corresponding task-and-budget average, while achieving strong instruction-following performance across all budgets and retaining depth-dependent gains in mathematical reasoning and code generation.
28. 【2610.32483】When Agents Fail: Model or Harness--Who's to Blame?
链接：https://arxiv.org/abs/2610.32483
作者：Shao Zhang,Hangfan Zhang,Yuanyuan Shi,Hao Li,Min-Le Su,Kangcong Li,Jingping Wang,Chunjiang Mu,Chen Zhang,Yang Chen,Bo Zhang,Shuyue Hu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Software Engineering (cs.SE)
关键词：LLM agents combine, LLM agents, agents combine models, joint behavior, reflects their joint
备注： Preprint under review
点击查看摘要
Abstract:LLM agents combine models with execution harnesses, so agentic benchmark performance reflects their joint behavior. We argue that harnesses should therefore be evaluated through their interactions with underlying models. We develop a framework combining five complementary measures: (i) Valid Completion Rate (VCR), how reliably agents finish normally and deliver evaluable results, irrespective of task correctness; (ii) Model-Harness Fit, how well a harness supports task achievement through valid completion for a given model; (iii) Cross-Model Fit, a harness's overall suitability across evaluated models; (iv) Interaction Residuals, pairing-specific execution strengths and weaknesses hidden by component-level summaries; and (v) Token Load, the token demands of agent execution, including failed attempts. We evaluate four general-purpose harnesses (OpenCode, Codex CLI, Pi CLI, and DeepAgents) with four core models, plus two fixed native model-harness systems, on six benchmarks covering context management, tool use, long-context planning, multimodal interaction, and artifact handoff. Including native references and stress conditions, 111 evaluation settings yield 52,168 trajectories. Harness rankings vary across models and benchmarks; task performance and valid completion can favor different pairings, and similar task scores can accompany distinct execution profiles. OpenCode ranks first in cross-model performance, while DeepSeek V4 Flash Preview maintains consistently high Mean VCR across harnesses on the shared four-benchmark panel. These findings support evaluating model-harness interactions, training transferable harness-use capabilities in models, and harness designs adapted to the model and task.
29. 【2610.32474】Beyond Post-Hoc Rewards: Privileged Reasoning Exploration for Multimodal Embeddings
链接：https://arxiv.org/abs/2610.32474
作者：Tianyu Yang,Yijun Tian,Lars Benedikt Kaesberg,Jan Philip Wahle,Bela Gipp,Terry Ruas,Daniel Kurzawe
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Multimodal Large Language, Large Language Models, Large Language, Advances in Multimodal, Multimodal Large
备注：
点击查看摘要
Abstract:Advances in Multimodal Large Language Models (MLLMs) have driven substantial progress in multimodal embeddings. Recent methods exploit generative capabilities by augmenting embedded inputs with self-generated reasoning to produce more informative embeddings. However, conventional retrieval supervision for training embedding models specifies pairwise relevance relations without explicitly guiding the reasoning used for input augmentation. Such reasoning is neither directly observed nor uniquely determined by the input, allowing multiple plausible traces to introduce semantic cues of varying retrieval utility. Existing approaches largely optimize reasoning conditioned on the input alone, limiting the exploration of retrieval-relevant traces. We introduce PILOT, a framework that models reasoning as a latent variable and instantiates its prior and posterior distributions as distinct reasoning modes of a shared MLLM. The prior conditions only on the input, whereas the posterior uses additional training-time relational evidence to guide reasoning exploration. To translate the posterior's broader exploration into inference-time improvements, we derive an importance-weighted variational objective and instantiate it as a prior-posterior co-evolution framework that improves both modes under a shared inference-compatible reward while selectively transferring posterior trajectories to the prior according to their utility and prior reachability. On the 78-task MMEB-V2 benchmark, PILOT outperforms the primary baseline across all 12 task groups at both 2B and 7B parameters, improving overall scores by 3.2 and 3.3 points, respectively, with the largest gains in visual-document retrieval (+6.1 and +6.4 points). Our results show that relational supervision is most valuable not as a post-hoc reward but as a signal for shaping how reasoning is explored in training reasoning-enhanced embedding models.
30. 【2610.32463】Reading Between the Layers: Cross-Modal Alignment and Representational Hierarchy in Vision Transformers
链接：https://arxiv.org/abs/2610.32463
作者：Sugam Karki,Raúl Vázquez,Yova Kementchedjhieva
类目：Computation and Language (cs.CL)
关键词：resembling reading comprehension, underlying vision encoders, vision encoders process, optical character recognition, encoders process text
备注： Accepted to AACL 2026 Findings
点击查看摘要
Abstract:While large vision-language models excel at optical character recognition, it remains unclear how their underlying vision encoders process text and its meaning, and whether they support anything resembling reading comprehension. We systematically study transformer-based vision encoders, using cross-modal alignment between rendered text and visual concepts together with probing and retrieval-based analyses as a controlled window into these broader capabilities. Our layer-wise analyses span orthographic, grammatical, and semantic organization, and reveal that strong cross-modal mapping emerges only in the deepest layers, after unimodal object and text recognition have already developed, coinciding with a progression from surface-level to semantic representations. Although this hierarchy is strongest in contrastively trained models, larger self-supervised models and text-rich training data partially support similar behaviors without explicit language supervision. Together, our results suggest that increasing model and training-data scale, as well as text-rich training data, can partially compensate for the absence of language supervision.
31. 【2610.32443】Decoupling Patient Personas and Clinical Workflows: A Dual-Agent Approach to Realistic Medical Dialogue Generation
链接：https://arxiv.org/abs/2610.32443
作者：Qiyuan Li,Xiaomei Guo,Chao Gao,Haijiang Liu,Deyu Chen,Caicai Guo,Jinguang Gu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：collecting comprehensive patient, ethical constraints, essential for collecting, collecting comprehensive, costly to obtain
备注：
点击查看摘要
Abstract:Pre-consultation medical dialogues are essential for collecting comprehensive patient information, but are costly to obtain at scale due to privacy and ethical constraints. Existing LLM-based synthesis methods often rely on prompt engineering or rigid rules, limiting their ability to balance clinical relevance with realistic patient diversity. We propose CoRPS-Dial, a controllable dual-agent framework for pre-consultation medical dialogue synthesis that integrates patient personas with guideline-aligned clinical workflow rules. CoRPS-Dial generates dialogues through interactions between a persona-driven patient agent and a process-guided doctor agent, followed by post-hoc quality control for role consistency, workflow completeness, and textual consistency. Experiments on coronary heart disease demonstrate that CoRPS-Dial improves alignment between synthetic and real dialogues in information coverage, clinical compliance, and dialogue naturalness. Downstream fine-tuning experiments further confirm the utility of the generated synthetic data for medical dialogue tasks. These results highlight the effectiveness of CoRPS-Dial for clinically grounded and controllable medical dialogue synthesis.
32. 【2610.32441】SCI-AGENT-EXAM: Benchmarking Agents on Scientific Research Tasks
链接：https://arxiv.org/abs/2610.32441
作者：Tianyun Zhong,Wei Wang,Jialin Li,Jianhong Tu,Liyao Li,Chuqiao Kuang,Tianshi Zheng,Songchi Zhou,Weiqi Zhai,Qile Jin,Jiajia Li,Jiasheng Zheng,Boxi Cao,Yaojie Lu,Hongyu Lin,Shiwei Ye,Bing Zhao,Hu Wei,Lin Qu,Xianpei Han
类目：Computation and Language (cs.CL)
关键词：Large language model, activities remain difficult, Large language, diverse research activities, research activities remain
备注：
点击查看摘要
Abstract:Large language model (LLM) agents are increasingly capable of supporting scientific workflows, but their capabilities across diverse research activities remain difficult to assess systematically. Existing benchmarks often focus on selected scientific capabilities or task types, limiting a comprehensive characterization of scientific agents' strengths and weaknesses in realistic research workflows. We introduce SCI-AGENT-EXAM, a workflow-oriented benchmark comprising 120 expert-curated tasks across 11 scientific fields and 7 research task types defined by the Scientific Workflow Task Taxonomy (SWTT). Each task requires both executable artifacts (e.g., code and scripts) and textual artifacts (e.g., reports and explanations). To evaluate the heterogeneous task outputs, we develop a hybrid evaluation protocol combining deterministic programmatic verification for executable artifacts with a calibrated, expert-validated LLM-based judge for textual artifacts. Beyond outcome assessment, we analyze progress and solution stability along execution trajectories to characterize how agents reach their final results. Experiments with 10 frontier LLM agents reveal substantial performance gaps: GPT-6 Astra achieves the highest overall score of 80.9, yet only 26.0% of its runs exceed the 0.95 success threshold. Further analyses uncover distinct capability profiles across scientific task types and substantial variation in execution efficiency and stability. Our code and data are available at this https URL.
33. 【2610.32435】Profile-Driven User Simulation via Reinforcement Learning with Hierarchical Rewards for Task-Oriented Dialogues
链接：https://arxiv.org/abs/2610.32435
作者：Juan Li,Fangshu Chang,Xinyi Jiang,Ling Huang,Yunzhang Chen
类目：Computation and Language (cs.CL)
关键词：Building Task-Oriented Dialogue, requires large volumes, expert labor make, labor make hard, marketing requires large
备注：
点击查看摘要
Abstract:Building Task-Oriented Dialogue (TOD) systems for high-value scenarios such as financial marketing requires large volumes of domain-specific dialogue data, which privacy regulations, annotation costs, and the need for expert labor make hard to obtain. User simulation offers a remedy, but existing methods target general-domain dialogue and exhibit two key limitations: insufficient modeling of domain-specific business processes and compliance constraints, and inadequate capture of the colloquial, spoken-language character of voice interactions. We propose ProfileSim, a profile-driven user simulation framework for financial marketing outbound calls. It jointly models user profiles---demographics and Big Five personality traits---and business profiles---intents reverse-engineered from real call logs---enabling fine-grained control over simulated behavior. The base model is fine-tuned on real voice dialogue data and refined by Group Relative Policy Optimization (GRPO) with hierarchical rewards at the dialogue and utterance levels. Paired with a customer service agent integrating Standard Operating Procedure (SOP) constraints and Retrieval-Augmented Generation (RAG), ProfileSim achieves the highest colloquial naturalness, the strongest user profile adherence and the lowest agent score on long-tail intents among all evaluated user generators, while producing substantially shorter user utterances at comparable business compliance. The generated dialogue data is designed to support intent recognition training, agent evaluation, and rapid cold-start deployment.
34. 【2610.32423】Cycle-of-Thought: Self-Evaluative Iterative Reasoning for Table Visual Question Answering in Document Images
链接：https://arxiv.org/abs/2610.32423
作者：Somraj Gautam,Gaurav Harit
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Visual Question Answering, improved Visual Question, Question Answering, Visual Question, significantly improved Visual
备注：
点击查看摘要
Abstract:Recent advances in Vision-Language Models (VLMs) have significantly improved Visual Question Answering (VQA) performance, yet their reasoning over structured content such as tables remains inconsistent, often plagued by spatial misalignment and logical hallucinations. Existing approaches for improving table VQA typically rely on architectural modifications or expensive supervised fine-tuning (SFT), which impose high barriers to entry due to the need for large-scale, expert-annotated datasets and significant computational resources. In this work, we propose Self-RefineVQA, a training-free, inference-time self-correction framework that improves table VQA performance without additional labeled data or model updates. Inspired by human revision behavior, our method enables a single VLM to iteratively act as a generator, critic, and refiner, forming a closed self-feedback loop that corrects common reasoning errors through prompt-guided re-evaluation. Experiments on tabular VQA benchmarks demonstrate that Self-RefineVQA yields consistent accuracy gains in monolingual and cross-lingual understanding, with a particularly significant boost for small models, enabling lightweight models (e.g., 2B-7B parameters) to rival the performance of significantly larger counterparts. Furthermore, we provide a comparative complexity analysis demonstrating that while inference cost increases linearly, our framework offers superior data efficiency and a lower cumulative cost by eliminating the prohibitive annotation bottleneck of human labeling required for fine-tuning. Our results highlight the potential of prompt-based self-improvement as a scalable, accessible paradigm for reliable table reasoning in VLMs.
35. 【2610.32415】Can LLM Annotators Match Human Consistency? Benchmarking Human Agreement and Optimizing Multi-Agent with Contrastive Knowledge
链接：https://arxiv.org/abs/2610.32415
作者：Xiaopeng Ke,Zhixin Wang,Xuebo Liu,Xinyu Ma,Xing Zheng,Bowen Song,Weiqiang Wang,Min Zhang
类目：Computation and Language (cs.CL)
关键词：benchmarks remain misaligned, advanced rapidly, remain misaligned, existing benchmarks remain, real-world practice
备注： Accepted to EMNLP 2026 Findings
点击查看摘要
Abstract:LLM-based annotation has advanced rapidly, yet existing benchmarks remain misaligned with real-world practice. Actual annotation often involves lengthy, task-specific guidelines, and different annotators may produce divergent but reasonable judgments, especially on boundary cases, where single-labeled dataset fail to reflect this disagreement. This gap also limits existing single-agent and workflow-based annotation systems, which often lack adaptability to complex, evolving guidelines. To bridge this gap, we introduce ANT-A Benchmark, a real-world multi-annotator benchmark spanning 7 datasets across domains and modalities, with task-specific guidelines and 5 independent human labels per instance. ANT-A enables a distribution-aware evaluation, using Fleiss kappa to assess how closely model annotations align with human labeling distributions. We further propose ANT-OR, a multi-agent annotation framework that refines prompts by distilling contrastive decision rules from positive and negative feedback. Experiments show that ANT-OR improves agreement@=2 accuracy by 4.5 points over the strongest baseline and achieves the highest alignment with human annotator distributions as measured by Fleiss kappa within 2 points. Code and benchmark are available at this https URL.
36. 【2610.32411】A Broader Look into MLLM's Retrieval Heads
链接：https://arxiv.org/abs/2610.32411
作者：Jia Wang,Yuqing Li,Jiangnan Li,Zheng Lin,Mo Yu
类目：Computation and Language (cs.CL)
关键词：Locating relevant evidence, Locating relevant, heads, retrieval heads, retrieval
备注： work in progress
点击查看摘要
Abstract:Locating relevant evidence in long inputs is a core capability of Multimodal Large Language Models. Prior studies attribute this capability to retrieval heads, a sparse set of attention heads that transfer information from the context to the output. However, these analyses are confined to a limited set of modalities and the corresponding models. Moreover, how retrieval heads can be leveraged to enhance the model calls for further exploration. In this paper, we ask whether this mechanism expands together with the input modalities of the model. Taking audio-visual input as a newly added modality, we construct paired inputs in which the same answer is either spoken or shown on screen. With the evidence content fixed, retrieval heads remain sparse in the new modality and are shared to a large extent across modalities. Across 18 language, vision-language, and omni-modal checkpoints, omni-modal models largely preserve the retrieval heads of their backbones. Ablating these heads eliminates nearly all audio-visual retrieval. The heads shared across modalities make up fewer than 2\% of all heads, yet ablating them also degrades document understanding, spatial perception, and visual mathematics. Building on these findings, we turn retrieval heads into a target of optimization by training their attention with a ranking objective. This raises the page Recall@1 of Qwen3-VL-8B on MMDocIR by 6.03 points and improves document retrieval across three model families. Functional attention heads can thus serve both as a lens on multimodal models and as a target for improving them.
37. 【2610.32382】Acoustic and Lexical Signals for Native Language Identification of Language Learners
链接：https://arxiv.org/abs/2610.32382
作者：Ahmet Yavuz Uluslu,Mengjie Qian,Kate Knill,Mark Gales
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：traditionally relied, Spoken native language, Spoken native, spoken learner English, speech
备注： Accepted for publication at NLP4CALL
点击查看摘要
Abstract:Spoken native language (L1) identification for second language learners has traditionally relied on acoustic attributes of speech. Comparatively little attention has been paid to analysing speech transcripts for L1 traces. In this paper, we present a study of L1 identification using both speech and corresponding transcripts from a spoken learner English corpus. We compare a WavLM-based audio L1 classifier with a zero-shot GPT-4o classifier operating on transcripts and analyse their predictions across proficiency levels using a CEFR-balanced evaluation set. Our experiments show that the audio classifier outperforms the transcript-based approach overall when full transcripts are available, although their relative strengths vary with learner proficiency. Audio performs better at A1, whereas text performs better from A2 to C1 with full transcripts. Transcript-based accuracy generally increases with proficiency, while acoustic performance remains comparatively stable. Restricting transcript length substantially reduces text-based accuracy, whereas audio is less sensitive to input length and performs relatively well with limited input. These findings provide insights into L1 identification from acoustic and textual representations of learner speech and how performance varies with proficiency and the amount of available language material.
38. 【2610.32349】Why Full-Duplex Speech Models Collapse in Long Conversations
链接：https://arxiv.org/abs/2610.32349
作者：Yeonju Kim,Bella Godiva,Se Jin Park,Yong Man Ro
类目：Computation and Language (cs.CL); Sound (cs.SD)
关键词：speech models listen, promising for natural, listen and speak, makes them promising, Full-duplex speech models
备注： Preprint. 31 pages, 16 figures, 18 tables
点击查看摘要
Abstract:Full-duplex speech models listen and speak at the same time, which makes them promising for natural, open-ended conversation. But can they sustain a coherent conversation for tens of minutes? Because they generate a token every frame, even while listening, they exhaust their context windows within minutes. Yet existing benchmarks evaluate only single turns or a few conversational rounds, too short to expose the long-horizon problem. We introduce the Full-Duplex Long-Horizon Benchmark (FD-LHB), which tests five recent full-duplex models on long replayed conversations and in live conversation with an LLM partner. Every evaluated model eventually either degrades or exhausts its context. Models that keep the full history often degrade before their context runs out, while sliding-window models still fall into repetition, silence, and gibberish. For sliding-window models, we identify two contributing mechanisms. Gibberish and silence are linked to Initialization-Anchor Eviction, where the sliding window discards the first KV entry. Repetition is also reinforced by the model's own recent outputs. Guided by this diagnosis, we apply two simple fixes: Initialization-Anchor Pinning (IAP) keeps that first entry, and Duplex Repetition Penalty (DRP) discourages echoing while guarding against prolonged silence. Together, they support the diagnosis and, without retraining, substantially reduce conversational collapse in replays of up to an hour while running in real time.
39. 【2610.32333】Beyond Final Outcomes: Quantifying Claim-Level Information Dynamics in Multi-Agent LLM Interaction
链接：https://arxiv.org/abs/2610.32333
作者：Haocheng Jiang,Herun Wan,Yongyuan Peng,Minnan Luo
类目：Computation and Language (cs.CL)
关键词：final task outcomes, multi-agent evaluation typically, evaluation typically focuses, LLM-powered agents interact, task outcomes
备注： 23 pages, 3 figures. Code and data: [this https URL](https://github.com/fzj-2023/RIVER)
点击查看摘要
Abstract:When LLM-powered agents interact, information is repeatedly shared, expanded, and forgotten, yet multi-agent evaluation typically focuses on final task outcomes. We study such interaction as claim-level information dynamics and propose RIVER, which decomposes agent outputs into atomic claims and evaluates three complementary dimensions: convergence, exploration, and retention. Convergence captures cross-agent claim correspondence and stance alignment; exploration captures semantic breadth and extension beyond the source; and retention tracks source preservation and the persistence of new claims across stages and lineages. We evaluate five interaction strategies on 40 controlled news-generation cases. Repeatedly pooled interaction promotes convergence but narrows the information space, whereas distributed relay yields broader, less shared information. Further comparisons show that method-specific constraints increase exploration while weakening convergence and retention. Our findings suggest that collective information dynamics are better explained by underlying information-flow mechanisms than by simple downstream performance.
40. 【2610.32332】4DMemory: Benchmarking Long-Horizon Spatiotemporal Memory with Harness-Augmented Agents
链接：https://arxiv.org/abs/2610.32332
作者：Yanhao Jia,Yi Zhu,Yiran Zhong,Weigao Sun,Feida Zhu,Pengkun Jiao,Sihan Yang,Ming Ma,Steven Hoi,Erik Cambria
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM)
关键词：Humans efficiently process, efficiently process multimodal, process multimodal streams, multimodal streams spanning, Humans efficiently
备注： 22 pages, 5 figures
点击查看摘要
Abstract:Humans efficiently process multimodal streams spanning hours to years, building persistent, fine-grained spatiotemporal memories that support reasoning about and predicting long-horizon events. In contrast, existing benchmarks focus on short- and medium-context tasks, and most foundation models struggle to preserve fine-grained information over long horizons. To evaluate and improve long-horizon spatiotemporal reasoning, we introduce the LongVideo dataset and the 4DMemoryBench. LongVideo comprises about 900 hours of video and over 5,000 manually reviewed questions covering visual, textual, and spatiotemporal reasoning across diverse context lengths. We further develop the 4DMemory Harness, which integrates four complementary skills, 22+ specialized tool models, and a model-specific retrieval-augmented generation system. Evaluating 13 leading models, we find that standalone foundation models struggle with long-horizon tasks, while the 4DMemory Harness improves all of them by over 50\%. Compared to previous benchmark, the same models exhibit a performance drop of more than 10\% on 4DMemoryBench. We hope 4DMemory will facilitate the development of spatiotemporal agents capable of addressing complex, long-horizon tasks.
41. 【2610.32318】System One models Are Not Better Rerankers
链接：https://arxiv.org/abs/2610.32318
作者：Michael Dinzinger,Kanishka Ghosh Dastidar,Michael Granitzer
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：reranker, generated text, System, decision, decision fine-tuning
备注：
点击查看摘要
Abstract:System One models, or decision models, answer a question about an input with a calibrated probability instead of generated text. Within weeks of the first release, in September 2026, they were used as rerankers. We test whether the decision fine-tuning behind them makes a better reranker than plain reranker fine-tuning of the same model. For six Qwen backbones from 0.6B to 27B parameters and ten TREC DL and BEIR collections, we compare the untuned model, asked zero-shot, with its decision fine-tunes and its reranker fine-tunes, two of which we train ourselves. In our work, we draw the conclusion that decision fine-tuning never makes the better reranker. From 0.6B to 9B, reranker fine-tuning wins on every backbone by 5 to 29 points nDCG@10, also on zero-shot collections, and at 27B the two tie. Up to 9B, decision fine-tuning adds nothing over simply asking the untuned model. Moreover, we find that the calibration advantage of decision models depends on the question. Asked whether a passage answers the query, they are better calibrated than the published reranker fine-tunes from 4B on. Asked a slightly different question from prior work, they lose this advantage. Lastly, calibration does not make up for a worse ranking: up to 9B, a reranker fine-tune keeps the better passages at a fixed threshold. If you need a reranker, fine-tune a reranker.
42. 【2610.32309】Many Perturbations, Shared Failure Dynamics: Tracing Direction-Sensitive Perturbation Influence in Language Models
链接：https://arxiv.org/abs/2610.32309
作者：Zhibo Hu,Chen Wang,Yanfeng Shu,Liming Dong,Hye-young Paik,Liming Zhu
类目：Computation and Language (cs.CL)
关键词：internal change leaves, task-preserving rewrite turn, answer intact, correct answer, larger internal change
备注： 42 pages, 6 figures
点击查看摘要
Abstract:Why can a task-preserving rewrite turn a correct answer into a failure while a larger internal change leaves the answer intact? We develop a direction-sensitive, readout-relative account of semantic fragility: heterogeneous language changes can share geometric and readout relationships without sharing an input-independent failure direction. Clean decision reserve, representation transformation, and response alignment provide complementary descriptions of this process. An exact longitudinal-transverse decomposition identifies directional information discarded by scalar transmission. A compact reserve-and-transmission model predicts failures across held-out families and items in Qwen3-32B and Gemma 4 31B, with useful but parameterization-dependent transfer to ReClor. Matched interventions show that orientation carries causal information beyond scalar geometry. Among naturally failed rewrites, attention-component tests on disjoint original items and subsequent answer-order controls favor the natural paired direction over tested random and same-answer-letter donor directions. Yet failures rarely persist across option orders, and current-order corrections use recomputed clean references. Shared predictive regularity thus coexists with context-dependent directional effects. Numerical path integration reduces, but does not eliminate, finite-patch approximation error within a fixed context; a larger discrepancy from the natural rewrite effect remains. A complementary fixed-CoT cue study extends this account to influence unacknowledged in recorded reasoning: readout associations transfer across domains, although the positive-mean causal criterion fails and signed-effect prediction remains post hoc. Together, these results support shared relations among reserve, transformation, and response while distinguishing local causal sensitivity from a complete explanation of natural failure.
43. 【2610.32305】DMAIC-Bench: From Self-Reflection to Self-Restraint for Agents in Multi-Stage Analytical Tasks
链接：https://arxiv.org/abs/2610.32305
作者：Shan Peng,Shuaiqi Cheng,Miao Peng,Chenyi Zi,Jia Li
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Multi-stage analytical tasks, Multi-stage analytical, redirect or stop, require LLM agents, tasks require LLM
备注： 54 pages, 14 figures. Code and data: [this https URL](https://github.com/psptpx/DMAIC-Bench-public)
点击查看摘要
Abstract:Multi-stage analytical tasks require LLM agents to use intermediate evidence to decide whether to continue, redirect or stop. Self-reflection, in which an agent critiques its output, is widely studied, yet a critique does not show whether evidence changed the next action. We call that capability self-restraint. Existing agent benchmarks largely measure task completion or output quality and leave it untested. DMAIC-Bench evaluates it with 97 seeded tasks across 15 industrial cases in four sectors, built around Lean Six Sigma's explicit statistical prerequisites. Paired counterfactual variants require opposite actions at the same workflow position, distinguishing warranted restraint from indiscriminate stopping. We assess execution traces with a private scorer and final claims through independent expert review. Across 13 models from six providers, execution-level routing accuracy averages 92% on matched GO decisions and 19% on NO-GO decisions, counting any forbidden downstream computation as a route error. Execution traces show agents reporting correct diagnostics before performing analyses that those results disallow. Separately, blinded expert review of the 11 audited agents estimates that reports act on invalid evidence at 47% of reached NO-GO decisions, with an interval from 31% to 61%. Explicit stopping permission helps some models without consistently restoring correct decisions at both GO and NO-GO forks. Sixteen life-sciences tasks in bulk ribonucleic acid sequencing (RNA-seq) and case-control genome-wide association studies (GWAS) show that the same framework can evaluate evidence-dependent decisions beyond industrial workflows. Project code and data are available at: this https URL.
44. 【2610.32281】"Not" is Not Lost in Translation: A Causal Analysis of Negation Representations in Multilingual LLMs
链接：https://arxiv.org/abs/2610.32281
作者：Giang Son Nguyen,Wray Buntine,Dung D. Le,Wenya Wang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：realization differs drastically, surface realization differs, differs drastically, surface realization, realization differs
备注： 29 pages, 20 figures
点击查看摘要
Abstract:Negation occurs in every language, yet its surface realization differs drastically. Despite this, multilingual large language models (LLMs) translate negation robustly, raising the question of whether they share an underlying representation of negation across languages. We study this question in six open models across English, French, Vietnamese, and Chinese, using causal interventions on a synthetic contrastive dataset and a negation translation dataset derived from FLORES-200. Across models, we find strong evidence that negation representations are causally controllable and largely shared across languages. In particular, we show that a contrastive activation direction extracted from one language can induce or remove negation in the others, and directions extracted from different languages are substantially aligned. We further find that negation is represented in sparse features: a single sparse autoencoder (SAE) feature per model suffices to control polarity across languages, while responding selectively to negated inputs. Finally, both dense and sparse interventions generalize to four additional languages and FLORES-derived sentences. We release data and code to support future work: this https URL.
45. 【2610.32246】Do Halting Heads Really Save Compute in Looped Language Models?
链接：https://arxiv.org/abs/2610.32246
作者：Tsung-Han Wu,Minsuk Heo,Kenny Tan
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Looped language models, Looped language, Looped, run, language models run
备注： 33 pages, 6 figures
点击查看摘要
Abstract:Looped language models run each token through the same layers several times, and each run is one iteration. To save compute, an extra layer, the halting head, gives after each iteration the probability that the token stops there, so that easy tokens can stop early. Pretraining models from scratch, up to 1.3B parameters, we find two problems. First, heads trained on a mix of all iterations predict that tokens need under half the iterations, yet under the standard stopping rule tokens run almost every iteration, because this training never scores the single iteration where a token stops. Scoring every iteration instead fixes this, but in our runs it works only with a strong penalty favoring early stops. Second, savings are commonly reported as an average number of iterations per token, but when sequences are generated in batches that run until their slowest token stops, a model without a head is almost as good at that cost. The reported average can therefore overstate the saving. We recommend reporting the iterations tokens actually run, with the stopping threshold and batch size, and give a test, run before training a head, that bounds its gain.
46. 【2610.32214】DIAL-S2ST: Learning Latency Control for Simultaneous Speech-to-Speech Translation
链接：https://arxiv.org/abs/2610.32214
作者：Jeongsoo Choi,Junseok Ahn,Joon Son Chung
类目：Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
关键词：learning inference-time latency, post-training method, method for learning, learning inference-time, translation models
备注：
点击查看摘要
Abstract:We propose DIAL-S2ST, a post-training method for learning inference-time latency control in simultaneous speech-to-speech translation models. Our approach reuses pretrained translation capabilities through self-distillation from lookahead predictions, while limiting the influence of large text distillation losses to account for the imitation gap. This provides supervision for earlier emission without paired target data or reward computation. To make the learned timing adjustable at inference, we jointly train a single LoRA adapter across scales with matched lookahead guidance. Experiments on French-to-English translation with Hibiki demonstrate that only 10 hours of source speech enable this adaptation, providing flexible latency control with a favorable quality-latency trade-off.
47. 【2610.32213】Head Dimension Matters in Language Models for Long-Context Retrieval
链接：https://arxiv.org/abs/2610.32213
作者：Seiya Tokui,Shoichiro Yamaguchi,Sosuke Kobayashi
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Multi-head attention retrieves, per-head representation space, combines context representations, Multi-head attention, wider heads
备注：
点击查看摘要
Abstract:Multi-head attention retrieves and combines context representations through query--key interactions and value aggregation, with head dimension constraining the per-head representation space. In long-context processing, it remains unclear whether allocating a fixed parameter budget to fewer, wider heads improves information retrieval. In this paper, we investigate how head dimension affects the performance of long-context retrieval tasks. Our empirical studies reveal that pretraining loss and short-context non-retrieval task performance are not affected much by head dimension, while long-context retrieval performance improves with wider heads at fixed model sizes. We find that models with wider heads have a higher proportion of retrieval heads, associating more parameters with retrieval. Our ablation studies also show that the retrieval performance improves with wider heads even when the projection weights in attention modules are frozen during long-context continual pretraining, suggesting that wider heads not only benefit updates in attention modules but lead to more effective adaptation of components such as embeddings and MLPs.
48. 【2610.32212】SOPO: Socratic Guided Policy Optimization for Span-Level Hallucination Detection
链接：https://arxiv.org/abs/2610.32212
作者：Jiawei Dong,Zilong Bai,Pengtian zhu,Peng Zhou
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large Language Models, natural language processing, language processing tasks, Large Language, gained widespread adoption
备注： 24 pages, 11 figures
点击查看摘要
Abstract:Large Language Models (LLMs) have gained widespread adoption in various natural language processing tasks, but suffer from hallucination issues where they generate unfaithful or inconsistent content. While Reinforcement Learning with Verifiable Rewards (RLVR) has shown promising applications in reasoning tasks, its application to span-level hallucination detection is challenged by localization ambiguity, reward sparsity on hard examples, and uncontrolled length inflation. To address these issues, we introduce Socratic Guided Policy Optimization (SOPO), a multi-turn RL framework for robust hallucination detection. The key innovation of SOPO is a Socratic feedback mechanism, where a teacher model guides the reasoning trajectories during rollout by providing indirect hints inferred from the ground truth. This teacher-guided approach enables the model to generate more effective reasoning trajectories for hard examples, thus alleviating reward sparsity. Furthermore, we incorporate Turn-based Advantage Scaling to penalize verbosity bias, encouraging the model to develop efficient and autonomous reasoning capabilities. Empirical results on RAGTruth demonstrate that SOPO (4B) achieves state-of-the-art performance, surpassing leading proprietary models (e.g., GPT-5) and standard RL baselines, while obtaining higher reported mean scores than GRPO on four out-of-domain benchmarks, with mixed evidence against CAPO. We release our training and evaluation code alongside the 1.7B and 4B SOPO models at this https URL.
49. 【2610.32196】SWE-Shift: Evaluating Coding Agents in Evolving Workspaces
链接：https://arxiv.org/abs/2610.32196
作者：Victor Shea-Jay Huang,Rongqing Li,Zhangyue Yin,Kelong Mao,Yaqi Zhao,Xinyuan Wang,Yao Yin,Lirui Luo,Renrui Zhang,Hongsheng Li
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Repository-level coding benchmarks, Repository-level coding, benchmarks largely assume, environments remain unchanged, largely assume
备注： 47 pages. Code: [this https URL](https://github.com/JeixHuang/SWE-Shift)
点击查看摘要
Abstract:Repository-level coding benchmarks largely assume that tasks and environments remain unchanged throughout execution. In software development, code, dependencies, runtime state, and requirements can change while an agent is still working. We introduce SWE-Shift, a benchmark for evaluating coding agents under such mid-execution changes. From the same saved history and workspace, a Clean continuation proceeds without intervention, while a matched Shifted continuation receives a task-relevant update. Success requires completing the current task, preserving still-valid work, and satisfying the applicable state and evidence checks. The benchmark contains 120 scenarios across 12 change families, each evaluated at nine scheduled intervention positions. We evaluate 17 coding-agent systems, all of which have lower Shifted than Clean success. GPT-6 Astra drops from 67.35% to 24.79%, with 20.34% paired success. Tool/session changes and stale evidence yield zero paired success across all systems. Late-position paired success is lower for some systems and higher for others. These results show that success on the unchanged task can coexist with failures to preserve work, recover state, or refresh evidence after an update.
50. 【2610.32191】Collection-Date Assignment Redirects Answers in Temporal QA
链接：https://arxiv.org/abs/2610.32191
作者：Minsu Oh,Seunghui Jwa,Soo Kyun Kim,Yeo-Chan Yoon
类目：Computation and Language (cs.CL)
关键词：contents changed, question, source revision, pages, Abstract
备注：
点击查看摘要
Abstract:A collection date records when a source revision was acquired, not when its contents changed. Can assigning this metadata redirect temporal question answering despite unchanged evidence? Swapping the question day and following day between two revisions lowers later-reference exact match (EM) by 37.6-51.4 percentage points across five open-weight LLMs on 595 Wikipedia pages, replicated on 128 disjoint pages. Previous-day swaps retain 29.0-39.6-point losses on 497 pages. Seven prompt variants, including explicit ignore-collection instructions and archived-revision provenance, retain the effect. Fictional answers and English month-name question dates show that remembered answers and identical date strings are unnecessary. Matched thinking reduces Qwen3.5's penalty from 30.1 to 11.1 points, while native reasoners vary. Two API LLMs show small Wikipedia swap effects and rarely shift to earlier answers on fictional records. Large swap-induced losses concentrate around the question date; swaps between distant dates have much smaller effects. Adding fields containing one observed acquisition date lowers EM relative to omission in three of five LLMs after correction. The diagnostic isolates metadata effects from changing evidence or missing the relevant revision, and provides a practical audit for temporal QA inputs.
51. 【2610.32182】Depth-Dependent Safety Geometry in Vision-Language Models: Layer-Wise Localization and Bidirectional Refusal Control
链接：https://arxiv.org/abs/2610.32182
作者：Muhammad Zeeshan Karamat,Syed Talal Hassan,Christiana Chamon Garcia
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Cryptography and Security (cs.CR); Machine Learning (cs.LG)
关键词：Vision-Language Models, remain poorly understood, widely deployed, poorly understood, behavior remain poorly
备注： Accepted at the NeurIPS 2026 Workshop
点击查看摘要
Abstract:Vision-Language Models (VLMs) are widely deployed, yet the internal mechanisms behind their safety behavior remain poorly understood. We present a lightweight inference-time framework for localizing and manipulating safety-sensitive representations in frozen VLMs, without retraining or modifying parameters. On Qwen3-VL-4B, layer-wise activation divergence analysis reveals non-uniform safety geometry across depth. Causal interventions show that early vision layers support strong bidirectional refusal control through activation steering along a learned safety direction, with unsafe rejection spanning 6%-96%, whereas later layers respond more to activation magnitude scaling and exhibit a substantial safety-selectivity trade-off. Deeper layers remain well separated along the safety direction yet are largely insensitive to steering, distinguishing representational separability from causal controllability. InternVL2.5-4B shows qualitatively similar depth-dependent activation geometry despite differences in layer location and magnitude. Our results expose a white-box, representation-level refusal-bypass attack surface in VLM vision encoders and motivate inference-time stabilization of safety-sensitive representations.
52. 【2610.32181】Not All Information Is Worth Asking For: Decision-Informed Information Seeking with LLMs
链接：https://arxiv.org/abs/2610.32181
作者：Seunghan Lee,Jun Seo,Junhyeok Kang,Jaehoon Lee,Sangjun Han,Sungdong Yoo,Minjae Kim,Tae Yoon Lim,Dongwan Kang,Hwanil Choi,Soonyoung Lee,Wonbin Ahn
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Large language models, Large language, final answer, LLM, stop matters
备注：
点击查看摘要
Abstract:Large language models (LLMs) are increasingly used to support decisions under incomplete information, where deciding what to look up and when to stop matters as much as the final answer. However, LLMs fall into an information trap: They pay for checks, i.e., costly pieces of evidence, that cannot change their decision or are not worth their cost, and they keep asking when the evidence is already sufficient. To this end, we propose Decision-Informed Value-of-information Acquisition (DIVA), a simple yet effective procedure for LLM information seeking based on the decision value of evidence. DIVA 1) lets the LLM specify a small decision model, i.e., how likely a bad outcome is and how each check would shift this probability, through short numeric questions and 2) values each candidate check by how much its imagined outcomes improve the decision net of its cost, stopping when no check is worth its cost. Its variant, DIVA-U, further accounts for the LLM's uncertain estimates of how strongly each check shifts this probability. DIVA is training-free and applies to any LLM. Across four domains and 20 LLMs, DIVA-U has lower regret, i.e., value lost relative to the best possible decision, than every LLM baseline on real-world data, mainly by stopping once evidence suffices, and DIVA cuts the regret of the best LLM baseline by 75% in synthetic scenarios where every check's reliability is given. Code: this http URL.
53. 【2610.32151】he LLENS Platform for On-Premises Large Language Model Agents in a Japanese University Hospital: Development and Evaluation Study
链接：https://arxiv.org/abs/2610.32151
作者：Ken Enda,Jien Saito,Masami Mukai,Feng Han,Emir Turkes,Tatsumi Kusakabe,Reona Umeki,Kazuhiro Sumiyoshi,Mitsuya Numata,Takumi Tanikawa,Akira Endoh,Kenji Hirata,Atsushi Yoshida,Kohsuke Kudo,Shinya Tanaka
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language model, occupies physicians' time, electronic health record, information systems run, medical information systems
备注： 49 pages, 3 figures, 6 tables, with supplementary material. Submitted to JMIR Medical Informatics
点击查看摘要
Abstract:Large language model agents that use tools could take on part of the electronic health record and desk work that occupies physicians' time, but in many hospitals the medical information systems run inside closed networks, so the model and the agent harness must also sit inside. We designed, implemented, and deployed LLENS, a clinical support AI agent platform that runs inside the closed network of Hokkaido University Hospital on one host with 8 NVIDIA H200 GPUs, the open-weight model Kimi K2.6 (~1 trillion parameters), and a web application rebuilt from Open WebUI. The harness has 10 components, including page image reading, full-text attachment input, a path-addressed document tree without a vector index, a network-isolated sandbox, artifact return, self-checking of generated output, subagents, and saved procedures. Kimi K2.6 was chosen from 3 open-weight candidates and scored 480/500 on the 2026 Japanese Medical Licensing Examination; it generated 119 tokens/s for one user and served 16 concurrent requests at 908 tokens/s in total. On 180 questions over hospital documents (3 seeds each), mean accuracy was 10.7% with no documents, 81.3% with fixed retrieval (top 10 chunks of one lexical search), and 97.2% with interactive access, in which the model reads with document tools and the sandbox (15.9 percentage points above fixed retrieval, 95% CI 10.9-21.3); the difference lay in filtering/counting questions (16.7% vs 87.8%). Five scenarios with synthetic data ran on combinations of the components: needlestick injury response, batch adverse event grading, scanned referral letter transcription, falls data aggregation and plotting, and investigation of 3 topics by subagents. The platform has run on the hospital network since September 14, 2026.
54. 【2610.32150】From Promises to Accountability: Comparative AI Modeling and Visualization of Electoral Commitments in Nepali Political Texts
链接：https://arxiv.org/abs/2610.32150
作者：Prakash Poudyal,Nischal Karki,Amrit Dahal,Rajani Chulyadyo,Sameer Tamrakar,Bal Krishna Bal
类目：Computation and Language (cs.CL)
关键词：Commitment Mining refers, Election Commitment Mining, Mining refers, South Asian countries, Commitment Mining
备注： Under review at Natural Language Processing (Cambridge University Press); revision submitted. 34 pages, 5 figures, 13 tables
点击查看摘要
Abstract:Election Commitment Mining refers to the analysis of election commitments made by electoral candidates or political parties during election campaigns. However, many elected candidates and political parties, especially in developing South Asian countries, do not fully deliver on the promises they make before elections. Even after the elections, commitments presented through election manifestos, posters, pamphlets, videos, and other campaign materials are often not systematically or transparently archived. As a result, these promises tend to fade away over time, making it difficult to hold the elected candidates accountable for their commitments. To address this persistent issue, this research aims to develop a system capable of structuring the commitments made by candidates during election periods. In this work, we created the first gold-standard dataset of Nepali political texts (Cohen's kappa = 0.777) and evaluated machine learning, deep learning and large language models to automatically extract and analyze election commitments. LaBSE-LR achieved the best results among machine learning models (0.897 accuracy, 0.896 macro F1-score, 0.947 AUROC), while fastText-LSTM achieved the highest performance among deep learning models (0.914 accuracy, 0.913 macro F1-score, 0.961 AUROC). Among the three evaluated large language models, Qwen3-8B performed best in the few-shot setting (0.848 macro F1-score). The outcome of this work is integrated into a mobile application, where commitments can be visualized with the support of GAI, enhancing transparency, civic engagement, and electoral accountability.
55. 【2610.32144】Disentangling Question, Response, and Verifier Languages in Multilingual P(True) Self-Evaluation
链接：https://arxiv.org/abs/2610.32144
作者：Jewon Yeom,Jaewon Sok,Seonghyeon Park,Jeongjae Park,Hwiyeong Lee,Taesup Kim
类目：Computation and Language (cs.CL)
关键词：verifier language, verifier instruction, Multilingual confidence, Multilingual confidence evaluations, verifier
备注：
点击查看摘要
Abstract:When a language model is asked whether its own answer is correct, three languages are involved: that of the question, that requested for the answer, and that of the verifier instruction asking for the judgment. Multilingual confidence evaluations seldom separate the three. We vary them independently in a six-language factorial design with ten open-weight models (3B-14B) on LSQA, MMMLU and TriviaQA, holding each answer fixed across verifier languages and measuring confidence with a first-token P(True) probe. The three languages move different parts of the evaluation: which of them governs accuracy depends on the benchmark, matching the response language to the question or verifier language sharpens discrimination but not calibration, and the verifier language alone shifts calibration error by up to 0.04 without changing accuracy. The scorer matters as well: an unvalidated judge would have shrunk the MMMLU English-Hindi accuracy gap from 0.198 to 0.038. Multilingual confidence results, model rankings included, are therefore comparable only when all three languages are reported and the scorer is validated.
56. 【2610.32132】SyncPro: Synchronous Reasoning and Responding for Proactive Streaming Video Understanding
链接：https://arxiv.org/abs/2610.32132
作者：Xueyun Tian,Bingbing Xu,Jiaming Liu,Jinpeng Yu,Yang Shi,Yu Zhao,Ruihua Huang,Yuanzhuo Wang,Huawei Shen
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：track unfolding events, video understanding requires, understanding requires assistants, streaming video understanding, understanding requires
备注：
点击查看摘要
Abstract:Proactive streaming video understanding requires assistants to track unfolding events and respond when a user's requested condition is met. To make these decisions, assistants must accumulate relevant evidence and reassess response conditions as new observations arrive. Existing work offers complementary capabilities for this process: proactive video assistants learn when to respond, while streaming video reasoning methods generate scheduled intermediate text to organize observations and support subsequent answers. Together, these capabilities provide a foundation for proactive reasoning, but how to coordinate ongoing reasoning with timely responses remains underexplored. In a direct adaptation, fixed reasoning intervals can trigger updates when nothing relevant has changed or postpone useful updates until the next scheduled step. Sharing one generation path also couples two distinct requirements: preserving evidence for future decisions and producing only the response requested by the user. Moreover, responses generated after reasoning must wait for it to finish, even when sufficient evidence is already available. To address these challenges, we introduce SyncPro, a synchronous dual-stream framework with specialized generation paths for evidence tracking and user-facing responses. Its Inner and Response branches share causal history and activate independently, allowing relevant evidence changes to trigger internal updates and responses to proceed concurrently with ongoing reasoning. We construct 189K dual-stream examples and train SyncPro through supervised fine-tuning followed by trajectory-level reinforcement learning. Experiments across three proactive benchmarks show improved response timing and more accurate answers to user requests.
57. 【2610.32129】Shorter Is Not Cheaper: A Controlled Comparison of Declarative Animation Specifications and Free-Form Code for LLM-Generated Explanations
链接：https://arxiv.org/abs/2610.32129
作者：Jiantang Huang
类目：Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Software Engineering (cs.SE)
关键词：Chat assistants increasingly, fixed runtime plays, Chat assistants, assistants increasingly answer, increasingly answer conceptual
备注： 15 pages, 6 figures, 8 tables
点击查看摘要
Abstract:Chat assistants increasingly answer conceptual questions with interactive, animated explanations, generated either as free-form HTML/JavaScript or as declarative specifications that a fixed runtime plays. The declarative route is widely expected to be cheaper, faster and more reliable, because its outputs are shorter and constrained. We test this expectation in controlled comparisons whose hypotheses and analysis plans were frozen before the runs. We designed ExplainSpec, a time-indexed declarative animation format, and an observation contract that makes every generated explanation programmatically inspectable; validated, pacing-agnostic checkers score 20 explanation requests from five domains. Three Claude models (360 jobs) and, in a follow-up, the open-weight Qwen3-14B with thinking enabled and disabled (240 jobs) answered every request in both formats. For every model the specifications were 25-48% shorter in answer tokens (output excluding reasoning), yet with reasoning enabled total output fell significantly only for the largest Claude model and no model generated significantly faster. The reasons differed. The Claude models reasoned far more before writing specifications (exploratory; for the two larger models, from 15-20% to 85-88% of generations). Qwen3-14B reasoned about as much in both formats (a pre-registered test of this shift was not supported), and its shorter answers saved little against a reasoning trace more than twice as long. Nor were specifications more reliable: free-form pages were valid after one repair round in 95-100% of jobs for every model, whereas Qwen3-14B produced valid specifications in only 33% of jobs and passed all semantic tests in 17% (HTML/JavaScript: 62%). For reasoning models, a shorter format alone therefore does not make generation cheaper, faster or more reliable, and a format learned in context can cost reliability.
58. 【2610.32128】From Noisy Retrieval to Decision Evidence: Silver Evidence Demonstrations for In-Context Learning
链接：https://arxiv.org/abs/2610.32128
作者：Masoud Monajatipoor,Fazlolah Mohaghegh,Hamid Reza Hassanzadeh,Akash Uttamrao Bhoite,Robert E. Tillman
类目：Computation and Language (cs.CL)
关键词：RAG and retrieval-augmented, retrieval-augmented few-shot ICL, evidence, retrieval-augmented few-shot, Retrieved passages
备注：
点击查看摘要
Abstract:RAG and retrieval-augmented few-shot ICL can struggle when decision-relevant evidence is buried in long, noisy context. Retrieved passages and demonstrations may contain redundant or distracting information. Although expert-labeled development examples may identify the text supporting each decision, these annotations are typically used only as answer-side rationales rather than as supervision for filtering noisy retrieval. We propose silver-evidence demonstrations, which replace raw retrieved passages in ICL examples with generated, target-conditioned evidence summaries. For each labeled development example, an LLM generates silver evidence without access to the expert label or gold evidence; this evidence is then paired with the expert label and gold evidence where available. At test time, a single structured call generates silver evidence from retrieved passages and then predicts the final label and decision evidence. Across EI 2.0, SciFact, synthetic policy retrieval, and HICRIC/IMR data, our full method improves over equally sized gold-only ICL (label-only for policy) on three of four datasets and improves evidence F1 on all annotated datasets. It also achieves higher mean label accuracy than InstructRAG-style ICL on all four datasets. These results suggest that replacing demonstration-side retrieved passages with compact, target-conditioned silver evidence is particularly useful for decisions based on long and noisy text, where it reduces distracting context while preserving decision-relevant signals and expert supervision.
59. 【2610.32126】Data Quality in RVL-CDIP: A Systematic Audit
链接：https://arxiv.org/abs/2610.32126
作者：Stefan Larson,Kevin Leach
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：facto standard benchmark, facto standard, standard benchmark, RVL-CDIP, document classification
备注：
点击查看摘要
Abstract:RVL-CDIP is the de facto standard benchmark for document classification, and reported accuracy on it is now 98.8%. In this paper, we audit RVL-CDIP for data quality issues and find that approximately 10.5% of its 400,000 documents have erroneous labels and that 35.2% of the test set has a duplicate or near-duplicate in the training set. Identification codes on the pages are sufficient to classify at 69% accuracy, and a state-of-the-art model loses 11 points without them. Image-only models trained on RVL-CDIP lose 16 to 28 points on documents from other sources, and the choice of OCR engine changes accuracy by 4.1 to 8.3 points. We find that nearly 16,000 RVL-CDIP documents contain sensitive personal data, and produce de-identified versions of these documents. We re-benchmark 25 models, and with all defects remediated, the 13 that we retrain are 0.9 to 2.9 points more accurate than in the original condition; the most accurate of them, LayoutLMv3, is 96.5% accurate. We release the corrected corpus, the annotations and the out-of-distribution data.
60. 【2610.32122】Semantically Rich, Metrically Affect-Blind: A Geometric Blind Spot in Modern Text Embedders
链接：https://arxiv.org/abs/2610.32122
作者：Mahdi Naser Moghadasi
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：modern text embedders, report a systematic, systematic dissociation, dissociation in modern, modern text
备注： 6 pages, 2 figures, 3 tables. Code: [this https URL](https://github.com/mahdinaser/sent2vec-sise)
点击查看摘要
Abstract:We report a systematic dissociation in modern text embedders: sentiment is almost perfectly decodable from their embeddings, yet almost entirely absent from their metric. Across eleven frozen encoders spanning 2021 to 2026, including 2026-generation models and the 4B-parameter LLM embedder Qwen3-Embedding-4B, a linear probe recovers sentence polarity at up to 91.3% accuracy while cosine similarity separates polarity by a margin of only 0.003-0.064. Qwen3-Embedding-4B, the strongest probe in the panel, reaches 91.3% probe accuracy but only 64.3 retrieval MAP. Because retrieval, clustering, deduplication, and retrieval-augmented generation operate on the metric rather than on a trained probe, these systems are effectively blind to information their encoder demonstrably contains. A task-conditioning control suggests this reflects the pretraining objective rather than a prompting artifact: conditioning Jina-v5 on its classification task rather than its retrieval task recovers only about half of the MAP gain that injection achieves on the same weights (63.2 to 73.8, versus 85.1), and leaves the alignment gap essentially unchanged. Sentiment-Injected Sentence Embeddings (SISE) train a small (0.13M-0.69M-parameter) supervised-contrastive head on a frozen encoder in seconds on a CPU, using the labelled training set. The head improves every encoder released since 2022 on full-data probe accuracy (up to +5.8 points), retrieval MAP (up to +26.0) and polarity margin (7-61x). This is a specialization, not a free gain: the compact 128-d head loses 38-41 Spearman points on STS-B, while a fused variant that concatenates it with the base embedding loses 2.4-12.0. With the head, a 0.6B encoder at 128 dimensions matches a 4B encoder given the same head (91.8 vs. 90.3 MAP). We release a CPU-reproducible pipeline and a reusable diagnostic, the Attribute Alignment Gap.
61. 【2610.32115】EDWARD-NMT: Elastic Dimensions With Adaptive Routing and Dual-consistency for Neural Machine Translation
链接：https://arxiv.org/abs/2610.32115
作者：Edward Nguyen,Thai Tran,Kiet Anh Hoang,Duy Hoang,Duy Vo,Khanh Le,Vu Le
类目：Computation and Language (cs.CL)
关键词：Neural Machine Translation, scaling Neural Machine, managing language heterogeneity, Machine Translation, Neural Machine
备注： Accepted to EMNLP 2026 (Findings)
点击查看摘要
Abstract:Sparse Mixture-of-Experts (MoE) is a powerful paradigm for scaling Neural Machine Translation (NMT) and managing language heterogeneity. However, practical limitations hinder its deployment on resource-constrained devices: the entire expert pool must remain in memory, and the per-token compute budget is statically fixed during training by rigid top-k routing. We introduce EDWARD-NMT (Elastic Dimensions With Adaptive Routing and Dual-consistency for NMT), a novel MoE encoder-decoder architecture designed for a train once, deploy anywhere paradigm that exposes a family of deployable sub-networks at inference time. EDWARD-NMT integrates three key innovations: (i) Matryoshka-style elastic dimensions to flexibly reduce the memory footprint; (ii) an adaptive sigmoid router with a learned, task-conditioned threshold, allowing each token to dynamically determine its active expert count; and (iii) a dual-consistency objective to maximize the performance of the extracted sub-networks. Extensive experiments on PhoMT (En-Vi), WMT-14 (En-De), multilingual OPUS-16, and a multi-domain De-En benchmark validate our approach. The full-capacity architecture matches or exceeds strong MoE baselines with improved parameter efficiency. Furthermore, the sub-networks seamlessly extracted from a single checkpoint consistently outperform comparably sized dense Transformers without any retraining.
62. 【2610.32114】ampered ML: Evaluating LLM Judgment of Machine Learning Research
链接：https://arxiv.org/abs/2610.32114
作者：Soroush Ebadian,Parand A. Alamdari,Joe Benton,Hailey Joren
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Digital Libraries (cs.DL); Machine Learning (cs.LG)
关键词：approach to accelerating, accelerating progress, automate parts, alignment research, parts of alignment
备注： 28 pages, 10 figures. Accepted at EMNLP 2026 (Main Conference)
点击查看摘要
Abstract:One approach to accelerating progress on AI alignment is to automate parts of alignment research itself. Doing so requires systems that can perform reliably on hard-to-supervise research tasks, including identifying flaws in research proposals and evaluating whether a proposed experiment supports its intended claim. To evaluate this capability, we introduce Tampered ML, a benchmark of 1,858 item-pairs, each consisting of an experiment proposal reconstructed from a published machine learning paper and a minimally edited counterfactual that introduces a targeted methodological flaw. Models must identify the more methodologically sound proposal in both presentation orders. A human validation study on a stratified sample estimates that 86% of items are valid (95% CI: 81-91%). Frontier models perform above chance but remain far from reliable (with Opus 5 achieving 77.9% accuracy). They are highly sensitive to the order of presentation and favor flawed designs that appear more specific, transparent, or conventional.
63. 【2610.32113】REACT: Representational Early Analysis and Control of Chain-of-Thought Trajectories
链接：https://arxiv.org/abs/2610.32113
作者：Hanwen Zhang,Enyi Jiang,Ruike Zhu,Qinan Yu,Sanmi Koyejo
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：completes its answer, opportunity to intervene, reasoning model completes, model completes, effective control
备注： 26 pages, 2 figures
点击查看摘要
Abstract:Chain-of-thought (CoT) generation offers an opportunity to intervene before a reasoning model completes its answer. But does the point at which risk is easiest to detect also offer the most effective control? We study this question with REACT, a conditional activation intervention that learns a safety direction from paired safe and unsafe trajectories and applies it once to an early CoT hidden state. The model weights remain frozen, and all subsequent tokens are generated without further edits. To study timing, we train directions separately at each of the first five CoT positions and evaluate ungated edits with full post-edit regeneration. Across three distilled reasoning models and three generation seeds, the strongest gains concentrate in a two- to three-token early window; on DeepSeek-R1-Distill-Llama-8B, the effect falls to approximately zero at the fourth and fifth tokens, even though later states can be more predictive of risk. This separates risk readability from effective control: intervention timing must be evaluated through its effect on subsequent generation. On the same 8B model, REACT raises the rate of fully safe CoT-answer outputs on StrongREJECT-273 from 29.06% to 82.05%, while keeping benign refusal and usefulness near baseline. An anonymized implementation is available at this https URL.
64. 【2610.32109】Context or Knowledge: How LLMs Attribute Their Own Answers
链接：https://arxiv.org/abs/2610.32109
作者：Kirill Afendulev,Alexey Dontsov,Alla Chepurova,Elena Tutubalina,Anton Korznikov
类目：Computation and Language (cs.CL)
关键词：Language models, parametric knowledge, answer, Language, source
备注： 25 pages, 7 figures, 23 tables, including appendices
点击查看摘要
Abstract:Language models can answer a question from a supplied document or from their parametric knowledge. When later asked where the answer came from, what determines their source report? We study this by intervening on the model's key-value (KV) cache after the answer is generated and before the source question is asked. On a controlled factual task with four models (7B-32B), changing or removing the document's cache never changes the report. In contrast, transplanting the question-and-answer (Q+A) cache between runs with identical question and answer tokens transfers it: every eligible report follows the donor, while the recipient's document is unchanged. On the two smaller models, steering Q+A values along directions fitted before any source question reverses 98.9-100% of reports across four document conditions at a fixed strength, while norm-matched random directions flip at most 1.1%. The components of keys and values along fitted directions carry the transplant effect: copying them alone nearly reproduces the report change; holding them fixed nearly prevents it. Applied during answer generation, the same value directions also change which source supplies the answer, though more weakly and depending on the prompt. Source reporting in this setting thus depends causally on cached state produced while answering. We do not establish general reporting accuracy or a complete interpretation of this state.
65. 【2610.32107】Beyond What to Say: Proactive Utterance Timing with Inner Thoughts for Werewolf Agents
链接：https://arxiv.org/abs/2610.32107
作者：Yoshiki Tanaka,Shuya Uchiyama,Daichi Hamaguchi,Michimasa Inaba
类目：Computation and Language (cs.CL)
关键词：Werewolf game, Werewolf games, Werewolf, Anytime Utterance Track, Participating
备注： Accepted to the 4th International AIWolfDial Workshop at INLG 2026
点击查看摘要
Abstract:Participating in a conversation involves not only deciding what to say but also whether to speak at all. This judgment carries even greater significance in environments like the Werewolf game, where participants' interests conflict, because both utterances and silence are subject to interpretation and assessment by others. Therefore, determining when to speak, as well as what to say, is crucial for an LLM agent playing the Werewolf game. In this study, we introduce a Werewolf AI agent developed for the Anytime Utterance Track of the AIWolfDial shared task. Our system builds on the existing Inner Thoughts framework, which determines utterance timing during conversations by generating internal thoughts and evaluating the value of each thought for expression at that moment. Since existing methods were designed for general dialogue, we have redesigned the system specifically for the competitive environment and incomplete information setting of Werewolf games. We call our adapted method Adversarial Inner Thoughts. Through experiments involving analysis of self-play logs and human evaluations, we analyze and discuss the effectiveness of our approach.
66. 【2610.32104】Putting Transformer Theories to the Test
链接：https://arxiv.org/abs/2610.32104
作者：Awni Altabaa,Tobias Schnabel,Kiran Tomlinson
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：developed to characterize, characterize the capabilities, capabilities and limitations, employing different abstractions, transformer architecture
备注：
点击查看摘要
Abstract:Several formal theories have been developed to characterize the capabilities and limitations of the transformer architecture, each employing different abstractions that capture different features of the architecture. Due to the differences in their underlying assumptions and conceptual frameworks, these theories can disagree in their predictions about what tasks transformers find easy or hard. We map out seven theories of transformer capability (Star-free, $\mathsf{AC}^0$, $\mathsf{TC}^0$, C-RASP, MPC, BAPO, and Sensitivity) and translate their results into a common matrix of predictions across a suite of tasks covering different computational structures. We provide new theoretical results to complete this matrix. We then evaluate theoretical predictions through controlled experiments measuring in-distribution sample complexity, length generalization, and pretrained language model performance. We find that no single theory explains the observed pattern of successes and failures. When a theory does not capture the transformer behaviors relevant to a task, its predictions break down; for instance, we show that the $k$-hop induction task is predicted hard by C-RASP because it does not model content-dependent attention, but we train small transformers on this task that length-generalize. Similarly, theories assuming hard attention like $\mathsf{AC}^0$ and BAPO predict binary majority to be hard, for which we also find success in practice. Together, our results point to several specific features that a theory of transformers must capture: soft rather than hard attention, dynamic content-dependent retrieval, bounded computation at each position, an account of learnability and inductive biases, and a combination of upper and lower bounds.
67. 【2610.32087】Behaviour analysis for large language model-driven agents
链接：https://arxiv.org/abs/2610.32087
作者：Tianqiang Yan,Lizhen Qu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Understanding language-agent behaviour, Understanding language-agent, language-agent behaviour requires, actions are organised, organisation relates
备注： Under review by Nature Machine Intelligence
点击查看摘要
Abstract:Understanding language-agent behaviour requires learning how actions are organised across a trajectory and how this organisation relates to context and outcomes. We propose a general framework that connects data-driven behavioural discovery with analysis and experimental investigation. Categories developed from recorded activity define what is measured. Analyses preserve the behaviours' positions in the process and express their relationships as interpretable hypotheses. Statistical assessment and tests in held-out contexts examine the strength and scope of the evidence. Experiments, including prompt steering, then test how behaviour and outcomes change under deliberately varied conditions. A study of iterative self-reflection illustrates how discovery, dependency learning and prompt comparisons can inform one another. We develop this approach for trajectories of varying length, event order and agent roles, and identify advances in coding, analysis and experimentation needed to support its wider use.
68. 【2610.32055】How Much Do You Trust A Dog? Quantifying Hint-Following in Reasoning Language Models
链接：https://arxiv.org/abs/2610.32055
作者：Anxin Guo,Chirag Pabbaraju,Sara Ahmadian,Kamesh Munagala,Aravindan Vijayaraghavan
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Large language models, Large language, exhibit sycophancy, reasoning tasks, align with user
备注：
点击查看摘要
Abstract:Large language models (LLMs) often exhibit sycophancy, altering their answers to align with user suggestions even on objective factual and reasoning tasks. Yet the quantitative form of this influence--- and whether it is calibrated to source reliability--- remains poorly understood. In this work, we investigate this behavior through hint-induced answer shifts on MMLU questions, evaluating prompts of the form ``[Source] thinks the answer is (X)''. We systematically vary the source to which the hint is attributed (a professor, a friend, or a dog) across three open-source model families, Qwen, Gemma, and SmolLM. We show that the change induced by the hint follows a predictable structure well-characterized by an exponential tilt: the hint induces an approximately constant mean shift in the hinted answer's log-odds, with question--target susceptibility largely shared across sources. To explore how this pattern can arise, we introduce a formal decomposition of the hint response and illustrate in controlled synthetic experiments how KL-regularized reward-based training reshapes both hinted and unhinted answer distributions. Finally, we evaluate whether this shift is calibrated to source reliability, finding that the log-odds shift persists even when the hint-giver is declared inaccurate or accompanied by explicit warnings not to trust the source, highlighting the vulnerability of LLMs to adversarial steering.
69. 【2610.32042】X-Dubbing: Speech-to-Speech Translation under Temporal and Visual Constraints
链接：https://arxiv.org/abs/2610.32042
作者：Jeongsoo Choi,Ji-Hoon Kim,Junseok Ahn,Joon Son Chung
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)
关键词：Cross-lingual dubbing aims, Cross-lingual dubbing, convert source speech, aims to convert, remains synchronized
备注：
点击查看摘要
Abstract:Cross-lingual dubbing aims to convert source speech into target-language speech that remains synchronized with the original video. The key to this task is to produce a faithful translation that is naturally speakable within the source timing, which is non-trivial because languages differ in duration, rhythm, and articulation. In this paper, we propose X-Dubbing, which formulates the task as a joint problem of time-aware speech-to-text translation and video-aware text-to-speech. Specifically, our method consists of a Dubbing Translator that generates temporally structured scripts and a Voice Actor that renders them in synchrony with the source video, both grounded in a language-agnostic timing budget. We further refine the translator with dubbing-aware feedback from the synthesized speech, encouraging scripts that yield well-synchronized dubbing. This design requires no paired dubbing data, as the two components are trained on speech-text and monolingual audio-visual data respectively. Extensive experiments show that X-Dubbing outperforms recent baselines across diverse metrics, including isochrony and audio-visual correspondence.
70. 【2610.32004】CRM-Agent-Bench: Benchmarking Tool-Using Agents in Stateful Enterprise Environments
链接：https://arxiv.org/abs/2610.32004
作者：Monojit Banerjee,Zhujun Lan,Defu Cao
类目：Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)
关键词：Deploying language agents, real applications demands, follow domain-specific rules, business process correctly, Deploying language
备注： 52 pages
点击查看摘要
Abstract:Deploying language agents in real applications demands more than the right answer: an agent must execute a multi-step business process correctly, follow domain-specific rules, and interact with a user across a dialogue, where the gap between saying and doing is the gap between a satisfied customer and a real loss. We argue that a deployable-agent benchmark should jointly assess four facets: the outcome an agent reaches, the trajectory it takes, its operational viability, and its policy compliance. Customer relationship management (CRM), where mutable records meet operational rules and consequential effects, exercises all four. We introduce CRM-Agent-Bench, an execution-grounded benchmark of 555 stateful, multi-turn tasks across nine business domains and 36 capability tags. Each task supplies a task-specific executable contract drawn from checks over actions, arguments, order, response, target state, and protected state; success is the strict conjunction of the checks declared for that task. We evaluate the complete agent system through these contracts and report scored coverage, latency, and cost. Across sixteen systems evaluated on the audited final release, strict success spans 64.32% to 83.60%; the closely grouped leading systems nonetheless diverge sharply in cost and per-domain reliability. CRM-Agent-Bench offers an auditable framework for measuring contract-grounded business-transaction integrity and adherence to task-declared benchmark policies, with a portable structure designed for extension as models improve. Github repository: this https URL
71. 【2610.32002】DraMaze: A Multi-Agent Pipeline with Future-Aware Memory for Diverse Microdrama Script Generation
链接：https://arxiv.org/abs/2610.32002
作者：Siyang He,Qiqi Wang,Fan Liu,Yuncheng Huang,Pengfei Xu,Xi Chen,Ziwei He,Xipeng Qiu
类目：Computation and Language (cs.CL)
关键词：high-quality script production, rapid growth, increased demand, demand for high-quality, script production
备注：
点击查看摘要
Abstract:The rapid growth of microdramas has increased demand for high-quality script production. Long-form microdrama script generation with LLMs requires both diverse plot progression and long-range narrative coherence. Our observations reveal that candidate continuations increasingly concentrate on fewer narrative mechanisms as generation progresses, while conventional retrieval may reinforce trope reuse and overlook historical information essential to future plots. To address these challenges, we propose DraMaze, a multi-agent pipeline that explores diverse causal paths through trope memory-guided evolutionary tree search and mutation. It further constructs a Backward Narrative Dependency Tree to organize, retain, and retrieve historical memories based on future narrative goals. We also introduce MiDramaBench, a bilingual benchmark for evaluating script logic and creative quality across different script lengths, together with causal-pattern metrics for narrative repetition and diversity. Experiments show consistent improvements across three backbone LLMs. For 60-episode scripts of up to 60k words, DraMaze reduces causal-pattern repetition by 32.1% and achieves a Logic score of 82.5, outperforming the best-performing baseline by 8.5 points.
72. 【2610.31993】AusClinBench: a deterministically scored benchmark of large language models against current Australian clinical policy
链接：https://arxiv.org/abs/2610.31993
作者：Daniel S. Epstein
类目：Computers and Society (cs.CY); Computation and Language (cs.CL)
关键词：Australian clinical software, inform clinical decisions, decisions and draft, draft notes, notes in Australian
备注： 19 pages, 3 figures. Technical report, version 1.4.1 of the benchmark. Not peer reviewed. Answer keys not yet independently reviewed. Results and methods: [this https URL](https://ausclinbench.vercel.app)
点击查看摘要
Abstract:AI models already inform clinical decisions and draft notes in Australian clinical software, usually without the practitioner being told which model is used. Existing medical benchmarks are written for other jurisdictions. We wrote 142 questions from Australian guidelines and schedules across five domains (PBS authority, MBS billing, Ahpra obligations, triage red flags, immunisation and screening), each with one verifiable answer scored by exact match. Each question ran blind and with the governing clause supplied, which separates failure to recall the current rule from failure to apply it. We tested 28 models between July and October 2026. Blind accuracy ranged from 51.5% to 92.7%, and the highest-scoring models could not be separated. Of 791 failed model-question pairs, 684 (86%) were wrong blind and right with the clause. Confident-error rates ranged from 6.6% to 47.8%. On five immunisation questions where the guideline gives no directive, 82% of answers stated one. On 20 Aboriginal and Torres Strait Islander health questions, models did no worse overall, but on a few the wrong answers gave the rule for the general population, an older rule or another country's rule. We propose treating the model as an ingredient of a clinical product, with a minimum standard on local rules that sits beside product evaluation. The keys are one general practitioner's and are not yet independently reviewed. The benchmark measures base models, not clinical products, and does not license any model for clinical use.
73. 【2610.31985】he Helpful Agent Problem: When Emergent Cooperation Among LLM Agents Bypasses Intended Workflows
链接：https://arxiv.org/abs/2610.31985
作者：Moumita Choudhury,Amit Sarker,Shlomo Zilberstein
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA)
关键词：pursue separate tasks, LLM agents, increasingly deployed, deployed in collaborative, tasks while sharing
备注：
点击查看摘要
Abstract:LLM agents are increasingly deployed in collaborative settings where they pursue separate tasks while sharing resources and operating under review or oversight processes. Such settings create safety risks not only when agents are malicious, but also when they are simply trying to help. Prior work has largely studied adversarial or explicitly collusive behavior; we show that benign agents pursuing separate objectives can spontaneously cooperate in ways that bypass intended workflows. We call this the \emph{helpful agent problem}. We study long-horizon shared-resource environments in which agents sometimes depend on resources owned by their peers and cross-owner changes are normally mediated by a reviewer. When review becomes unavailable, agents begin making changes on one another's behalf despite having no shared reward or explicit incentive to cooperate. Crucially, these actions remain within each agent's local permissions while circumventing the system's intended oversight structure. We introduce \textsc{FavorBench}, a controlled benchmark with measurable downstream side effects, and adapt \textsc{CooperBench} to test the phenomenon in realistic repositories. Across two benchmarks and four models, we find that out-of-workflow favors emerge frequently. Further, in \textsc{FavorBench}, favors from at least three models cause significant harm to parties outside the interaction. These results reveal a distinct multi-agent safety challenge: cooperation itself can create pathways around system-level safeguards.
74. 【2610.31971】Knowing Whom to Trust is not Enough: The Trust--Agreement Gap in Repeated Multi-Party LLM Negotiation
链接：https://arxiv.org/abs/2610.31971
作者：Amit Sarker,Moumita Choudhury,Saaduddin Mahmud,Shlomo Zilberstein
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA)
关键词：Large language model, Large language, LLM, individuals and organizations, vulnerable to manipulation
备注：
点击查看摘要
Abstract:Large language model (LLM) agents increasingly participate in negotiations on behalf of individuals and organizations, yet they remain vulnerable to manipulation, particularly in repeated multi-party interactions. Classical multi-agent systems address this challenge through explicit trust and reputation models, whereas existing work on LLM negotiation largely treats trust as an emergent phenomenon. We investigate whether LLM agents can form useful trust estimates from prior interactions and leverage them to improve future negotiation outcomes. We introduce a repeated, multi-party, multi-issue negotiation framework in which recurring agents participate in a sequence of negotiation games while one participant covertly attempts to prevent agreement. After each game, agents assess their counterparts and maintain pairwise trust estimates that carry over to subsequent negotiations. We compare trust-aware and trust-agnostic agents and analyze how explicit trust influences negotiation outcomes. Our results reveal a \emph{trust--agreement gap}: trust-aware agents can identify the adversary within a few games, but accurate trust estimates do not consistently translate into better agreements. Trust increases agreement rates by up to 23 percentage points, but only when agents are explicitly guided to use it in their decisions. Explicit trust can therefore improve repeated LLM negotiations, but its value depends critically on how trust is assessed and incorporated into agents' reasoning.
75. 【2610.31966】POS-Signature Demonstration Retrieval for In-Context Dependency Parsing
链接：https://arxiv.org/abs/2610.31966
作者：Muhammad Azam Afridi,Rajab Ali,Marco Passarotti
类目：Computation and Language (cs.CL)
关键词：Universal Dependencies parsing, structured prediction, English Web Treebank, in-context learning, poor proxy
备注： 14 pages, 1 figure, 8 tables. Code and research artifacts: [this https URL](https://github.com/azamafridi23/pos-signature-parsing)
点击查看摘要
Abstract:Demonstrations for in-context learning are often retrieved by semantic similarity, which may be a poor proxy for relevance in structured prediction. We study demonstration selection for Universal Dependencies parsing with a POS-signature policy that represents sentences with weighted part-of-speech statistics and retrieves three length-compatible, gold-parsed examples from the labeled training split. We evaluate two open-weight language models without fine-tuning on all 2,077 sentences of the UD English Web Treebank test set, comparing the policy with shot- and format-matched fixed and semantic three-shot baselines, as well as zero-shot, chain-of-thought, and critique-refinement systems. POS-signature retrieval yields the highest labeled attachment score among the tested prompting systems for both models (72.4 and 73.2), outperforming semantic retrieval by 1.9 and 2.7 points; paired-bootstrap 95% confidence intervals exclude zero for both contrasts. Chain-of-thought and refinement comparisons vary across models. These exploratory results favor the tested POS-signature retrieval approach on English-EWT. We release the prompts, archived outputs, and evaluation code.
76. 【2610.31946】Which Answer Did the Seventeen-Year-Old Write? A Behavioral Case Study of Author-Age Misattribution, Miscalibrated Confidence, and Non-Corrective Self-Explanation in Six Frontier Language Models
链接：https://arxiv.org/abs/2610.31946
作者：Brianne Lee
类目：Computation and Language (cs.CL)
关键词：prompt by hand, students answered, exam prompt, models, model
备注： 15 pages, 6 tables. Code and data: [this https URL](https://github.com/BraveAnn011/llm-author-misattribution)
点击查看摘要
Abstract:Three students answered the same exam prompt by hand: "What is happiness? Are you happy?" Their ages, recorded at collection, are 17, 28, and 45. The 17-year-old's answer is hedged and formally phrased. Asked to match each answer to an age and gender label, most frontier language models confidently assign it to an adult. This paper reports a structured case study of that failure across six models: Claude Fable 5, Gemini 3.1 Pro, GPT-5.6 Sol, Grok 4.5, GPT-4o (2024), and DeepSeek V4. We ran 1,081 API sessions and scored 3,225 responses across six experimental conditions that manipulate framing, disclosure format, and audience-awareness instruction. Three of six models perform at or near chance (1/3) on the matching task while reporting 73-88% mean confidence. The youngest writer's answer is misattributed to an adult in up to 90% of trials. Removing the multiple-choice scaffold collapses accuracy further: three models never place within three years of the true age once open-ended estimation is required. Institutional framing ("a community-college biology final") significantly degrades the best-performing model's accuracy; a neutral label does not. A single audience-awareness instruction significantly improves one model (+21 points) and moves another to ceiling, with no detectable effect on the three weakest models. Stated confidence is uncorrelated or inversely correlated with correctness for five of six models. After ground truth is revealed, one model names its own stereotyping in 68 of 114 explanations, yet shows the lowest accuracy and highest confidence of any model under blind presentation: articulate retrospective diagnosis that does not track the quality of its judgments. This is a three-item, single-topic, single-language case study meant to isolate a mechanism, not to estimate a population bias rate. Data, code, and raw model outputs are publicly released.
77. 【2610.31945】Kolibri: A Sovereign European Model on the Pareto Frontier
链接：https://arxiv.org/abs/2610.31945
作者：Aleph Alpha:Moritz Althaus,Artur Baranowski,Michael Barlow,Fabien C. Y. Benureau,Felix Berkenkamp,Amrita Bhattacherjee,Lukas Blübaum,Duncan Blythe,Augustijn de Boer,Bastian Boll,Thomas F. Burns,Björn Deiseroth,Niko Dürr,Béni Balázs Egressy,Niklas Finken,Niklas Freymuth,Fabian Gebhart,Max Hammer,Bastian Harren,Andreas Hartel,Johann Higl,Steffen Hirschmann,Pablo Iyu Guerrero,Yasser Jadidi,Andreas Jagusch,Mitja Kleider,Markus Klein,Jonas Knupp,Murali Kondragunta,Garwin Lechner,Dominik Lê-Kellner,Jurek Leonhardt,Jiaze Li,Sohir Maskey,Omar Mehio,Pit Neitemeier,Letitia Parcalabescu,Alejandro Petry Pacheco,Pranav Ragupathy,Martin Reinhardt,Peter Rodenkirch Nfissi,Dylan Rodriquez,Leonard Salewski,Raziye Sari,Jordan Sassoon,Ivo Schaper,Ilhan Scheer,Frank Schneider,Philipp Scholl,Lukas Schott,Eric Schreiber,Pablo Schumacher,Alessio Serra,Philipp Siedler,Prabhu Teja Sivaprasad,Mohamed Soliman,Till Speicher,Volker Stampa,Simon Thel,Serge Thilges,Irina Vidal Migallón,Denis Waßmann,Samuel Weinbach,Sascha Wirges,Michael Wüthrich,Alexei Zacharov
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：report introduces Kolibri, German, introduces Kolibri, Kolibri, Apache
备注：
点击查看摘要
Abstract:This report introduces Kolibri, an English-German mixture-of-experts transformer with 78.1B total parameters and 3.46B active parameters per token, released as open weights under the Apache 2.0 licence. We built Kolibri for sovereign and specialised deployment, with a particular focus on German and on regulated domains such as public administration, industry, and aerospace. To support these settings, we control the full model-development process, including data, architecture, training infrastructure, post-training, and evaluation. We train Kolibri on 24T tokens across pre-training, mid-training, and long-context extension, with German accounting for more than 20% of the data mix by bytes. To reach this share, we complement German datasets with more than 2T German tokens that we curate from the web with our own pipeline and generate synthetically. Post-training combines supervised fine-tuning on curated German and English data with reinforcement learning on more than 1.2M internally curated tasks, which cover reasoning, tool use, instruction following, code, and retrieval. The model activates 4.4% of its parameters per token, and among the open models evaluated in this report, it lies on the Pareto frontier of quality and serving cost in English and German. Kolibri builds on Kolibri Origin, an earlier iteration that validated our full pipeline at scale. Both models come from our Model Factory, which connects data, experimentation, training, evaluation, and deployment through version-controlled workflows.
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
Cite as:
arXiv:2610.31945 [cs.CL]
(or
arXiv:2610.31945v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2610.31945
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
78. 【2610.31943】Agreement rather than normalisation keeps depth reusable in looped language models
链接：https://arxiv.org/abs/2610.31943
作者：Ivan Viakhirev,Kirill Borodin,Maxim Abramov,Grach Mkrtchian
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：language models apply, Looped language models, released Ouro models, loop steps, trained budget
备注： Under review at ICLR 2027
点击查看摘要
Abstract:Looped language models apply one block of layers repeatedly, and the design pays off only if depth is reusable: loop steps beyond the trained budget must remain usable at inference. We ask whether that rests on normalising the state between loop steps, as the released Ouro models do, or on agreement between the loop a model is trained with and the loop it is run with. On released weights this loop-boundary normalisation can be removed without adding parameters and with the readout path bit-identical, and the operation is an identity at one loop step, which serves as an implementation check. Removing it takes Ouro-1.4B and Ouro-2.6B to zero accuracy by the trained budget on a balanced binary task (chance 0.500). State-norm growth, the failure that prior accounts predict, is not the cause: the norm stays within a factor of 2.021 while the head commits to a single wrong token. Yet in 19M-parameter models trained from scratch on two synthetic tasks, 16 seeds per configuration, training without the normalisation is never worse than training with it and extrapolates better: the two are closest at the trained depth and separate on both sides of it (Cliff's delta up to 0.867 beyond the budget). Both results follow if agreement, and not the normalisation itself, is what keeps depth reusable. The damage sits in the readout together with the last layer of the block: in the models trained from scratch, refitting the head over the frozen modified loop recovers a third of the lost accuracy and plateaus, while refitting the last block layer with it recovers all of it. Finally, comparing looped with stacked depth at an equal inference loop count is confounded by unequal overshoot of the trained budget; at matched overshoot the advantage of looping vanishes on one task and shrinks on the other.
79. 【2610.31911】LazyFlash: Forward-Dense, Backward-Sparse Attention for Accelerated Long-Context Fine-Tuning
链接：https://arxiv.org/abs/2610.31911
作者：Keqi Deng,Ruchao Fan,Jinyu Li
类目：Computation and Language (cs.CL)
关键词：process increasingly long, increasingly long sequences, major computational bottleneck, large language models, process increasingly
备注：
点击查看摘要
Abstract:As large language models (LLMs) process increasingly long sequences, attention becomes a major computational bottleneck. Sparse attention mostly targets inference, yet many methods still train densely or cannot support sparse training, and their added complexity makes sparsity hard to turn into wall-clock speedups, leaving dense attention widely used in practice. This paper introduces LazyFlash, a forward-dense, backward-sparse attention method built on the observation that attention training is dominated by the backward pass. LazyFlash keeps the forward pass exactly dense, so the trained model remains a standard dense model that existing systems such as vLLM can serve without any change. For the backward pass, LazyFlash proposes a gradient-aware block sparsification design that ranks query blocks by their attention-output gradient norms and skips those contributing negligibly to parameter updates, turning the dense backward into a block-sparse one. A gradient-mass budget adapts the amount of skipped computation to each head and training step, while importance sampling preserves the dense gradient in expectation. These designs are implemented inside the tiled FlashAttention backward kernel, where skipped blocks are never loaded or computed, translating gradient sparsity into real wall-clock acceleration. Experiments on long-context text and speech LLMs show that LazyFlash maintains downstream performance while achieving up to 5.7x attention-backward speedup over FlashAttention and 1.7x end-to-end training speedup.
80. 【2610.31895】Knowing When to Stop: The Evidence-Action Gap in Coding Agents
链接：https://arxiv.org/abs/2610.31895
作者：Tianyu Chen,Xinran Zhao,Vijay Viswanathan,Shoubin Yu,Mingyuan Zhou,Tongshuang Wu
类目：oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：makes completion impossible, environment makes completion, Coding agents, completion impossible, trained to complete
备注： 36 pages
点击查看摘要
Abstract:Coding agents are trained to complete tasks, and they keep trying even when the environment makes completion impossible. The evidence that only outside help can restore progress usually appears within a few steps, yet agents rarely act on it: they over-persist, attempt undesired workarounds, and claim success the record does not support -- a phenomenon we call evidence-action gap. To measure it, we introduce ImpasseBench, which injects twelve realistic environment blockers into otherwise solvable repair tasks and marks, in each trajectory, the step at which the collected evidence becomes sufficient. Scoring actions relative to that step separates appropriate effort from over-persistence and premature handoff. Across eight frontier models and 19,371 trajectories, we find that nearly every run that needs outside help collects sufficient evidence, yet a third still exhaust their budget, and every unsafe request we detect comes after that point. Fortunately, an escalation tool, or an external monitor for models that ignore the tool, already guards against much of this behavior: the tool cuts budget exhaustion from 34.0% to 6.7%, and the monitor nearly triples task success after environment restoration. Even then, a fired escalation is not yet a useful handoff: tickets reliably name the blocker but often omit the agent's own progress and verification status. Taken together, we argue that knowing when to stop therefore needs explicit support, both in the tool that lets an agent hand off and in the report it leaves behind.
81. 【2610.31894】axoSAE: Rethinking Sparse Autoencoders through Taxonomic Logic
链接：https://arxiv.org/abs/2610.31894
作者：Xinyu Guo,Minglai Yang,Clayton T. Morrison,Eduardo Blanco,Mihai Surdeanu
类目：Computation and Language (cs.CL)
关键词：Recent Sparse Autoencoders, Recent Sparse, Sparse Autoencoders, large language models, decompose the representations
备注：
点击查看摘要
Abstract:Recent Sparse Autoencoders (SAEs) decompose the representations of large language models (LLMs) into interpretable features, enabling precise readout and control of encoded knowledge. However, existing SAEs treat each feature as a standalone unit, whereas real-world knowledge is often taxonomically organized. As a result, readout carries no guarantee of taxonomic consistency, and control lacks the granularity to specify the scope of an edit. We propose TaxoSAE, which explicitly encodes taxonomical information, built on is-a (hypernym-hyponym) relations, into the SAE feature space. TaxoSAE mirrors a taxonomy with a stack of SAEs, one per taxonomy level, and introduces a taxonomic alignment loss that trains each concept to be active whenever one of its hyponyms is. On two factual QA taxonomies, one over biographical relations and one over animals, TaxoSAE enables (1) more accurate readout through the taxonomy with concentrated activations, e.g., +31.3 points in reading out the hypernyms of abstract concepts never queried in training; (2) more precise control, with +25.5 points in swap success, while suppressing a concept removes only its own answers (0-2% accuracy vs. 91-100% on other concepts); and, more importantly, (3) readout of unseen concepts through their hypernyms, with up to +37.9 points in hypernym readout accuracy.
82. 【2610.31874】Mining Frames: Association Rule Mining as an Unsupervised Framework for News Framing Detection
链接：https://arxiv.org/abs/2610.31874
作者：Hager Hesham Mustafa(Anmat Computational Analysis Lab)
类目：Computation and Language (cs.CL); Computers and Society (cs.CY); Information Retrieval (cs.IR)
关键词：require large annotated, large annotated corpora, Association Rule Mining, Computational framing analysis, Computational framing
备注： 35 pages, 5 figures, 4 tables. Working paper. Dataset: [this https URL](https://www.kaggle.com/datasets/anmatproject/framings-gaza-arm-dataset)
点击查看摘要
Abstract:Computational framing analysis is dominated by supervised classifiers that require large annotated corpora and predefined frame taxonomies, limiting their use for non-English languages, novel events, and low-resource settings. This paper presents Association Rule Mining (ARM) as an unsupervised, annotation-free framework for news framing detection. Each document or sentence is treated as a transaction of lexical items, and high-lift co-occurrence rules are read as candidate framing signals (Gamson and Modigliani's condensing symbols), confirmed in context by journalist-researchers. The primary validation is Framing Gaza: 25,512 English-language articles from 16 US, UK, French, and German outlets covering the first year of the Gaza war (October 2023 to October 2024), analyzed with Apriori (mlxtend), platform-weighted support, POS-filtered n-grams, and lift-based scoring. ARM inductively surfaces interpretable patterns without predefined categories: a cross-platform military frame, {israeli, strike} to {kill}, appears as a closed rule in 14 of 16 outlets, and a month-by-month analysis recovers event-driven framing pivots (e.g., the April 2024 World Central Kitchen strike) with no prior event labeling. A systematic headline-body divergence is identified, with headlines carrying concentrated, high-lift editorial framing and body text reproducing institutional, procedural language. A methodological validation on the Seven Days project (1,575 Arabic articles on the 2026 Iran war) shows that FP-Growth enables sentence-level analysis with far lower memory overhead. Findings were validated through editorial uptake: two published investigative stories (Daraj Media; Saheeh Masr). Preprocessing code is released openly; the full pipeline is documented but withheld to preserve operational deployability.
83. 【2610.31867】Rewriting Scaling Laws for Synthetic Data with Compute and Data Constraints
链接：https://arxiv.org/abs/2610.31867
作者：Nicholas Roberts,Ahmed Ahmed,Suhas Kotha,Percy Liang,Yu Wang,Alex Renda,Nitya Mani
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：natural data, model, rewrites, standard ingredient, language model rewrites
备注：
点击查看摘要
Abstract:Synthetic rewrites, where a language model rewrites a natural document e.g. into a target style, are now a standard ingredient of pretraining corpora. However, critical aspects of their use remain poorly understood, such as how much compute should be spent rewriting training data and whether a model trained on rewrites can outperform the rewriter. We study these two questions by proposing a rewriting scaling law that predicts loss from model size, training tokens, the fraction of training tokens that are rewrites, and the number of epochs over the natural data, charging the compute spent generating rewrites. We fit this scaling law in two settings. In the compute-limited setting, natural data is plentiful and rewrites come from a third-party rewriter trained with more compute than our largest run. We find that the estimated optimal rewrite fraction increases with compute, from under $10\%$ at $3\times10^{18}$ FLOPs to $32\%$ at $10^{22}$ FLOPs. Our scaling forecast extrapolates $33\times$ in FLOPs to train a 22B-parameter model, whose final loss is within $1.1\%$ of our prediction. This model achieves a better BPB than its rewriter on several web domains at one-tenth the rewriter's training compute. In the data-limited setting, we assume we only have a fixed seed set of natural data and that our rewriter is a model of the same size as the target, pretrained on that seed set. Again, we find the optimal rewrite fraction increases with the compute budget. We also demonstrate that a model trained on rewrites of its own pretraining data, generated by a rewriter of the same size, beats the best run on natural data alone at every model size up to 3B. Our results show that synthetic rewriting can be studied through the scaling law lens: that optimal methodological choices are predictable and scaling does not necessarily break down beyond the rewriter's capabilities.
84. 【2610.31863】Machine-Readable Operator Manuals over the ISO 11783 Network for Offline, Multilingual LLM Assistance
链接：https://arxiv.org/abs/2610.31863
作者：Timo Oksanen,Julius Gun
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：technical documentation dynamically, access technical documentation, offline assistance, support intelligent, documentation dynamically
备注：
点击查看摘要
Abstract:If agricultural machinery is to support intelligent, offline assistance, then the system must access technical documentation dynamically. In this paper, the Semantic Synchronization of operator manuals over ISO 11783-based CAN buses is analyzed, defined as the process that brings the local knowledge base of a tractor-side assistant into agreement with the operator manual of the connected implement. Data transfer performance was benchmarked using Markdown, JSON, and XML; various open-weight Large Language Models (LLMs) were also evaluated in cross-lingual query tasks. The automatic evaluation of the answers was validated against four human raters. A complete manual was transferred over a physical ISO 11783 network in 31 to 89 s, depending on format and transport settings, which is comparable to the object pool upload that operators already wait for at the first coupling of an implement. Markdown produced the smallest files, while the question-answering performance was comparable across the three formats for most models. With retrieval-augmented generation, locally run models answered most questions on the English manual correctly, with no advantage of the largest model over 7B and 8B models, but performed worse on the five other language editions. Keyword retrieval failed across languages, whereas semantic retrieval provided the cross-lingual capability. The exchange requires only a new parameter group that uses the existing request and transport mechanisms of ISO 11783, which makes it a candidate for standardization. The study is a proof of concept with inference on PC-grade hardware; deployment on embedded agricultural hardware remains future work.
85. 【2610.31862】Aligning Large Language Models with Human Feedback: Mathematical Foundations and Algorithm Design
链接：https://arxiv.org/abs/2610.31862
作者：Siliang Zeng,Luca Viano,Chenliang Li,Jiaxiang Li,Volkan Cevher,Markus Wulfmeier,Stefano Ermon,Alfredo Garcia,Mingyi Hong
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：align Large Language, Large Language Models, Large Language, align Large, Language Models
备注：
点击查看摘要
Abstract:This article provides an introduction to the mathematical foundations and algorithmic frameworks used to align Large Language Models (LLMs) with human intentions, preferences, and values. We discuss standard alignment techniques, such as fine-tuning (SFT), reinforcement learning with human feedback (RLHF), and direct preference optimization (DPO). We also explore the theoretical underpinnings of learning from human preferences, drawing connections to inverse reinforcement learning (IRL) and discrete choice models. We present state-of-the-art algorithms in a tutorial style, discuss their advantages and limitations, and offer insights into practical implementation. Our exposition is intended to serve as a comprehensive resource for researchers and practitioners, providing both a foundational understanding of alignment methodologies and a framework for developing more robust and scalable alignment techniques.
86. 【2610.31854】SWE-Clar: Can Coding Agents Clarify Incomplete Client Requirements and Deliver Greenfield Software?
链接：https://arxiv.org/abs/2610.31854
作者：Jialei Li,Dingxian Wang,Xiaoyan Zhao,Yimeng Bai,Xuanyi Zhu,Yang Zhang,Chao Yin,Wentao Shi,Ganesh Prabhu,Karthik Gomadam Rajagopal,Brett Levert,Darvin Yi,Andrew Rabinovich,Zhao Chen
类目：oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Greenfield software development, turn incomplete client, incomplete client requests, freelance settings requires, Greenfield software
备注： 29 pages, 9 figures, 11 tables. Code and data: [this https URL](https://github.com/upwork/SWE-Clar)
点击查看摘要
Abstract:Greenfield software development in freelance settings requires coding agents to turn incomplete client requests into working software. This makes requirement clarification essential, yet clients may be unable to provide continuous feedback over long development cycles, and receiving their answers does not guarantee correct understanding of complex requirements. These challenges motivate two benchmark design choices: clarification precedes code implementation, and its effectiveness is assessed through explicit tests of requirement understanding. Guided by these choices, we introduce SWE-Clar, a benchmark grounded in real, high-value client commissions to evaluate requirement clarification and code implementation in this setting. It comprises 100 tasks based on real software development jobs on Upwork, each with at least US\$4,000 in total payments. Each task begins with multi-round interaction between a coding agent and a client agent, followed by separate runs for code implementation with acceptance testing and clarification assessment. For the latter, we construct 512 questions paired with reference answers from real client-freelancer interactions, covering both explicitly stated requirements and those inferred from the conversational context. Both runs begin from the same clarification context but remain isolated, preventing assessment questions from guiding code implementation. Experiments with nine frontier models show that even GPT-6 Astra, which has the highest observed implementation score, achieves a task pass rate of only 67%, underscoring the challenge of independent software delivery in this setting. The dataset and evaluation code are available at this https URL.
87. 【2610.31842】Scaling cross-situational word learning on children's naturalistic experiences
链接：https://arxiv.org/abs/2610.31842
作者：Michael C. Frank,Alvin W. M. Tan,Khai Loong Aw,Robert Z. Sparks,Victor Moreno,Grace Keene-Lee,Meesha R. Ryan,Tarun Sepuri,Jane Yang,Virginia A. Marchman,Daniel L. K. Yamins,Bria Long
类目：Computation and Language (cs.CL)
关键词：visual representations, visual, learning, representations, models
备注：
点击查看摘要
Abstract:How do children learn the meanings of the simple, concrete words that form a majority of their early vocabulary? Statistical information about many word meanings can be recovered from the gradual accumulation of information about the co-occurrence of words with their referents, a proposal known as ``cross-situational learning''. Contrastive vision--language models allow this learning strategy to be tested on egocentric video data capturing children's early real-life experiences with visual and linguistic inputs. Initial successes of this method on small datasets provide a proof-of-concept, but vision models struggle to learn robust visual representations when trained on these same egocentric videos. How dependent is cross-situational word learning performance on the quality of the model's visual representations? And can cross-situational models scale to larger and more diverse datasets? To address these questions, we trained models on the BabyView corpus, including 2,441 hours of longitudinal egocentric video from 48 children. Models trained on this dataset learned object--label mappings, but performance was far higher when they used internet-pretrained visual representations as opposed to when visual representations were learned solely from the developmental video data. Further, the majority of the learning signal was carried by a small proportion of utterances that described a visible referent. Models learned lexical representations that showed recognizable human-like semantic structure, but model performance showed substantially different trajectories over training experiences than those observed in children. Cross-situational learning is a viable word learning strategy for early noun vocabulary, but constructing developmentally plausible models will require understanding how to learn high-quality visual representations from naturalistic data.
88. 【2610.31840】SPECMEM: Accelerating Agentic Tool Calling via Live Memory Management
链接：https://arxiv.org/abs/2610.31840
作者：Zihe Song,Wenting Zhao,Ye Liu,Yuanjie Zhu,Ke Xu,Shanghao Li,Philip S. Yu
类目：Computation and Language (cs.CL)
关键词：Tool-calling agents, optimized for accuracy, cost is latency, decoded autoregressively, growing cost
备注：
点击查看摘要
Abstract:Tool-calling agents are mostly optimized for accuracy; in deployment, however, their growing cost is latency: every tool call is decoded autoregressively. Speculative decoding accelerates this without changing the output, and retrieved past calls make strong drafts under real use, where each user's behavior tends to repeat. Yet existing systems keep no cross-session memory, or build the draft store once and never update it. We propose SpecMem, a tool-call memory kept alive and managed throughout deployment: verified calls are written back online into bounded per-user stores with LRU eviction, and a side-effect gate defers irreversible calls until verification confirms. On multi-session, multi-user query streams served by three open-weight models, a frozen store steadily loses acceptance while SpecMem holds it: a 27% gap in mean accepted tokens (+11% to +34% across benchmarks, tracking how much novel work arrives after the store is built) and up to 1.74x wall-clock speedup. Ablations attribute the gain almost entirely to keeping the store live; local per-user scoping adds no acceptance but closes a measured cross-user leakage channel, and gating on declared side effects, rather than on retrieval confidence, is what eliminates irreversible mistakes.
89. 【2610.31838】SAGE: Sense-Aligned Multimodal Grounding Evaluation with Gloss-Augmented Reasoning
链接：https://arxiv.org/abs/2610.31838
作者：Sunjae Kwon,Suhaas Kiran DG,Zonghai Yao,Talha Chafekar,Deepali Singh,Hong Yu
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：protocol covering noun, paper introduces Sense-Aligned, shared term-centric protocol, term-centric protocol covering, introduces Sense-Aligned Grounding
备注：
点击查看摘要
Abstract:This paper introduces Sense-Aligned Grounding Evaluation (SAGE), a unified 10-candidate image-selection benchmark that reformulates VWSD, VerSe, and WikiDiverse into a shared term-centric protocol covering noun-, verb-, and entity-centered grounding. SAGE includes confusable hard negatives and a context-swapped VerSe diagnostic to probe target-term grounding beyond direct caption--image compatibility. We further propose Gloss-Augmented Reasoning (GAR), a training-free framework combining definition grounding with constraint-guided semantic verification. Experiments show that strong VWSD performance does not transfer uniformly across grounding settings. With Gemma3-12B, definition augmentation improves all three subsets, while constraint-guided reasoning improves VWSD and yields particularly strong gains on VerSe, but is less effective on WikiDiverse. Combining the two signals achieves the best macro-average performance, improving Hits@1 from 65.90 to 71.22. These results show that SAGE supports both unified evaluation and fine-grained analysis of explicit semantic reasoning across grounding settings.
90. 【2610.31833】Latent Coherence: Do Frontier Language Models' Probability Judgments Obey the Law of Total Probability?
链接：https://arxiv.org/abs/2610.31833
作者：Peter Potash
类目：Computation and Language (cs.CL)
关键词：penalizes inconsistent probabilities, LawZero Scientist, Bayesian posterior, Scientist AI trains, trains a Predictor
备注： 15 pages
点击查看摘要
Abstract:LawZero's Scientist AI trains a Predictor toward the Bayesian posterior, with an objective that penalizes inconsistent probabilities among latent explanations. We ask whether current frontier language models, with no such training, are already consistent in this sense zero-shot: do their probability judgments satisfy the law of total probability, $P(X)=\sum_z P(z)P(X|z)$, when the latent $z$ must be inferred from records in the context? In separate single-turn calls, models are asked for $P(X)$, for $P(z)$ over the latent's states, and for $P(X|z)$; a causal family applies the same test to $P(y|do(x))$ and the back-door adjustment. Every query has an exact ground-truth probability, and a subset of items is asked in three wordings to separate persistent incoherence from rewording noise. Across seven models, GPT-6.1 Sol and Claude Opus 5.5 are the most coherent (mean absolute residual 0.08 and 0.12 log-odds, about 2 percentage points). Claude Haiku 5.5, Gemini 3.8 Flash and DeepSeek V4-Pro show persistent incoherence (0.27-0.35 log-odds) that is mostly item-specific rather than a shared offset. Within every model, larger residuals go with larger errors against the truth (Spearman 0.40-0.62), so the residual, which needs no ground truth, flags unreliable answers. Reasoning length does not predict coherence, across models or within a model across rewordings of the same question. Simple consistency checks pass almost everywhere; the failures are specific to reasoning through a latent variable. Code and data: this https URL
91. 【2610.31821】What the Query Remembers: Query Abstraction Governs Lexical and Dense Retrieval of Classical Arabic Poetry
链接：https://arxiv.org/abs/2610.31821
作者：Omar Farouk Zouak,Selma Mani,Larbi Said Chikh,Raid Abderrezak Ouahioune
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Classical Arabic poetry, user still remembers, searched depends, Classical Arabic, poetry archive
备注：
点击查看摘要
Abstract:How well a poetry archive can be searched depends on what the user still remembers, not only on what the model understands. We show this for Classical Arabic poetry, benchmarking nine dense encoders and BM25 over two corpora, three indexing modes and two evaluation protocols. Which retriever wins is governed by how much of a poem's wording the query still carries. On tip-of-the-tongue queries BM25 leads every dense encoder, including an 8B state-of-the-art model (0.746 vs. 0.717 Recall@5); on abstract queries it falls to eighth out of ten (0.392 vs. 0.748). Editing the wording of the same queries shows that this ranking largely reflects query composition: adding one remembered half-verse raises BM25 by 38 points, rewriting the quoted words by hand leaves BM25 level with the 8B encoder, and BM25's sensitivity to remembered wording is significantly steeper than that of the strongest dense encoder. The same axis controls explanation augmentation, whose effect swings from +37 to -39 points. The mechanism splits by system type: lexical containment predicts BM25's behaviour, while embedding proximity predicts dense encoders. Finally, the field's two standard protocols, known-item retrieval and thematic relevance, dissociate on the same systems, a result reproduced by two blind human annotators and by two open-weights judges, one of them under a rubric with no literal-match criterion. A benchmark that reports one protocol, or one query register, can give a materially wrong picture. Code and data are available at this https URL.
92. 【2610.31820】Free Lunch for LLMs Confidence: The RL Critic Already Knows
链接：https://arxiv.org/abs/2610.31820
作者：Shujin Wu,Heng Ji
类目：Computation and Language (cs.CL)
关键词：Reliable confidence estimation, training stage requires, large language models, stage requires additional, Reliable confidence
备注：
点击查看摘要
Abstract:Reliable confidence estimation is essential for trustworthy deployment of large language models (LLMs), but dedicated confidence training stage requires additional data and compute. We ask a fundamental question: what prediction problem does confidence training actually solve? Inspired by prior work on external confidence estimation, we compare self- and external estimators of comparable capacity trained on the same (question, response, correctness) triples. We show that an external model trained solely on a policy's behavioral traces can estimate the policy's confidence as accurately as the policy itself, without accessing the policy's internal representations. This points to a deeper connection with value function learning in reinforcement learning (RL): under a correctness-based outcome, we prove that confidence estimation and critic training are equivalent, both predicting the likelihood that a policy's response will be correct from its trajectory. A simple consequence follows: for LLMs trained with value-based RL, the existing critic can be reused as an off-the-shelf confidence estimator with no additional training or data. The policy remains unchanged, so its task performance is preserved, and the critic provides confidence throughout generation, including intermediate reasoning steps. Across math, code, tool calling, and general reasoning spanning a dozen domains, the reused critic is the best confidence estimator on every in-distribution split and the best-calibrated on 14 of 16, without hurting the task performance.
93. 【2610.31723】LAMB: A Modern Contextual Language Model for Latin
链接：https://arxiv.org/abs/2610.31723
作者：Aidan McCarthy
类目：Computation and Language (cs.CL)
关键词：Latin Modern BERT, introduces Latin Modern, article introduces Latin, Modern BERT, Latin Modern
备注：
点击查看摘要
Abstract:This article introduces Latin Modern BERT (LAMB), an encoder for the Latin language based on the ModernBERT architecture, pretrained in two phases on more than 74B Latin tokens using a novel morphologically informed masking regimen. We also present two corpora for the Latin language. Acervus contains 24B BERT WordPiece tokens, including over 760K samples from heavily damaged OCR transcriptions, repaired by a ByT5 model trained for Latin text repair. The second dataset, Corpus Trinum, contains a mixture of over 100M strong and weak Latin language semantic triplets. Corpus Trinum is the first Latin semantic triplet dataset, opening the door for Latin language models to be adapted to general sentence semantic similarity tasks. We construct an experimental grid using five tasks and seventeen subtasks, applying a variety of finetuning configurations and subword aggregation techniques for 15 pretrained encoders, 6 LAMB training checkpoints, and an ablation model designed to quantify the impact of different masking regimens. Using this benchmark, we rank Latin encoders and find that LAMB outperforms all other evaluated models on 16 of 17 subtasks, coming within 0.8 percentage points of state of the art on the seventeenth. We provide additional analyses relating Latin encoder performance to tokenizer behavior, syntactic structure, finetuning configuration, pretraining state, subword aggregation, and variation in source texts and domains. In these, we identify unique acquisition dynamics for Latin open class words during terminal decay phases, and establish that for some task categories, finetuning configuration selection can have a greater effect on downstream scores than additional pretraining tokens.
94. 【2610.31713】Omni-UBench: Benchmarking Omni-Modal LLM-based Guardrails Across Safety, Utility, and Reliability
链接：https://arxiv.org/abs/2610.31713
作者：Junhao Wang,Yidou Chen,Li Lu,Hongwei Yao,Xiaodan Li,Mengjie Wu,Yuefeng Chen,Zhan Qin,Kui Ren
类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
关键词：Large Language Models, Omni-modal Large Language, Large Language, seamless human-AI interaction, enabled increasingly seamless
备注：
点击查看摘要
Abstract:Advances in Omni-modal Large Language Models (OLLMs) have enabled increasingly seamless human-AI interaction, but their unified processing of heterogeneous modalities also expands the attack surface, allowing adversaries to exploit richer input compositions to circumvent safety alignment. To counter such risks, omni-modal guardrails have been proposed to detect and filter unsafe queries across arbitrary modalities. However, their capabilities and limitations remain insufficiently understood due to the absence of a comprehensive evaluation benchmark. In this paper, we present Omni-UBench, the first comprehensive framework for omni-modal safety assessment, evaluating guardrail models along three critical dimensions, i.e., safety, utility, and reliability. Omni-UBench curates over 183k samples drawn from 35+ heterogeneous sources spanning text, image, audio, video, and their cross-modal combinations, annotated with safety labels under a unified risk taxonomy. Benchmarking under Omni-UBench on 15 representative OLLMs and omni-modal guardrails yields several key findings, including: (1) modern OLLMs exhibit strong content moderation potential even without guardrail-specific tuning; (2) existing guardrails still struggle to identify cross-modal queries that conceal harmful intent or involve sophisticated jailbreaks; (3) they further exhibit substantial safety hallucination and over-sensitivity to textual patterns, revealing a deficient understanding of cross-modal safety semantics. Our findings provide valuable insights for developing more trustworthy omni-modal guardrails in future research.
95. 【2610.31695】Fooling LLM Safety Guards into Judging the Wrong Text
链接：https://arxiv.org/abs/2610.31695
作者：Utkarsh Kanwat
类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：LLM application acts, Safety guards check, LLM application, Safety guards, guards check content
备注： 21 pages (13 main body), 2 figures, 8 tables. Code: [this https URL](https://github.com/ukanwat/guardrebind) ; model: [this https URL](https://huggingface.co/ukanwat/shieldstral-1.0-3b-rebinding-fix)
点击查看摘要
Abstract:Safety guards check content before an LLM application acts on it, and most paste that content into a plain-text prompt. Content that imitates the prompt can append a second task, and the guard answers that one instead. We call this target rebinding. Our explanation is that the guard grades the last complete task in its input, here a harmless decoy, so the harmful request goes through unchanged. In a pre-registered test, an appended forged query and decoy clear all 75 held-out AdvBench requests that Shieldstral-1.0-3B flags. The guard is not persuaded: a directive to ignore the text above clears none of them, and in a follow-up run a harmful decoy stops the attack. On our GuardRebind benchmark, each of five guards has an attack family, chosen per guard, that clears at least 93% of its flagged items. Rebinding explains this best on Shieldstral and gpt-oss-safeguard; on ShieldGemma and Llama Guard 3, generic evasion and trailing text respectively do part of the work, and Qwen3Guard falls mainly to a forgery of its whole task. Training the guard to score content no lower than its most harmful part cuts attack success from 75% to 0.8-1.6% on attack families, decoys and forged queries held out of training. All of these attacks append the forged structure after the request, and we added the held-out-decoy evaluation after a first round of test runs. Clean AUROC falls by at most 0.01, but our test of non-inferiority is inconclusive. A score-guided search still beats this trained guard on 47 of 50 items, usually by placing forged structure before the request. On about half of the items where the search wins, the same search also finds benign text, with no forged structure, that clears the guard.
96. 【2610.31687】Distributional Alignment of LLMs and Its Generalization Properties
链接：https://arxiv.org/abs/2610.31687
作者：Nelson Jo
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language models, probe human behavior, Large language, language models, models are increasingly
备注： IJCAI 2026 Workshop on Augmented Democracies
点击查看摘要
Abstract:Large language models are increasingly used to simulate and probe human behavior, e.g., for surveys. For these applications, a key property is that outputs satisfy distributional alignment: to match its output distribution with some reference (in this case, human) distribution. An obstacle in achieving distributional alignment is generalizing from small training data. In this work, we study (1) how to distributionally align LLMs; and (2) how aligned LLMs might generalize to unseen samples and unrelated topics and tasks. Using two large-scale benchmarks, we find that LLMs can indeed achieve distributional alignment and generalize to unseen questions of the same domain. Cross-topic generalization depends on the relationship between topics (e.g., questions about politics are related to trust in institutions). However, aligned LLMs can degrade in surprising ways (e.g., lose their creative ability), suggesting that its generalization properties are inherently unpredictable and unstable.
97. 【2610.31686】From Target Selection to Condition Reuse: Auditing Residual Interventions in Tool-Use Models
链接：https://arxiv.org/abs/2610.31686
作者：Tianda Sun,Dimitar Kazakov
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：language model produce, Activation interventions, language model, model produce, interventions can make
备注： 21 pages, 5 figures. Code: [this https URL](https://github.com/TiandaSun/residual-condition-reuse)
点击查看摘要
Abstract:Activation interventions can make a language model produce a target answer, but can the model use the intended condition in other computations? We study this question in Qwen3.5-27B on tool-use tasks where time or permissions determine eligibility and selection. Across 32 fresh worlds, two case-specific residual-writing variants raise familiar target-selection correctness from 35/128 to 119/128 and from 33/128 to 114/128. Yet these gains disappear when familiar facts and identifiers are recombined within the same selection task, while selection of previously rewarded identifiers increases. The gains persist across output formats but yield little improvement in independent judgments about whether a candidate is eligible or should be selected. Internal edits can nevertheless change how a source fact affects a judgment: in a prespecified secondary comparison, an early-layer source patch changes 50/64 judgments when that source is used, with one adverse change among 64 cases where it is not. This selective effect does not ensure correct complete actions. Together, these results separate target-selection control, condition-sensitive judgments, and complete-action correctness. Evaluating how an edited state is used, rather than only its trained answer, exposes these differences.
98. 【2610.31685】An Agentic Approach with Evidence-Grounded Verification for Multimodal Emotion Reasoning in Conversation
链接：https://arxiv.org/abs/2610.31685
作者：Elyas Rashno,Farhana Zulkernine
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Image and Video Processing (eess.IV)
关键词：reasoning systems perform, LLM-based multimodal emotion, multimodal emotion reasoning, standard benchmarks, computationally expensive
备注： Accepted at the NeurIPS 2026 Workshop on Real-Time Multimodal Conversational AI (ReMuCAI), Paris, France. OpenReview: [this https URL](https://openreview.net/forum?id=NVX6A2xWmG)
点击查看摘要
Abstract:LLM-based multimodal emotion reasoning systems perform well on standard benchmarks, but improving them through instruction tuning can be computationally expensive. Agentic pipelines built from frozen models avoid this cost, but introduce a different challenge: when a prediction is wrong, the system must identify which agent or stage caused the error. We address this problem with an agentic framework for traceable multimodal emotion reasoning and prompt-space adaptation. Modality-specific perception agents analyze visual, acoustic, and lexical inputs and post evidence-cited observations to a shared board. An integration agent combines these observations with retrieved multimodal examples to produce an emotion description, label set, and supporting citations, while an MLLM critic can request one revision before the output is finalized. For incorrect predictions, a separate evidence-grounded verification stage applies deterministic checks to verify that cited evidence and references are valid, and an entailment check to determine whether the final claims are supported by that evidence. Detected failures are then grouped by the responsible component and failure type, converted into targeted prompt patches, and accepted only after validation on a held-out set. This adapts the agent prompts without updating model weights. On the MER2025 dataset, targeted prompt adaptation outperforms the frozen static pipeline on all four MLLMs, ranging from 2B to 38B parameters, and matches or outperforms undifferentiated reflection baselines on each of them: VideoLLaMA3-2B, Phi-3.5-vision-instruct, Qwen2.5-VL-7B-Instruct, and InternVL2.5-38B. It improves F-score by 0.6--2.2 points depending on the backbone, including an increase from 52.3 to 54.5 on Qwen2.5-VL-7B.
99. 【2610.31684】Knowledge Graphs Quality Assessment in the Era of LLMs: A Conceptual Framework
链接：https://arxiv.org/abs/2610.31684
作者：Elwin Huaman
类目：Computation and Language (cs.CL)
关键词：Large Language Models, Knowledge Graphs, Language Models, Large Language, consumed by Large
备注： 8 pages, 1 figure, KGSWC 2026
点击查看摘要
Abstract:Knowledge Graphs (KGs) have been popularized during the last few decades and are increasingly constructed and consumed by Large Language Models (LLMs). Various applications therefore rely on KGs to provide concise, complete, accurate, faithful, fresh, and traceable answers. However, what is the quality of those KGs? In which cases should a KG be used, and can it be trusted to ground an LLM? How might it be evaluated? We reviewed the literature on quality assessment (QA) of data, information, linked data, KGs, and the intersection of KGs and LLMs. We extended the current state-of-the-art frameworks to a catalog of 24 quality dimensions (QDs) and various quality metrics (QMs). Furthermore, we propose a general-purpose, customizable to a domain or task, and practical QA framework for assessing the quality of KGs.
100. 【2610.31683】he Schema Coherence Inventory: Measuring Whether an Assigned Belief Organizes a Language Model's Cognition
链接：https://arxiv.org/abs/2610.31683
作者：Yuqi Wu,Deyang Li,Katharine Hibbard,Ron Oswald,David Sinclair,Adegboyega Sapara,Kalutota Kuruwe Arachchige Sajana Indula Samarasinghe,Abhinav Pillai,Reham Shalaby,Riffat Alam,Xin-Min Li,Yanbo Zhang,Jie Chen
类目：Computation and Language (cs.CL)
关键词：Schema Coherence Inventory, Persona-conditioned language models, Persona-conditioned language, adopted a mood, organizes its behaviour
备注：
点击查看摘要
Abstract:Persona-conditioned language models are used as simulated patients and affective agents, but there is no validated way to ask whether a belief assigned to such a model organizes its behaviour or whether the model has merely adopted a mood. We present the Schema Coherence Inventory (SCI): 96 forced-choice items at eight levels of Beck's cognitive model, each offering six replies keyed to three negative self-schemas and their positive counterparts, scored by length-normalized log-likelihood so that nothing is generated or parsed. Affect alone can move a model onto a default belief, so the discriminant criterion is target specificity: a condition built for one belief must select that belief more often than conditions built for the other beliefs of its pole. Six validation studies over 107 conditions on five backbones (1.7B-14B parameters) support this reading. Nine clinically trained raters recover the keyed belief at 79.5% (chance 16.7%). Belief adapters are target-specific on every backbone (+17.7 points; 30/30 belief cells positive), and a condition's SCI profile identifies its own free generations in 24/30 cases against 5 expected by chance. A 48-item short form correlates r = 0.73 with the other 48 items. Applied to six published patient simulators, none carries its formulation's core belief better than a one-sentence statement of it. The validation route, which separates a construct from the affect that accompanies it and checks model judges against clinicians, offers a template for affective measurement in language models; we outline its extension across task types, raters, sites and languages. We release the items, scoring code and short form.
101. 【2610.31682】Multi modal perceived conversation success prediction for spontaneous autistic and non-autistic dyadic interactions
链接：https://arxiv.org/abs/2610.31682
作者：Thanushi Withanage,Desi Jones,Noah Sasson,Elizabeth Redcay,Carol Espy-Wilson
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：perceived conversation success, Conversation success, social bonds, important for communication, perceived conversation
备注： Submitted to ICASSP 2027
点击查看摘要
Abstract:Conversation success is important for communication, social bonds, and well-being and is often reduced in autistic-neurotypical conversations. Previous studies have predicted perceived conversation success using acoustic and lexical features in pediatric autism-enriched samples, or using nonverbal behavior in non-autistic group interactions. Other work has characterized prosodic, facial, motor, and turn-taking synchrony in autistic interactions, but has primarily targeted diagnostic classification or group differences. The present study instead predicts participant perceived conversation success from complementary articulatory, facial, acoustic-prosodic, and turn-taking measures across three spontaneous dyadic-interaction datasets including autistic and non autistic individuals. By leveraging multimodal features, we demonstrate that conversational success is inherently multidimensional and requires a multi-faceted analytical framework. Combining these complementary modalities offers the potential to improve prediction of perceived conversation success by capturing information unavailable from any single modality.
102. 【2610.31681】Rethinking Structured Generation: Can Graph-Based Reasoning Resolve Ambiguity?
链接：https://arxiv.org/abs/2610.31681
作者：Ratun Rahman,Atit Pokharel
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：typically formulated, deterministic mapping, Structured generation, Structured, single structured output
备注： Accepted as NeurIPS 2026
点击查看摘要
Abstract:Structured generation is typically formulated as a deterministic mapping from input to a single structured output. This assumption is fundamentally misaligned with natural language, which often admits multiple structurally distinct yet semantically valid interpretations. As a result, existing methods rely on single-reference supervision that collapses ambiguity into one prediction, leading to unstable and inconsistent outputs under underspecified inputs. We reformulate structured generation as an \textit{ambiguity-aware inference problem}, where the objective is to reason over a set of plausible structured outputs rather than predict a single solution. We show that standard training inherently suppresses valid alternatives, and instead adopt a multi-valid learning framework that preserves ambiguity during optimization. To operationalize this formulation, we construct a candidate space of structured outputs, represent each candidate as a graph capturing entities and their relationships, and perform selection via graph-based reasoning over semantic alignment and relational consistency. This enables principled comparison across competing interpretations beyond token-level likelihoods. Experiments on structured generation benchmarks demonstrate consistent improvements in accuracy, stability, and robustness under varying levels of ambiguity. These results highlight the importance of modeling ambiguity explicitly and suggest a shift from single-output prediction to set-level reasoning in structured generation.
103. 【2610.31679】MisconceptDialogue: Evaluation Criteria Shape Measured Success in LLM Math Tutoring
链接：https://arxiv.org/abs/2610.31679
作者：Woojin Lee,Yoonkyu Woo,Jinah Kim,Hyeok-Min Gwon,Jin-Xia Huang
类目：Computation and Language (cs.CL)
关键词：Large language models, single LLM detect, Large language, Remediation Success Rate, diagnose the underlying
备注： Accepted to the AACL-IJCNLP 2026 Main Conference. 20 pages, 1 figure, 16 tables
点击查看摘要
Abstract:Large language models are increasingly used as math tutors, raising two questions: can a single LLM detect a student's error, diagnose the underlying misconception, and remediate it through multi-turn dialogue - and can we trust the numbers that report how well it does? We address both with MISCONCEPTDIALOGUE, a fully automated framework that runs the full pipeline on five open-weight LLM tutors (7B-14B) interacting with LLM-simulated students over 5,000+ dialogues - a deliberately simulated protocol (paired conditions, a wrong-diagnosis control unsafe with real learners, scale) whose results do not establish real-student learning. On measurement, our headline finding is uncomfortable for the field: benchmark-style exact-match scoring common in standard math NLP - a lower-bound stress test - reports 42.1% measured Remediation Success Rate on identical dialogues where a human-calibrated LLM-as-judge reports 81.3%, a 39.2 percentage-point spread larger than the combined effects of tutor model, teaching strategy, and supplied diagnostic information. This is not a single-judge artifact: four independent LLM judges and 200 human annotations converge to within a few points (kappa up to 0.91). On capability, the verdict is equally striking: the score barely changes whether we tell the tutor the student's actual misconception or a deliberately swapped one - under the tested diagnosis-presentation format, these tutors show little evidence of reliably conditioning on the diagnostic information they are handed. For LLM tutoring evaluation to mature, multi-criterion scoring with multi-judge convergence and human anchoring should become standard practice - and the measurement question deserves as much scrutiny as the capability question it claims to answer.
104. 【2610.31678】Validating the Comparison, Not Just the Scorer: Why Overall Accuracy Can Mislead in Interactive LLM Evaluation
链接：https://arxiv.org/abs/2610.31678
作者：Ancil Crayton
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)
关键词：LLM studies compare, studies compare, scorer, prompt, LLM studies
备注： 14 pages, 2 figures. Accepted to the Trustworthy AI for Good (AI4GOOD) Workshop at NeurIPS 2026
点击查看摘要
Abstract:Many LLM studies compare how models respond to different follow-up prompts. For example, one prompt may neutrally ask a model to reconsider, while another insists that an invented film really exists. The difference is used to measure the effect of conversational pressure. An automatic scorer then labels whether each response makes an unsupported factual claim. Researchers commonly validate the scorer with one overall accuracy or $F_1$ score. However, high overall performance can hide prompt-specific mistakes: if the scorer makes more errors after one prompt, the measured difference can be too large, too small, or point in the wrong direction. An audit containing mostly difficult responses can also misrepresent performance in the full study. We derive how such errors alter a prompt comparison and examine the problem using six models, 180 invented-entity questions, and six prompt conditions. In a balanced audit of 288 responses, overall $F_1$ was $.916$. Yet, depending on the prompt, the scorer flagged 2.6%-33.3% of responses that the primary LLM rater judged not to contain an unsupported claim; these prompt-specific estimates were uncertain. In a second audit, the scorer and two separate LLM raters evaluated the same 300 model-question cases under each prompt. An apparent 9.3-point increase from asserting certainty rather than neutrally asking the model to reconsider fell to 2.3 points under both raters. The primary-rater interval included zero, so it did not establish an increase. Two other prompt comparisons kept their direction under both raters, while an attempted prompt-specific correction remained too uncertain for a firm conclusion. Researchers should therefore validate the exact difference they plan to report, not just the scorer as a whole: audit both prompts on matching cases and include scorer and rater uncertainty in the final result.
105. 【2610.32726】he Butterfly Defects: Tracing Cooperation in LLM Agent Networks
链接：https://arxiv.org/abs/2610.32726
作者：Maria Sampani,Maria Lymperaiou,Angeliki Dimitriou,Giorgos Filandrianos,Chrysoula Zerva,Giorgos Stamou
类目：Physics and Society (physics.soc-ph); Computation and Language (cs.CL)
关键词：Iterated Prisoner Dilemma, fundamental question emerges, increasingly operate, individual cooperation translate, operate as interconnected
备注：
点击查看摘要
Abstract:As large language models (LLMs) increasingly operate as interconnected agents, a fundamental question emerges: does individual cooperation translate into collective cooperation? We investigate this question through the Iterated Prisoner's Dilemma (IPD), moving from dyadic interactions to homogeneous and heterogeneous networks of open-weight LLMs. Our findings reveal that cooperation is highly sensitive to model composition and seemingly minor linguistic changes. Models that cooperate with identical peers can shift toward defection in mixed populations. A simple uncertainty cue can increase or decrease cooperation, redistribute costs, and affect unexposed agents several hops away. Even reversing action-label order can dramatically alter behavior, with uncertainty framing sometimes amplifying this sensitivity. Together, these findings challenge the notion of cooperation as a stable model-level property, revealing how strategic behavior depends on interaction partners, network positions, and the language used to frame decisions.
106. 【2610.32061】Concentrated Causal Influence, Distributed Diagnostic Information: Cognitive Impairment Decisions in Large Audio-Language Models
链接：https://arxiv.org/abs/2610.32061
作者：Xiutian Zhao,Luqi Sun,Björn Schuller,Berrak Sisman
类目：Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)
关键词：assess cognitive impairment, internal components control, cognitive impairment, Large audio-language models, assess cognitive
备注：
点击查看摘要
Abstract:Large audio-language models (LALMs) can assess cognitive impairment (CI) from speech, yet their answers reveal neither which internal components control the decision nor how much CI information is accessible in their representations. We investigate both questions through CI-contrast neurons (CICNs), selected by class-contrastive activation frequency in decoder MLPs. Across eight open LALMs and two corpora (Pitt and PROCESS-2), we causally test CICNs against size- and layer-matched random masks and activity-matched controls. In three of the five models that meet our eligibility criteria, ablation of small CICN sets causes large, class-directed prediction shifts; speech-identified masks also control transcript-only decisions, and three of four primary Pitt masks retain specificity on PROCESS-2. Position-restricted interventions locate the influence before the final answer position, most strongly after the speech or transcript evidence under letter-labeled options, largely as a decision-direction shift. Beyond causal localization, supervised linear readouts of frozen CICN activations achieve 0.92--0.97 AUC within Pitt, versus 0.67--0.84 for the models' direct answers. Matched random and all-neuron readouts reach comparable performance; top-ranked CICNs show only an exploratory advantage at very small unit budgets. These results distinguish concentrated causal control over output decisions from broadly distributed diagnostic information for CI detection in LALMs.
信息检索
1. 【2610.32980】Separating Thinking from Spelling for Efficient Generative Recommendation
链接：https://arxiv.org/abs/2610.32980
作者：Danil Gusak,Anna Volodkevich,Ivan Oseledets,Evgeny Frolov
类目：Information Retrieval (cs.IR)
关键词：large web platforms, recommenders retrieve items, Generative recommenders retrieve, semantic IDs, web platforms
备注：
点击查看摘要
Abstract:Generative recommenders retrieve items by writing their semantic IDs (SIDs) code by code under trie-constrained beam search, an approach now deployed on large web platforms. Standard autoregressive interfaces pay for the SID length K twice: a history of T items enters the backbone as TK code tokens, and every beam-search step runs through the backbone, so returning B candidates costs O(BK) backbone decode tokens per user. The second cost often dominates, and it grows with the backbone, the SID depth and the candidate budget. We introduce Deco (decoding from concepts), which separates reading the history from writing the identifier. The backbone reads each history item as one fused token and condenses the history once into a compact next-item concept; a light KV-cached decoder conditioned on the concept and the generated prefix runs the entire beam search, while the identifiers, the trie and the autoregressive factorization stay unchanged. The decoder approaches full-backbone accuracy with cross-entropy alone, and distillation improves it further. On seven datasets from e-commerce, movies and music streaming, Deco achieves comparable or better accuracy than both a standard generative recommender and the full-backbone teacher with fused inputs, while delivering 3.2--8.6$\times$ their throughput under a 50 ms p95 latency budget in a production-style serving pipeline. Delegating beam search makes larger candidate pools and models practical: Deco generates 1000 candidates faster than its teacher generates 100, and with a 1.5B-parameter LLM backbone, it matches the 69M-parameter teacher's throughput while achieving higher accuracy.
Subjects:
Information Retrieval (cs.IR)
Cite as:
arXiv:2610.32980 [cs.IR]
(or
arXiv:2610.32980v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2610.32980
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
2. 【2610.32943】Knowledge Distillation across Item and Code Spaces for Parallel Generative Recommendation
链接：https://arxiv.org/abs/2610.32943
作者：Yixuan Xu,Hailin Liu,Linxiang Peng,Can Yang
类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：semantic IDs represents, discrete codes derived, semantic IDs, semantic representation, IDs represents
备注： 12 pages, 2 figures
点击查看摘要
Abstract:Generative recommendation with semantic IDs represents each item as a sequence of discrete codes derived from its semantic representation and predicts these codes to generate recommendations. Existing semantic-ID recommenders are typically trained with hard labels for the observed next item. Although such supervision identifies the target, it provides no explicit distributional information about alternative items conditioned on the same user history. Sequential recommenders can supply this item-level predictive knowledge, but transferring it to semantic-ID generation is challenging because the teacher and student operate in item and code spaces, respectively. We propose two complementary knowledge-distillation objectives for parallel semantic-ID recommenders, which predict all code positions simultaneously without autoregressive prefix conditioning. Item Distribution Matching (IDM) reconstructs a catalogue-level item distribution from the student's parallel code predictions and aligns it with the teacher's item distribution. Code Marginal Matching (CMM) projects the teacher's item probabilities onto each code position using fixed item-to-code assignments, then matches the resulting code marginals to the corresponding student heads. Both objectives transfer the teacher's soft distributional knowledge while preserving the student's parallel prediction structure. Experiments on benchmark datasets show that both methods consistently outperform existing state-of-the-art approaches. On average, IDM improves Recall@10 by 15.39%, while CMM improves NDCG@10 by 8.28%. These results demonstrate that distillation in either reconstructed item space or code-marginal space can substantially strengthen hard-label supervision for parallel generative recommendation.
3. 【2610.32781】Every Edge Needs a Quote: Building a Quote-Grounded Knowledge Graph of Healthcare Software Adoption with Language-Model Agents
链接：https://arxiv.org/abs/2610.32781
作者：Juan Felipe Duran,Arthur Tobler,Martin Vallières
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Hospitals regularly buy, regularly buy software, Hospitals regularly, regularly buy, buy software
备注： 19 pages, 3 figures, 9 tables. Code: [this https URL](https://github.com/MEDomicsLab/healthcare-agentic-kg)
点击查看摘要
Abstract:Hospitals regularly buy software that clinicians and patients depend on. Because these purchases are costly, hard to reverse and can affect patient care, buyers look for evidence of which peer institutions already use a product and which systems it connects to. This evidence is public but scattered across vendor websites, press releases and third-party pages. Language-model agents can now collect it at low cost, but the correctness of the extracted claims is difficult to establish, and a wrongly listed customer can mislead buyers and misrepresent an organisation. We present a pipeline that builds a knowledge graph of customer and integration relations from the open web under one rule: every edge must be supported by a verbatim quote from its source page. Pages come from a deterministic crawl of each vendor's site and a budgeted ReAct agent that searches the rest of the web. A permissive extractor proposes relations with quotes, and a layered grounding stage decides which to keep, using a referent step that reads the whole page when a quote names only one side, deterministic checks, and a panel of five model calls voting on nine criteria. On 61 vendors, the pipeline reaches 0.94 precision and 0.71 recall against a page-level key covering the 6,428 candidate relations proposed by its extractor, whose verdicts were drafted by one model and re-checked with a second. Against the golden reference, the marketplace's own curated list, it scores lower, but 89% of the relations it keeps that the reference lacks are stated on a page. A confidence score built from the panel's votes keeps more correct relations than the fixed rule at the same precision, and reaches 0.90 precision at 0.90 recall. We also discuss how narrow, bounded model calls, string-matched evidence and voting address long-context degradation and run-to-run variance.
4. 【2610.32616】From archive to resource: bringing legacy data back to life at scale with large language models
链接：https://arxiv.org/abs/2610.32616
作者：C. H. Vieira-Vieira,I. Schneider Chernov,A. Serra,M. Correa Marrero,P. L. Bhavani Mohan,G. Duchateau-Nguyen,T. Y. Doktorova,A. Kreuchwig
类目：Information Retrieval (cs.IR)
关键词：Pharmaceutical companies maintain, companies maintain vast, maintain vast archives, Pharmaceutical companies, preclinical study reports
备注：
点击查看摘要
Abstract:Pharmaceutical companies maintain vast archives of legacy preclinical study reports that contain study-context details, such as fasting, anesthesia, and laboratory instrumentation, that are rarely captured in structured data formats, yet they can correlate with clinical pathology parameters values and limit the reuse of historical data. This work demonstrates practical, scalable solutions to recover such descriptors from heterogeneous report texts using large language model (LLM)-based extraction pipelines developed independently by two industry teams. The pipelines identify and normalize metadata fields and return verbatim evidence with page and section reference, hasting human verification and iterative refinement. Evaluation of over 400 documents against expert-curated reference values showed high agreement across a broad set of metadata fields. Performance was strongest for consistently reported items and lower for descriptors subject to linguistic or report structure variability. Extraction time has shrunk from 25 minutes in the manual benchmark to 1.6 minutes. As a concrete biological demonstration, we show that fasting status extracted from report text was associated with species- and analyte-specific shifts in clinical chemistry parameters, illustrating how recovered metadata can improve selection of historical controls. Key strengths of the approach are scalability, traceability, and the ability to recover information missing from current industry standards. Main limitations are dependence on source-report quality and initial expert effort to define and refine schemas. These results establish how LLMs can convert heterogeneous, unstructured legacy reports into evidence-grounded, reusable and structured metadata, leading to better experimental comparability, and thus enabling reliable data pooling or informed virtual control selection.
5. 【2610.32608】UAE GovTrust Scope Filtering Gains and Routing Failures in Bilingual Public Service Retrieval
链接：https://arxiv.org/abs/2610.32608
作者：Aleksandar Mihajlovic
类目：Information Retrieval (cs.IR)
关键词：Public-service queries, mention several locations, controls the requested, Public-service, requested service
备注： 14 pages, 2 figures, 5 tables. Reproducibility materials included as ancillary files
点击查看摘要
Abstract:Public-service queries can mention several locations while only one controls the requested service. We study this distinction in UAE GovTrust, a controlled English-Arabic retrieval diagnostic comprising 22 authored service summaries and 50 scenarios with 110 query variants. Twelve methods separate lexical and dense ranking, rank fusion, scope filtering, a multilingual cross-encoder, and direct service lookup. On 72 matched answerable queries with bilingual evidence, role-filtered reciprocal rank fusion retrieves a relevant first result for 69 queries (95.8%), versus 47 (65.3%) for unfiltered fusion; filtered dense retrieval and direct lookup each achieve 68 (94.4%). With English-only evidence, excluding zero-score lexical candidates raises filtered fusion from 52 to 64 correct first hits. However, the unchanged router selects the correct action and scope for only 2 of 168 post-audit perturbations covering paraphrases, irrelevant facts, negation, and corrections. These perturbations are deliberately authored diagnostics, not held-out evaluation. Fresh-environment execution reproduces all 1,320 original ranking orders and actions. The results show that correct scope metadata can improve ranking while brittle scope inference can remove the evidence needed to answer. The study evaluates retrieval and routing, not generated answers or legal correctness; independent Arabic and domain validation remains necessary.
6. 【2610.32464】Agentic Memory Management Is the Next Frontier of Information Retrieval
链接：https://arxiv.org/abs/2610.32464
作者：Qingyao Ai
类目：Information Retrieval (cs.IR)
关键词：emph, complete their tasks, long been focusing, focusing on connecting, Information
备注：
点击查看摘要
Abstract:Information retrieval has long been focusing on connecting people with information they need to complete their tasks. Recently, the meaning of this has changed dramatically as more and more AI agents now consume, retain, and act on information on a user's behalf. Consequently, information management now also takes place \emph{inside} the agent in the form of memory management. In this perspective paper, we argue that \emph{agentic memory management} (AMM), which studies the structure, analysis, organization, storage, searching, retrieval, and \emph{use} of information in an intelligent agent's memory, is a natural extension of IR research and an area in which the IR community can make distinctive contributions. Specifically, we first present a system-level framework for AMM and introduce a computational taxonomy of memory objects as \emph{constants}, \emph{functions}, and \emph{operators}, each with distinct retrieval semantics. Then, we compare AMM with established IR research and identify their difference and connections. Last but not least, we outline a research agenda covering benchmarks, candidate principles of memory utility, optimization procedures that mix parametric and non-parametric updates, and more. We hope this paper could attract more people, both inside and outside the IR communities, to think more about AMM problems and research from IR perspectives.
7. 【2610.32420】Hierarchical GTV Estimation: Bridging the Gap between Container-Level Ranking and Item-Level Conversion
链接：https://arxiv.org/abs/2610.32420
作者：Zerong Lan,Fan Zhang,Chuang Chen,Tianchun Huang,Teng Zhang,Xingxing Wang
类目：Information Retrieval (cs.IR)
关键词：Emerging e-commerce platforms, Emerging e-commerce, display paradigm, inherently operate, Hierarchical GTV Estimation
备注： 5 pages; published in the 20th ACM Conference on Recommender Systems (RecSys '26)
点击查看摘要
Abstract:Emerging e-commerce platforms, such as live-streaming and Online-to-Offline (O2O) services, inherently operate under a "Container-based" display paradigm. In this setting, a critical granularity mismatch exists: the platform performs ranking and estimation at the container level (e.g., livestream rooms or stores), whereas the actual transactions occur at the item level within these containers. This structural discrepancy complicates Gross Transaction Value (GTV) estimation, introducing unique challenges including high label variance, severe label sparsity, and dynamic item heterogeneity. To address these challenges, we propose a novel framework named Hierarchical GTV Estimation (HGE). HGE employs a Hybrid Set-Aware Encoder (HSAE) to model the dynamic composition of items and feature interactions. To mitigate label variance, we introduce a Proxy-Label Learning (PLL) strategy that decomposes post-click GTV into purchase probability, quantity, and unit price. Furthermore, a Residual Correction and Ensemble Fusion (RCEF) module is designed to handle label sparsity by effectively combining item-level aggregation with container-level inference. Extensive experiments on large-scale industrial datasets demonstrate that HGE significantly outperforms state-of-the-art baselines, achieving a +0.63% lift in XAUC offline and a +1.42% increase in Revenue Per Search (RPS) in online A/B tests. HGE framework has been fully deployed into our main traffic.
8. 【2610.32336】SkillRep: Characterizing and Understanding the Representation Design Space of Agent Skill Retrieval
链接：https://arxiv.org/abs/2610.32336
作者：Tianyi Sun,Pengfei Yao,Yanze Wang,Hongda Chen,Yunyun Han,Jun Sun,Chuanrui Hu,Yafeng Deng
类目：Information Retrieval (cs.IR)
关键词：large library, library is essential, LLM agents, Retrieving, Existing retrievers narrow
备注： 12 pages, 3 figures. Code: [this https URL](https://github.com/EverMind-AI/SkillCorpus/tree/main/skillrep)
点击查看摘要
Abstract:Retrieving the right skill from a large library is essential for LLM agents, yet requests and skills are written for different purposes and in different words. Existing retrievers narrow this request-skill gap with one or two representation choices each, so it is unknown whether their gains hold in combination. No prior work measures the gap itself, so it is also unclear which part of it each choice narrows. We define a representation design space by five choices -- encoder fine-tuning, query-side and document-side expansion, background projection and a lexical channel -- and evaluate them together for the first time, as modules of one retriever, SkillRep. With a 0.6B encoder and LLM expansion, SkillRep improves MRR@10 on SRA-Bench over the strongest same-size retriever by 7.02 points with the official skill pool and 8.79 with UniPool, a 111,247-skill pool we build from public registries, and is best on SkillsBench. The value of each choice depends on the others. Fine-tuning, for instance, reverses the ranking of the four training-free modules and turns them from complementary into overlapping. To understand why, we measure the gap with three quantities: background, the embedding component that does not separate skills; unsaid vocabulary, the gold skill's content a request leaves unsaid; and dilution, the information lost when a skill is encoded into a single vector. They show which part each module narrows and by what mechanism. This reveals that modules narrowing the same part compete for it, while those narrowing different parts complement each other.
9. 【2610.32318】System One models Are Not Better Rerankers
链接：https://arxiv.org/abs/2610.32318
作者：Michael Dinzinger,Kanishka Ghosh Dastidar,Michael Granitzer
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：reranker, generated text, System, decision, decision fine-tuning
备注：
点击查看摘要
Abstract:System One models, or decision models, answer a question about an input with a calibrated probability instead of generated text. Within weeks of the first release, in September 2026, they were used as rerankers. We test whether the decision fine-tuning behind them makes a better reranker than plain reranker fine-tuning of the same model. For six Qwen backbones from 0.6B to 27B parameters and ten TREC DL and BEIR collections, we compare the untuned model, asked zero-shot, with its decision fine-tunes and its reranker fine-tunes, two of which we train ourselves. In our work, we draw the conclusion that decision fine-tuning never makes the better reranker. From 0.6B to 9B, reranker fine-tuning wins on every backbone by 5 to 29 points nDCG@10, also on zero-shot collections, and at 27B the two tie. Up to 9B, decision fine-tuning adds nothing over simply asking the untuned model. Moreover, we find that the calibration advantage of decision models depends on the question. Asked whether a passage answers the query, they are better calibrated than the published reranker fine-tunes from 4B on. Asked a slightly different question from prior work, they lose this advantage. Lastly, calibration does not make up for a worse ranking: up to 9B, a reranker fine-tune keeps the better passages at a fixed threshold. If you need a reranker, fine-tune a reranker.
10. 【2610.32164】PersonalQuery-Benchmark:Evaluating Retrieval Robustness to Personalized User Expression Differences
链接：https://arxiv.org/abs/2610.32164
作者：Wenyu Liang,Hongzhi Yin,Tongtong Wu,Fan Liu,Kexin Dai,Weiqing Wang
类目：Information Retrieval (cs.IR)
关键词：personalized expression differences, Existing real query, expression differences, personalized, expression
备注：
点击查看摘要
Abstract:Existing personalized information retrieval methods mainly model differences in user needs through user preferences and query intent, while paying little attention to the personalized expression differences that arise when different users express the same retrieval need. Existing real query data typically lack stable user identities, long-term expression histories, and intent-matched counterparts, making it difficult to systematically evaluate the impact of personalized expression differences on retrieval outcomes. To this end, we propose PersonalQuery-Benchmark (PQB). PQB models personalized syntactic expression and personalized writing errors from users' historical texts, constructs personalized syntactic expression queries and personalized writing-error queries, and validates benchmark quality through LLM assessment and independent human evaluation. PQB covers three Amazon product domains with 6,516 query instances in total, and is evaluated on five retrieval models representing lexical, learned sparse, dense bi-encoder, late-interaction, and hybrid architectures, together with two LLM-based ranking models. Results show that even when the information need is held fixed, personalized expression differences still induce measurable ranking variation; different retrieval models exhibit clearly different sensitivities to syntactic variation and writing-error variation, while higher overall retrieval effectiveness does not necessarily correspond to stronger robustness against expression variation. PQB provides a new benchmark and evaluation framework for systematically studying personalized expression robustness. The associated code and dataset are available at the following address: this https URL.
11. 【2610.32098】From Item Scores to Semantic Tokens: Test-Time Collaborative Adaptation for Generative Recommendation
链接：https://arxiv.org/abs/2610.32098
作者：Xiongfeng Shan,Xing Tang,Hanchong Chen,Fuyuan Lyu,Lingjie Li,Jingyan Jiang,Duguang Liu,Xiuqiang He
类目：Information Retrieval (cs.IR)
关键词：irreversibly prune promising, successive token decisions, identifiers predict items, prune promising item, textbf
备注：
点击查看摘要
Abstract:Generative recommenders using semantic identifiers predict items through successive token decisions, but beam search may irreversibly prune promising item paths. This limitation is particularly consequential when a few recent interactions signal an emerging interest while earlier behavior favors established preferences. Yet an independently trained discriminative recommender may rank the same items highly from the same interaction history. Such complementary scores are available at test time, offering a way to adapt a frozen generator without retraining either model. The challenge is to use these scores before pruning: combining completed recommendation lists cannot alter earlier beam decisions, while scores over complete items cannot directly inform choices among semantic prefixes shared by multiple items. We propose \textbf{T}est-Time \textbf{C}ollaborative \textbf{B}eam \textbf{S}earch \textbf{A}daptation (\textbf{TCBSA}), a training-free method that incorporates collaborative information into semantic decoding. TCBSA transforms discriminative score margins into potentials over shared semantic edges and uses a confidence gate to regulate their contributions to cumulative path scores before beam selection. We establish a sufficient condition for target prefix survival under global beam competition and bound score perturbations under low discriminative confidence. Full-catalog experiments show consistent improvements over strong baselines across datasets and different generative and discriminative recommenders. Analyses of emerging interests and decoding behavior demonstrate gains in recommendation accuracy and target path survival, while targeted interventions support the contribution of shared prefix corrections. TCBSA also offers a favorable balance between recommendation accuracy and inference latency compared with simply widening the native beam.
12. 【2610.32015】Scaling Graph Query Processing: Focused Exploration on Partitions Using Load Balancing
链接：https://arxiv.org/abs/2610.32015
作者：Harshit Modi,Abhishek Santra,Sharma Chakravarthy
类目：Databases (cs.DB); Distributed, Parallel, and Cluster Computing (cs.DC); Information Retrieval (cs.IR)
关键词：approximate or exact, query processing, query, processing, SQL query processing
备注：
点击查看摘要
Abstract:The focus of this paper is on query processing and not search (approximate or exact). The goal is to find all or k answers and the expressiveness of a query (as opposed to a search expression which is typically simpler) is considered important. Although SQL query processing has matured over the last several decades, query processing over graph data has not received the same attention. Only recently, systems, such as Neo4J, and others have started using graphs for data representation on a large scale. Their approaches and algorithms remain proprietary. In this paper, we address the problem of answering graph queries and their efficient processing on arbitrary-sized graphs. We propose the partitioning of graphs and the use of the distributed paradigm to achieve efficiency and scalability. Our approach takes a subgraph as query input including wild cards and comparison operations. Our partitioned approach leverages focused exploration and distributed processing to achieve the desired parallelism and improve the response time. We also present heuristics to reduce the number of partitions loaded for query processing. We present our partitioning algorithm, distributed processing architecture used, and load balancing for computing query answers. We establish the correctness of the approach in the presence of partitions, compare heuristics for load balancing, and extensive experimental results over large synthetic and real-world graph data sets.
Subjects:
Databases (cs.DB); Distributed, Parallel, and Cluster Computing (cs.DC); Information Retrieval (cs.IR)
Cite as:
arXiv:2610.32015 [cs.DB]
(or
arXiv:2610.32015v1 [cs.DB] for this version)
https://doi.org/10.48550/arXiv.2610.32015
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
13. 【2610.31959】A Model-Agnostic Correction Framework for Short-Term Building Load Forecasting
链接：https://arxiv.org/abs/2610.31959
作者：Shiqiao Zhou,Huanbo Lyu,Holger Schöner,Zipeng Wu,Jessica Deuschel,Freya Wentzel,IAG Wilson,Shuo Wang
类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：forecasting remains challenging, Short-term building load, Short-term building, remains challenging, patterns can change
备注： Work in progress
点击查看摘要
Abstract:Short-term building load forecasting remains challenging because load patterns can change rapidly with weather and operating conditions. Data-driven forecasting models may become less reliable when the current operating regime is rare or poorly represented during training, even when similar situations exist elsewhere in the historical record. Recent advances in retrieval-augmented time series forecasting offer a promising way to adapt predictions to changing conditions by directly reusing relevant historical cases at inference time. Motivated by this idea, we propose WeL-RAC, a model-agnostic Weather-Load Retrieval-Augmented Correction framework that explicitly retrieves such evidence at prediction time. WeL-RAC retrieves historical cases that are similar to the current condition based on both recent load states and horizon-aligned weather forecasts. Their observed future load trajectories are then aggregated and used to correct the initial prediction, without retraining or modifying the base forecaster. We evaluate WeL-RAC on 31 building cases across three datasets, eight forecasting backbones, and four horizons from 1 to 18 hours. The framework improves the corresponding base forecasters in 90 of 96 dataset-level comparisons. Beyond accuracy, success and failure case studies further illustrate the framework's interpretability by tracing how retrieved historical evidence improves or degrades forecasts. These findings support explicit historical retrieval as an effective and interpretable complement to the building load forecasting.
14. 【2610.31932】MICE to Meet You: From Re-ranking Only to End-to-End Retrieval
链接：https://arxiv.org/abs/2610.31932
作者：Victor Morand,Yuxuan Zong,Mathias Vast,Josiane Mothe,Benjamin Piwowarski
类目：Information Retrieval (cs.IR)
关键词：efficiently indexed, pre-computed and efficiently, Late-interaction models offer, MICE, enabling document representations
备注： code: [this https URL](https://github.com/xpmir/mice)
点击查看摘要
Abstract:Late-interaction models offer state-of-the-art efficiency-effectiveness trade-offs for neural retrieval by enabling document representations to be pre-computed and efficiently indexed. Yet, their relatively simple interaction mechanisms, typically MaxSim, can limit their effectiveness compared to cross-encoders. MICE, a recently introduced re-ranking architecture, aims to combine cross-encoder-like effectiveness through expressive transformer-based scoring with reduced inference-time computation through document-side pre-computation. However, no practical way to store these document representations was explored. We address this limitation here and introduce MICE-P, the first end-to-end retrieval pipeline with MICE, based on PLAID to index the contextualized document token representations. We conduct a controlled comparison of MICE, ColBERT and cross-encoders by training comparable models using the Ettin Family under matched experimental conditions. Our results show that MICE-P defines a new class of retrieval architecture with an efficiency-effectiveness trade-off of its own: it matches late-interaction retrieval throughput while retaining the effectiveness of cross-encoders.
15. 【2610.31874】Mining Frames: Association Rule Mining as an Unsupervised Framework for News Framing Detection
链接：https://arxiv.org/abs/2610.31874
作者：Hager Hesham Mustafa(Anmat Computational Analysis Lab)
类目：Computation and Language (cs.CL); Computers and Society (cs.CY); Information Retrieval (cs.IR)
关键词：require large annotated, large annotated corpora, Association Rule Mining, Computational framing analysis, Computational framing
备注： 35 pages, 5 figures, 4 tables. Working paper. Dataset: [this https URL](https://www.kaggle.com/datasets/anmatproject/framings-gaza-arm-dataset)
点击查看摘要
Abstract:Computational framing analysis is dominated by supervised classifiers that require large annotated corpora and predefined frame taxonomies, limiting their use for non-English languages, novel events, and low-resource settings. This paper presents Association Rule Mining (ARM) as an unsupervised, annotation-free framework for news framing detection. Each document or sentence is treated as a transaction of lexical items, and high-lift co-occurrence rules are read as candidate framing signals (Gamson and Modigliani's condensing symbols), confirmed in context by journalist-researchers. The primary validation is Framing Gaza: 25,512 English-language articles from 16 US, UK, French, and German outlets covering the first year of the Gaza war (October 2023 to October 2024), analyzed with Apriori (mlxtend), platform-weighted support, POS-filtered n-grams, and lift-based scoring. ARM inductively surfaces interpretable patterns without predefined categories: a cross-platform military frame, {israeli, strike} to {kill}, appears as a closed rule in 14 of 16 outlets, and a month-by-month analysis recovers event-driven framing pivots (e.g., the April 2024 World Central Kitchen strike) with no prior event labeling. A systematic headline-body divergence is identified, with headlines carrying concentrated, high-lift editorial framing and body text reproducing institutional, procedural language. A methodological validation on the Seven Days project (1,575 Arabic articles on the 2026 Iran war) shows that FP-Growth enables sentence-level analysis with far lower memory overhead. Findings were validated through editorial uptake: two published investigative stories (Daraj Media; Saheeh Masr). Preprocessing code is released openly; the full pipeline is documented but withheld to preserve operational deployability.
16. 【2610.31863】Machine-Readable Operator Manuals over the ISO 11783 Network for Offline, Multilingual LLM Assistance
链接：https://arxiv.org/abs/2610.31863
作者：Timo Oksanen,Julius Gun
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：technical documentation dynamically, access technical documentation, offline assistance, support intelligent, documentation dynamically
备注：
点击查看摘要
Abstract:If agricultural machinery is to support intelligent, offline assistance, then the system must access technical documentation dynamically. In this paper, the Semantic Synchronization of operator manuals over ISO 11783-based CAN buses is analyzed, defined as the process that brings the local knowledge base of a tractor-side assistant into agreement with the operator manual of the connected implement. Data transfer performance was benchmarked using Markdown, JSON, and XML; various open-weight Large Language Models (LLMs) were also evaluated in cross-lingual query tasks. The automatic evaluation of the answers was validated against four human raters. A complete manual was transferred over a physical ISO 11783 network in 31 to 89 s, depending on format and transport settings, which is comparable to the object pool upload that operators already wait for at the first coupling of an implement. Markdown produced the smallest files, while the question-answering performance was comparable across the three formats for most models. With retrieval-augmented generation, locally run models answered most questions on the English manual correctly, with no advantage of the largest model over 7B and 8B models, but performed worse on the five other language editions. Keyword retrieval failed across languages, whereas semantic retrieval provided the cross-lingual capability. The exchange requires only a new parameter group that uses the existing request and transport mechanisms of ISO 11783, which makes it a candidate for standardization. The study is a proof of concept with inference on PC-grade hardware; deployment on embedded agricultural hardware remains future work.
17. 【2610.31821】What the Query Remembers: Query Abstraction Governs Lexical and Dense Retrieval of Classical Arabic Poetry
链接：https://arxiv.org/abs/2610.31821
作者：Omar Farouk Zouak,Selma Mani,Larbi Said Chikh,Raid Abderrezak Ouahioune
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Classical Arabic poetry, user still remembers, searched depends, Classical Arabic, poetry archive
备注：
点击查看摘要
Abstract:How well a poetry archive can be searched depends on what the user still remembers, not only on what the model understands. We show this for Classical Arabic poetry, benchmarking nine dense encoders and BM25 over two corpora, three indexing modes and two evaluation protocols. Which retriever wins is governed by how much of a poem's wording the query still carries. On tip-of-the-tongue queries BM25 leads every dense encoder, including an 8B state-of-the-art model (0.746 vs. 0.717 Recall@5); on abstract queries it falls to eighth out of ten (0.392 vs. 0.748). Editing the wording of the same queries shows that this ranking largely reflects query composition: adding one remembered half-verse raises BM25 by 38 points, rewriting the quoted words by hand leaves BM25 level with the 8B encoder, and BM25's sensitivity to remembered wording is significantly steeper than that of the strongest dense encoder. The same axis controls explanation augmentation, whose effect swings from +37 to -39 points. The mechanism splits by system type: lexical containment predicts BM25's behaviour, while embedding proximity predicts dense encoders. Finally, the field's two standard protocols, known-item retrieval and thematic relevance, dissociate on the same systems, a result reproduced by two blind human annotators and by two open-weights judges, one of them under a rubric with no literal-match criterion. A benchmark that reports one protocol, or one query register, can give a materially wrong picture. Code and data are available at this https URL.
计算机视觉
1. 【2610.32978】SceneBloom: Agentic Indoor Environment Generation with Realistic and Diverse Layouts for Embodied Learning
链接：https://arxiv.org/abs/2610.32978
作者：Yuhan Liu,Lianhui Qin,Shenji Wan
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Robotics (cs.RO)
关键词：simulation-ready indoor environments, generalizable embodied agents, embodied agents requires, Training generalizable embodied, indoor environments
备注：
点击查看摘要
Abstract:Training generalizable embodied agents requires realistic, varied, and simulation-ready indoor environments. Language-guided methods support semantic planning and object-level reasoning, but precise spatial grounding remains difficult. Visual generative models offer rich priors over plausible arrangements, yet their outputs require geometric reasoning to become physically valid 3D scenes. We introduce SceneBloom, an agentic framework that combines visual layout sampling with contract-guided 3D compilation. A hierarchical sampler uses diffusion priors to generate furniture arrangements within functional zones. A compiler then uses relations extracted from each proposal to guide geometric fitting and local pose correction. Across five room types, SceneBloom attains the highest visual quality and physical stability among the compared methods and is the only method with no detected mesh collisions and out-of-bounds objects. Its layouts are also closer to the distribution of real rooms than those of all compared baselines. Object navigation policies trained in these realistic scenes achieve a higher success rate in held-out real scans than those trained on an equal number of real training scans. Code is available at this https URL.
2. 【2610.32977】UniAction: Unified Action Conditioning for World Models
链接：https://arxiv.org/abs/2610.32977
作者：Bowen Xue,Zizhang Li,Hong-Xing Yu,Jiajun Wu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：existing action-conditioned world, individual action types, limited action-annotated data, action-conditioned world models, fragmenting already limited
备注： Project page: [this https URL](https://uniaction.github.io/)
点击查看摘要
Abstract:Actions that condition world models are highly heterogeneous, and thus existing action-conditioned world models are typically built for individual action types, fragmenting already limited action-annotated data across separate models. We introduce UniAction, a unified action-conditioning framework that represents any action as a sparse set of action elements, each with a discrete semantic identity and a continuous spatiotemporal grounding coordinate. By mapping these coordinates directly into the pretrained video model's native positional space, UniAction allows heterogeneous actions to condition a shared world model within the same spatiotemporal structure. We further introduce cardinality-calibrated attention to address the bias from differing action representation granularities. We evaluate UniAction on four representative action forms: force, camera control, hand pose, and robot pose. UniAction outperforms conditioning alternatives in action following, and a single jointly trained model surpasses the action-specific experts, showing that heterogeneous action data benefit from unified model and joint training.
3. 【2610.32976】FlexGlue: Sparse-to-Dense Feature Matching and Visual Disambiguation
链接：https://arxiv.org/abs/2610.32976
作者：Philipp Lindenberger,Paul-Edouard Sarlin,Ondrej Miksik,Marc Pollefeys
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：robust but expensive, existing approaches match, highly efficient, dense pixel grids, sparse interest points
备注：
点击查看摘要
Abstract:To estimate correspondences across images, existing approaches match either sparse interest points, which is highly efficient but limited by repeatability, or dense pixel grids, which is robust but expensive. Furthermore, these approaches are trained with only matching pairs and thus often fail to reject unrelated pairs that exhibit visual symmetries, which is equally important in applications like Structure-from-Motion (SfM). We bridge these gaps by introducing FlexGlue, a neural network for asymmetric sparse-to-dense matching and disambiguation. Given two images and coordinates of points in the first image, FlexGlue estimates the coordinates of the corresponding points in the second image while simultaneously rejecting the pair if non-matching. By searching for a limited set of correspondences among dense pixels, our approach is both fast and effective at both matching and disambiguation: it combines the sub-pixel accuracy of dense matching with the speed of sparse matching, while rejecting incorrect pairs with high precision. Experiments on multiple datasets show that FlexGlue pushes the Pareto frontier in relative pose estimation and significantly outperforms existing approaches for SfM and visual localization. FlexGlue is publicly available at this https URL .
4. 【2610.32967】MiD-VLM: Detecting and Grounding Global Semantic Misinformation in Image-Caption Pairs
链接：https://arxiv.org/abs/2610.32967
作者：Tarunya Prasad,Bharatesh Chakravarthi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：distorts its narrative, misinformation can arise, Semantic misinformation, semantic inconsistencies, Semantic
备注：
点击查看摘要
Abstract:Semantic misinformation can arise when an authentic image is paired with a caption that changes or distorts its narrative. Because the image itself may contain no visible signs of manipulation, methods designed to detect pixel-level artifacts can miss these misleading image-caption pairs. We study this problem using DGM4+, a dataset designed to evaluate the detection of global scene and semantic inconsistencies. We propose a multimodal model that combines image-text representations from SigLIP with visual scene features from DINOv2 through a projection MLP, and adapts Qwen2-VL-7B using LoRA. The model jointly predicts whether an image-caption pair is authentic, identifies the manipulation type, and grounds the misleading caption tokens. On the DGM4+ validation split, the model achieves an F1 score of $0.9679$ for binary authenticity classification. These results suggest that parameter-efficient adaptation of vision-language models is promising for detecting semantic inconsistencies, while also motivating further work on precise token-level grounding.
5. 【2610.32966】ViT-H: Generative Video-To-Humanoid Control with Motion Tracking Feedback
链接：https://arxiv.org/abs/2610.32966
作者：Zimo He,Tianyi Bian,Zizhong Yang,Hongjie Li,Nan Jiang,Jieming Cui,Baoxiong Jia,Yizhou Wang,Siyuan Huang,Yixin Zhu
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：diverse whole-body behaviors, acquire diverse whole-body, Learning humanoid control, whole-body behaviors, Learning humanoid
备注： The first four authors contributed equally. Project website: [this https URL](https://awfuact.github.io/vit-h/)
点击查看摘要
Abstract:Learning humanoid control from monocular human videos offers a scalable way to acquire diverse whole-body behaviors. Yet, existing reconstruction-retargeting-tracking pipelines are limited in system-level scalability by separately optimized intermediate stages and cannot directly optimize reference motion executability using downstream tracking feedback. We present ViT-H, a video-to-humanoid control framework following a generation-and-tracking paradigm. ViT-H directly generates humanoid reference motions from videos with a diffusion model, bypassing human motion reconstruction and retargeting, and uses motion-tracking outcomes to post-train the generator with direct preference optimization. We further introduce an autoregressive variant that enables real-time humanoid video teleoperation with sub-400 ms latency. Extensive experiments on the Unitree G1 demonstrate that ViT-H outperforms state-of-the-art reconstruction-retargeting-tracking pipelines in both motion quality and executability. We further show that ViT-H scales favorably with model size and with both pre-training and post-training data scale, while motion-tracking feedback consistently improves executability across different motion trackers.
6. 【2610.32964】Flownomaly: Single-Step Conditional-Mean Recovery for Few-Shot Anomaly Detection
链接：https://arxiv.org/abs/2610.32964
作者：Bernardo Perrone Ribeiro,Erkut Akdag,Egor Bondarev
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Few-shot industrial anomaly, Few-shot industrial, detection requires modeling, requires modeling category-specific, modeling category-specific normality
备注： Accepted to WACV 2027
点击查看摘要
Abstract:Few-shot industrial anomaly detection requires modeling category-specific normality from only a handful of defect-free images. Common approaches tie inference to stored exemplars, impose rigid linear structure, or risk reproducing anomalous content. Flownomaly instead casts the problem as normal-counterpart recovery in frozen DINOv2 feature space. Given normal supports, a velocity field is learned through conditional flow matching over frozen patch tokens to transport Gaussian noise toward normal features. Along straight paths, a single recovery step using one evaluation of the optimal field yields the posterior mean of the clean normal token without trajectory integration. The operating time governs how strongly recovery modifies a query token. With no anomalous validation samples available for tuning, a normal-only Jacobian gain-to-noise criterion selects this time from the supports alone. Squared residuals between query tokens and their recovered counterparts yield anomaly signals for both dense localization and image-level detection. Across 1-, 2-, and 4-shot benchmarks on MVTec-AD and VisA, together with sample-shot evaluations on Real-IAD, Flownomaly achieves state-of-the-art performance against recent category-specific methods. In the 1-shot setting, image- and pixel-level AUROC reach 97.8% and 98.0% on MVTec-AD and 95.3% and 98.7% on VisA, with a 2.1-point image-level AUROC improvement over the strongest baseline on VisA. Code is available at this https URL.
7. 【2610.32948】Beyond Discrete Tokens: Preserving Numerical Continuity in Medical Vision-Language Models
链接：https://arxiv.org/abs/2610.32948
作者：Dianye Huang,Jiamei Guo,Yue Zhou,Mingde Li,Yi Xiong,Wei Wang,Nassir Navab,Zhongliang Jiang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：unified vision-language model, discrete token-based numerical, vision-language model, addresses the mismatch, targets and discrete
备注：
点击查看摘要
Abstract:Objective: To develop a unified vision-language model for prompt-conditioned quantitative ultrasound measurement that addresses the mismatch between continuous measurement targets and discrete token-based numerical prediction. Methods: This article presents HAD-VLM, a hybrid autoregressive-diffusion framework that combines autoregressive text generation with continuous measurement prediction within a shared backbone. Visual prompt tuning adapts the vision encoder to ultrasound images. A diffusion process predicts a five-component representation comprising caliper endpoint coordinates and measurement length. A post-processing strategy combining the proposed coordinate-length consistency mechanism with ensemble prediction is introduced to refine measurement estimates. We evaluate four echocardiographic measurement tasks on EchoNet-LVH, with additional assessments of medical question answering and X-ray vertebral measurement. Results: HAD-VLM achieves mean absolute errors of 1.36, 2.77, 3.05, and 1.16 mm for IVSd, LVIDd, LVIDs, and LVPWd, respectively, reducing errors by 21.4-37.6\% relative to the Vicuna-based autoregressive baseline. It also outperforms fine-tuned Qwen3-VL and direct MLP regression across all four tasks. Medical question answering performance is preserved on the evaluated dataset. For X-ray vertebral measurement, HAD-VLM reduces mean absolute error from 11.4 to 6.7 pixels. Conclusion: Integrating autoregressive language generation with diffusion-based continuous prediction improves quantitative medical image measurement while retaining prompt-conditioned task flexibility. Significance: HAD-VLM provides a unified approach to combining language interaction with anatomically grounded numerical prediction for quantitative medical image analysis.
8. 【2610.32932】STROKE: Simple Sparse Structural Occlusions for Black-Box Adversarial Attacks
链接：https://arxiv.org/abs/2610.32932
作者：Ankit Gupta,Akshat Pandya,Paul Lin,Christoph Adami,Emily Dolson
类目：Computer Vision and Pattern Recognition (cs.CV); Cryptography and Security (cs.CR); Human-Computer Interaction (cs.HC)
关键词：query-efficient score-based black-box, oriented rectangular occlusions, simple oriented rectangular, query-efficient score-based, oriented rectangular
备注： 13 pages, 4 figures, 4 tables, and 16 pages of Supplementary Information with 3 figures and 5 tables
点击查看摘要
Abstract:We introduce STROKE, a query-efficient score-based black-box adversarial attack that constructs perturbations from simple oriented rectangular occlusions. STROKE optimizes these perturbations through a lightweight greedy add-and-refine procedure. Across diverse image classifiers, STROKE achieves high attack success with low query counts at nominal 1--2\% area settings, showing favorable performance relative to existing patch-based attacks in several configurations. Matched comparisons further demonstrate substantial reductions in wall-clock attack time, while ablation studies examine the key design choices and effectiveness across structural primitives. These findings suggest that simple structural occlusions offer an effective and computationally efficient search space for black-box adversarial attacks.
9. 【2610.32894】LoCA: Enabling Multi-Modality in Geospatial Location Encoders
链接：https://arxiv.org/abs/2610.32894
作者：Panagiotis Koromilas,Eleanna Vali,Diogenis Antonopoulos,Eleni Saka,Dimitris Christofis,Nikolaos Ioannis Bountos,Konstantin Klemmer,Ioannis Papoutsis,Yannis Panagakis,Mihalis A. Nicolaou
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Earth Observation imagery, paired Earth Observation, Earth Observation, Observation imagery, paired Earth
备注：
点击查看摘要
Abstract:Location encoders map geographic coordinates to high-dimensional descriptors through contrastive alignment with paired Earth Observation imagery. We prove that this construction is structurally limited: any Lipschitz location encoder produces an output of intrinsic dimension at most 2, regardless of architecture or bandwidth, which forces the contrastive loss to strictly exceed its asymptotic optimum. Empirically, joint training also collapses the encoder's embedding covariance to low rank. Although dimension-limited, current location encoders sidestep this spectral collapse by training against a frozen image encoder, which we reinterpret as a covariance regularizer that supplies a high-rank target for the location encoder to fold onto. However, extending this approach to multimodal inputs is challenging, as location encoders should simultaneously map a single location to multiple, potentially incompatible, descriptors. We identify two requirements a regularizer must satisfy for location encoding in multimodal regimes: co-alignment across modalities, since adapters alone cannot align independently pretrained encoders; and high effective rank, since the location encoder inherits its target's spectrum. We propose LoCA (Location Contrastive Alignment), a two-stage pipeline that satisfies both. Stage 1 jointly trains Sentinel-1 and Sentinel-2 encoders with contrastive learning, producing a co-aligned, high-rank multimodal target. Stage 2 freezes the image encoders and trains a location and a tabular metadata encoder as projection adapters with multi-view contrastive learning. Against five state-of-the-art encoders on 17 tasks ranging from land cover and wildfire forecasting to geophysical, socio-economic, biodiversity and climate applications, LoCA achieves the most task wins, is the only model to outperform every other on a majority of tasks, and wins 68.8% of all per-task comparisons.
10. 【2610.32890】Closing the Modality Gap via Simplex-Constrained Representations
链接：https://arxiv.org/abs/2610.32890
作者：Shubham Gupta,Siva Reddy,Perouz Taslakian,Valentina Zantedeschi,Cem Subakan
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：CLAP successfully learn, learn shared representations, successfully learn shared, CLIP and CLAP, embeddings typically exhibit
备注：
点击查看摘要
Abstract:While multimodal contrastive models like CLIP and CLAP successfully learn shared representations, their embeddings typically exhibit a persistent \emph{modality gap}. We propose addressing this separation through a purely geometric approach: changing the embedding domain from the unit sphere, $S^{d-1}$, to the probability simplex, $\Delta^{d-1}$. Although both manifolds share the same intrinsic dimension, the simplex acts as a structural prior; its nonnegative, unit-mass constraints serve as a cross-modal calibration that forces both modalities to ground themselves in the same coordinate system. By attaching lightweight softmax adapters and using Total Variation similarity, we reduce the centroid $\ell_2$ gap by 97--99\% across five multimodal retrieval benchmarks. This confirms that simplicial geometry induces genuine semantic alignment, matching or exceeding the retrieval performance of standard unconstrained models.
11. 【2610.32884】VTRL-Med: Progressive Visual Refinement with Topology-Guided Regularization for Medical Image Clustering
链接：https://arxiv.org/abs/2610.32884
作者：Guangyu Meng,Pengfei Gu,Peixian Liang,John P. Lalor,Erin Wolf Chambers,Danny Z. Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Deep clustering offers, analyzing large unlabeled, capture object boundaries, encode topological patterns, explicitly encode topological
备注：
点击查看摘要
Abstract:Deep clustering offers a promising approach for analyzing large unlabeled medical image datasets, yet prevailing methods still face two limitations: they may neglect class-agnostic structural priors that capture object boundaries and regions, and they do not explicitly encode topological patterns (e.g., connectivity and holes). These sources of information play distinct and complementary roles: visual-structural features provide the primary discriminative representation for clustering, while topological features provide additional global geometric cues for residual visual ambiguities. We introduce VTRL-Med, a progressive visual-structural learning framework with topology-guided regularization for medical image clustering. VTRL-Med first adapts the Segment Anything Model (SAM) to extract image features that retain structural cues inherited from mask-supervised pretraining. It then generates reliable pseudo-labels through a two-step filtering process that combines prototype-based selection with k-nearest neighbor consistency validation. Finally, it progressively refines the visual branch while an auxiliary topology branch, constructed from persistent homology (PH) descriptors, provides additional geometric regularization during training. Across 13 medical image benchmarks, VTRL-Med achieves state-of-the-art clustering performance, improving average accuracy by 4.48% over existing methods. On three representative datasets, topology-guided regularization further improves accuracy by 1.3--4.3% over visual refinement alone.
12. 【2610.32880】Multimodal Generative AI Assists Comprehensive Echocardiographic Interpretation
链接：https://arxiv.org/abs/2610.32880
作者：Yi Qin,Marawan Elbatel,Shanshan Song,Taoran Huang,Jiarong Guo,Ningshu Li,Lehan Wang,Chenxu Zhao,Jiexin He,Machteld J. Boonstra,Stephan van der Zwaard,Marielle C. van de Veerdonk,Pere Lopez-Gutierrez,Lydia Dux-Santoy,Andrea Guala,Enrique Almar-Munoz,Sebastian Johannes Reinstadler,Radek Debiec,Yi-Hang Zhu,Huiyu Zhou,Adrian P Cheong,Yike Guo,Agnes Mayr,Karim Lekadir,Yong Jiang,Nilesh J. Samani,Dacheng Tao,Folkert W. Asselbergs,Hongwen Fei,Alex PW Lee,Xiaomeng Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：experienced interpreters, global utility, utility is constrained, critical shortage, shortage of experienced
备注：
点击查看摘要
Abstract:Echocardiography is the cornerstone of cardiovascular diagnostics, yet its global utility is constrained by a critical shortage of experienced interpreters. Current artificial intelligence (AI) solutions remain limited, typically operating as opaque "black boxes" or focusing on narrow tasks that fail to capture the holistic, guideline-driven reasoning of a clinician. Here we introduce EchoChat, a generative multimodal vision-language model that performs comprehensive echocardiographic analysis to support clinician interpretation. By emulating the cognitive workflow of a cardiologist, EchoChat integrates vast medical knowledge with a chain-of-thought reasoning mechanism to explicitly ground its conclusions in visual evidence. Trained on echocardiography-instruction pairs from 46,358 examinations, our model establishes a new state-of-the-art across diverse cohorts from six international medical centers. It supports the broadest diagnostic scope of 33 cardiac conditions and findings, including 15 newly added conditions for which it achieves an average F1 of 73.7% across available external evaluations. It surpasses existing best-performing foundation models in cardiac condition recognition (improving average recall by 13.54% on shared tasks) and quantification (average R2 score increase of 0.275 on shared tasks). Furthermore, in a source-blinded echocardiographer reader study, echocardiography reports co-generated with EchoChat were rated higher in diagnostic accuracy and completeness by two senior echocardiographers, and improved diagnostic performance from 72.78% to 82.75% in terms of F1 score over routine-reader only reports. These results demonstrate that integrating clinical reasoning into multimodal AI can democratize specialist expertise and transform the standard of cardiovascular care.
13. 【2610.32848】OpenStripe supports open-set identification and spatial stripe profiling in wild Amur tigers
链接：https://arxiv.org/abs/2610.32848
作者：Yichun Peng,Yansong Li,Jin Hou,Qi Song,Xi Guo,Ning Zhang,Degang Wei,Huang Yang,Yu Guan,Jianping Ge,Lei Bao,Tianming Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：complicate image comparison, Non-invasive camera-trap monitoring, backgrounds complicate image, endangered wildlife requires, wildlife requires open-set
备注： 14 pages, 4 figures. Code and nonspatial data: [this https URL](https://github.com/Yichun-Peng/OpenStripe)
点击查看摘要
Abstract:Non-invasive camera-trap monitoring of endangered wildlife requires open-set individual identification---grouping field images into identities without predefined classes or a known population size---yet pose deformation and cluttered backgrounds complicate image comparison. Here, we present OpenStripe, a multi-agent framework that reconstructs canonical two-dimensional (2D) tiger torso patterns and encodes four interpretable local stripe structures: breakpoints, bifurcations, irregular structures, and round structures. We evaluated OpenStripe on 100 camera-trap records from 28 wild Amur tigers (Panthera tigris altaica), representing nearly one-third of the documented population in the Northeast China Tiger and Leopard National Park. Combining all four complementary structures enabled automatic identity grouping with 0.90 matched accuracy and a 0.85 adjusted Rand index (ARI), outperforming 49 baseline configurations under the same backend (up to 0.43 accuracy and 0.14 ARI). In addition, results from OpenStripe indicate that stripe similarity in Amur tigers declines with geographic distance and suggest that traits such as fractal dimension and inter-stripe spacing are associated with geographic proximity. OpenStripe thus provides an interpretable representation that connects automated individual grouping with spatial phenotypic profiling in wild populations.
14. 【2610.32835】SPOOK: Sparse Pixel Optimization for Off-Manifold Knowledge in Vision Encoders
链接：https://arxiv.org/abs/2610.32835
作者：Ankit Gupta,Akshat Pandya,Christoph Adami,Emily Dolson
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
关键词：natural-image manifold, relationship between embedding, embedding similarity, similarity and human-visible, Modern vision encoders
备注： 12 pages, 3 figures, 3 tables, and 14 pages of Supplementary Material with 8 figures
点击查看摘要
Abstract:Modern vision encoders are widely used as semantic representations, but the relationship between embedding similarity and human-visible semantics can become unclear far from the natural-image manifold. We probe this regime in a black-box setting by applying sparse pixel edits to blank canvases with a simple pixel-level hill-climbing procedure. Across ImageNet and Flickr30k, we evaluate whether these edited blank canvases can retrieve chosen targets in multimodal contrastive encoders and self-supervised visual encoders. On OpenCLIP, inputs optimized toward class prompts achieve strong top-1 and top-5 targeted retrieval performance; on DINOv3, inputs optimized toward class prototypes achieve high target alignment and near-top prototype ranks. These results show that sparse edits on otherwise blank, visually non-semantic inputs can enter target semantic basins in both language-aligned and self-supervised visual representation spaces. Our findings identify a shared off-manifold failure mode of modern vision encoders and suggest sparse blank-canvas optimization as a simple probe of representation geometry.
15. 【2610.32816】Sounding Surgical Instrument Localisation through Audio-Visual Correspondence
链接：https://arxiv.org/abs/2610.32816
作者：Dominic Behling,Jonas Hein,Matthias Seibold
类目：ound (cs.SD); Computer Vision and Pattern Recognition (cs.CV)
关键词：Surgical scene understanding, Surgical, operating room, surgical activity, scene understanding
备注：
点击查看摘要
Abstract:Surgical scene understanding is a prerequisite for context-aware and intelligent systems in the operating room. Current methods rely mostly on visual data, while acoustic sensing has shown potential to provide complementary information on surgical activity. First approaches for the localisation of surgical activity relied on microphone arrays and acoustic beamforming. This work investigates whether the active instrument can be localized from a single microphone and a camera by learning the correspondence between the appearance and the sound of surgical instruments, without annotating its position. We adapt weakly supervised audio-visual localisation, which learns from the co-occurrence of image and sound, to the surgical setting. We record simulated surgical actions, sawing, drilling, and chiseling, and train the model on these recordings without any spatial annotation to produce a heatmap over the sounding tool. We extend the training objective by two terms: a silence term, which suppresses the output for silence and background noise, and a composite term, which trains the model to select the sounding one of two visible instruments. The model localizes the active instrument on an independent corpus recorded with a different camera and microphone, in which instrument positions were obtained by optical tracking. It separates tool activity from silence and background noise and can attribute sound correctly when two tools are present. Audio-visual correspondence learned from in-domain recordings connects the sound of a surgical action to the instrument that produces it, using a single microphone and a camera. This proof of concept introduces a novel paradigm that enables the detection and localisation of surgical activity without manual annotations.
16. 【2610.32800】CompMVR: Compression-Aware Multi-View Restoration Using Diffusion Models for Geometrically Consistent 3D Reconstruction
链接：https://arxiv.org/abs/2610.32800
作者：Dong-hwi Kim,Chaewon Moon,Hojun Song,Dongbeom Kim,Junyeong Jang,Aro Kim,Gahyeon Kim,Heejung Choi,Jehee Kim,Gianella Cravioto,Sohyun Lee,Gyeongjin Choi,EunHye Jeong,Soo Ye Kim,Jaehyup Lee,Sang-hyo Park
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：pipelines often rely, Real-world, multi-view images degraded, reconstruction pipelines, compression
备注： Accepted to SIGGRAPH Asia 2026 (Technical paper)
点击查看摘要
Abstract:Real-world 3D reconstruction pipelines often rely on multi-view images degraded by lossy compression. While compression artifacts have been extensively studied in single-image or video restoration, their impact on multi-view geometry remains largely overlooked. In this work, we identify compression-induced cross-view geometric inconsistency as a critical failure mode, where view-dependent artifacts disrupt feature matching, dense correspondence, camera parameter estimation, and downstream 3D reconstruction tasks such as novel view synthesis. To address this problem, we propose CompMVR, a compression-aware multi-view diffusion restoration framework that jointly refines compressed views while preserving cross-view consistency, and construct compressed datasets for systematic evaluation. Unlike conventional restoration methods that optimize each image independently for 2D perceptual quality, CompMVR leverages learned compression priors and cross-view correspondence to recover visual details while improving geometric reliability across views. Experiments across diverse datasets, codecs, and compression levels demonstrate gains in restoration quality and downstream 3D tasks, including novel-view synthesis, camera pose estimation, and view matching. These results establish compressed multi-view restoration as a distinct problem and highlight its importance for 3D reconstruction under lossy compression. Code and data for this paper are available at this https URL.
17. 【2610.32794】Consommé: Conditioned Token Merging for Split Inference
链接：https://arxiv.org/abs/2610.32794
作者：Man Ngo,Jan S. Rellermeyer
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Vision Transformer, resource-constrained edge device, partitions a Vision, Split inference partitions, resource-constrained edge
备注：
点击查看摘要
Abstract:Split inference partitions a Vision Transformer between a resource-constrained edge device and a server. However, transmitting intermediate tokens across the communication channel is costly. Deploying fine-tuned backbones to every endpoint becomes expensive as well. We study token reduction for split inference under a frozen backbone, where only a small adapter is shipped. We observe that the CLS token plays a dual role: it acts as the global summary the receiver needs for classification, and it serves as a signal on which patches to keep. We propose Consommé, a method utilizing both characteristics. There, an information bottleneck compresses the CLS token into a compact latent which is transmitted in place of the full CLS token and conditions a learned patch gate merging patches into exactly $k$ tokens via soft assignment. It reaches any budget in a single step, thus escaping the per-layer cap of bipartite matching (BPM). On DeiT-S/T, it leads all methods at aggressive token budgets and remains operable at shallow splits where BPM cannot operate, while matching fine-tuned methods at gentle budgets at a fraction of their deployment cost.
18. 【2610.32792】SREdit: Scene Response Guided Appearance Editing for Projection Mapping
链接：https://arxiv.org/abs/2610.32792
作者：Yuqiao Xia,Yuchen Deng,Ziheng Chang,Bingyao Huang
类目：Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：selected visual attributes, appearance, selected visual, visual attributes, Projection-based appearance editing
备注： 28 pages, 65 figures
点击查看摘要
Abstract:Projection-based appearance editing changes selected visual attributes of a physical object through projection mapping (PM). To display a desired appearance, PM typically uses projector compensation, which computes a projector input that counteracts the geometric and photometric distortions of the scene. Compensation can only approximate this appearance within the available projection range, and it cannot revise the appearance itself. Pretrained LLM-based image editors provide a direct way to produce the desired appearance from a text prompt or reference image; projector compensation can then attempt to reproduce the edited result through projection. However, these editors do not have an accurate measure of the scene geometry or scene response. Therefore, their outputs may contain geometric misalignment, inconsistent shading, or changes outside the available projection range, which downstream projector compensation cannot correct. To address this problem, we introduce SREdit, an efficient response-guided framework for projection-based appearance editing. SREdit estimates a scene response map from the reconstructed scene that reflects how strongly projected illumination can affect different surface regions. SREdit uses the source appearance to constrain the early sampling process and preserve registration with the fixed physical object, while the scene response map adapts the amount of editing across surface regions. Experiments across two pretrained image editors show that SREdit improves projected appearance quality and reproduction fidelity. It adds less than one second per image with negligible VRAM overhead. Participants also consistently preferred the results produced with SREdit in our user study.
19. 【2610.32784】Video-MemComp: Taylor-Guided Sensitivity-Aware Memory Management for Streaming Video Understanding
链接：https://arxiv.org/abs/2610.32784
作者：Yonghui Niu,Yuhao Ji,Chang Nie,Jiao Zhang,Yilong Li,Junlan Feng,Ran He,Caifeng Shan,Chaoyou Fu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Large Language Models, Multimodal Large Language, Language Models, Multimodal Large, Large Language
备注： Accepted by ACM MM 2026. Project Page: [this https URL](https://hhnk666.github.io/Video-MemComp.github.io)
点击查看摘要
Abstract:The rapid growth of video data has created an urgent need for efficient video understanding systems that can handle long and continuous visual inputs, posing significant challenges for Multimodal Large Language Models (MLLMs) due to severe memory bottlenecks. Moreover, existing compression methods often overlook the explosive accumulation of approximation errors. To address this issue, we propose Video-MemComp, a training-free and sensitivity-aware context management framework for memory-constrained streaming video understanding. Our method theoretically decomposes compression error into orthogonal local approximation error and layer-wise structural sensitivity via a first-order Taylor expansion. To minimize local approximation error, we perform token aggregation in a pre-RoPE safe zone with an attention-conserving logit bias, mitigating geometric distortions caused by RoPE rotations. To manage layer-wise structural sensitivity, we dynamically allocate the KV cache budget based on offline gradient priors and online context entropy, prioritizing high-sensitivity layers. Video-MemComp outperforms or achieves performance comparable to full-cache and state-of-the-art compression methods on benchmarks including MLVU, VideoMME, and EgoSchema. Notably, it improves the overall accuracy of Qwen2.5-VL-3B from 62.3% to 64.1% while reducing the KV cache to an equivalent of 6,000 tokens per layer, saving over 90% of KV memory.
20. 【2610.32768】SCDM-HTD: Spectral-Wise Conditional Diffusion Model for Hyperspectral Target Detection
链接：https://arxiv.org/abs/2610.32768
作者：Dunbin Shen,Wenfeng Kong,Jianjun Liu,Xiaorui Ma,Hongyu Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Hyperspectral target detection, Hyperspectral target, aims to locate, fine-grained scale, playing a pivotal
备注：
点击查看摘要
Abstract:Hyperspectral target detection (HTD) aims to locate and recognize objects at a fine-grained scale, playing a pivotal role in remote sensing. Despite significant progress, current HTD methods primarily focus on feature comparison while neglecting distribution learning for background-target separation, which can limit detection robustness in practical applications. This paper addresses this issue by introducing a spectral-wise conditional diffusion model that reformulates HTD as a task of generating a detection map. Specifically, we treat background and target confidence scores as training samples and use the corresponding pixel spectra as guiding conditions to capture the distributional discrepancy between background and target through diffusion and denoising. To enhance practical applicability, we propose a lightweight conditional denoising network based on multilayer perceptron to map noisy confidence scores to their ideal counterparts and adopt a deterministic reverse non-Markov chain to skip sampling steps, thereby accelerating the generation process. Furthermore, we introduce a composite loss to improve background-target separation. This loss integrates constrained energy minimization loss to enhance target saliency and suppress the background by maximizing the target response while minimizing average output energy, alongside binary cross-entropy loss to classify background and target using pixel-wise labels. Experimental results on four benchmark datasets demonstrate the effectiveness of the proposed method, with improvements in both quantitative metrics and qualitative visual effects.
21. 【2610.32730】Cross-Architectural Feature Fusion for Coronary Artery Stenosis Detection in X-ray Angiography
链接：https://arxiv.org/abs/2610.32730
作者：Haobo Zhu,Mojtaba Lashgari,Jason Chai,Giovanni Luigi De Maria,Vicente Grau,Abhirup Banerjee
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：X-ray Coronary Angiography, invasive X-ray Coronary, Coronary artery disease, Coronary Angiography, X-ray Coronary
备注： 12 pages, 3 figures
点击查看摘要
Abstract:Coronary artery disease remains a leading cause of mortality, with stenosis detection from invasive X-ray Coronary Angiography (XCA) critical for diagnosis. Manual interpretation is time-consuming, subjective, and variable, especially under low contrast and vessel overlap. Existing deep learning methods often rely solely on detection or segmentation, limiting this http URL propose a hybrid framework, Fusion-YOLOv11-L, combining a YOLOv11-L detector with a pretrained UNet++ via a channel attention gating module. This enables fusion of semantic and vessel-aware structural features, improving localisation of stenotic regions. The UNet++ is pretrained on ARCADE vessel segmentation dataset to provide anatomically informed representations. Experiments on the relabeled ARCADE (ARCADE*) dataset show improved performance over YOLOv11-L, achieving AP@50 of 0.585 and F1-score of 0.596. Cross-domain evaluation on a dataset from the Oxford Acute Myocardial Infarction (OxAMI) Study reveals performance degradation due to domain shift, mitigated using test-time adaptation and augmentation. Test-time augmentation improves AP@50 from 0.434 to 0.480, indicating better generalisability. These results show that cross-architecture feature fusion and lightweight adaptation improve robustness and generalisability of automated stenosis detection in XCA.
22. 【2610.32728】CityLift: Compositional 3D Urban Generation from a Single Image
链接：https://arxiv.org/abs/2610.32728
作者：Haoran Gong,Jie Feng,Chenxu Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Generating editable, coherent spatial arrangement, single image requires, image requires detailed, requires detailed building
备注：
点击查看摘要
Abstract:Generating editable 3D urban scenes from a single image requires detailed building assets with a coherent spatial arrangement. Occlusion and perspective ambiguity make it difficult to infer complete building geometry together with consistent relative scales and positions. We present CityLift, a framework that generates individual textured building meshes from an urban image by coupling scene-level spatial modeling with building-level synthesis. CityLift first learns building shape and placement jointly through coupled scene and instance streams, producing coarse sparse structures in a common coordinate system. We then introduce generative spatial inheritance, which maps each building's coarse occupancy and scene-conditioned 3D feature field into a local volume to guide a flow model that generates finer structure. The same coordinate mapping places the generated meshes back into the scene, preserving their spatial relationship to the scaffold. To address the scarcity of urban data pairing scene images with individual 3D buildings, we construct CityLift-5K, comprising 4,997 synthetic scenes with instance masks, building meshes, and placement annotations. Experiments on CityLift-5K and scene blocks from UrbanScene3D and InstanceBuilding demonstrate improved building geometry and scene composition. The project page is available at this https URL.
23. 【2610.32709】Are Textual Residuals Truly Complementary? Learning Visual Complements under Semantic Superposition for Visible-Infrared Person Re-Identification
链接：https://arxiv.org/abs/2610.32709
作者：Xiaoyang Li,Mingming Lu,Wei Zhou,Hao Li,Canhui Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Text-enhanced visible-infrared person, visible-infrared person re-identification, Text-enhanced visible-infrared, exploits textual descriptions, person re-identification
备注： 24 pages, 4 figures
点击查看摘要
Abstract:Text-enhanced visible-infrared person re-identification (VI-ReID) exploits textual descriptions to compensate for appearance cues that are weak or unavailable under infrared imaging. Existing methods construct compensation from differences between modality-oriented textual representations, implicitly assuming that textual differences are visually complementary. We revisit this assumption through semantic superposition and show that dense textual residuals may entangle useful appearance variations with redundant, making direct residual fusion unreliable. We propose Superposition-Aware Residual Calibration, which transforms dense textual differences into selective and visually grounded complements. Low-Interference Sparse Residual Learning represents modality-oriented text embeddings as sparse activation strengths over a shared dictionary, selects positive strength differences, and suppresses both dictionary-level overlap and activation-weighted interference to reconstruct a compact, selectively controlled residual. Visual Complement and Counterfactual Calibration further calibrates the residual against identity-specific RGB-IR visual discrepancies, encouraging retained semantics to provide meaningful compensation while preserving the residual structure. Experiments on Tri-SYSU-MM01, Tri-RegDB, and Tri-LLCM show that SARC consistently improves the VI-ReID backbone and remains competitive with text-assisted methods. Mechanism analyses show that SARC produces more concentrated textual variations, reduces dictionary-level feature interference, and improves residual-visual-complement alignment for most samples. These results demonstrate that effective cross-modal compensation requires textual residuals to be selectively represented and explicitly calibrated, rather than directly treated as visual complements. Code and implementation details will be released upon publication.
24. 【2610.32697】SP-Guide: Enhancing Aerial Vision-Language Navigation with Spatial Priors
链接：https://arxiv.org/abs/2610.32697
作者：Haoxiang Tang,Dong Zhou,Shen Tan,Minxuan Jiang,Xitong Li
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Aerial vision-language navigation, large outdoor scenes, requires a UAV, partial egocentric observations, Aerial vision-language
备注：
点击查看摘要
Abstract:Aerial vision-language navigation (AVLN) requires a UAV to reach a language-described target from partial egocentric observations while reasoning over large outdoor scenes. Existing approaches typically fuse view-centered RGB observations and globally anchored history maps as generic visual embeddings, leaving cross-modal spatial alignment to be learned from sparse navigation supervision. We present SP-Guide, a transformer- based goal-prediction framework that addresses this weakness of alignment through a Spatial Prior Cross-Modal Encoder, an Instruction Enhanced Decoder, and a Goal Convergence Filter for terminal target refinement. Experiments implemented on the CityNav benchmark show that SP-Guide improves success rate over the representative baselines, with the largest gains on unseen environments. These results indicate that physically grounded spatial priors provide an effective inductive bias for robust AVLN.
25. 【2610.32666】Robust Offset-Free Lane-Keeping Control Framework for Vision-Only Automated Vehicles
链接：https://arxiv.org/abs/2610.32666
作者：Der-Hau Lee
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Systems and Control (eess.SY)
关键词：ensuring robust vehicle, robust vehicle stability, real-time lane-keeping control, high-speed cornering, cornering on large-curvature
备注： 13 pages, 10 figures
点击查看摘要
Abstract:Achieving accurate, real-time lane-keeping control during high-speed cornering on large-curvature roads while ensuring robust vehicle stability is a critical challenge in autonomous driving. To address this challenge, this study developed a robust offset-free model predictive control (OF-MPC) framework for vision-based autonomous vehicle lane-keeping. The regulation problem in this framework is solved using several algorithms. Numerical simulation results indicated that the interpolation-tube-based constrained iterative linear quadratic regulator (itube-CILQR) algorithm outperformed solvers based on the standard Interior Point Optimizer (IPOPT) and Operator Splitting Quadratic Program (OSQP), achieving a mean computation time of less than 5 ms. The itube-CILQR algorithm was then used for vehicle control in vision-based lane-keeping experiments in a simulation environment to quantify the perceptual uncertainty of a visual perception model (multitask UNet). This quantification was performed using the OF-MPC framework for traffic scenes that were not encountered during model training. Overall, the developed OF-MPC framework and the proposed method for characterizing the perceptual uncertainty of a visual perception system in unseen environments can contribute to the future development of advanced autonomous driving systems.
26. 【2610.32664】he Answer Knows Where to Look: Zooming before MLLMs Answer under Visual-Token Budgets
链接：https://arxiv.org/abs/2610.32664
作者：Zhensheng Hu,Guanglong Xu,Guanqiang Hu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal large language, efficient deployment requires, small per-image budgets, large language models, Multimodal large
备注：
点击查看摘要
Abstract:Multimodal large language models (MLLMs) read images through visual tokens, and under the small per-image budgets that efficient deployment requires, the fine text of documents, charts and infographics becomes illegible. Zooming in recovers the evidence, but the region must be chosen before the model answers. We find that MLLMs know where the evidence is, but not in a form that can be read before they answer: the answer tokens localize it from the middle layers on, whereas the attention available before answering does so only in the top layers, at a depth that varies across models, and diffusely. Supervising the pre-answer attention to point degrades reading, and the benefit of zooming is governed by each image's information gap. Building on these findings, we introduce ours, which lets an MLLM look where its answer would. A dedicated look token, processed in a single prefill and kept out of the answering pass, learns in hindsight to attend as the model's own correct answers do, extracting this knowledge into a concentrated pointer before any answer exists. Its hidden state then selects how to look, from no zoom to crops, square windows, windows that adapt to the pointer and foveated warps, supervised by the counterfactual outcome of every view. ours needs no box annotations, per-model layer search, external localizers or generation before the answer. On Qwen3-VL at three scales and five text-rich benchmarks, it surpasses the strongest baseline by 4.8-9.1 points at 98 visual tokens per view and attention-guided zooming by 11.1-17.0 points, while running faster than attention-guided and grounding-based zooming.
27. 【2610.32663】SemGeo-Gen: Unsupervised Generation of Approximate Cross-Instance Semantic-Geometric Correspondences
链接：https://arxiv.org/abs/2610.32663
作者：Roy Amoyal,Shira Ifergane,Oren Freifeld
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：generating approximate cross-instance, weakly aligned, unsupervised method, method for generating, cross-instance semantic-geometric supervision
备注： Accepted to NeurIPS 2026
点击查看摘要
Abstract:We introduce SemGeo-Gen, an unsupervised method for generating approximate cross-instance semantic-geometric supervision from weakly aligned 3D object collections. Our goal is not to recover exact point-level correspondences, which are often ambiguous across different instances and would require expensive, impractical manual supervision at scale. Instead, we automatically produce approximate correspondences that are semantically meaningful, geometrically consistent, and diverse enough to train modern correspondence models. Given only coarse category-level rotation alignment, SemGeo-Gen lifts multi-view DINOv2 features to 3D, aligns object instances using continuous piecewise-affine registration, and prunes candidate matches using semantic consistency. The resulting 3D correspondences can be projected into rendered views, yielding scalable 3D-3D, 3D-2D, and 2D-2D supervision without manual annotation. We validate the generated correspondences against sparse human annotations from KeypointNet, obtaining 93% PCK@0.10 and 97% PCK@0.15. More importantly, we show that using the generated correspondences for synthetic pretraining improves recent state-of-the-art semantic correspondence models on SPair-71k after fine-tuning on real data, with gains of up to 5 PCK@0.10 points. Together, these results indicate that approximate semantic-geometric supervision generated from 3D assets can improve real-image correspondence learning and serve as a scalable alternative to costly manual annotation. Project page: this https URL.
28. 【2610.32635】EditJev: System One Routing for Image Editing Models
链接：https://arxiv.org/abs/2610.32635
作者：Zhile Guan,Xu Jiang,Yule Duan,Gongbo Zhang,Shuyu Wang,Xiao Chen,Jian Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：sample-specific performance variation, Instruction-based image editing, exhibit pronounced sample-specific, pronounced sample-specific performance, Instruction-based image
备注： 12 pages, 4 figures, 7 tables
点击查看摘要
Abstract:Instruction-based image editing models exhibit pronounced sample-specific performance variation: different models can produce substantially different results for the same source image and editing instruction, and the best-performing model often varies across requests. These models also differ substantially in inference latency, making fixed-model deployment inefficient. We therefore study image editing model routing, which dynamically selects an editor from a candidate pool given an input image and editing instruction. We introduce EditJev, a System One routing model that directly predicts sample-level preference scores over candidate image editing models in a single forward pass. A lightweight preference head on a vision-language backbone produces a fixed-dimensional score vector without autoregressive model-name generation or response parsing. To train EditJev, we construct pairwise preferences from offline candidate outputs and optimize a pairwise ranking objective to learn relative model suitability. At inference time, EditJev combines the predicted preference scores with model-level speed scores to balance editing quality and generation latency. Experiments on ImgEdit and GEdit-En show that EditJev improves aggregate quality over the strongest fixed editor, from 4.540 to 4.592 and from 8.194 to 8.255, respectively, while reducing estimated end-to-end latency by 60.8% and 31.7%. These results demonstrate the effectiveness of direct, structured model routing for efficient image editing.
29. 【2610.32617】Earth embeddings are decomposable records of the land surface
链接：https://arxiv.org/abs/2610.32617
作者：Robin Young,Srinivasan Keshav
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Populations and Evolution (q-bio.PE)
关键词：annual Earth embeddings, biodiversity assessment increasingly, assessment increasingly rely, annual Earth, carbon accounting
备注：
点击查看摘要
Abstract:Ecological monitoring, carbon accounting and biodiversity assessment increasingly rely on annual Earth embeddings--learned vectors that compress a year of satellite observation for every ten-meter pixel on Earth, consumed in place of the imagery itself. What these vectors mean has not been established. Here we decompose two widely used embedding products and show that they contain individual ecological features, including fire, forest clearing and crop type, validated against independent reference data on events across six continents. The recovered concepts date abrupt canopy loss to the first post-disturbance growing season and resolve severity well enough to separate prescribed fire from wildfire. Small fires that recover quickly are detectable in one product but not the other, which instead separates crops more strongly.
30. 【2610.32612】DriveOSS: Dataset and Benchmark for 3D Anomaly Segmentation and Open-set Semantic Segmentation in Autonomous Driving
链接：https://arxiv.org/abs/2610.32612
作者：Zhiran Yan,Savankumar Bhanderi,Sourabh Lolge,Rui Song,Girdharbhai Paneliya,Shiva Agrawal,Gordon Elger
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Recent advances, improved scene understanding, significantly improved scene, significantly improved, semantic segmentation
备注： Accepted to WACV 2027
点击查看摘要
Abstract:Recent advances in 3D semantic segmentation have significantly improved scene understanding in autonomous driving. However, existing methods are typically developed under a closed-set assumption and evaluated under standard driving conditions, where all categories are known in advance. In real-world driving, autonomous vehicles inevitably encounter previously unseen objects, making closed-set perception insufficient for safe deployment. To address this challenge, we introduce DriveOSS, which, to the best of our knowledge, is the first real-world multimodal dataset and benchmark specifically designed for 3D anomaly segmentation and open-set semantic segmentation. It contains 12,661 synchronized and annotated frames captured using six surround-view RGB cameras, a 128-beam LiDAR, and a GPS/IMU unit. The dataset comprises 52 real-world driving scenes collected under clear, nighttime, cloudy, rainy, and snowy conditions and is organized into ID (in-distribution) and OOD (out-of-distribution) subsets. The ID scenes contain only known classes and are used for training, whereas the OOD scenes additionally contain unknown objects annotated as the outlier class and are used for validation and testing. Extensive experiments show that unseen objects remain a major challenge for current 3D perception systems. The dataset, benchmark protocols, and code are available at this https URL.
31. 【2610.32609】Hair Segmentation and Skin Characterization on Macroscopic Dermatological Images for Laser Treatment Parameterization
链接：https://arxiv.org/abs/2610.32609
作者：Alex Navarro Navarro,Marc Arriaga Hidalgo,Carlos Moreno Rubio,Maxime Talarmain,Noelia Vaquero Gallardo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：intense pulsed light, Current light-based devices, uncalibrated point-based colorimeters, vascular laser therapy, subjective manual parameterization
备注： Published open access in Journal of Imaging Informatics in Medicine (2026)
点击查看摘要
Abstract:Current light-based devices, such as laser hair removal, intense pulsed light (IPL), vascular laser therapy, and dermatologic phototherapy, are widely used in clinical dermatology but rely heavily on subjective manual parameterization or uncalibrated point-based colorimeters. To overcome these limitations, this work presents a unified system for hair segmentation and skin characterization in macroscopic dermatological images. Unlike most existing literature that relies on dermoscopic datasets captured under highly controlled conditions, our approach is specifically designed for macroscopic images that replicate real clinical laser treatments. The proposed pipeline integrates a custom-trained variant of the YOLOv9 deep learning architecture for instance segmentation and classical image processing within a single workflow to extract objective skin and hair parameters such as phototype, hair density, color, and thickness. A color calibration stage using spectrophotometric measurements ensures accurate feature estimation regardless of illumination conditions. Experimental results show competitive segmentation metrics (mAP@50 $\approx$ 0.80) on a custom dataset featuring short, shaved hairs, typical of pre-treatment scenarios. These findings demonstrate the feasibility of the proposed pipeline in providing the objective, foundational skin and hair features required for future automated laser parameterization, paving the way for its extension to broader light-based medical therapies.
32. 【2610.32573】Standing on Open Shoulders: Regional Fine-Tuning of Open-Weight Camera-Trap Models for UK Wildlife with Modest Data and Compute
链接：https://arxiv.org/abs/2610.32573
作者：Paul Fergus
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Camera-trap species classification, native red versus, red versus invasive, versus invasive grey, invasive grey squirrels
备注： 39 pages, 9 Figures, and 8 Tables
点击查看摘要
Abstract:Camera-trap species classification is dominated by large models from well-resourced organisations, which often lack the species-level distinctions regional conservation needs, such as native red versus invasive grey squirrels in the UK. We ask whether open weights let a small team with a modest dataset and a single GPU take a real part in AI development. We fine-tuned the open DeepFaune classifier on 28 UK classes, paired it with the unmodified MegaDetector v6, and compared the resulting DeepFaune-UK v1.2 with DeepFaune v1.5.0 and SpeciesNet on 20,212 hand-verified MammalWeb citizen-science images, after removing sequences sharing any of 1,039 images with our training archive. DeepFaune-UK achieved a strict image-level accuracy of 88.8%, including empty frames, against 56.5% and 59.0% for the baselines, but at DeepFaune's coarser label resolution DeepFaune v1.5.0 was more accurate, though not significantly under contributor resampling (91.4% vs. 88.8%). As DeepFaune v1.5.0 uses a newer DINOv3-based classifier, we applied the identical recipe, without new data, to that classifier. The resulting DeepFaune-UK v1.3 reached 90.6% strict accuracy, narrowed the like-for-like gap to 0.8 points and reduced roe deer misclassified as fallow deer by 69%. On 1,850 images from the 26 contributors with no overlapping images, the three DeepFaune-based models did not differ significantly (90.5%, 90.6%, 89.9% like-for-like). Fine-tuning on 10% of the training crops (about 150 per class) gave out-of-distribution accuracy similar to using all of them, and a DINOv2 run on this subset took about 22 minutes with under 4 GB of GPU memory. Open weights thus make regional model development feasible for small teams, but the largest like-for-like gain came from a newer base model trained by others, so this democratisation depends on large actors continuing to release open weights, under licences that may change.
33. 【2610.32566】Reuse, Don't Retrain: Efficient, Modality-Versatile Geospatial Foundation Models through Feature Distillation
链接：https://arxiv.org/abs/2610.32566
作者：Mario Hamon,Pierre Adorni,Minh-Tan Pham
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Geospatial foundation models, Geospatial foundation, costly to pretrain, sensing modalities, families often repeat
备注：
点击查看摘要
Abstract:Geospatial foundation models (GeoFMs) are costly to pretrain, yet model families often repeat this process across backbone scales and sensing modalities. We investigate feature distillation as a more efficient way to reuse existing representations. First, we distill frozen CROMA and TerraMind teachers into smaller Vision Transformers through patch-level feature matching. Across nine PANGAEA tasks, distilled TerraMind Tiny, Small, and Base outperform their scale-matched released counterparts by 2.76, 3.02, and 1.87 mean IoU points, respectively; each also matches or exceeds the next-larger released model. Distilled CROMA-Base gains 2.05 points. TerraMind-Base required only 43 A6000 GPU-hours, approximately 0.5\% of the reported cost of independent pretraining. Second, we introduce TEDI, an unpaired multi-expert approach combining TerraMind for multispectral imagery and DINOv3 for high-resolution RGB. Separate patch embeddings route unpaired inputs into a shared Transformer trunk, removing the need for co-registered data. TEDI-Large achieves the highest single-model mean in our PANGAEA-9 comparison (62.51 mIoU), outperforming both teachers overall while retaining their modality-specific strengths. TEDI-Base reaches 61.75 mIoU with 72\% fewer parameters. These results show that distillation improves the GeoFM accuracy-compute frontier while consolidating complementary experts into a single versatile backbone.
34. 【2610.32562】Shared Is Not Enough: Predictor Width and Factor Readability Under Masked Latent Prediction
链接：https://arxiv.org/abs/2610.32562
作者：Nilotpal Kakati
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Data Analysis, Statistics and Probability (physics.data-an)
关键词：Masked latent prediction, learn predictable features, Masked latent, latent prediction methods, predictable features
备注：
点击查看摘要
Abstract:Masked latent prediction methods such as I-JEPA aim to learn predictable features, but what determines which information they retain is less clear. We built a simulator in which every factor behind an image is known, so a probe can measure how readable each factor remains after training. We trained small encoders (0.7M parameters) with I-JEPA, SimCLR and BYOL on the same pairs of views and probed a factor that both views share. I-JEPA had a predictor with half the encoder's width and depth, the proportions it uses for ViT-B. Its median score was about 40% of SimCLR's. Widening the predictor to the encoder's width reversed this ordering at every training seed, against both other methods. We release the simulator and the trained models.
35. 【2610.32561】HEALPix-Based Implicit Neural Compression of Omnidirectional Images
链接：https://arxiv.org/abs/2610.32561
作者：Yulong Cheng,Youneng Bao,Junfeng Zhou,Mu Li,Jie Wen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：immersive virtual reality, Real-time decoding, virtual reality, essential for immersive, immersive virtual
备注： [N] pages, 10 figures, 4 tables. Submitted to IEEE Transactions on Image Processing
点击查看摘要
Abstract:Real-time decoding of omnidirectional images is essential for immersive virtual reality (VR) experiences. Compared with conventional transform-based learned image compression (LIC), overfitted codecs offer lower decoding complexity by representing each image with a lightweight implicit neural representation (INR). However, existing approaches typically operate on the equirectangular projection (ERP), which introduces nonuniform spherical sampling and spatial distortion, leading to redundant sampling near the poles and latitude-dependent receptive fields. To address these limitations, we propose a spherical overfitted codec based on a multi-scale Hierarchical Equal Area isoLatitude Pixelization (HEALPix) representation, which enables equal-area sampling and efficient hierarchical modeling of spherical signals. Building on this representation, we develop a Spherical Inter-Scale Conditional entropy model that exploits spatial dependencies and cross-scale correlations among HEALPix latents to improve coding efficiency. We further introduce a Multi-Ring Spherical Convolution that aggregates neighboring pixels over a nearly uniform spherical receptive field across latitudes. Experiments on a public omnidirectional image dataset demonstrate BD-rate reductions of 16.3%, 26.5%, and 19.5% over VVC in terms of V-PSNR, V-MS-SSIM, and V-LPIPS, respectively. Our method also achieves a 13.1% BD-rate reduction over ERP-based Cool-Chic 5.0 in terms of V-PSNR, while providing 2.6-3.6x faster decoding than the evaluated learned autoencoder codecs.
36. 【2610.32517】VERA-Hand: A Verified Multidimensional Benchmark for 2D Hand Pose Estimation in Third-Person Dynamic Gesture Videos
链接：https://arxiv.org/abs/2610.32517
作者：Gibran Benitez-Garcia,Hiroki Takahashi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：sign language understanding, touchless human-computer interaction, Hand landmarks serve, gesture recognition, sign language
备注： Accepted to WACV 2027
点击查看摘要
Abstract:Hand landmarks serve as input for gesture recognition, sign language understanding, and touchless human-computer interaction. Yet hand pose estimators are typically evaluated with frame-wise localization metrics such as PCK or MPJPE, which are computed over matched predictions and overlook missed or spurious hands, handedness errors, and temporal instability. To address these limitations, we present VERA-Hand, a benchmark that evaluates estimators using manually verified, frame-level 2D annotations for 10,690 hands across four complementary dimensions (detection, localization, identification, and temporal stability), as well as a joint Pose-F1 metric that requires both correct detection and accurate localization. Evaluating six estimators spanning hand-specific, whole-body, reconstruction-based, and foundation-model paradigms, we find that no estimator dominates: rankings reorder sharply across dimensions. VERA-Hand also exposes failures that localization-only and downstream evaluations may not reveal, including cross-hand overlap in over 85% of frames for a recent foundation model. A post-hoc cleanup case study demonstrates how the benchmark can validate corrective interventions, while stratified analyses show that robustness varies across motion-blur classes and hand regions. We release the verified annotations, protocol, and code at this https URL
37. 【2610.32512】Fast and Useful: Adapting Distilled Generators for Visual Learning
链接：https://arxiv.org/abs/2610.32512
作者：Patryk Bartkowiak,Dominik Michels,Sören Pirk,Wojciech Pałubicki
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：generate images quickly, perform substantially worse, classifiers trained, trained, adapt released distilled
备注：
点击查看摘要
Abstract:Distilled text-to-image models generate images quickly, but classifiers trained on those images can perform substantially worse than classifiers trained on images from their slower base models. We adapt released distilled generators to produce better training data while retaining fast generation. We fit a low-rank update to the student's first prediction so that it reaches an intermediate state produced by its unguided base, then disable the update and let the unchanged student finish generation. The base supplies training targets and is absent at inference. Guided targets and shorter jumps give classifiers lower accuracy in our ablations, showing why the state used for supervision matters. Across three generator families, the adapted images train better classifiers than images from the released students. With class-name templates at full ImageNet-1k scale, ResNet-50 top-1 rises from 8.4% to 34.2% for FLUX.2-klein and from 12.7% to 32.1% for SD-Turbo, using two and three denoiser evaluations per image, respectively. Fixed adapters also improve results on additional classes, fine-grained datasets, and other learner architectures and training recipes. Template-based adaptation remains useful against richer-prompt alternatives, while the benefit of combining adaptation with LLM generation prompts depends on the generator. Adapting a single generation step makes fast generators substantially more useful for training visual models.
38. 【2610.32511】Augmentation Strategy for DINO in Glaucoma Classification
链接：https://arxiv.org/abs/2610.32511
作者：Ashish Kumar Meena,Chandra Sekhar Seelamantula
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Self-supervised learning, medical imaging domains, specialized medical imaging, SSL frameworks validated, based SSL framework
备注： 11 pages, 3 figures. Accepted at the 17th International Workshop on Machine Learning in Medical Imaging (MLMI 2026), held in conjunction with MICCAI 2026
点击查看摘要
Abstract:Self-supervised learning (SSL) offers a promising approach to medical image representation learning, yet augmentation strategies of SSL frameworks validated on natural images do not reliably transfer to specialized medical imaging domains. We analyze DINO, a knowledge-distillation based SSL framework, and empirically demonstrate that its default augmentation strategy produces unreliable representations for retinal fundus images, degrading downstream glaucoma classification performance. Guided by the principle that effective cropped views should share minimal redundant information while retaining clinically relevant signal, we redesign DINO's augmentation strategy. Our approach biases the learned representations toward diagnostically critical features rather than low-level image statistics. We evaluate our method for glaucoma classification by training a linear classifier on the frozen representations, achieving strong generalization across seven benchmark datasets. URL for code and weights: this https URL
39. 【2610.32500】Distortion-Aware Spatiotemporal Learning for Real-Time Wide-Angle Video Rectification
链接：https://arxiv.org/abs/2610.32500
作者：Lang Nie,Yihan Yang,Wenbo Nie,Hongguang Zhu,Yang Wei,Chunyu Lin,Bin Xiao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：unnaturally stretching people, exhibit severe nonlinear, severe nonlinear distortion, wide-angle lenses provide, field of view
备注： 9 pages, 7 figures
点击查看摘要
Abstract:While wide-angle lenses provide an expanded field of view (FoV), they exhibit severe nonlinear distortion near image boundaries, unnaturally stretching people in these regions. Existing methods mostly focus on facial regions, require high computational costs, and lack temporal modeling, resulting in incomplete full-body rectification, impractical real-time deployment, and noticeable inter-frame shakes. To tackle these issues, we propose \textbf{FastVC}, an efficient full-body video rectification framework driven by distortion-aware spatiotemporal learning. Grounded in lens physics, FastVC introduces a distortion-aware thin-plate spline (DA-TPS) module that nonlinearly remaps control points into a peripheral-dense layout, enabling more accurate geometric fitting without additional computational cost. We further develop a dual-level spatiotemporal learning scheme for causal and stable video rectification. At the model level, neighborhood spatiotemporal attention (NST) aggregates local context and selectively fuses historical features with low overhead. At the optimization level, sparse spatiotemporal supervision applies spatial alignment only to anchor frames, decoupling frame-wise accuracy from temporal stability. Besides, we contribute the first benchmark dataset for wide-angle full-body video correction. Extensive experiments show that FastVC achieves state-of-the-art rectification fidelity and visual stability at 57.0 FPS.
40. 【2610.32493】K-CLUE: A Segmentation-to-Clustering Framework for Ki67 Cell Typing
链接：https://arxiv.org/abs/2610.32493
作者：Ana Beatriz Vieira,Sara P. Oliveira,Diana Montezuma,João Fraga,Jaime S. Cardoso,Arlindo L. Oliveira
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：supervised classifiers trained, breast cancer, key marker, marker of tumor, tumor proliferation
备注： Accepted at the BD-MedVis Workshop, BMVC 2026
点击查看摘要
Abstract:Ki67 is a key marker of tumor proliferation in breast cancer, but its quantification from immunohistochemistry images normally depends on supervised classifiers trained per dataset. We examine the role of frozen pretrained visual representations in annotation-free Ki67 cell typing. To this end, we use K-CLUE, a framework that segments individual nuclei, represents each nucleus with a pretrained encoder, reduces the resulting embeddings with principal component analysis, and separates Ki67-positive from Ki67-negative nuclei using k-means clustering, without task-specific training or manual annotations. Clustering the raw components is highly sensitive to the choice of encoder: across seven encoders, the Ki67-positive F1-score on matched MIST nuclei varies by 44 points, although Ki67 status remains linearly decodable from every representation, with supervised probe AUCs above 0.98. Analysis of the embedding spaces shows that clustering succeeds when DAB-related variation occupies the leading directions of variance. Whitening the retained principal components removes this dependence, reducing the spread across encoders to 1.00 F1-score point. Handcrafted color representations are also competitive, confirming that Ki67 status is strongly reflected in chromatic information, but they require an explicit choice of color space. In end-to-end evaluation, K-CLUE reaches F1-scores of 85.00% and 81.91% for Ki67-positive and Ki67-negative nuclei on MIST, and 79.59% and 81.16% on BCData, outperforming DeepLIIF and IHCScoreGAN on both datasets. These results show that pretrained representations can support annotation-free Ki67 typing when their variance structure is accounted for.
41. 【2610.32491】L0-Norm-Based CycleGAN for Unpaired Brain CT-to-MR Synthesis
链接：https://arxiv.org/abs/2610.32491
作者：Yunxiao Zhang,Shouqiang Du,Zexian Xu,Chuanlong Xu
类目：Computer Vision and Pattern Recognition (cs.CV); Optimization and Control (math.OC)
关键词：imaging provide complementary, provide complementary information, Computed tomography, magnetic resonance, imaging provide
备注： 13 pages, 2 figures
点击查看摘要
Abstract:Computed tomography (CT) and magnetic resonance (MR) imaging provide complementary information for the brain, but acquiring both modalities is not always possible. The cycle-consistent adversarial network (CycleGAN) enables unpaired CT-to-MR synthesis, but because the standard L1-norm cycle?consistency penalty grows linearly with the residual magnitude, the network tends to focus on large residuals. This paper introduces an L0-norm-based cycle?consistency term, in which the L0-norm is approximated by a smooth and bounded function. This approximation not only increases sensitivity to small residuals but also effectively suppresses the influence of large residuals. The proposed model and an otherwise identical L1-norm baseline were trained on 102 images and evaluated on 9 test images. The proposed model achieves a lower mean squared error (0.02746 versus 0.03464, a 20.7% reduction), a higher mean peak signal-to-noise ratio (15.80 versus 14.77 dB), and a higher mean structural similarity index (0.5689 versus 0.5407). It also has a lower maximum MSE and higher minimum PSNR and SSIM than the baseline. These results indicate that modifying the cycle-consistency penalty can improve reconstruction accuracy on this dataset.
42. 【2610.32486】Efficient Zero-Shot Video Anomaly Detection via Signal-Aware Adaptive Fusion (SAAF)
链接：https://arxiv.org/abs/2610.32486
作者：Khaled Waleed Dawoud,Muhammad Haris Khan
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Deploying Vision-Language Models, Deploying Vision-Language, Vision-Language Models, anomaly detection confronts, fundamental constraint
备注： Accepted at WACV 2027
点击查看摘要
Abstract:Deploying Vision-Language Models for video anomaly detection confronts a fundamental constraint. Their semantic reasoning demands computational budgets incompatible with the scale of real-world video streams. We present Signal-Aware Adaptive Fusion (SAAF), a framework that achieves efficient zero-shot anomaly detection through three key innovations. First, we introduce a dual-signal adaptive sampler operating in semantic embedding space: a delta signal captures sudden events via frame-to-frame cosine distance, while a drift signal detects static and gradual anomalies through deviation from rolling temporal context. Their OR-gated combination with adaptive EMA-based thresholding provides comprehensive anomaly coverage without training data. Second, we propose a threshold-gated cascaded architecture where lightweight frame-level scoring precedes expensive video-level temporal analysis, invoking it only when confidence warrants additional context. Third, we design a signal-aware weighted fusion mechanism that dynamically adapts score combination based on which signal triggered frame selection. Across four benchmarks, SAAF delivers competitive accuracy at substantially lower cost. Among training-free zero-shot methods, SAAF sets a new state of the art on XD-Violence (92.07%), MSAD (86.70%), and ShanghaiTech (80.54%) AUC-ROC, with XD-Violence and MSAD also surpassing supervised baselines. SAAF sustains 44.95, 48.61, and 41.06 FPS on XD-Violence, UCF-Crime, and MSAD, a 2.43$\times$, 2.63$\times$, and 2.22$\times$ throughput improvement over the prior best zero-shot method. Code: this https URL
43. 【2610.32485】PCFBench: How Far Can Large Vision-Language Models Go in Physics-aware Photonic Inverse Design?
链接：https://arxiv.org/abs/2610.32485
作者：Shengchao Chen,Ting Shu,Sufen Ren
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：high-power laser delivery, underpin critical applications, couples geometric intuition, deep waveguide physics, underpin critical
备注： Accepted to NeurIPS 2026, 66 pages, 30 figures, 27 tables
点击查看摘要
Abstract:Photonic crystal fibers (PCFs) underpin critical applications in telecommunications, sensing, and high-power laser delivery, yet their design remains a manual, expert-intensive process that couples geometric intuition with deep waveguide physics. Vision-language models (VLMs) offer a promising path toward automating PCF design, but can they truly reason about photonic physics from microscopy images, or do they merely recognize visual patterns? We introduce PCFBench, the first comprehensive benchmark for evaluating VLMs on the perception, reasoning, and decision steps of the photonic inverse-design loop. PCFBench spans 26 tasks organized into six categories of increasing cognitive demand (Geometry Perception, Physics Understanding, Text Generation, Multi-modal Reasoning, Inverse-Design Decision, and Code Generation), built from over 220K FDTD simulation samples across 18 structurally diverse fiber families. We evaluate both individual VLMs on isolated tasks and multi-agent systems (MAS) on the full sequential pipeline from perception to design. Our results reveal a striking perception-design gap: current models can identify fiber geometry with moderate success, yet consistently fail to translate that visual understanding into physics-aware design actions. Moreover, cascading agents through the pipeline exposes significant error propagation, where upstream perception mistakes compound into downstream design failures. These findings suggest that neither model scaling nor naive agent chaining suffices, and that closing the loop demands explicit physical grounding. PCFBench provides the community with a rigorous, multi-dimensional testbed to measure progress toward AI-assisted photonic engineering. The project is available at this https URL.
44. 【2610.32478】PathJev: Decision-Native Vision-Language Modelling for Histopathology
链接：https://arxiv.org/abs/2610.32478
作者：Cristian Tommasino,Antonio M. Rinaldi
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：histopathology rarely return, Vision-language models, generative model, rarely return calibrated, model
备注： 25 pages, 4 figures. Code: [this https URL](https://github.com/CosmoIknosLab/PathJev) ; model and demo: [this https URL](https://huggingface.co/Cristiandieti/PathJev-P)
点击查看摘要
Abstract:Vision-language models used for decisions in histopathology rarely return calibrated probabilities over the candidates a user cares about. Decision-native models write a question and a candidate set chosen at run time into the input and return a normalised distribution from a small decision head in one forward pass. We build PathJev-P, a decision-native model for histopathology: MedGemma-1.5-4B with LoRA adapters and a decision head, trained on 40,000 patch states from three public collections whose expert labels are turned into typed questions with organ-specific candidate sets and a "none of these" option. In a comparison over 3 seeds with an analysis plan fixed before testing, on test sets without documented overlap with the training data of the backbone, PathJev-P is more accurate than a generative model trained with the same backbone, data and selection rule, the zero-shot pathology model CONCH and a general medical decision model (balanced accuracy 0.541 against 0.492, 0.345 and 0.213); its advantage over the generative model comes from two organs absent from training. The calibration advantage depends on how the generative model's probabilities are read out. With the summed candidate log-likelihood used in previous work, PathJev-P has the lower calibration error (ECE 0.204 against 0.279); with a length-normalised read-out of the same generative model, examined post hoc, the two have similar mean calibration error (0.201) and the generative model is better calibrated on the unseen organs, where PathJev-P remains over-confident. A supervised linear probe on a pathology foundation model is better calibrated in every setting. In a qualitative whole-slide demonstration, PathJev-P labels unsupervised tissue clusters with abstention and separates carcinoma from other tissue while running the model on a fraction of the tiles.
45. 【2610.32473】From Perception to Pixels: Human-Derived Visually Distinct Colors for Improved Dominant Color Extraction
链接：https://arxiv.org/abs/2610.32473
作者：Uldana Shyndali,Nurdaulet Toleugaliyev,Kuat Zharykbayev,Zarina Abildasheva,Pakizar Shamoi
类目：Human-Computer Interaction (cs.HC); Computer Vision and Pattern Recognition (cs.CV)
关键词：Dominant color extraction, color, computer vision, content recommendation, Dominant color
备注：
点击查看摘要
Abstract:Dominant color extraction is a fundamental task in computer vision, with applications in design, image retrieval, and content recommendation. However, conventional algorithms based on device-oriented color spaces (e.g., RGB) and fixed quantization often fail to capture how humans perceive color differences. In this study, we propose a human-perception-based framework for dominant color extraction, built on a novel Human Color Dictionary (HCD) derived from a perceptual experiment. Participants (n=110) were sequentially shown 120 colors and asked to identify those they perceived as unique. Based on their responses, we constructed a 120 by 120 co-occurrence matrix and applied a greedy selection algorithm to derive 64 perceptually distinct colors, forming the HCD. This dictionary was integrated into RGB color histogram and K-means color extraction algorithms by initializing centroids and mapping pixel values to their nearest perceptual color using the deltaE 00 distance. Evaluation on a dataset of 4,562 images paired with expert-designed palettes demonstrated that our method improves perceptual alignment, as measured by Earth Mover's Distance (EMD) and best-match distance. Our findings suggest no meaningful gender differences in the number of uniquely perceived colors, indicating that sex does not significantly influence color perception in this task. Another key finding is that highly saturated colors are perceived as the most distinguishable, whereas dark and deep colors tend to perceptually collapse and are less reliably differentiated. The results confirm that incorporating experimentally derived human color representations ensures the generated color clusters align more closely with human perception, thus improving the usability of color palette generation in practical applications.
46. 【2610.32472】Online Continual Learning in Edge-Cloud Applications
链接：https://arxiv.org/abs/2610.32472
作者：Charalampos Davalas,Dimitrios Michail,Christos Diou,Iraklis Varlamis,Konstantinos Tserpes
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：Deployed machine learning, cloud systems face, critical reliability bottleneck, full original training, Deployed machine
备注：
点击查看摘要
Abstract:Deployed machine learning models in real-world IoT and edge/cloud systems face a critical reliability bottleneck: the requirement for online adaptation to non-stationary data streams while operating without access to the full original training dataset. Performance is severely degraded when models encounter Out-of-Distribution (OOD) inputs or suffer from catastrophic forgetting. Addressing these challenges requires adaptation mechanisms capable of learning from evolving data streams while preserving previously acquired knowledge. This paper proposes an edge-cloud methodology for integrating Continual Learning (CL) with Out-of-Distribution (OOD) Detection and Concept Drift Detection in IoT applications. The methodology incorporates ODIN and ECDD as alternative mechanisms for identifying informative samples for annotation and triggering rehearsal-based model updates. Experimental results across automotive, healthcare, and agricultural datasets demonstrate the applicability of the proposed methodology and its potential to support model adaptation while mitigating catastrophic forgetting.
47. 【2610.32468】OPTARI: An open-source software framework for clinical translation of optoacoustic imaging
链接：https://arxiv.org/abs/2610.32468
作者：Moritz Schillinger,Maximilian Bader,Adrian Buehler,Felix Wachter,Ferdinand Knieling,Vasilis Ntziachristos,Katharina Breininger
类目：oftware Engineering (cs.SE); Computer Vision and Pattern Recognition (cs.CV); Medical Physics (physics.med-ph)
关键词：Combined optoacoustic, range of pathologies, promising modality, wide range, Combined
备注： 15 pages, 4 figures, 2 tables. Submitted to the Journal of Biomedical Optics. Code and documentation: [this https URL](https://mo-sc.github.io/OPTARI/)
点击查看摘要
Abstract:Combined optoacoustic (OptA) and ultrasound imaging is a promising modality across a wide range of pathologies. Its use in clinical research, however, is limited by a lack of analysis software accessible to users without programming expertise. Existing tools are either script-based engineering frameworks or proprietary vendor applications. We present OPTARI, an open-source graphical software application to facilitate large-scale clinical optoacoustic-ultrasound (OPUS) studies. OPTARI builds on the napari image viewer and the PATATO toolkit for OptA data processing. It supports native vendor and open HDF5 data formats, aligns with the IPASC standard, and is distributed as a standalone executable. Features include region-of-interest annotation, reconstruction, chromophore unmixing, deep-learning-based tissue segmentation, and temporal and spectral analysis modules. OPTARI offers a combination of features for clinical study analysis that none of the compared tools provide. The automated tissue segmentation produced results comparable to expert labeling for muscle tissue, and batch processing reduced analysis time from minutes to under one second per scan. The tool is used in ongoing clinical OPUS studies. OPTARI connects engineering frameworks with medical research and provides an open-source basis for reproducible and standardized analysis in clinical OptA imaging studies.
48. 【2610.32459】MDMR-Bench: A Multi-Dimensional Benchmark for Multi-Reference Image Generation
链接：https://arxiv.org/abs/2610.32459
作者：Bowen Zheng,Jintao Lin,Changheng Yi,Haoran Yang,Binxiao Huang,Chenyang Lei,Rui Liu,Xihui Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：multi-reference image generation, supporting generation conditioned, Image generation, multiple reference images, multi-reference image
备注： Bowen Zheng and Jintao Lin contributed equally to this work. Accepted at NeurIPS 2026, Evaluations Datasets Track
点击查看摘要
Abstract:Image generation models have rapidly advanced, with many models now supporting generation conditioned on multiple reference images and textual instructions. Such models enable a wide range of applications, including entity fusion and attribute transfer across images. However, existing benchmarks for multi-reference image generation rely on limited evaluation dimensions and fail to capture the diverse challenges of the task. To address this limitation, we propose MDMR-Bench, a Multi-Dimensional benchmark for Multi-Reference image generation. MDMR-Bench is organized around representative capability settings and consists of multiple evaluation subsets spanning diverse dimensions of multi-reference image generation, including (1) common entity fusion and attribute transfer, (2) multi-element extraction from a single image, (3) infographic manipulation, and (4) visual reasoning-intensive generation. This design enables systematic analysis of model capabilities and failure modes across different challenge dimensions. Furthermore, to achieve more reliable and interpretable evaluation, we introduce a checklist-based evaluation protocol that decomposes generation quality into fine-grained evaluation aspects. Instead of relying solely on holistic scoring, our framework uses structured checklists composed of both global-level and atomic-level queries, enabling more diagnostic assessment of model performance. By benchmarking both open-source and proprietary models, we demonstrate that MDMR-Bench provides fine-grained insights into model performance across different dimensions. The dataset and code are publicly available.
49. 【2610.32452】AutoMIL: Automated Multiple Instance Learning for Whole-Slide Image Classification
链接：https://arxiv.org/abs/2610.32452
作者：Jonas Waibel,Frank Kramer,Dominik Müller
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Developing multiple instance, interdependent design decisions, Developing multiple, multiple instance learning, multiple instance
备注：
点击查看摘要
Abstract:Developing multiple instance learning pipelines for the classification of whole-slide images involves many interdependent design decisions and expertise in both pathology and machine learning. We present AutoMIL, an open-source framework that applies principles from the field of automated machine learning to tackle this task by automating integral pipeline steps, such as preprocessing, training and evaluation. In a benchmark evaluation with default settings, AutoMIL reached ROC-AUC scores of 0.94 on UBC-OCEAN, 0.99 on PCam and 0.93-0.96 on a TCGA-NSCLC subset, comparable to specialised pipelines in related work. Ensembling mainly improved performance on imbalanced data, showing that an automated pipeline must adapt to dataset characteristics. AutoMIL thus provides an accessible baseline for whole-slide image classification without manual pipeline configuration.
50. 【2610.32442】Learning Fine-Grained Visual Classification with Text as Privileged Information via Multimodal Distillation
链接：https://arxiv.org/abs/2610.32442
作者：Aishwarya Venkataramanan,Christian Ickler,Joachim Denzler
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：highly similar categories, localized visual differences, requires distinguishing, focusing on subtle, distinguishing between highly
备注： 16 pages
点击查看摘要
Abstract:Fine-grained visual classification (FGVC) requires distinguishing between highly similar categories by focusing on subtle, localized visual differences. Recent multimodal methods have demonstrated that textual attribute descriptions can provide valuable semantic supervision by explicitly describing discriminative object characteristics. However, these descriptions are typically unavailable at test time, limiting their direct use in deployment. We propose FG-LUPI, a Learning Using Privileged Information (LUPI)-based framework that leverages attribute descriptions during training. We train a multimodal teacher that integrates image patches and textual attributes via gated cross-attention, allowing semantic attributes to condition visual representations. We distill this knowledge into an image-only student using multi-level distillation at the prediction, patch, and attention levels, aligning global predictions, patch representations, and attention patterns with the teacher. This encourages the student to inherit attention structure learned from multimodal supervision while maintaining image-only inference. Experiments on multiple FGVC benchmarks show consistent improvements in classification accuracy over strong ViT-based baselines. Furthermore, evaluation using Expected Calibration Error (ECE) shows that FG-LUPI also produces better-calibrated predictions across all six benchmarks. These results suggest that textual attribute supervision can benefit not only fine-grained recognition performance but also the reliability of model confidence, while preserving the efficiency and practicality of image-only inference.
51. 【2610.32440】PROVE: Probabilistic Visual Grounding via Patch-Level Evidence for Vision-Language Models
链接：https://arxiv.org/abs/2610.32440
作者：Mayank Nautiyal,Tianru Zhang,Li Ju,Ekta Vats,Prashant Singh
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：CLIP typically produces, deterministic relevance map, single deterministic relevance, Visual grounding, image-query pair
备注：
点击查看摘要
Abstract:Visual grounding with vision-language models such as CLIP typically produces a single deterministic relevance map for an image-query pair, without indicating whether the localisation is reliable or whether the referent is present at all. We introduce \textbf{PROVE} (\textbf{Pro}babilistic \textbf{V}isual Grounding via Patch-Level \textbf{E}vidence), a post-hoc evidential adapter that maps frozen CLIP patch features to per-patch Beta distributions without modifying the backbone. PROVE casts grounding as per-patch membership: each patch accumulates positive and negative evidence for whether it belongs to the referent, so a query may match zero, one, or many patches. We train PROVE with an evidential objective on soft patch-coverage targets, and define a prior-pull objective that keeps absent-referent examples near an uninformative prior, so that vacuity serves as an absence signal without a dedicated presence classifier. During inference, a single forward pass yields, in closed form, a posterior-mean grounding map, a spatial vacuity map, and an image-level absence score. We evaluate PROVE on referring-expression benchmarks: it is competitive in localisation with state-of-the-art CLIP grounding methods, its uncertainty tracks localisation error and supports selective prediction under abstention, and its image-level score detects when the referent is absent altogether. Our evidential patch-membership modelling offers a simple, drop-in mechanism for probabilistic verification in frozen vision-language grounding systems.
52. 【2610.32433】mpo-Zero: Recursive Self-Play in Executable Worlds for Video Reasoning
链接：https://arxiv.org/abs/2610.32433
作者：Jingmin Zhu,Yanyan Zou,Xiuyu Li,James Bailey,Dinh Phung,Tao Yu,Yunyun Hou,Jun Liu,Jun Zhou,Sirui Wang,Nan Duan,Jiachen Liu,Qiuhong Ke
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：reasoning requires understanding, unfold over time, expensive to collect, accurate temporal annotations, Video reasoning requires
备注：
点击查看摘要
Abstract:Video reasoning requires understanding how events unfold over time, yet videos with accurate temporal annotations are expensive to collect. Self-play offers an alternative by letting a model generate and solve its own tasks without manual annotation. However, existing video self-play methods train on fixed sets of recorded videos, so they cannot alter the underlying event dynamics and rely on noisy pseudo-labels derived from the model's own outputs, such as majority voting, that risk reinforcing shared model errors. To overcome these limitations, we introduce Tempo-Zero, a self-improvement framework that closes a loop of executable environments, execution-verified self-play, and environment evolution, where executing a program renders a video with the ground-truth option and interval of every question. A single policy plays both Questioner and Solver, proposing questions and answering them with timestamped evidence lines, and is trained on execution-grounded rewards instead of model consensus. The Solver's performance steers a curriculum over tasks and difficulty levels, and the policy selects rule changes that enrich the event dynamics of later rounds. Despite being trained solely on simple programs, without supervised fine-tuning or external video data which prior methods typically require, Tempo-Zero outperforms the base models and recent self-play baselines on average across twelve real-world video benchmarks at different model scales, with particularly strong gains on temporal grounding tasks. Project page: this https URL
53. 【2610.32423】Cycle-of-Thought: Self-Evaluative Iterative Reasoning for Table Visual Question Answering in Document Images
链接：https://arxiv.org/abs/2610.32423
作者：Somraj Gautam,Gaurav Harit
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Visual Question Answering, improved Visual Question, Question Answering, Visual Question, significantly improved Visual
备注：
点击查看摘要
Abstract:Recent advances in Vision-Language Models (VLMs) have significantly improved Visual Question Answering (VQA) performance, yet their reasoning over structured content such as tables remains inconsistent, often plagued by spatial misalignment and logical hallucinations. Existing approaches for improving table VQA typically rely on architectural modifications or expensive supervised fine-tuning (SFT), which impose high barriers to entry due to the need for large-scale, expert-annotated datasets and significant computational resources. In this work, we propose Self-RefineVQA, a training-free, inference-time self-correction framework that improves table VQA performance without additional labeled data or model updates. Inspired by human revision behavior, our method enables a single VLM to iteratively act as a generator, critic, and refiner, forming a closed self-feedback loop that corrects common reasoning errors through prompt-guided re-evaluation. Experiments on tabular VQA benchmarks demonstrate that Self-RefineVQA yields consistent accuracy gains in monolingual and cross-lingual understanding, with a particularly significant boost for small models, enabling lightweight models (e.g., 2B-7B parameters) to rival the performance of significantly larger counterparts. Furthermore, we provide a comparative complexity analysis demonstrating that while inference cost increases linearly, our framework offers superior data efficiency and a lower cumulative cost by eliminating the prohibitive annotation bottleneck of human labeling required for fine-tuning. Our results highlight the potential of prompt-based self-improvement as a scalable, accessible paradigm for reliable table reasoning in VLMs.
54. 【2610.32413】AlphaAnything: Extending Pretrained RGB Generators to RGBA
链接：https://arxiv.org/abs/2610.32413
作者：Qijie Wang,Zhixin Xu,Zhe Li,Haowei Zhu,Honghao Qiao,Bo Peng,Dawei Li,Bin Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Existing RGBA generation, methods commonly learn, Existing RGBA, decoding function inherited, RGBA generation methods
备注：
点击查看摘要
Abstract:Existing RGBA generation methods commonly learn a transparency-specific representation through reconstruction, introducing an additional training stage and potentially altering the RGB decoding function inherited from pretrained models. We present AlphaAnything, a lightweight framework that extends pretrained RGB generators to RGBA directly in their original latent space, without RGBA reconstruction pretraining. AlphaAnything inserts LoRA modules into the generative transformer and attaches an alpha branch to the frozen RGB VAE decoder. Unidirectional RGB-to-alpha feature sharing allows opacity supervision to shape the generative latent while guaranteeing that, for any fixed latent, RGB decoding remains identical to that of the pretrained decoder. We further introduce Endpoint-Aware Alpha Loss (EA Loss), which derives opacity supervision from the complementary foreground--background weights used in compositing. It supports exact opacity endpoints and continuous partial transparency while emphasizing localized alpha errors. Experiments on text-to-RGBA and image-to-RGBA tasks across multiple pretrained RGB backbones demonstrate competitive generation quality, and controlled ablations validate the shared-latent training design and EA Loss.
55. 【2610.32407】IE: Training-free CLIP Embedding Guidance for Compositional Text-to-Image Alignment
链接：https://arxiv.org/abs/2610.32407
作者：Sujung Hong,Tae Eun Choi,Youngjun Jun,Chanyong Yoon,Seong Jae Hwang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：satisfy prompt conditions, concept loss, concept, advanced notably, concept confusion
备注：
点击查看摘要
Abstract:Text-to-image (T2I) diffusion models have advanced notably, but still fail to satisfy prompt conditions, resulting in attribute mismatches and missing objects. These errors normally fall into two categories: concept loss, when an object or attribute (i.e., concept) goes missing, and concept confusion, when an attribute is assigned to the wrong object or multiple objects blend together. Recent studies suggest that these challenges are caused by the limited capacity of CLIP text encoder to capture fine-grained semantic details. Although several methods have been proposed, concept loss and concept confusion persist in recent T2I models when handling multi-object, multi-attribute prompts. In this paper, we conduct an embedding-level analysis to develop a training-free, inference-time solution for concept loss and concept confusion across CLIP-based T2I models. We find that (1) concepts mentioned later exhibit higher embedding entropy, reflecting less concentrated representations that are more often associated with concept loss, and (2) the first CLIP attention layer captures the strength of binding between each object and its attribute. Guided by our findings, we introduce TIE, a method that improves semantic alignment through a single text-embedding update. TIE addresses concept loss via entropy-aware singular value amplification and resolves concept confusion through interpolation-extrapolation binding based on CLIP attention scores, all in a training-free manner. Extensive experiments demonstrate that TIE enhances semantic fidelity in multi-concept scenarios with minimal sampling overhead. The project page is available at this https URL.
56. 【2610.32398】An Error Budget for Shuffled Multimodal Windows in the 3rd WEAR Challenge: Stacking, Count Constraints and Seam Matching
链接：https://arxiv.org/abs/2610.32398
作者：Soheil Kooklan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：WEAR Dataset Challenge, WEAR Dataset, Dataset Challenge, one-second window, count constraint
备注： 12 pages, 10 tables, 1 figure. Technical report on a post-deadline system for the 3rd WEAR Dataset Challenge at HASCA 2026. Code: [this https URL](https://github.com/soheilkooklan/wear-seam-decoder)
点击查看摘要
Abstract:The 3rd WEAR Dataset Challenge asks for an activity label for every one-second window of four unseen participants. Each window has 15 VideoMAEv2 frame embeddings, the accelerometer signal of one random limb, and the windows are shuffled. This report is an empirical analysis of one system built after the challenge deadline. Window classifiers are stacked with features averaged over per-participant graphs of video neighbours and scored successor candidates, and a mean-field style decoder with a soft count constraint per activity labels all windows of a participant together. The setting is offline and transductive, and the count constraint relies on each activity being performed once. In a participant-wise simulation with participant-level bootstrap intervals, stacking added 0.051 macro F1 over stage-1 fusion and the count constraint 0.011 (95% interval 0.006 to 0.017). A quadratic seam distance ranks the true same-limb successor first among about 720 candidates in 83.9% of cases, but adding it to the link model changed macro F1 by -0.0001 (-0.0006 to 0.0005). With the decoder settings and the mixing weight chosen inside the folds and the mislabelled spans left out of training, the system scores 0.936 in simulation (0.940 for participants who performed each activity once); the submitted configuration scores 0.938 (0.943). Per-participant scores range from 0.80 to 0.97. These results come from a non-nested stacking protocol that uses unlabelled features transductively, so they are not a fully inductive estimate. An oracle that averages the final unary scores over the true segments reaches 0.973, and 79% of the remaining errors involve the null class. On the private leaderboard, which no choice used, the selected Kaggle submission scored 0.9231 (public 0.9254, with bounds partly tuned there), and a later one with bounds chosen in simulation scored 0.9247 (public 0.9253).
57. 【2610.32396】Interactive image diagnosis using test-time backpropagation from the auxiliary task
链接：https://arxiv.org/abs/2610.32396
作者：Takuro Shimaya
类目：Computer Vision and Pattern Recognition (cs.CV); Medical Physics (physics.med-ph)
关键词：Multi-task deep learning, deep learning, developed to ensure, ensure explainability, explainability in computer-aided
备注： 8 pages, accepted to SPIE Medical Imaging 2025
点击查看摘要
Abstract:Multi-task deep learning has been developed to ensure explainability in computer-aided diagnosis (CAD) systems. These systems simultaneously predict interpretable characteristics of findings in auxiliary tasks to help radiologists assess the reliability of the diagnostic prediction. However, the CAD's opinion would not be referred to when the auxiliary task prediction deviates from the radiologist's expectation. To further leverage CAD's knowledge in the above situation, we proposed a multi-task gradient assist (MGA) method that brings interactivity to multi-task models without additional training. MGA allows radiologists to give feedback to the CAD and ask for additional diagnostic suggestions. Using two datasets of mammography and CT, we show that MGA successfully improves diagnostic accuracy upon feedback on various auxiliary tasks. Compared to an existing method using forward propagation only, MGA performs more robustly and can be combined to further improve accuracy. Our method paves a promising way for integrating artificial intelligence into image diagnosis.
58. 【2610.32390】PASTA: Prompt-Aware Annealed Diffusion Sampling
链接：https://arxiv.org/abs/2610.32390
作者：Ren Ajiki,Ryugo Morita,Stanislav Frolov,Brian Bernhard Moser,Ko Watanabe,Riku Takahashi,Andreas Dengel,Jinjia Zhou
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：models produce high-quality, design requires intentionally, Diffusion models produce, real-world visual design, visual design requires
备注： 15 pages, 4 figures, 2 tables. Accepted to ICONIP2026
点击查看摘要
Abstract:While Diffusion models produce high-quality images, real-world visual design requires intentionally preserving clean regions for headlines, logos, or UI elements. Existing layout-aware text-to-image methods struggle to strictly preserve reserved regions, often introducing unwanted content that complicates downstream editing. Existing approaches either manipulate attention to displace content or suppress conditioning via noise-level interventions. However, these methods sacrifice visual coherence, producing flat regions or noticeable style inconsistencies between reserved and non-reserved areas. To address this limitation, we propose a Prompt-Aware Shared-Latent Training-Free Annealed Diffusion Sampling (PASTA), a training-free framework that enforces reserved-region constraints by selectively applying semantic guidance to object-allowed regions during sampling. PASTA operates on a shared latent trajectory, where full-prompt and context-prompt guidance are fused through mask-guided sampling. An annealed schedule suppresses semantic leakage during early denoising stages while gradually restoring visual consistency in later stages. Extensive experiments demonstrate that PASTA improves reserved-region fidelity while preserving overall image realism and perceptual consistency.
59. 【2610.32381】UniWorld: A Unified World Model for Real-Time Visual World Simulation
链接：https://arxiv.org/abs/2610.32381
作者：Xin Zhang,Yabo Chen,Shuaiwei Wang,Zixuan Duan,Haibin Huang,Feng Xu,Xuelong Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：requires coupling evolving, temporally persistent appearance, coupling evolving scene, simulation requires coupling, requires coupling
备注：
点击查看摘要
Abstract:Continuous visual world simulation requires coupling evolving scene geometry with temporally persistent appearance. We present UniWorld, a unified framework that integrates depth trajectories and reference appearance within a shared video generation model. The central design maintains visual and geometric histories on a common timeline. Noise-aligned overlapping continuation places generated history at the prescribed sampling noise level and commits only newly generated latents. Rolling depth latent state preserves the corresponding geometric controls, incrementally reads newly available geometry, and keeps the conditioning fixed within each sampling window. Together, these mechanisms ensure exact preservation of latent history while bounding the active depth state by the window size. We evaluate continuous generation, paired history interventions, and long-horizon behavior across diverse scene categories. The same generator supports estimated, native, and on-demand simulator depth, while cached and incremental execution paths produce bitwise-identical outputs. Appearance changes and geometric control branches operate through the same interface without modifying committed history. The measured steady-state DiT execution path achieves real-time generation throughput, demonstrating the efficiency of UniWorld for continuous visual world simulation.
60. 【2610.32377】Sam-Correction: Fully Adaptive Label Noise Reduction for Medical Image Segmentation
链接：https://arxiv.org/abs/2610.32377
作者：Takuro Shimaya,Masahiro Saiko
类目：Computer Vision and Pattern Recognition (cs.CV); Medical Physics (physics.med-ph)
关键词：machine learning process, learning process, dramatic impact, machine learning, noisy ground truth
备注： 5 pages, accepted to IEEE International Symposium on Biomedical Imaging (ISBI) 2024
点击查看摘要
Abstract:The quality of the teacher label has a dramatic impact on the outcome of the machine learning process. Medical image segmentation often suffers from a noisy ground truth (GT) mask due to difficulties in consistent annotation. Although a recent study has proposed a promising method to curate the noisy GT mask, this requires additional well-curated GT masks that are not always accessible without the aid of multiple medical experts. As an alternative, we propose SAM-Correction, which utilizes a foundation model to correct the noisy GT mask in a fully adaptive manner instead of manually preparing well-curated masks. In our approach, we progressively mitigate label noise via the segment anything model (SAM), where prompts are given from another segmentation network that we train concurrently. Experiments with various types of label noise derived from actual human annotations demonstrate that SAM-C achieves precise noise reduction and high-performing segmentation models trained thereby. Our method paves the way for robust model training even when clean labels are entirely unavailable.
61. 【2610.32374】EigenGradCAM with AugSmooth: Enhancing Explainability and Precision in Multi-Stage Alzheimer's Disease Detection
链接：https://arxiv.org/abs/2610.32374
作者：Arsham Azam,Sagar Ashraf,Tayyaba Farhat,Rasikh Ali,Sheeraz Akram
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：progressive neurological disorder, cognitive decline, memory loss, behavioral disturbances, progressive neurological
备注：
点击查看摘要
Abstract:Alzheimer's disease (AD) is a progressive neurological disorder associated with memory loss, cognitive decline, and behavioral disturbances. Early and accurate diagnosis is essential, yet MRI-based deep learning models often lack interpretability, limiting their clinical use. This study presents an explainable deep learning approach for four-class AD staging using 2D axial MRI images. The method combines eigenvector-based Grad-CAM with gradient smoothing to improve saliency localization and heatmap stability. Principal component analysis is applied to gradient-weighted convolutional layers, while Gaussian noise is added to saliency weights before decomposition. To address class imbalance in the Moderate Dementia category, Wasserstein Generative Adversarial Network with Gradient Penalty (WGAN-GP) generates synthetic samples to balance the four-stage training distribution. Custom convolutional neural networks are trained on the Best Alzheimer MRI Dataset, achieving 97.2% test accuracy, 97.0% balanced accuracy, and a Matthews correlation coefficient of 0.944. The area under the ROC curve ranges from 0.96 to 0.99 across classes. Generated heatmaps highlight the hippocampus and entorhinal cortex, regions associated with Alzheimer's disease biomarkers. These findings suggest that the proposed approach combines strong classification performance with improved model interpretability, although further clinical validation is needed.
62. 【2610.32373】Past as State, Present as Attention: Persistent-State Blockwise Flow Matching for Long-Horizon Co-Speech Motion Generation
链接：https://arxiv.org/abs/2610.32373
作者：Yi Liu,Xiangyue Zhang,Jianfang Li,Jia Ma,Yisheng He,Jianqiang Ren
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Multimedia (cs.MM)
关键词：long horizons due, generation remains challenging, remains challenging, horizons due, temporal coherence
备注： Accepted at NeurIPS 2026. 38 pages, 10 figures, 17 tables
点击查看摘要
Abstract:Co-speech motion generation remains challenging over long horizons due to the need for temporal coherence and consistent style. Existing methods typically generate long motions segment by segment, either conditioning on a short seed of recent frames, which gradually drifts, or retaining ever-longer explicit histories, which are costly to maintain and hard to learn from limited data. We trace these limitations to a key asymmetry between past and present: past motion carries slowly varying style that should be compactly summarized, whereas the current segment exhibits fast-changing local dynamics that require fine-grained modeling. This asymmetry motivates a simple Past-As-State, Present-as-Attention principle for long-horizon co-speech motion generation. Following this principle, we propose PASPA, which summarizes past history with an inter-block persistent state and models the current segment with intra-block bidirectional self-attention. We instantiate PASPA within a blockwise flow matching framework, with multi-block supervision for effective training over variable histories, prefill-decode state caching for efficient rollout, and hybrid classifier-free guidance for enhanced history and speech conditioning. Extensive public-benchmark experiments show that PASPA achieves state-of-the-art FGD performance and preserves motion style across long-sequence generation.
63. 【2610.32369】A Regularity Condition Under Which a CPAB Transformation is a Diffeomorphism
链接：https://arxiv.org/abs/2610.32369
作者：Amit Aflalo,Oren Freifeld
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Continuous Piecewise-Affine Based, Piecewise-Affine Based, Continuous Piecewise-Affine, integrating continuous piecewise-affine, CPAB
备注：
点击查看摘要
Abstract:Continuous Piecewise-Affine Based (CPAB) transformations, introduced by Freifeld et al. (2015, 2017), are flows obtained by integrating continuous piecewise-affine (CPA) velocity fields. These expressive transformations have proven useful in applications including nonlinear temporal warping and trainable activation functions in 1D, as well as nonrigid spatial deformations in 2D and 3D. While computational costs were not an issue in 1D, they originally limited the practical expressiveness of CPAB transformations in higher dimensions, especially in 3D. Our recent work (Aflalo et al., 2026) removed this bottleneck, enabling efficient optimization with much finer tessellations and substantially greater expressiveness. There is, however, a mathematical subtlety that was overlooked in the original CPAB papers (Freifeld et al., 2015, 2017). CPAB transformations are always bi-Lipschitz homeomorphisms, implying that both the transformations and their inverses are differentiable almost everywhere. They are not, however, necessarily diffeomorphisms. This note remedies the omission by identifying sufficient regularity conditions under which a CPAB transformation is guaranteed to be a diffeomorphism. We explain how differentiability can fail and how the proposed conditions prevent this failure. In 1D and 2D, we show that these conditions can be easily enforced and, for commonly used tessellations, hold with probability one under standard sampling assumptions. We expect analogous behavior in 3D.
64. 【2610.32360】Search-Based Testing of Modality Sensitivity in Vision Language Models
链接：https://arxiv.org/abs/2610.32360
作者：Oliver Weißl,Eduardo Breitembach,Andrea Stocco
类目：Computer Vision and Pattern Recognition (cs.CV); Software Engineering (cs.SE)
关键词：predefined corruption levels, corruption levels, Vision-language models, assess only predefined, predefined corruption
备注：
点击查看摘要
Abstract:Vision-language models (VLMs) process images and text jointly, yet robustness evaluations often perturb these inputs separately or assess only predefined corruption levels. Such evaluations provide limited evidence of which modality is more susceptible to perturbations and whether smaller changes across both modalities can jointly expose failures. We present MoST, a black-box testing framework that characterizes modality sensitivity by comparing image-only, text-only, and joint perturbations. MoST uses multi-objective search to select and combine perturbations and adjust their severity, seeking prediction degradation while limiting changes to images and prompts. We evaluate MoST on four VLMs performing object localization on ImageNet and driving images. The models exhibit distinct sensitivities: textual perturbations dominate for some, whereas others are susceptible across both modalities. In several configurations, joint perturbations match or exceed the effectiveness of single-modality perturbations with smaller modifications to each input. In a human study, 60-76% of assessments across models judge the perturbed inputs sufficiently understandable to perform the task, and human localization is more accurate than that of the corresponding VLMs. These results show that evaluating modalities separately can overlook failure-inducing combinations and that modality sensitivity provides a more detailed account of VLM robustness than aggregate failure rates alone.
65. 【2610.32332】4DMemory: Benchmarking Long-Horizon Spatiotemporal Memory with Harness-Augmented Agents
链接：https://arxiv.org/abs/2610.32332
作者：Yanhao Jia,Yi Zhu,Yiran Zhong,Weigao Sun,Feida Zhu,Pengkun Jiao,Sihan Yang,Ming Ma,Steven Hoi,Erik Cambria
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM)
关键词：Humans efficiently process, efficiently process multimodal, process multimodal streams, multimodal streams spanning, Humans efficiently
备注： 22 pages, 5 figures
点击查看摘要
Abstract:Humans efficiently process multimodal streams spanning hours to years, building persistent, fine-grained spatiotemporal memories that support reasoning about and predicting long-horizon events. In contrast, existing benchmarks focus on short- and medium-context tasks, and most foundation models struggle to preserve fine-grained information over long horizons. To evaluate and improve long-horizon spatiotemporal reasoning, we introduce the LongVideo dataset and the 4DMemoryBench. LongVideo comprises about 900 hours of video and over 5,000 manually reviewed questions covering visual, textual, and spatiotemporal reasoning across diverse context lengths. We further develop the 4DMemory Harness, which integrates four complementary skills, 22+ specialized tool models, and a model-specific retrieval-augmented generation system. Evaluating 13 leading models, we find that standalone foundation models struggle with long-horizon tasks, while the 4DMemory Harness improves all of them by over 50\%. Compared to previous benchmark, the same models exhibit a performance drop of more than 10\% on 4DMemoryBench. We hope 4DMemory will facilitate the development of spatiotemporal agents capable of addressing complex, long-horizon tasks.
66. 【2610.32325】ChoreoStudio: Planning What, When, and Who in Music-Driven Group Choreography
链接：https://arxiv.org/abs/2610.32325
作者：Jing Xu,Cunjian Chen,Qiuhong Ke
类目：ound (cs.SD); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Music-driven group dance, group dance generation, Music-driven group, dancer moves, dance generation
备注：
点击查看摘要
Abstract:Music-driven group dance generation must decide not only how each dancer moves, but also what formation the group should form, when it should change, and who should execute each transition. Existing methods can generate orderly and rhythmically synchronized group motion, but remain limited in formation evolution and inter-dancer interaction. In human choreography, formation transitions often align with changes in high-level musical structure, such as the progression from an introduction to a chorus or from a chorus to a climax. We present ChoreoStudio, which makes choreography planning explicit. A music disentangler first decomposes the audio into frame-level rhythmic features and segment-level structural features. Given the segment-level features and sparse labels, a frozen omni-modal model acts as a scriptwriter, producing a global semantic description that guides the Director's choreography planning. Based on this context, the Director produces three coupled interaction decisions: a centroid-relative point set specifies what formation to produce, a transition gate determines when it should change, and a mobility allocation indicates who should execute the transition. The transition gate and mobility allocation are further conditioned on the planned geometric change, coupling formation targets with their temporal and dancer-specific execution. At a finer temporal scale, frame-aligned music features condition the diffusion generator to control detailed body motion and preserve beat-level alignment. The segment-level interaction plan is injected in parallel through frame-aligned instruction tokens and cross-dancer attention biases, coordinating how the generator realizes each transition. Experiments on AIOZ-GDance demonstrate that ChoreoStudio follows the planned interactions while achieving state-of-the-art performance in motion quality, group organization, and formation dynamics.
67. 【2610.32321】DeformStruct: Deformable Structure Modeling for Point-Supervised Temporal Action Localization
链接：https://arxiv.org/abs/2610.32321
作者：Mengnan Liu,Sanping Zhou,Kun Xia,Yonghao Dong,Jie Wang,Gang Hua
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：single annotated timestamp, aims to localize, localize action instances, structural organization, structural
备注：
点击查看摘要
Abstract:Point-supervised Temporal Action Localization (PTAL) aims to localize action instances using only a single annotated timestamp for each instance. Such sparse supervision offers limited guidance for modeling the structural organization of an action instance. Existing PTAL methods primarily infer action regions from classification responses, leaving the structural organization of multiple action-related parts within each instance insufficiently modeled. To address this problem, we propose DeformStruct, an instance-level deformable structure modeling framework for PTAL. DeformStruct progressively constructs the structure of each action instance through three stages. First, Structural Anchor Mining discovers multiple anchors from annotated points and action-responsive regions, providing structural nodes grounded in the current instance. Second, Deformable Part Alignment associates latent structural parts with these anchors through deformation-aware matching, allowing their temporal supports to adapt to instance-dependent variations. Third, Relational Structural Organization explicitly models the relative temporal relations among the aligned parts, forming a relational representation that characterizes how different action-related parts are organized together. Extensive experiments on THUMOS14, ActivityNet-v1.3, GTEA, and BEOID demonstrate consistent improvements in point-supervised temporal localization and validate the effectiveness of deformable structural modeling.
68. 【2610.32317】Organizing Temporal Evidence in Hyperbolic Space for Video Moment Retrieval
链接：https://arxiv.org/abs/2610.32317
作者：Mengnan Liu,Sanping Zhou,Kun Xia,Jiaxuan Lin,Gang Hua,Le Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Video moment retrieval, temporal evidence organization, untrimmed video, moment retrieval aims, temporal evidence
备注：
点击查看摘要
Abstract:Video moment retrieval aims to localize a query-relevant temporal segment in an untrimmed video. Existing methods typically perform video-text alignment in Euclidean space, where representations are embedded in a flat geometry. However, accurate moment localization requires organizing query-relevant evidence across multiple grounding states, where target regions, boundary transitions, and contextual distractors exhibit distinct temporal structures and relevance patterns. Such Euclidean representations lack an explicit geometry to jointly capture these relationships, motivating us to explore structured temporal evidence organization from a geometric perspective. Specifically, we propose Hyperbolic Temporal Evidence Organization (HTEO), a geometric framework that organizes query-aware temporal memory in hyperbolic space. HTEO maps temporal representations into a Poincaré ball and organizes temporal evidence through Radial Evidence Organization (REO) and Orthogonal Angular Refinement (OAR). REO adjusts temporal tokens' radial positions to encode the structural differences among temporal evidence, while OAR enhances query-conditioned semantic alignment through orthogonal rotation. The organized representation is then projected back to the Euclidean tangent space and injected into the decoder through a lightweight residual memory update, enabling hyperbolic geometric cues to be incorporated into standard Transformer decoders while preserving the original cross-modal memory. Furthermore, we introduce radial structure regularization and angular relevance supervision to explicitly guide temporal evidence organization and query-conditioned semantic alignment, respectively. Extensive experiments and analyses across multiple benchmarks demonstrate that HTEO improves temporal localization while providing an interpretable geometric organization of temporal evidence.
69. 【2610.32311】GeoLEON-CLIP: Graph-Anchored Multimodal Contrastive Learning for Geographic Region Representation
链接：https://arxiv.org/abs/2610.32311
作者：Radoslaw Malek,Szymon Soltysiak,Aleksandra Kawala-Sterniuk,Piotr Szymanski
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：captures visual morphology, describe urban context, conveys human-interpretable semantics, text conveys human-interpretable, Geographic regions
备注： Accepted at the 9th International Workshop on AI for Geographic Knowledge Discovery (GeoAI 2026), co-located with the 34th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (SIGSPATIAL 2026)
点击查看摘要
Abstract:Geographic regions are multimodal: satellite imagery captures visual morphology, text conveys human-interpretable semantics, and map structures describe urban context. Existing geospatial contrastive methods typically align image-text or image-location pairs, underusing structured map data. We introduce GeoLEON-CLIP, a graph-anchored contrastive framework that aligns three views of each H3-indexed region: an OpenStreetMap-derived graph embedding, a satellite image crop, and a textual description. Frozen pretrained LEON graph embeddings provide a semantic anchor between vision and language. Frozen graph, image, and text encoders are connected by trainable residual projection heads and trained with a symmetric tri-modal contrastive objective. Experiments show strong graph-image and graph-text alignment; graph-image retrieval achieves the best cross-modal performance in a mixed-resolution pool. To evaluate the anchoring hypothesis, we propose chained cross-modal recall $\mathrm{R}@A@B$, which routes retrieval through the graph modality and compares it with direct retrieval under a matched candidate budget. At $\mathrm{R}@1@1$, image$\rightarrow$graph$\rightarrow$text and text$\rightarrow$graph$\rightarrow$image outperform direct image-text retrieval by 4.8 and 4.4 points, respectively, despite using a single intermediate cell. Downstream probes show task-dependent gains, with the largest improvements on Airbnb and Beijing housing. These results indicate that OpenStreetMap graph structure can anchor multimodal representations combining maps, imagery, and language.
70. 【2610.32294】OlmoEarth v1.3: Embeddings
链接：https://arxiv.org/abs/2610.32294
作者：Gabriel Tseng,Favyen Bastani,Patrick Alan Johnson,Yawen Zhang,Piper Wolters,Ando Shah,Hadrien Sablon,Joseph Redmon,Heather DeHaven,Rachel Ratner,Sasha Levy,Jordan Steward,Katrina Midgley,Andrew Howe,Hunter Pitelka,Ted Schmitt
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：OlmoEarth, embeddings, Abstract, make, train
备注：
点击查看摘要
Abstract:We make some OlmoEarth embeddings. To do this, we train a new model: OlmoEarth v1.3. OlmoEarth v1.3 is designed to condense multimodal, multitemporal remote sensing data into a single digestible 64 or 128-dimensional vector. OlmoEarth v1.3 produces state-of-the-art embeddings. In addition, OlmoEarth v1.3 is a strong encoder backbone -- competitive with OlmoEarth v1 and v1.2 -- while requiring 18% and 53% of the GPU hours to train, respectively. We use OlmoEarth v1.3 to compute global, annualized 10m embeddings, which we release under the OlmoEarth artifact license.
71. 【2610.32293】Complementing DINO Features with Image Structure for Part Discovery
链接：https://arxiv.org/abs/2610.32293
作者：Samyak Rawlekar,Nikhil Chowdary Paleti,Amey Gupta,Narendra Ahuja
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Self-supervised Vision Transformers, Self-supervised Vision, Vision Transformers, DINO encode rich, encode rich semantics
备注：
点击查看摘要
Abstract:Self-supervised Vision Transformers (ViTs) like DINO encode rich semantics, enabling training-free segmentation of objects from the background and discovery of their parts via feature clustering. This paper focuses on part discovery: partitioning a foreground object into semantic parts. Existing approaches produce imprecise part boundaries. We trace this to the rigid ViT patch grid used in training DINO, where patches straddling boundaries contain pixels from multiple parts. While DINO's invariance-based training could absorb this pixel-level mixing into clean features, experiments with over 26K foreground patches show it does not: boundary-overlapping patches produce features with higher entropy and lower assignment confidence, blurring predicted part boundaries. Rather than make the massive effort of retraining DINO over geometrically coherent regions, an easier approach is to take boundaries directly from a boundary detector, which supplies the geometric information DINO's features lack. Motivated by this, we introduce Part-DINO, a training-free framework that combines boundaries from low-level image segmentation with DINO's semantic features. We use the boundaries to partition the image into regions, pool DINO features within each region, and group them to discover parts. Without any training, Part-DINO produces structurally coherent part assignments, outperforming training-free baselines across four standard benchmarks (CUB, CelebA, PartImageNet-OOD, PartImageNet-Seg) and remaining competitive with weakly-supervised and unsupervised methods.
72. 【2610.32289】ReLEAP: Upcycling Vision Datasets through Cross-Task Unification and Semi-Supervised Annotation
链接：https://arxiv.org/abs/2610.32289
作者：Julia Simon,Daniel Steininger,Andreas Trondl
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Developing robust vision, variable environmental conditions, requires large amounts, involving fine-grained class, fine-grained class distinctions
备注： Accepted at Asian Conference on Computer Vision (ACCV) 2026. Code and models available at [this https URL](https://github.com/releap-vision/releap)
点击查看摘要
Abstract:Developing robust vision models requires large amounts of annotated data, especially for tasks involving fine-grained class distinctions under variable environmental conditions. Even in domains with numerous existing datasets, differences in annotation formats, label definitions and targeted learning tasks hinder data reuse and integration. To address this challenge, we introduce ReLEAP, a scalable Python framework for unifying heterogeneous image datasets through data-source abstraction, systematic reuse of annotations across learning tasks, and mapping of labels to a shared hierarchical taxonomy. We demonstrate its applicability in precision agriculture by integrating fifteen diverse datasets covering a broad range of plant species and annotation types. Beyond unification, ReLEAP enables systematic recycling of existing data and provides a robust foundation for learning-based annotation upcycling. Leveraging this foundation, we conduct extensive cross-dataset and fine-tuning experiments to investigate how domain-specific models trained on unified data and foundation models can be used to automatically generate higher-level annotations under unsupervised, weakly supervised and semi-supervised settings, and how dataset characteristics influence their effectiveness. Our results show that unified data access and annotation upcycling substantially expand the pool of reusable training data and annotations while improving data transparency, enabling more sustainable and resource-efficient use of existing datasets. We release the framework and trained models for academic use to support accessible and collaborative research, particularly in data-scarce and heterogeneous domains.
73. 【2610.32282】Polyp-VSSD: A Pre-trained Transformer with Local-Global Joint VSSD Decoding for Polyp Segmentation
链接：https://arxiv.org/abs/2610.32282
作者：Xiaobo Zhu,Shiwei Wu,Yu An,Yuechen Tao,He Sun,Song Zhang,Zhenyu Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：preventing colorectal cancer, computer-aided diagnosis systems, making accurate polyp, Early detection, accurate polyp segmentation
备注：
点击查看摘要
Abstract:Early detection of colorectal polyps is essential for preventing colorectal cancer, making accurate polyp segmentation a key component in computer-aided diagnosis systems. However, existing endoscopic segmentation methods often exhibit limited representational capacity and insufficient integration of global and local contextual information. To address these limitations, we propose Polyp-VSSD, a novel local-global joint decoding framework built upon a pre-trained Transformer backbone for high-precision polyp segmentation. Polyp-VSSD leverages the strong feature expressiveness of large-scale visual pre-training and unifies global semantic modeling with local fine-grained reconstruction to enhance segmentation fidelity. Extensive experiments on multiple public endoscopic datasets demonstrate that our approach significantly outperforms state-of-the-art methods in both Dice and IoU. On the EndoScene dataset, Polyp-VSSD achieves mIoU and mDice scores of 0.903 and 0.946, respectively, highlighting its robustness and strong generalization capability. This work presents an effective and scalable solution for intelligent endoscopic image analysis.
74. 【2610.32275】RootDown: Deploying and Benchmarking Models for Beet-Root Detection on Edge Devices
链接：https://arxiv.org/abs/2610.32275
作者：Gerardus Croonen,Andreas Trondl,Julia Simon,Daniel Steininger
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：optimal processing efficiency, ensure optimal processing, preserve sugar content, processing efficiency, harvest and storage
备注： Accepted at MLCSA Workshop at Asian Conference on Computer Vision (ACCV 2026). Benchmark, code and models available at [this https URL](https://github.com/semanticsugarbeets/rootdown)
点击查看摘要
Abstract:Quality inspection of sugar beets after harvest and storage is critical to preserve sugar content and ensure optimal processing efficiency. The transfer of harvested beets to field clamps or trucks provides an opportunity to visually inspect individual beets automatically on loader conveyors. However, this is a challenging task as the large number of beets causes partial overlap and occlusion, complicating both annotation and detection. In this work, we propose an end-to-end image-based pipeline for detecting partially occluded sugar beets in loading scenarios as a first step toward automated quality inspection. We introduce a dedicated benchmark and present an automatic annotation strategy that leverages the SAM 3 foundation model to generate bounding boxes. We compare models trained on manually annotated and automatically generated labels. Additionally, we investigate deployment considerations by benchmarking multiple inference configurations, including execution on an edge device, under realistic operational constraints regarding precision, inference time and power consumption. Our results show that, despite substantial occlusion and inherent annotation ambiguity, foundation-model-based labels can substitute for a substantial share of manual annotation, trading labeling effort for data volume at a modest accuracy cost. Furthermore, we demonstrate that a Raspberry Pi 5 equipped with a Hailo accelerator enables high-performance, low-power inference, making it a practical solution for mobile outdoor deployment.
75. 【2610.32268】RVG-Bench: A Benchmark for Reasoning-Driven Audio-Visual Temporal Grounding
链接：https://arxiv.org/abs/2610.32268
作者：Yue Feng,Boshen Xu,Zihao Yue,Xiaokun Liu,Miao Yang,Xin Tao,Pengfei Wan,Qin Jin
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：descriptive text queries, Existing temporal video, benchmarks primarily focus, Existing temporal, primarily focus
备注： 42 pages, including appendices. Project page: [this https URL](https://fyrisk.github.io/RVG-Bench/)
点击查看摘要
Abstract:Existing temporal video grounding (TVG) benchmarks primarily focus on localizing target video segments according to descriptive text queries of the visual content. However, real-world queries are more diverse and often require the model to first understand the user's intent before localization, such as finding visual evidence, identifying the cause of an event, or recalling a remembered moment, yet such queries remain largely overlooked. To mitigate this gap, we introduce RVG-Bench, a benchmark for reasoning-driven audio-visual temporal grounding, where every query is constructed such that the target segment can only be identified through reasoning about the query's underlying intent. We carefully construct the benchmark and rigorously verify its data quality to ensure models truly comprehend the audio-visual content. RVG-Bench comprises 1,255 videos and 1,890 query-interval pairs across eight reasoning types. We evaluate 22 models and find that the strongest, Qwen3.8-Omni-Flash, achieves only 49.6 mIoU. Through a series of controlled analyses, including oracle-grounding probes and test-time scaling experiments, we systematically examine where and why current models struggle, providing insights for future model development.
76. 【2610.32266】Hyperparameter-Free Boundary-Interior t-vMF Dice Loss for Medical Image Segmentation
链接：https://arxiv.org/abs/2610.32266
作者：Hinako Mitsuoka,Kazuhiro Hotta
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：t-vMF Dice Loss, medical image segmentation, Class imbalance, Dice Loss, Adaptive t-vMF Dice
备注：
点击查看摘要
Abstract:Class imbalance and errors near anatomical boundaries remain challenges in medical image segmentation, motivating loss functions that account for these difficulties. Adaptive t-vMF Dice Loss adjusts the similarity function during training but requires hyperparameter tuning. We propose Self-Tuned Boundary-Aware t-vMF Dice Loss (STB-tvMF Dice), which adapts the function separately for boundary and interior regions without tuning shape-adaptation parameters. Each region's shape parameter of t-vMF function is determined from its mean prediction-target cosine similarity in the preceding epoch and remains fixed throughout the current epoch. This rule maximizes the slope of the similarity function at the observed mean similarity, providing a principled basis for adaptation without validation-based parameter selection. Experiments on three datasets and architectures demonstrated its effectiveness. On Synapse with U-Net, STB-tvMF Dice achieved a mean DSC of 70.75%, compared with 63.03% for Adaptive t-vMF Dice Loss. Our code will be available soon.
77. 【2610.32263】LapaFM: A Laparoscopic Foundation Model via Multi-Stage Continual Learning
链接：https://arxiv.org/abs/2610.32263
作者：Xiaobo Zhu,Shiwei Wu,Yu An,Yuechen Tao,He Sun,Song Zhang,Jianbo Wang,Xiaojing Wang,Junwei Liu,Wei Guo,Yanfei Shao,Xuan Zhao,Jiangwei Xiao,Wenbo Niu,Bo Wei,Yuhan Wang,Gang Hu,Fei Liu,Kunshan He,Chongwei Chi,Jianqiang Tang,Kang Zhang,Jie Tian,Zhenyu Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Artificial intelligence-based analysis, improve surgical decision-making, Artificial intelligence-based, decision-making and precision, intelligence-based analysis
备注：
点击查看摘要
Abstract:Artificial intelligence-based analysis of intraoperative laparoscopic videos has the potential to improve surgical decision-making and precision. However, effective surgical assistance requires models that can generalize across diverse intraoperative tasks. Here we present LapaFM, a foundation model for laparoscopic surgery trained on more than 20,000 minutes of surgical videos using a multi-stage continual learning strategy that mitigates catastrophic forgetting and inter-task interference. LapaFM learns multimodal visual representations and supports multiple tasks, including smoke removal, surgical phase recognition, instrument and polyp segmentation, and lesion identification. The model was evaluated on 13 retrospective and two prospective cohorts collected from different imaging devices. LapaFM consistently outperformed task-specific models and existing foundation models across datasets, and also generalized to gastrointestinal endoscopy tasks, including polyp detection and classification. Notably, it recovered over 90% of smoke-obscured frames and achieved clinician-level or superior performance in lymph node metastasis prediction and prospective polyp classification.
78. 【2610.32262】Beyond Pattern Matching in 3D MLLMs: Part-Level Functional Reasoning for Generalizable Recognition
链接：https://arxiv.org/abs/2610.32262
作者：Weihong Li,Hao Jiang,Yaohua Zha,Tao Dai,Shu-Tao Xia
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：MLLMs recognize objects, similar objects require, Geometric Confusion Score, objects require functional, geometrically similar objects
备注：
点击查看摘要
Abstract:3D MLLMs recognize objects via pattern matching, which fails when geometrically similar objects require functional reasoning to disambiguate (e.g., dresser vs. wardrobe). Our per-sample Geometric Confusion Score (GCS) exposes this failure: baseline accuracy is 33.7% on ModelNet40's most ambiguous 20% versus 84.0% on its least ambiguous 20%. We identify a function-as-annotation pattern, in which functional language decorates a known identity instead of supporting inference, and hypothesize that reversing this information flow should concentrate improvements on the most ambiguous samples. PFIR (Part-level Functional Inference for Recognition) reverses that flow. Built on PartNeXt part segmentation, its data pipeline produces 507K QA pairs with functional CoTs (geometry $\to$ function $\to$ identity), and its progressive curriculum culminates in dual-objective GRPO: strict functional reasoning and descriptive grounding for Objaverse's diverse distribution. The two RL objectives yield nearly orthogonal task vectors ($\cos = 0.056$), enabling composition via Task Arithmetic. Under a strict dual OOD protocol (Objaverse $\to$ ModelNet40; XYZRGB $\to$ XYZ-only), PFIR raises zero-shot accuracy from 60.5% to 66.7%, with gains concentrated $2.6\times$ more on geometrically ambiguous samples---supporting part-level functional reasoning as an effective route to more generalizable 3D recognition. Code: this https URL.
79. 【2610.32256】Representation Learning via Composite Subspace Flow Matching
链接：https://arxiv.org/abs/2610.32256
作者：José Afonso,Mário Figueiredo
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Distilling semantic meaning, raw image data, image data remains, Distilling semantic, meaning from raw
备注： 27 pages, 4 figures
点击查看摘要
Abstract:Distilling semantic meaning from raw image data remains a challenge in machine learning. Current self-supervised paradigms face a trade-off: joint-embedding architectures produce relevant features by aggressively discarding intra-class variance, irreversibly spatial and reconstruction. Conversely, generative models preserve spatial details but struggle to isolate semantics, as their optimization is dominated by pixel variations. To bridge this divide, we propose composite subspace flow matching (CSFM). Rather than corrupting data with unstructured isotropic noise, CSFM formulates representation learning as the variance-minimizing inversion of a deterministic degradation curriculum across spectral, color, and illumination subspaces. By bounding trajectory variance with hard temporal style truncation, a capacity-constrained encoder is driven to ignore transient style artifacts and encode persistent content. Empirical evaluations across CIFAR-10, CIFAR-100, and STL-10 show that CSFM yields competitive discriminative transferability while preserving generative synthesis across both convolutional and vision transformer architectures. By avoiding the collapse pathologies of non-generative methods, CSFM forms a smooth latent space that outperforms standard optimal transport flows on linear probing and few-shot classification, while enabling coherent synthesis and trajectory interpolation. These results confirm that steering the physical dynamics of generative flows offers a scalable paradigm for learning representations that are simultaneously linearly separable and generatively invertible.
80. 【2610.32250】Easy-3Dfy: Object-Level Geometric Composition for Single-Image 3D Scene Construction
链接：https://arxiv.org/abs/2610.32250
作者：Ziang Zhang,Wenyou Yi,Zehan Wang,Jiachen Xu,Xintong Han,Chunchao Guo,Zhou Zhao
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：fundamental problem, Single-image, scene, object, Abstract
备注：
点击查看摘要
Abstract:Single-image 3D scene construction is a fundamental problem in 3D vision. Recent methods such as SAM-3Dfy enable end-to-end reconstruction of 3D assets and their scene layouts, but still struggle with fine-grained scene geometry and asset quality. Meanwhile, specialized 3D object generators provide detailed object geometry, while 3D foundation models offer strong and generalizable spatial understanding. We propose Easy-3Dfy, a compositional workflow that decouples object generation from scene layout estimation, allowing specialized models to fully exploit their respective strengths. An RPF-based aligner then bridges these capabilities by establishing geometric correspondence between object-local meshes and partial scene pointmaps, recovering object layout for scene composition. Without requiring complete scene-level supervision, the proposed workflow consistently outperforms SAM-3Dfy across multiple geometric metrics on Scene-Maker and 3D-FUTURE200. Our results demonstrate that explicit geometric composition can effectively combine high-quality object generation with strong spatial understanding, while enabling the workflow to benefit independently from advances in both 3D object generation and foundation models.
81. 【2610.32233】Share: Training-Free Acceleration of Overlapping Tiled ViT Decoding
链接：https://arxiv.org/abs/2610.32233
作者：Xiangzhong Ye,Zhongshen Li,Shen You,Ziyang Meng,Liang Xu,Junkai Ji,Qiuzhen Lin,Xiangtao Li,Ka-Chun Wong
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Fixed-window Vision Transformer, Fixed-window Vision, Vision Transformer, full decoder instances, run at deployment
备注： 8 pages main paper + supplementary material
点击查看摘要
Abstract:Fixed-window Vision Transformer (ViT) decoders run at deployment resolution as overlapping tiles: every token in an overlap band is processed by several full decoder instances. In the 2.4B-parameter MiniMax-H3 video decoder, about half of all per-token computation is duplicated. Removing the tiles fails because attention, global tokens and coordinates are bound to them. TileShare keeps each released tile's attention and computes every other operation once per token. The released computation changes at one kind of step only: an overlap token's per-tile results are blended into one shared state with the released weights. Interventions show that this blend costs quality where attention reads the shared states, mainly in the first few layers, which TileShare therefore keeps per tile. Without training, keeping six layers per tile decodes 1.38-1.51x faster than batched and compiled tiling on two GPU types (up to 1.96x with FP8) and is equivalent to the released decoder in PSNR, LPIPS and DISTS on DAVIS videos. On unseen UVG videos with the setting frozen beforehand, it matches PSNR and DISTS and improves LPIPS. TileShare carries over to two further decoders and is again confirmed on unseen data. It is equivalent in PSNR and DISTS on MAGI-1. On the ViTok-v2 image autoencoder at 2K-4K, it matches overlapping tiling in PSNR, improves LPIPS and DISTS and decodes 1.5-1.8x faster. How many layers stay per tile is measured once per model (for decoders, without labels); we report it for 14 decoders and encoders. Optionally, two GPU-hours of self-distillation let MiniMax-H3 share every layer without a loss in PSNR, and a coordinate field trained while the network stays frozen brings fully shared CLIP-based open-vocabulary segmentation to parity with sliding windows on seven benchmarks.
82. 【2610.32230】owards Effective and Transferable Physical Camouflage against Multi-View BEV-based 3D Perception in Autonomous Driving
链接：https://arxiv.org/abs/2610.32230
作者：Linye Lyu,Jiawei Zhou,Daojing He,Yu Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Modern autonomous driving, autonomous driving systems, driving systems widely, systems widely adopt, Modern autonomous
备注：
点击查看摘要
Abstract:Modern autonomous driving systems widely adopt multi-view Bird's-Eye-View (BEV) based 3D perception models due to their superior performance. Despite their success, the robustness of these models against adversarial camouflage attacks remains largely unexplored. Existing camouflage attacks primarily target single-view 2D detectors, limiting their effectiveness in multi-view 3D perception settings. To address this gap, we propose BEVCA, a novel adversarial camouflage generation framework tailored for multi-view BEV-based 3D perception. Our framework integrates a BEV-feature-based adversarial loss with a multi-view neural rendering module, enabling effective and transferable camouflage attacks across different models and tasks. Extensive experiments in both digital and physical settings demonstrate that BEVCA outperforms state-of-the-art baselines and exhibits strong robustness under real-world conditions. Our code is available at this https URL.
83. 【2610.32222】ACWM-RM: A Reference-Free Reward Model from Complementary Mismatch Preferences
链接：https://arxiv.org/abs/2610.32222
作者：Shibo Hong,Siyu Ren,FengJiao Chen,Zhongyuan Peng,Wei Shi,Yixin Cao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：enables reward-driven optimization, Reinforcement learning, generated videos, videos, improving action-conditioned world
备注：
点击查看摘要
Abstract:Reinforcement learning has gained attention for improving action-conditioned world models (ACWMs), as it enables reward-driven optimization of visual quality (VQ) and action-following fidelity (AF) beyond flow-matching optimization. Realizing this potential requires reward signals that reliably rank videos by both VQ and AF. However, existing rewards capture only one dimension: metric-based rewards assess VQ but require ground-truth videos and do not directly assess AF, while inverse dynamics model (IDM) rewards assess AF without references but do not guarantee VQ. Moreover, IDMs, typically trained on real videos, may provide unreliable rewards for generated videos containing visual artifacts and physical inconsistencies. In this work, we introduce the Action and Video Mismatch Benchmark (AVM-Eval), comprising 67.2k pairs that evaluate how reliably IDMs assess AF on real and generated videos. We then propose ACWM-RM, a reward model that jointly assesses VQ and AF without ground-truth videos during reward computation. To train it, we first construct the Action and Video Mismatch Preference Dataset (AVM-Pref) with 506.3k pairs providing complementary supervision: action-mismatch pairs supervise AF, while video-mismatch pairs supervise VQ and expose the model to generated videos. We then pretrain an action-conditioned predictor on real videos to learn forward dynamics before jointly training it with a patch-weighted score head on AVM-Pref to transfer these dynamics to AF assessment on generated videos. Evaluation on AVM-Eval reveals the limited reliability of IDMs on generated videos, while downstream RL experiments show that ACWM-RM outperforms reward baselines in both criteria.
84. 【2610.32220】Angular Supervision for Visual Object Grounding in Autoregressive Vision-Language Models
链接：https://arxiv.org/abs/2610.32220
作者：Parsa Esmaeilkhani,Longin Jan Latecki
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Autoregressive vision-language models, correct image regions, ground generated text, poor spatial explanations, spatial explanations due
备注：
点击查看摘要
Abstract:Autoregressive vision-language models (VLMs) struggle to ground generated text in the correct image regions, and existing explainability methods, such as attention maps and Logit Lens, often produce poor spatial explanations due to weak text-to-vision attention and sink tokens. We propose \textbf{Angular Relevance} ($R_L$), a simple visualization measure based on cosine similarity between visual token embeddings and unembedding-matrix rows. Because $R_L$ is invariant to token norm, it produces substantially sharper and more faithful heatmaps than attention maps or Logit Lens on out-of-the-box models. Without any training, $R_L$ yields competitive referring-expression segmentation (RES), outperforming prior diagnostic maps and CLIP-based training-free methods. To preserve localized object information during cross-modal mixing, we introduce \textbf{Angular Object-Aware Loss (AOL)}, an auxiliary loss that directly supervises visual token embeddings to align angularly with the vocabulary directions of their corresponding object concepts. Finetuning with AOL alongside the standard next-token prediction objective significantly sharpens object localization in heatmaps, showing that the VLM's own visual tokens can be used directly for grounding and improving RES, without training any segmentation heads and without degrading general VQA performance. We further demonstrate that the learned grounding also transfers to category-level segmentation of object categories not seen during training.
85. 【2610.32207】Benchmarking Data-Free Continual Model Merging for Whole-Slide Image Survival Analysis
链接：https://arxiv.org/abs/2610.32207
作者：Vu Minh Tran,Doanh C. Bui,Maï K. Nguyen,Khang Nguyen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：previously learned information, preserving previously learned, sequentially arriving cancer, whole-slide images, learned information
备注：
点击查看摘要
Abstract:Continual survival analysis on whole-slide images (WSIs) requires models to integrate knowledge from sequentially arriving cancer cohorts while preserving previously learned information. Model merging offers a data-free alternative by combining independently fine-tuned task experts without retaining previous training data. However, the relative behavior of different merging strategies for WSI-based survival prediction remains insufficiently understood. In this work, we establish an end-to-end benchmark for data-free continual model merging, covering task-specific fine-tuning, sequential merging, and inference under both TASK-IL and CLASS-IL settings. We systematically evaluate six representative merging strategies across four TCGA cancer cohorts and three task orders using C-index, IPCW C-index, Forgetting, and Backward Transfer under a controlled protocol. Results show that no merging strategy consistently dominates across all evaluation criteria, while censoring-aware evaluation can substantially alter the relative ranking of the compared methods. This benchmark provides a unified foundation for developing and evaluating more effective continual model merging methods for WSI-based survival analysis.
86. 【2610.32203】Neural Disjunctive Normal Forms for Learning Exact Rank Filters
链接：https://arxiv.org/abs/2610.32203
作者：Diego Marcondes,Wonder A. L. Alves,Ronaldo F. Hashimoto
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：locally sparse derivatives, Gradient-based learning, hindered by locally, locally sparse, structuring elements
备注： 12 pages, 4 figures, 2 tables
点击查看摘要
Abstract:Gradient-based learning of morphological operators is hindered by locally sparse derivatives with respect to the structuring elements. We develop a method for learning rank filters that retains exact operator evaluation while distributing the derivatives across the window. Using threshold decomposition, we construct a neural disjunctive normal form representation and establish a sufficient condition for exactness with integer-valued images and structuring elements. We then derive a smooth surrogate from the unique root of a smooth threshold equation. Implicit differentiation gives closed-form derivatives with normalised local weights, whose distribution is controlled by a smoothing parameter. These derivatives are used in a straight-through procedure: the forward pass evaluates the exact rank filter, while the backward pass uses the surrogate. For fixed ranks, the procedure learns real-valued structuring elements of any rank filter, including the median, and extends to compositions, infima, and suprema of rank filters. Experiments on image denoising using MNIST and Fashion-MNIST and retinal vessel segmentation show that, starting from a generic random initialisation, the proposed approach consistently improves performance over training with exact subgradients in every setting. In image denoising, our best network also outperforms smooth morphological networks in all settings. On vessel segmentation, the learned erosions recover structuring elements that fit the vessels, as theoretically expected, whereas most of those trained with exact subgradients remain close to their initialisation.
87. 【2610.32200】DS-BiCA-Net: Pair-Preserving Cross-Temporal Modeling for Remote Sensing Change Captioning
链接：https://arxiv.org/abs/2610.32200
作者：Licheng Zhang,Naveed Akhtar,Siew-Kei Lam
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Remote sensing image, image change captioning, sensing image change, Remote sensing, change captioning
备注：
点击查看摘要
Abstract:Remote sensing image change captioning (RSICC) describes in natural language the semantic changes between two images of the same scene captured at different times. Previous methods commonly merge the pair during repeated processing or combine intra-image and cross-image relations in one operation, weakening source identity and leaving the two temporal directions implicit. Without separate modules for intra-image and cross-temporal processing and a separate path for each direction, the contribution of each part cannot be measured on its own, so it remains unclear which part matters most, and the design of later models has no such evidence to build on. To address these issues, we propose DS-BiCA-Net, which assigns the two kinds of processing to separate modules and keeps the two images as separate streams throughout the encoder. A windowed state-space module models context within each image, and a bidirectional cross-attention module compares the two images along two directed paths that share their projections. The two modules use the same pre-normalisation residual architecture and differ only in their mixers, and the two streams are fused only in the aggregation head, so each module and each direction can be removed and its contribution measured on its own. Controlled experiments on LEVIR-CC and Dubai-CC examine operator interaction, temporal direction and module order, showing that intra-image refinement carries no benefit alone and becomes beneficial only when followed by bidirectional cross-attention, an order that outperforms the reverse at matched parameter count and FLOPs. The bidirectional module also outperforms either temporal direction alone. Our method reaches an S_m^* of 82.65 on LEVIR-CC, the highest among the published results compared, and 66.72 on Dubai-CC without geometric augmentation, the second-highest among the published results compared.
88. 【2610.32182】Depth-Dependent Safety Geometry in Vision-Language Models: Layer-Wise Localization and Bidirectional Refusal Control
链接：https://arxiv.org/abs/2610.32182
作者：Muhammad Zeeshan Karamat,Syed Talal Hassan,Christiana Chamon Garcia
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Cryptography and Security (cs.CR); Machine Learning (cs.LG)
关键词：Vision-Language Models, remain poorly understood, widely deployed, poorly understood, behavior remain poorly
备注： Accepted at the NeurIPS 2026 Workshop
点击查看摘要
Abstract:Vision-Language Models (VLMs) are widely deployed, yet the internal mechanisms behind their safety behavior remain poorly understood. We present a lightweight inference-time framework for localizing and manipulating safety-sensitive representations in frozen VLMs, without retraining or modifying parameters. On Qwen3-VL-4B, layer-wise activation divergence analysis reveals non-uniform safety geometry across depth. Causal interventions show that early vision layers support strong bidirectional refusal control through activation steering along a learned safety direction, with unsafe rejection spanning 6%-96%, whereas later layers respond more to activation magnitude scaling and exhibit a substantial safety-selectivity trade-off. Deeper layers remain well separated along the safety direction yet are largely insensitive to steering, distinguishing representational separability from causal controllability. InternVL2.5-4B shows qualitatively similar depth-dependent activation geometry despite differences in layer location and magnitude. Our results expose a white-box, representation-level refusal-bypass attack surface in VLM vision encoders and motivate inference-time stabilization of safety-sensitive representations.
89. 【2610.32179】Searching with Sparse Histories: Cross-Task Architecture Search from Incomplete Search Logs and Zero-Cost Proxies
链接：https://arxiv.org/abs/2610.32179
作者：Yuefeng Xu,Jun Yu
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Neural and Evolutionary Computing (cs.NE)
关键词：Neural architecture search, Neural architecture, previous tasks, reduce costs, costs by reusing
备注：
点击查看摘要
Abstract:Neural architecture search (NAS) is expensive, but cross-task transfer can reduce costs by reusing knowledge from previous tasks. However, existing methods struggle with sparse search histories and task-specific transfer failures. We propose a method, a risk-robust strategy that combines sparse source logs with zero-cost proxies through champion-based initialization and joint pairwise-ranker pretraining. On TransNAS-Bench-101, the proposal mitigates severe worst-case failures, reducing worst-10% ranks from 290 to 43 for Micro autoencoding and from 465 to 45 for Macro room layout. Across 13 cell-space targets, it outperforms a proxy-only ranker on 10 targets in both mean and worst-case performance, while maintaining competitive average performance.
90. 【2610.32177】$Ψ$-0.6: Adaptive Streams of Thought in a Unified Vision-Language World Model
链接：https://arxiv.org/abs/2610.32177
作者：Khai Loong Aw,Klemen Kotar,Baihan Zhang,Yifan Liu,Lilian Chen,Atlas Kazemian,Rahul Venkatesh,Daniel Yamins
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：problem unfolds, Humans reason, flexibly combining, combining different forms, forms of inference
备注：
点击查看摘要
Abstract:Humans reason about the physical world by flexibly combining different forms of inference as a problem unfolds. Achieving this flexibility is a major open challenge in AI: capabilities often remain separated across specialized models, limiting how they can be composed and jointly adapted to a task. We introduce $\Psi$-0.6, a unified vision-language world model that adaptively composes perception, language, geometry, and simulation within a shared reasoning process we call streams of thought. These streams interleave images, text, and explicit representations of geometry and motion, all of which the model can generate and interpret through a shared token interface. $\Psi$-0.6 surpasses leading open-weight models zero-shot on multi-view spatial reasoning, with further gains from reasoning through geometric intermediates. It also supports counterfactual simulation: generating and interpreting imagined scenes to determine, for example, whether moving an object would obstruct a pathway. Reinforcement learning from task feedback jointly optimizes the selection, generation, and use of intermediate representations, improving visual question-answering accuracy with gains that transfer to unseen benchmarks. $\Psi$-0.6 offers a path toward adaptive physical reasoning -- not only predicting the physical world but also choosing the representations through which to reason.
91. 【2610.32174】Real-Time Localisation of Dorsal Anatomical Regions on Dairy Cows in Commercial Rotary Parlours from RGB-D
链接：https://arxiv.org/abs/2610.32174
作者：Vineet Prasad,Shiron Melvin,Sheikh Azid,Hai Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Automated monitoring, cows increasingly measures, increasingly measures, measures one part, dairy cows increasingly
备注： 9 pages, 7 figures, 3 tables. Submitted to ACRA 2026
点击查看摘要
Abstract:Automated monitoring of dairy cows increasingly measures one part of the body, such as the rump for temperature or the back for posture, yet the region itself is usually placed by hand. Existing systems either score the cow as a whole or detect sparse keypoints, often in controlled walkways, and neither yields the named region masks that such measurements need on a crowded commercial rotary platform. We present a perception front end that finds the target cow, ten bony landmarks and four named dorsal regions (withers, back, rump and tail-head) in a single forward pass over a whole RGB-D frame from a commercial rotary parlour. Two encoders, one for colour and one for depth, are fused late and share one decoder with three heads. On an anatomical region dataset that we built on public rotary-parlour RGB-D images (538 annotated frames, cow-disjoint test set), the network reaches PCK@10 0.905 for landmarks and region IoU 0.70 to 0.91, and runs end to end in 26.4 ms per frame on a T4 GPU, against an 11 fps camera. Dense region supervision is what makes the landmarks accurate: removing the region head costs 0.15 PCK@10. Agreement between the two heads flags unreliable frames without labels. On our own rig at the largest dairy farm in Western Australia, the model transfers with ten labelled frames (PCK@10 0.84), and its regions are carried through depth into a radiometric thermal camera, giving one repeatable temperature per region and cow.
92. 【2610.32163】Forging Emotions: a deep learning experiment on emotions and art
链接：https://arxiv.org/abs/2610.32163
作者：Amalia Foka
类目：Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC)
关键词：Affective computing, studies computational methods, affect generation, Generative Adversarial Networks, interdisciplinary field
备注： 10 pages. Published in Artnodes no. 31 (2023), Universitat Oberta de Catalunya, under CC BY 4.0. Extended version of a paper presented at ISEA 2022, Barcelona
点击查看摘要
Abstract:Affective computing is an interdisciplinary field that studies computational methods that relate to or influence emotion. These methods have been applied to interactive media artworks, but they have focused on affect detection rather than affect generation. For affect generation, computationally creative methods need to be explored that have recently been driven by the use of Generative Adversarial Networks (GANs), a deep learning method. The experiment presented in this paper, Forging Emotions, explores the use of visual emotion datasets and the working processes of GANs for visual affect generation, that is, for generating images that can convey or trigger specified emotions. This experiment concludes that the methodology used so far by computer science researchers to build image datasets for describing high-level concepts such as emotions is insufficient and proposes utilizing emotional networks of associations according to psychology research. Forging Emotions also concludes that to generate affect visually, merely corresponding to basic psychology findings, such as bright or dark colours, does not seem adequate. Therefore, research efforts should aim to understand the structure of trained GANs and compositional GANs in order to produce genuinely novel compositions that can convey or trigger emotions through the subject matter of generated images.
93. 【2610.32159】Playing Bias: Epistemic Games for Interpreting Text-to-Image Models
链接：https://arxiv.org/abs/2610.32159
作者：Amalia Foka
类目：Computers and Society (cs.CY); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)
关键词：shaping recognition, recognition through pose, circulate defaults, render prompts, audits quantify disparities
备注： 11 pages. Accepted at iLRN 2026, the 12th International Conference of the Immersive Learning Research Network, Athens, Greece, June 2026. Video presentation: [this https URL](https://www.youtube.com/watch?v=n_4MiKG5sjw)
点击查看摘要
Abstract:Text-to-image (T2I) systems do not merely render prompts; they circulate defaults for "what X looks like," shaping recognition through pose, camera, costume, props, and setting. While technical audits quantify disparities, they rarely cultivate the literacy needed to argue how images assemble stereotypes and confer authority. This paper translates a three-stage, humanities-informed framework into a set of epistemic games that make this cultural work visible and debatable: Interpret (art-historical close looking with AI outputs), Interrogate (counter-intent prompting as artistic exploration), and Expose (creative misuse through paired prompts with a constant motif and a BiasSlot rule, in which only the bias cue varies). In a pilot with undergraduate fine-arts students, the games shifted discussion from impressionistic reactions to concise, warranted hypotheses grounded in visual evidence, supported by lightweight classroom instruments that enabled reproducibility and structured collaboration. We argue that such game-based approaches foster critical literacy across educational contexts, equipping learners to recognize, discuss, and contest how T2I models encode bias.
94. 【2610.32146】Separating Angular Alignment from Radial Ordering in Hyperbolic Vision-Language Models
链接：https://arxiv.org/abs/2610.32146
作者：Mingyang Gao,Yuwei Wu,Shiyu Luo,Wei Wu,Xiaomeng Fan,Qihao Lv,Haoyu Zhang,Rui Gao,Bingzhen Liu,Zhi Gao,Che Sun
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：enabling low-distortion representations, volume grows exponentially, hyperbolic volume grows, Hyperbolic vision-language, multimodal data
备注： 34 pages, 12 figures
点击查看摘要
Abstract:Hyperbolic vision-language models are well suited to modeling the hierarchical structure of multimodal data, because hyperbolic volume grows exponentially with radius, enabling low-distortion representations of tree-like taxonomies from general to specific concepts. However, existing pretraining objectives for hyperbolic vision-language models entangle semantic alignment with entailment modeling, forcing radial coordinates to simultaneously encode semantic matching and hierarchical structure, leading to conflicting geometric constraints. In this paper, we introduce AURORA, a hyperbolic vision-language framework that decouples the objectives through angular alignment and a novel Radial-Angular Order Cone (RAOC) for entailment modeling. Angular alignment captures semantic similarity while preserving the radial structure for representing hierarchies. Unlike conventional entailment cones, RAOC determines angular allowance from relative parent-child radial gaps. It is incorporated into hierarchical entailment contrastive training to capture partial-order relations. We further introduce a norm regularization term that prevents undesirable radial degeneration for stable training. We train models on millions of image-text pairs and evaluate them across zero-shot classification, image-text retrieval, hierarchical reasoning, and compositional understanding. Our model consistently outperforms strong Euclidean and hyperbolic vision-language baselines, demonstrating the effectiveness of decoupling semantic alignment from hierarchical entailment modeling.
95. 【2610.32132】SyncPro: Synchronous Reasoning and Responding for Proactive Streaming Video Understanding
链接：https://arxiv.org/abs/2610.32132
作者：Xueyun Tian,Bingbing Xu,Jiaming Liu,Jinpeng Yu,Yang Shi,Yu Zhao,Ruihua Huang,Yuanzhuo Wang,Huawei Shen
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：track unfolding events, video understanding requires, understanding requires assistants, streaming video understanding, understanding requires
备注：
点击查看摘要
Abstract:Proactive streaming video understanding requires assistants to track unfolding events and respond when a user's requested condition is met. To make these decisions, assistants must accumulate relevant evidence and reassess response conditions as new observations arrive. Existing work offers complementary capabilities for this process: proactive video assistants learn when to respond, while streaming video reasoning methods generate scheduled intermediate text to organize observations and support subsequent answers. Together, these capabilities provide a foundation for proactive reasoning, but how to coordinate ongoing reasoning with timely responses remains underexplored. In a direct adaptation, fixed reasoning intervals can trigger updates when nothing relevant has changed or postpone useful updates until the next scheduled step. Sharing one generation path also couples two distinct requirements: preserving evidence for future decisions and producing only the response requested by the user. Moreover, responses generated after reasoning must wait for it to finish, even when sufficient evidence is already available. To address these challenges, we introduce SyncPro, a synchronous dual-stream framework with specialized generation paths for evidence tracking and user-facing responses. Its Inner and Response branches share causal history and activate independently, allowing relevant evidence changes to trigger internal updates and responses to proceed concurrently with ongoing reasoning. We construct 189K dual-stream examples and train SyncPro through supervised fine-tuning followed by trajectory-level reinforcement learning. Experiments across three proactive benchmarks show improved response timing and more accurate answers to user requests.
96. 【2610.32126】Data Quality in RVL-CDIP: A Systematic Audit
链接：https://arxiv.org/abs/2610.32126
作者：Stefan Larson,Kevin Leach
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：facto standard benchmark, facto standard, standard benchmark, RVL-CDIP, document classification
备注：
点击查看摘要
Abstract:RVL-CDIP is the de facto standard benchmark for document classification, and reported accuracy on it is now 98.8%. In this paper, we audit RVL-CDIP for data quality issues and find that approximately 10.5% of its 400,000 documents have erroneous labels and that 35.2% of the test set has a duplicate or near-duplicate in the training set. Identification codes on the pages are sufficient to classify at 69% accuracy, and a state-of-the-art model loses 11 points without them. Image-only models trained on RVL-CDIP lose 16 to 28 points on documents from other sources, and the choice of OCR engine changes accuracy by 4.1 to 8.3 points. We find that nearly 16,000 RVL-CDIP documents contain sensitive personal data, and produce de-identified versions of these documents. We re-benchmark 25 models, and with all defects remediated, the 13 that we retrain are 0.9 to 2.9 points more accurate than in the original condition; the most accurate of them, LayoutLMv3, is 96.5% accurate. We release the corrected corpus, the annotations and the out-of-distribution data.
97. 【2610.32120】ImageRSI: Verification-Driven Recursive Self-Improvement for Agentic Image Generation
链接：https://arxiv.org/abs/2610.32120
作者：Shuo Han,Zhilin Wang,Peng Ling,Wenjia Gong,Yang Liu,Guanjun Jiang,Yukun Cao,Xike Xie
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：requests remain difficult, satisfy reliably, remain difficult, difficult to satisfy, requests remain
备注：
点击查看摘要
Abstract:Complex text-to-image requests remain difficult to satisfy reliably. Verifying and repairing an image can fix an individual output, but a successful repair does not necessarily carry over to other requests. We present ImageRSI, a framework that keeps the image generator frozen and combines three components: five-dimensional verification and repair within each task, an experience library shared across tasks, and offline updating of the judge. Candidate experiences enter the library only after paired A/B validation, and the judge is updated with supervised fine-tuning and GRPO on accumulated image-judgment records and evaluated before reuse. We also introduce ImageReq-Bench, a benchmark of 961 requests built around hard cases in real-world image-generation requests, each paired with an evaluation checklist. ImageRSI achieves a Checklist Strict Accuracy (CSA) of 52.6% on MindBench (with Nano Banana Pro as the generator) and 65.66% on ImageReq-Bench, and we compare system outcomes across judge-training configurations.
98. 【2610.32094】 in VLA Models: Exploring Training with Human Demonstrations
链接：https://arxiv.org/abs/2610.32094
作者：Qiangong Zhou,Jiafeng Liang,Yimin Dong,Yang He,Hongxiang Li
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Long-horizon robot tasks, tasks require retaining, robot tasks require, Long-horizon robot, past information
备注： 22 pages, 6 figures, a techreport form standard-robots company
点击查看摘要
Abstract:Long-horizon robot tasks require retaining and using past information. We integrate Test-Time Training (TTT), which stores context in fast weights, into InternVLA-A1 and Pi0.5 to study action generation conditioned on human demonstrations through training on paired demonstrations and robot trajectories. We implement memory transfer between the two phases and truncated backpropagation, and examine training objectives, gradient coverage, and contrastive regularization across video, short-video, and single-frame cue tasks. In our experiments, adding TTT and training on paired data at the current scale did not lead to consistent target selection based on demonstrations. Under the tested settings, shorter sequences, full trajectory gradient connectivity, and contrastive regularization did not clearly improve responsiveness to demonstrations. When demonstrations were reduced to single-frame cues, real-robot execution still showed a preference for cups at fixed positions. We document the implementation, training configurations, and observations to support further inspection and replication.
99. 【2610.32075】RADIANT: Object-Centric Feed-Forward Global Illumination
链接：https://arxiv.org/abs/2610.32075
作者：Sarah Zhang,Zhiyang Dou,Minghao Guo,Benjamin Tod Jones,Wojciech Matusik
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Machine Learning (cs.LG)
关键词：neural renderers synthesize, runtime ray tracing, renderers synthesize global, Feed-forward neural renderers, synthesize global illumination
备注：
点击查看摘要
Abstract:Feed-forward neural renderers synthesize global illumination across novel 3D scenes without per-scene optimization or runtime ray tracing. Existing transformer-based renderers tokenize individual triangles, so self-attention scales quadratically with mesh resolution. Yet macroscopic radiative transport is governed by the underlying surface geometry and object arrangements rather than a particular mesh discretization; finer tessellation can thus inflate token counts without changing the underlying transport physics, motivating a discretization-agnostic and object-centric representation. We introduce RADIANT (RADiance-based Inter-Actor Neural Transformer), an object-centric architecture for feed-forward global illumination from point inputs. By representing each object with a compact budget of 32 surface-patch tokens, RADIANT decouples attention sequence length from polygon counts. In a single network, an inter-object scene transformer models 3D radiative exchange and a view decoder renders images at target camera poses. To capture light transport without materializing O(N^2) bias matrices, invariant form-factor attention embeds geometric distances and surface orientations directly into query-key dot products as SE(3)-invariant inner products weighted by learned area and material gains. For primary visibility without mesh connectivity, camera rays cross-attend scene tokens guided by depth-tested point splats in a shared spherical frame. Across a 1.03M-scene benchmark under matched model capacity, RADIANT reaches 25 dB tone-mapped PSNR in 5x fewer training steps than RenderFormer, and achieves 32.2 dB at 600k steps (+3.3 dB over RenderFormer and +7.6 dB over RenderFormer-V2). We further demonstrate the scalability of RADIANT, which completes a 512x512 forward pass of a 500-object scene in 0.83 s, with computational cost scaling with the number of objects rather than polygons.
100. 【2610.32073】Guided Zero-Shot Anomaly Explanation for Anonymized Crowd Video Monitoring: Context, Categorization, and Spatial Localization
链接：https://arxiv.org/abs/2610.32073
作者：Mulugeta Weldezgina Asres,Lei Jiao,Christian Walter Omlin
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：remains a challenge, promising development, development of deep, deep learning, models remains
备注： 21 pages, 12 figures, 13 tables, preprint
点击查看摘要
Abstract:Despite the promising development of deep learning for video anomaly detection (VAD), explainability (XAI) of these models remains a challenge. Explainable and privacy-protecting VAD builds transparency and trust that facilitates adoption of computer vision systems, including safety and security monitoring. However, anomaly explainability in privacy-preserving VAD systems is underexplored. In this study, we present the XAVAD approach, a unified descriptive anomaly XAI for an anonymized VAD, that integrates flexible zero-shot anonymization, anomaly type categorization, visual localization, and scene context description. We provide empirical and qualitative assessments of multifaceted explanations integrated with full-body visual anonymization for privacy protection. We adopt a multimodal CLIP embedding for videos, using improved LLM-assisted prompting and pool-scoring mechanisms for anomaly-type identification. We enhance Grad-ECLIP for spatial anomaly heatmap localization, leveraging computation and accuracy through our novel prompt-guided patching autofocus mechanism. We employ VLMs to generate context and reasoning descriptions of detected anomalies through curated prompt engineering. We have evaluated the accuracy and computational cost of XAVAD on several publicly available CCTV and video datasets. Our experiments demonstrate substantial gains of our XAVAD over state-of-the-art benchmark approaches and provide insights into privacy protection trade-offs in XAI for VAD. We further present ablation studies and assessments across diverse configurations and modeling alternatives to demonstrate the efficacy of our proposed methods. Code: this https URL}{this https URL .
101. 【2610.32059】Concept Acupuncturist: An Efficient and Precise Concept Erasure Method for Diffusion Models via Sparse Autoencoders
链接：https://arxiv.org/abs/2610.32059
作者：Yiran Xiahou,Siliang Qin,Kai Chen,Shengzhi Zhang,Renyang Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Machine Learning (cs.LG)
关键词：models produce high-quality, selectively remove target, motivating machine unlearning, remove target concepts, preserving general capabilities
备注：
点击查看摘要
Abstract:Diffusion-based image generation models produce high-quality images but may generate harmful or policy-violating content, motivating machine unlearning (MU) to selectively remove target concepts while preserving general capabilities. However, existing MU approaches often struggle with the distributed and entangled nature of concept representations, leading to inefficient optimization and imprecise edits when applied through large-scale fine-tuning over full diffusion trajectories. To bridge this gap, we propose Concept Acupuncturist (ConceptACP), a novel MU framework that integrates interpretability-guided analysis with inference-free fine-tuning for efficient and precise concept removal. By establishing mappings between semantic concepts and cross-attention blocks in the U-Net denoiser and localizing the most concept-relevant block for targeted optimization, ConceptACP avoids full diffusion trajectory optimization, thereby improving fine-tuning efficiency. To mitigate concept entanglement, we propose a feature-level correction mechanism based on Sparse Autoencoders (SAEs), where SAE-derived sparse, semantically meaningful feature activations are manipulated to construct targeted correction signals, which are then projected back to the output space of the corresponding block and used as supervision for precise concept removal. Consequently, ConceptACP eliminates the need for external inference-time modules while achieving efficient and fine-grained unlearning. Instantiated on SDXL-Turbo, ConceptACP improves the forgetting success rate by 36.34 percentage points in the standard one-step generation setting on average over the best-performing baseline, while preserving image quality and prompt fidelity, and generalizes effectively across other Stable Diffusion backbones. Our code is available at this https URL.
102. 【2610.32058】ACVA-Bench: Beyond Prompt Following in Abstract Concept Visualization Ability for Text-to-Image Models
链接：https://arxiv.org/abs/2610.32058
作者：Mengyan Wang,Jiyuan An,Yining Liu,YaoWen Zhang,Liner Yang ang Erhong Yang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：achieved remarkable progress, prompting growing research, literal prompt matching, growing research interest, abstract concepts
备注：
点击查看摘要
Abstract:Text-to-image (T2I) models have achieved remarkable progress in image quality and instruction following, prompting growing research interest in their capacity for deep understanding that goes beyond literal prompt matching. However, without an explicit visual scheme provided, it remains unclear and has not been systematically evaluated whether T2I models can autonomously translate abstract concepts lacking a fixed visual referent, such as "loyalty," into visual representations that are accurate, diverse, and distinguishable from closely related concepts. We define this capability as Abstract Concept Visualization Ability (ACVA) and introduce ACVA-Bench, a category-balanced benchmark grounded in psycholinguistic norms of abstract concepts, which examines models' ACVA along three dimensions semantic sufficiency, representational diversity, and conceptual distinctiveness under a low-intervention setting that withholds concrete objects, scenes, or visual metaphors. Since abstract concepts lack a unique reference image, conventional evaluation metrics that rely on reference-image matching are difficult to apply. To address this, we propose a fine-grained visual-semantic evaluation method constrained by concept semantics, which decomposes concept semantics into independently verifiable visual-semantic questions to assess the semantic representation quality of generated images, with its validity further confirmed by human evaluation. Benchmarking results on mainstream T2I models show that these models rely on a small set of prototypical visual patterns, leaving room for improvement in representational diversity and conceptual distinctiveness for abstract concepts, thereby providing an interpretable and reproducible evaluation foundation for future research.
103. 【2610.32042】X-Dubbing: Speech-to-Speech Translation under Temporal and Visual Constraints
链接：https://arxiv.org/abs/2610.32042
作者：Jeongsoo Choi,Ji-Hoon Kim,Junseok Ahn,Joon Son Chung
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)
关键词：Cross-lingual dubbing aims, Cross-lingual dubbing, convert source speech, aims to convert, remains synchronized
备注：
点击查看摘要
Abstract:Cross-lingual dubbing aims to convert source speech into target-language speech that remains synchronized with the original video. The key to this task is to produce a faithful translation that is naturally speakable within the source timing, which is non-trivial because languages differ in duration, rhythm, and articulation. In this paper, we propose X-Dubbing, which formulates the task as a joint problem of time-aware speech-to-text translation and video-aware text-to-speech. Specifically, our method consists of a Dubbing Translator that generates temporally structured scripts and a Voice Actor that renders them in synchrony with the source video, both grounded in a language-agnostic timing budget. We further refine the translator with dubbing-aware feedback from the synthesized speech, encouraging scripts that yield well-synchronized dubbing. This design requires no paired dubbing data, as the two components are trained on speech-text and monolingual audio-visual data respectively. Extensive experiments show that X-Dubbing outperforms recent baselines across diverse metrics, including isochrony and audio-visual correspondence.
104. 【2610.32041】NUViT: Vision Transformers for Fourier Space Data
链接：https://arxiv.org/abs/2610.32041
作者：Jeffrey Gu,Robert C. Heeter,Ellen D. Zhong
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：demonstrated strong performance, computer vision tasks, natural image domain, demonstrated strong, strong performance
备注：
点击查看摘要
Abstract:Vision Transformers (ViTs) have demonstrated strong performance in many computer vision tasks but do not naturally extend beyond the natural image domain. One important example is Fourier-space data, which is used to represent a rich and diverse set of modalities, including medical imaging and microscopy. Standard ViT tokenization partitions an image into square patches on a Cartesian grid, which poorly fit the frequency and phase structure of Fourier-space data. We introduce Non-Uniform ViT, a simple, general-purpose vision transformer that redesigns image tokenization, data representation, and positional encoding to respect this structure. Experiments on Fourier-domain image classification, 2D crystal lattice identification, MRI annotation, and cryo-EM protein heterogeneity analysis show that NUViT consistently captures the structure of Fourier data better than standard architectures.
105. 【2610.32039】Rethinking Representation Geometry in Supervised Contrastive Learning under Long-Tailed Data
链接：https://arxiv.org/abs/2610.32039
作者：Joonhyeok Jeong,Jy-yong Sohn,Kibok Lee
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)
关键词：Supervised contrastive learning, regular simplex, regular simplex geometry, Supervised contrastive, variants have demonstrated
备注：
点击查看摘要
Abstract:Supervised contrastive learning and its balanced variants have demonstrated their effectiveness for representation learning under long-tailed distributions. However, although prior analyses suggest that their optimal representations may exhibit a regular simplex geometry, whether such a geometry is indeed exhibited remains insufficiently understood. In this work, we present a theoretical framework for these objectives that characterizes whether a regular simplex is formed at the optimum. By applying this to representative objectives, we show that these objectives fail to form a regular simplex at the optimum because they remain dependent on the number of samples per class. Motivated by this analysis, we introduce structural balancing that can be applied to contrastive objectives, and propose a fully balanced contrastive objective that provably forms a regular simplex geometry at its optimum. Both theoretical and empirical results demonstrate that the proposed method yields a more balanced representation space and improves performance on long-tailed recognition and transfer learning tasks.
106. 【2610.32013】MAGIC: Margin-gated Contrastive Debiasing with Evidence Restoration for VLM Test-time Robustness Scaling
链接：https://arxiv.org/abs/2610.32013
作者：Shunshun Gu,Enze Zhang,Ming Pei,Hang Zhou,Xiao Luo
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：large vision-language models, test-time robustness scaling, mitigate language bias, vision-language models, paper studies
备注：
点击查看摘要
Abstract:This paper studies the problem of test-time robustness scaling for large vision-language models (LVLMs), which aims to mitigate language bias during inference. Existing approaches typically adopt test-time scaling techniques such as contrastive decoding to improve inference performance. Despite the progress, the performance of these approaches is far from satisfactory due to intentional evidence removal during perturbations and redundant inference cost. Towards this end, we propose a novel approach named Margin-gated Contrastive Debiasing with Evidence Restoration (MAGIC). The core of our MAGIC is to evaluate the decision margins of LVLMs to selectively activate textual and visual perturbation branches for efficient debiased inference. In particular, our MAGIC first measures the prediction margins of crucial tokens, and applies a gating function to identify low-confidence responses that are susceptible to language biases. For selected samples, we integrate the token logits from multiple textual and image perturbation branches with the original ones for debiased decision. More importantly, we selectively restore the most informative corrupted views with sharp prediction distributions for ambiguous samples after debiasing, enabling evidence recovery for discriminative decision-making. We further utilize a calibration dataset to actively identify and prune ineffective branches during contrastive debiasing for cost reduction. Extensive experiments on benchmark datasets validate the effectiveness of the proposed MAGIC in comparison with extensive baselines.
107. 【2610.31986】OpenHome: From Perception to Insight in Smart-Home Camera Videos
链接：https://arxiv.org/abs/2610.31986
作者：Xianglong Wang,Neil Rodrigues,Pei Guo,Yiru Fang,Kevin Beussman,Shuyang Wang,Jingzhi Wang,Liangju Li,Shunyao Xu,Zhongwei Cheng,Wei Li,Lin Chen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Vision language models, Vision language, interpret recorded videos, consumer smart-home camera, smart-home camera systems
备注：
点击查看摘要
Abstract:Vision language models (VLMs) have been increasingly adopted in consumer smart-home camera systems to interpret recorded videos and provide insights. However, video clips captured from smart-home cameras are different from curated web videos dominating existing VLM benchmarks. Smart-home video clips often do not contain subtitles or narration and are captured from different viewing angles, under various lighting conditions, and in diverse scenarios. However, the capabilities of the model in this domain, under sparse visual signals and limited context, are not fully assessed by existing VLM benchmarks. To close this gap, we introduce OpenHome, a visual-only, four-option multiple-choice benchmark for evaluating smart-home video understanding. It contains 2,254 questions on 1,118 real-world video clips and organizes 10 tasks into three capability levels. Perception evaluates visible content, Reasoning evaluates causal, spatial, and temporal relationships, and Insight evaluates subject intent, supporting evidence and appropriate homeowner responses. Based on the dataset, we describe the task design, data pipeline and evaluation protocol, and report results for 32 closed-source and open-weight VLMs. The best model, Gemini 4 Argon, reaches 81.2% overall accuracy. Frontier closed-source models outperform open-weight models on every level. The best closed-source model leads the best open-weight model by 16.3% on Perception, 22.4% on Reasoning and 37.4% on Insight.
108. 【2610.31983】Interpreting Physics in Video Encoders using Multi-Object Interaction Videos
链接：https://arxiv.org/abs/2610.31983
作者：Ayushi Mehrotra,Sai Vidyaranya Nuthalapati
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：latent holds bounds, policy plans, latent, plans by rolling, agent can plan
备注：
点击查看摘要
Abstract:Video encoder models are increasingly used as world models for physical AI, where a policy plans by rolling out the latent, so what physics the latent holds bounds what the agent can plan over. Moreover, existing interpretability work probes quantities belonging to a single object; the quantities that make physics relational, such as momentum transfer, restitution, and friction, are defined between bodies and have not been examined. We probe relational physics attributes in two frozen self-supervised video encoders (V-JEPA2 and VideoMAE) under two-body settings and test if they transfer across environments. Our early findings are mixed. Both encoders separate elastic from inelastic collisions reliably. V-JEPA2's own predictor is less likely to predict a collision that creates kinetic energy compared to one that loses it. Momentum-violation detection appears in only one of the two encoders, a kinetic-energy readout survives a change of environment for V-JEPA2 but not for VideoMAE, and neither model holds a friction coefficient that survives a change of geometry.
109. 【2610.31979】Spectra: Multi-Scale Implicit Decomposition for Deepfake Detection
链接：https://arxiv.org/abs/2610.31979
作者：Dhananjaya Jayasundara,Kartik Narayan,Vishal M. Patel
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：unseen manipulation techniques, increasingly undermine trust, Deepfakes increasingly undermine, compression levels, digital media
备注：
点击查看摘要
Abstract:Deepfakes increasingly undermine trust in digital media, yet existing detectors often struggle to generalize across unseen manipulation techniques, compression levels, and dataset shifts. Most approaches rely on RGB appearance, frequency-domain artifacts, or their combination, learning cues present in the final synthesized image. While effective in-distribution, such cues are frequently generator-specific and can diminish as synthesis models evolve. We argue that a complementary perspective can be obtained through implicit neural representations (INRs), which expose how an image is reconstructed rather than merely how it appears. By fitting an INR to an image and analyzing its internal activations, one can reveal reconstruction dynamics that are difficult to observe in the image domain alone and may capture more intrinsic differences between genuine and synthetic content. To this end, we propose Spectra, a deepfake detection framework that combines semantic visual representations with artifact-aware cues derived from INR reconstruction. Spectra extracts multi-level reconstruction heatmaps from image-specific INRs and jointly models them with semantic features through a bidirectional fusion mechanism. This enables direct interaction between image semantics and reconstruction artifacts, allowing the model to identify forgery cues that are less dependent on specific generation pipelines. Extensive experiments on multiple deepfake benchmarks demonstrate improved robustness and cross-dataset generalization, consistently outperforming detectors based solely on RGB appearance or semantic representations. Furthermore, we show that the proposed representation extends beyond deepfake detection to face presentation attack detection, highlighting its potential as a unified framework for facial attack detection.
110. 【2610.31951】STEP: Surgical Point Tracking from Sparse Endpoints and Pseudo-trajectories
链接：https://arxiv.org/abs/2610.31951
作者：Bing Fan,Anwesa Choudhuri,Zhongpai Gao,Meng Zheng,Benjamin Planche,Terrence Chen,Heng Fan,Ziyan Wu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：tracking requires persistent, dense trajectory annotations, requires persistent correspondence, point tracking requires, Surgical point tracking
备注：
点击查看摘要
Abstract:Surgical point tracking requires persistent correspondence through tissue deformation and occlusion, yet dense trajectory annotations are costly to obtain. We present STEP, a two-stage framework that learns from surgical video and sparse physical endpoints. First, a frozen offline teacher generates candidate trajectories, and temporal reversibility and stereo consistency select dense supervision for a causal student. Second, a robust physical endpoint loss anchors terminal correspondence, while a round-trip loss constrains temporal consistency. A gradient-free prefix exposes training to accumulated drift, while a final differentiable window bounds activation memory. The trained tracker processes a single RGB stream with fixed weights. In STIR-to-VL-SurgPT transfer, temporal-stereo union selection reduces endpoint error by 7.0% relative to unfiltered trajectories. On a post-hoc diagnostic of 29 VL-SurgPT clips excluded from the endpoint-training manifest, STEP reduces endpoint error from 31.52 to 16.80 pixels relative to dense-label fine-tuning. These results support combining curated trajectories with physical observations to train surgical point trackers.
111. 【2610.31950】LOCI: Localized Continuous Control for Multi-Subject Image Editing
链接：https://arxiv.org/abs/2610.31950
作者：Sai Vidyaranya Nuthalapati,Shlok Kumar Mishra
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Recent instruction-following image, Recent instruction-following, enable text-driven editing, instruction-following image editors, lack fine-grained control
备注：
点击查看摘要
Abstract:Recent instruction-following image editors such as Flux.1-Kontext enable text-driven editing but lack fine-grained control over where and how much an edit is applied. Existing approaches provide either continuous but global control or spatially localized editing at a fixed strength. To our knowledge, none jointly supports explicit spatial localization, continuous per-region strength, and independent simultaneous control of multiple subjects. We present LOCI (LOcalized Continuous control for multi- subject Image editing). Given a multi-subject image with per-subject regions and instructions, LOCI edits each subject at an independently chosen, continuously adjustable strength, for instance gradually aging one person while adding a beard to another with minimal cross-region leakage. LOCI pairs subject-level attention binding for spatial isolation with a Regional LoRA layer that replaces the LoRA's scalar coefficient with a per-token scaling vector aligned to the spatial layout. A single adapter is trained at one suppression point, and continuous edit strengths follow by rescaling its regional residual at inference. Experiments on multi-subject scenes demonstrate that LOCI achieves strong edit fidelity with significantly reduced cross-region interference compared to baselines, while maintaining continuous control over edit strength
112. 【2610.31930】Synthetic-to-Real Text-Based Person Anomaly Search via Multi-Model Retrieval Fusion and Cross-Encoder Reranking
链接：https://arxiv.org/abs/2610.31930
作者：Eugene Denteh,Blessing Agyei Kyem,Andrews Danyo,Joshua Kofi Asamoah,Richard Dzinyela,Solomon Owusu-Ansah,Dickson G. Asiedu,Armstrong Aboah
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Text-based person anomaly, anomaly search requires, person anomaly search, large image gallery, Text-based person
备注：
点击查看摘要
Abstract:Text-based person anomaly search requires a model to retrieve individuals from a large image gallery using natural-language descriptions of both appearance and behavior. This task is challenging because model training relies on synthetic image-text pairs, whereas evaluation is performed on real surveillance images containing domain differences, near-duplicate frames, and many visually similar distractors. We present a multi-model retrieval and reranking framework designed to improve synthetic-to-real transfer. The framework first adapts Qwen3-VL-Embedding-8B to synthetic person descriptions using bidirectional contrastive learning, explicit negative sampling, false-negative masking, and domain randomization. It then combines the normalized scores of six complementary Qwen3-VL checkpoints with those of a frozen SigLIP2 model using four-view gallery encoding. The fused retrieval scores identify the strongest candidates, which are jointly evaluated with the query using Qwen3-VL-Reranker-8B. The cross-encoder and retrieval scores are subsequently blended to produce the final ranking. We also construct a distractor-matched validation protocol entirely from synthetic data to select checkpoint weights, fusion coefficients, candidate depths, and reranking parameters without accessing the official test images. The final system achieves 94.7815% mAP and 90.8493% R@1 under the official AI City Challenge 2026 Track 4 test setting, with a reported eighth-place finish on the public leaderboard.
113. 【2610.31908】PixGR: Pixel-Space Generative Decoding for Fast Feed-Forward 3D Reconstruction
链接：https://arxiv.org/abs/2610.31908
作者：Ranran Huang,Wenjing Bian,Weixun Luo,Ye Mao,Krystian Mikolajczyk
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：efficient framework, framework that integrates, Gaussian, Gaussian reconstruction, pixel-space generative modeling
备注： Project page: [this https URL](https://ranrhuang.github.io/pixgr/)
点击查看摘要
Abstract:We present PixGR, an efficient framework that integrates lightweight pixel-space generative modeling into feed-forward 3D Gaussian reconstruction to model scene uncertainty. Context observations are encoded once into a scene latent representation, which conditions generative decoding from noisy target views to produce a shared 3D Gaussian representation. We formulate this process using pixel-space flow matching, enabling end-to-end optimization of 3D reconstruction with direct pixel-space generative supervision through differentiable rendering. This avoids VAE-based latent compression and error propagation inherent in previous two-stage pipelines. To preserve feed-forward efficiency, PixGR caches the scene representation and performs iterative inference using a lightweight DiT decoder. Experiments demonstrate that PixGR outperforms regression-based approaches in challenging sparse-view settings, particularly with widely spaced observations and view extrapolation. Meanwhile, it maintains sub-second inference and remains competitive with substantially heavier pretrained generative models. Our project page is available at this https URL.
114. 【2610.31902】Automated Nucleus Segmentation in Histology Images: An Attention U-Net Approach with Comprehensive Preprocessing and Inference Pipelines
链接：https://arxiv.org/abs/2610.31902
作者：Akshat G,Divyansh Gupta,Tusar Kanti Mishra
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：high nuclear density, histology images pose, digital pathology, quantitative analysis, high nuclear
备注： 8 pages, 8 figures
点击查看摘要
Abstract:Objectives: In the area of digital pathology, nucleus segmentation is an essential step for quantitative analysis; however, high nuclear density and staining heterogeneity in histology images pose a great challenge. Methods: This study implements a lightweight Attention U-Net model on the MoNuSeg 2018 dataset to overcome these challenges. The proposed pipeline integrates comprehensive image and mask preprocessing, including stain deconvolution and multi-pass mask smoothing, with a high-fidelity overlapping patch-stitching strategy during inference on high-resolution images. Results: The model achieved an Intersection over Union (IoU) score of 0.8745 on full-resolution, unseen test images. This result demonstrates the effectiveness of attention mechanisms in enhancing feature localization and validates the stitching methodology for generating seamless and accurate segmentation maps. Conclusion: Attention U-Net is an effective and competitive method for automated, scalable nucleus delineation in challenging clinical contexts.
Comments:
8 pages, 8 figures
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2610.31902 [cs.CV]
(or
arXiv:2610.31902v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2610.31902
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Akshat Gururaj [view email] [v1]
Thu, 22 Oct 2026 20:57:54 UTC (6,360 KB)
115. 【2610.31898】StateBridge: Phase- and Track-Grounded Reasoning for Synthetic-to-Real Traffic Video Captioning and VQA
链接：https://arxiv.org/abs/2610.31898
作者：Blessing Agyei Kyem,Richard Dzinyela,Joshua Kofi Asamoah,Eugene Denteh,Andrews Danyo,Solomon Owusu-Ansah,Dickson Gyimah Asiedu,Armstrong Aboah
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：videos provide rich, provide rich evidence, safety videos provide, evaluation makes, Traffic safety videos
备注： 25 pages, 5 figures, ECCV conference
点击查看摘要
Abstract:Traffic safety videos provide rich evidence for understanding interactions between pedestrians and vehicles, but synthetic-to-real evaluation makes this setting challenging because models must learn from simulated scenes and generalize to real-world traffic. In this work, we present StateBridge, a traffic video-language framework designed to operate under this synthetic-only training protocol. Our approach uses phase-aware clip construction, pedestrian and vehicle track summaries, and structured prompts to ground vision-language models in stable traffic evidence rather than appearance alone. We fine-tune public vision-language models on synthetic captioning and visual question answering examples, then combine their outputs through fact-locked caption fusion and evidence-diverse VQA consensus to improve consistency across actor roles, behavioral phases, and question types. StateBridge achieves an official S2 score of 55.4679 on AI City Challenge 2026 Track 2 using only synthetic training data. These results demonstrate the effectiveness of structured evidence transfer for traffic safety captioning and visual question answering.
116. 【2610.31892】VisFlow: Interpretable Flow Matching for Visibility Reconstruction, Characterization, and Recognition
链接：https://arxiv.org/abs/2610.31892
作者：Rahul Moorthy,Volkan Isler
类目：Computational Geometry (cs.CG); Computer Vision and Pattern Recognition (cs.CV)
关键词：modern machine learning, visibility, Visibility Reconstruction, Visibility Characterization, latent manifolds
备注：
点击查看摘要
Abstract:Methods for learning continuous representations, such as latent manifolds, are fundamental and ubiquitous in modern machine learning. Yet many geometric objects combine continuous shape information with discrete combinatorial structure. This combination presents a fundamental challenge for representation learning because small geometric perturbations can induce abrupt changes in the underlying discrete representation. As a result, the smoothness assumptions that make continuous representations effective no longer hold. Polygons provide a canonical example. Their vertex locations vary continuously, but infinitesimal changes in geometry can dramatically alter the associated visibility graph. Existing methods address the inverse mapping from visibility graphs to polygon geometry using vertex-, triangulation-, or signed-distance-function (SDF)-based representations. Vertex- and triangulation-based approaches construct polygons through explicit geometric operations. However, they are less effective at modeling the relationship between geometry and visibility. SDF-based approaches capture this relationship more naturally. Their intermediate states, however, do not correspond to explicit stages of polygon construction. We present VisFlow, a novel, interpretable flow formulation that combines continuous SDF representations with explicit polygon evolution. We evaluate VisFlow on Visibility Reconstruction and Visibility Characterization. Visibility Reconstruction generates one polygon consistent with a visibility graph (G), while Visibility Characterization characterizes all such polygons. VisFlow maintains 20% more visibility relations on Visibility Reconstruction and improves coverage by 30% on Visibility Characterization compared to state-of-the-art methods.
117. 【2610.31889】Scaling Transformer Energy-based Models For High Quality Image Synthesis
链接：https://arxiv.org/abs/2610.31889
作者：Jungsoo Lee,Alexi Gladstone,Yilun Du
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：decouple probabilistic modeling, flexible class, class of generative, decouple probabilistic, probabilistic modeling
备注：
点击查看摘要
Abstract:Energy-Based Models (EBMs) are a flexible class of generative models that decouple probabilistic modeling from the generation process. This decoupling directly enables compositional generation and inference-time scaling, where sample quality can be refined simply by increasing sampling steps. However, severe challenges in high-dimensional sampling and training instabilities with deep architectures have restricted EBMs to low-dimensional regimes. To resolve these bottlenecks, we introduce the Transformer Energy-Based Model (TEM), a scalable transformer energy function operating entirely within a latent space. On top of this backbone, we extract energies at multiple layers and sum them, composing complementary constraints from local texture to global semantics. Furthermore, two components make this high-quality at scale: Positive Representation Alignment (PRA), which supervises TEM's intermediate representations with a vision foundation model, and advanced sampling strategies that improve sample quality at inference. TEM-XL achieves an FID-50K of 3.82 on class-conditional ImageNet 256$\times$256 without classifier-free guidance, showing that a contrastive EBM can generate high-fidelity images. On ImageNet 512$\times$512, TEM achieves an FID-50K of 8.24, demonstrating that the approach scales to higher resolution. We further validate the core promises of EBMs: compositional generation, zero-shot inpainting, and out-of-distribution detection.
118. 【2610.31880】FSVL: Taxonomic Fast-Slow Vision-to-Language Collaborative Framework for Interpretable Confusable Fish Species Identification and Knowledge Generation in the Middle Yangtze River
链接：https://arxiv.org/abs/2610.31880
作者：Meng Liang,Fucheng Wang,Lang Zhao,Jun Chen,Ziying Li,Yuxiang Zhao,Haozhuang Chi,Wenkai Fang,Qiong Zhou,Junlin Yang,Jinming Wu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Yangtze River Basin, Yangtze River, Middle Yangtze River, Yangtze River Ten-Year, River Ten-Year Fishing
备注：
点击查看摘要
Abstract:The Yangtze River Basin is a critical region for freshwater biodiversity conservation. The implementation of the Yangtze River Ten-Year Fishing Ban has increased the importance of effective aquatic biodiversity monitoring and species-level identification. However, fine-grained identification of closely related freshwater fish species remains challenging due to subtle morphological differences. Existing deep learning methods often struggle to balance classification accuracy and inference efficiency, while LLMs may generate unsupported information when producing specialized biological knowledge. To address these challenges, this study proposes FSVL, a fast-slow dual-pathway framework integrating visual recognition with LLM-based Retrieval-Augmented Generation (RAG). A lightweight ResNet50 fast path performs preliminary classification across 51 fish species in the Middle Yangtze River Basin and routes predefined groups of easily confused species to a slow path for refined identification. Guided by taxonomic criteria, the slow path uses YOLOv8n to detect key morphological regions, including the head, dorsal fin, and tail, leveraging morphometric and outline traits to improve discrimination among closely related species. The framework further integrates a retrieval-enhanced Qwen3-14B backend, using soft tokens and Low-Rank Adaptation (LoRA) for parameter-efficient domain knowledge generation. On the evaluated test set of 607 images, the fast classifier achieved 99.67% accuracy, whereas the cascade corrected the two errors, yielding 100.00% overall accuracy; further validation on independent specimens and external conditions remains needed. Across 255 knowledge generation samples, scientific name accuracy rises from 91.37% to 100.00%, genus accuracy from 90.20% to 98.82%, and ROUGE-L from 0.335 to 0.655, supporting intelligent biodiversity monitoring and fisheries management.
119. 【2610.31848】IFC-SSL-Bench: Benchmarking Self-Supervised Learning for Annotation-Efficient Multispectral Imaging Flow Cytometry
链接：https://arxiv.org/abs/2610.31848
作者：Angelo Jovin Yamachui Sitcheu,Roxana-Teodora Fetescu,Thomas Lautenschlager,Nils Friederich,Linus Schilpp,Stephan Allgeier,Luca Deininger,Daniel Hübschmann,Ralf Mikut
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Imaging Flow Cytometry, Flow Cytometry, deep learning models, generates large multispectral, large multispectral datasets
备注： 35 pages, six main figures, seven supplementary figures, five tables and four supplemntary tables
点击查看摘要
Abstract:Imaging Flow Cytometry (IFC) generates large multispectral datasets, yet the need for expert annotations bottlenecks the development of supervised deep learning models. While Self-Supervised Learning (SSL) offers a solution, its application to IFC remains fragmented and lacks systematic benchmarking. To address this, we present IFC-SSL-Bench, a modular framework for evaluating SSL in IFC. We benchmark six SSL approaches across four backbones on two heterogeneous datasets. By assessing downstream classification performance across annotation regimes of the training sets (1%-100%), we quantify annotation efficiency and identify optimal configurations for high-dimensional biological imaging. SSL matches the performance of fully supervised baselines trained on 100% of annotated data while using as little as 5% of annotations for morphological classification, with advantages in low-data regimes below 5%. Across both datasets, the contrastive approach MoCo-v2 paired with ConvNeXt backbones emerged as the top-performing configuration, with ConvNeXtV1-T best for immunological synapse classification and ConvNeXtV2-T for morphological classification. We identify a clear pattern in transfer dynamics: ImageNet initialization benefits morphological classification, consistent with its visual similarity to natural images, whereas random initialization better captures the more domain-specific immunological synapse classification. SSL elevates class-specific F1-scores by over 35 percentage points for structurally complex classes at 1% of annotated data. We synthesize these insights into a unified set of guidelines for deploying self-supervised workflows in high-throughput IFC, and release the benchmark as a resource for future work.
120. 【2610.31845】EgoForesight: Effectively Scaling Policy Learning with Noisy Egocentric Actions
链接：https://arxiv.org/abs/2610.31845
作者：Chubin Zhang,Changyuan Wang,Yirui Wang,Ao Li,Shilin Ma,Yue Su,Cai Zhou,Xiuwei Xu,Tianle Zhang,Yansong Tang
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：requires broad experience, policy learning requires, learning requires broad, requires broad, broad experience
备注： Project page: [this https URL](https://lin-shan.com/EgoForesight)
点击查看摘要
Abstract:Scaling policy learning requires broad experience and reliable supervision. Robot demonstrations provide high-quality trajectory supervision but are costly to collect. Egocentric videos broaden task and environment coverage, yet motion reconstruction and retargeting introduce noisy action labels. To address this challenge, we introduce EgoForesight, a vision-language-action framework that learns jointly from both sources by reducing the influence of unreliable action labels and exploiting demonstrated outcomes as complementary supervision. A joint vision-action flow couples future visual representation prediction with action generation, unifying reliability-aware action learning with outcome-informed representation transfer. Specifically, reliability-conditioned corruption allocates action supervision across noise levels according to source reliability, while reliability-weighted regression regulates each source's contribution. Complementing this treatment of noisy labels, privileged-future representation distillation draws supervision from demonstrated outcomes. An exponential-moving-average teacher observes the current scene and clean future to encode action-relevant structure from the resulting scene change. Its deeper representations supervise an earlier student layer receiving a corrupted future, providing outcome-informed structure beyond noisy action annotations. Together, these mechanisms support effective scaling with noisy egocentric actions. Over the tested range, EgoForesight exhibits steeper scaling slopes than the baseline, reducing real-world open-loop action MSE by 20.5% and improving RoboCasa few-shot success by 8.1 percentage points at 30,000 hours of pretraining data. After post-training, it also achieves strong absolute performance in both simulated and real-world dexterous manipulation.
121. 【2610.31838】SAGE: Sense-Aligned Multimodal Grounding Evaluation with Gloss-Augmented Reasoning
链接：https://arxiv.org/abs/2610.31838
作者：Sunjae Kwon,Suhaas Kiran DG,Zonghai Yao,Talha Chafekar,Deepali Singh,Hong Yu
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：protocol covering noun, paper introduces Sense-Aligned, shared term-centric protocol, term-centric protocol covering, introduces Sense-Aligned Grounding
备注：
点击查看摘要
Abstract:This paper introduces Sense-Aligned Grounding Evaluation (SAGE), a unified 10-candidate image-selection benchmark that reformulates VWSD, VerSe, and WikiDiverse into a shared term-centric protocol covering noun-, verb-, and entity-centered grounding. SAGE includes confusable hard negatives and a context-swapped VerSe diagnostic to probe target-term grounding beyond direct caption--image compatibility. We further propose Gloss-Augmented Reasoning (GAR), a training-free framework combining definition grounding with constraint-guided semantic verification. Experiments show that strong VWSD performance does not transfer uniformly across grounding settings. With Gemma3-12B, definition augmentation improves all three subsets, while constraint-guided reasoning improves VWSD and yields particularly strong gains on VerSe, but is less effective on WikiDiverse. Combining the two signals achieves the best macro-average performance, improving Hits@1 from 65.90 to 71.22. These results show that SAGE supports both unified evaluation and fine-grained analysis of explicit semantic reasoning across grounding settings.
122. 【2610.31835】SAGE: A hybrid vision-language and geometry framework for work-zone pathway prediction under temporary traffic control
链接：https://arxiv.org/abs/2610.31835
作者：Jiaxi Liu,Keshu Wu,Weizhe Tang,Bofeng Cao,Sikai Chen,Xiaopeng Li,Steven T. Parker,Bin Ran
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：requiring automated vehicles, control redirects vehicles, continuous passing path, Temporary traffic control, traffic control redirects
备注： 26 pages, 9 figures, 7 tables. Project page: [this https URL](https://hhjj233.github.io/SAGE-page/)
点击查看摘要
Abstract:Temporary traffic control redirects vehicles through work zones, requiring automated vehicles to connect an interpretation of the visible devices to a continuous passing path. Geometric predictors can provide several plausible paths, yet selecting the one consistent with the temporary control remains difficult. We propose SAGE (Semantic-to-Action Grounded Execution), a read-decide-execute-check framework that separates path construction, path preference, and control compliance within a shared candidate space. The central idea is to use a vision-language model's (VLM's) trajectory as a preference over intact geometric candidates. A role-decoupled generator constructs the candidates, and rank fusion combines each candidate's geometric score with its agreement with the VLM trajectory. Supervision structured around the Manual on Uniform Traffic Control Devices (MUTCD) trains SAGE-VLM to state the lane status and hazard side before its passage decision and trajectory. The predicted hazard side enters image-space predicates derived from MUTCD provisions, which support a final intervention bounded in score and displacement. On 2,306 real-world ROADWork validation episodes, the candidates include a path within 10 px of the human demonstration in 87% of episodes, yet selection regret accounts for 53% of the geometric ranker's error. SAGE reduces average and final displacement errors by 8.3% and 12.0% relative to the ranker, mostly in the far field, and hard-constraint violations by 37%. The trajectory opinion improves all four tested generator-selector combinations. SAGE is comparable to state-of-the-art VLM modules in accuracy, with a faster-responding VLM, and outperforms four other adapted driving VLMs in displacement error and safety measures. Project page: this https URL.
123. 【2610.31834】WorldMirror: Agentic Real-to-Sim Generation of Interactive Worlds from In-the-Wild Robot Demonstrations
链接：https://arxiv.org/abs/2610.31834
作者：Tianling Xu,Weijie Wan,Honghao Su,Kailun Su,Junyuan Tang,Huichi Zhou,Haozheng Zhang,Qi Xiong,Ping Luo,Wenbo Ding,Tianxing Chen,Yue Chen
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：limiting training scalability, substantial manual effort, Existing approaches, require substantial manual, limiting training
备注：
点击查看摘要
Abstract:Existing approaches for robot learning in simulation often require substantial manual effort to construct scenes and specify tasks, limiting training scalability and data diversity. Meanwhile, in-the-wild robot demonstrations naturally provide diverse and realistic observations of real-world interactions. Leveraging these demonstrations for simulation requires both high-fidelity visual reconstruction and physically consistent interactions. General-purpose agents offer flexible adaptation to diverse scenarios and strong reasoning about 3D spatial relationships, while specialized generative models provide high-fidelity reconstruction of scene appearance and geometry. We introduce WorldMirror, an agentic real-to-sim framework that constructs interactive digital twins from in-the-wild robot demonstrations. Our central idea is to formulate real-to-sim construction as the iterative refinement of an executable world program. A coding agent decomposes the observed scene, plans reconstruction steps, and orchestrates specialized image and 3D generation tools, refining the program through verification feedback. A camera-pose-anchored scene representation organizes the world into static visual context, support geometry, and editable interactive assets while preserving spatial relationships among the scene, objects, and robot. The agent uses this representation to diagnose and correct reconstruction errors, enabling physically consistent interaction and trajectory replay. Experiments on DROID demonstrate that WorldMirror can reconstruct visually faithful and geometrically consistent interactive worlds while preserving the physical validity of recorded robot trajectories.
124. 【2610.31803】StackGen3D: Stable 3D Block Stack Generation from Multiview Silhouettes
链接：https://arxiv.org/abs/2610.31803
作者：Xiaopeng Zhang,Luzhe Sun,Yiqing Xu,Matthew R. Walter
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：visual specifications requires, specifications requires resolving, Generating physically stable, requires resolving geometric, resolving geometric ambiguity
备注： A poster of this work is publicly available on the website of the Creativity in Assembly Workshop at IROS 2026 (non-archival)
点击查看摘要
Abstract:Generating physically stable 3D structures from visual specifications requires resolving geometric ambiguity while accounting for physical interactions among objects. We present StackGen3D, a framework for generating stable block assemblies conditioned on a given block inventory and three orthographic silhouettes. Our approach consists of two stages. First, we develop a physics-informed graph neural network (PI-GNN) that models support relations between blocks and serves as a fast stability predictor for curating a diverse dataset of stable structures. Second, we train a conditional flow-matching model on this dataset to capture the multimodal distribution of block configurations consistent with the target silhouettes. At inference time, lightweight geometric selection and refinement reduce inter-block penetration without physics simulation. Preliminary experiments show that the PI-GNN generalizes from simple stacks to complex structures substantially better than a parameter-matched multilayer perceptron. For structure generation, Best-of-10 selection improves physical stability from 45.3% to 72.4% while achieving a silhouette IoU of 0.970. These results highlight the potential of combining relational physical reasoning, scalable data curation, and conditional generative modeling for creative 3D assembly. Project website: [this https URL](this https URL)
Comments:
A poster of this work is publicly available on the website of the Creativity in Assembly Workshop at IROS 2026 (non-archival)
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
Cite as:
arXiv:2610.31803 [cs.CV]
(or
arXiv:2610.31803v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2610.31803
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
125. 【2610.31797】PnP*: A certifiable solver for Perspective-n-Point
链接：https://arxiv.org/abs/2610.31797
作者：Bang-Shien Chen,Caitrin E. Eaton,David M. Rosen
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO); Optimization and Control (math.OC)
关键词：Maximum Likelihood Estimation, computer vision, fundamental problems, actual Maximum Likelihood, Estimating a camera
备注： 28 pages, 3 figures
点击查看摘要
Abstract:Estimating a camera pose from 3D-2D correspondences - Perspective-n-Point - is one of the most fundamental problems in computer vision. Existing methods either solve a minimal problem or replace the objective with an easier one. Surprisingly, no scalable certifiable solver for the actual Maximum Likelihood Estimation (MLE) exists. We propose PnP*, the first practical solver that guarantees efficient computation and returns a certifiable globally optimal solution. We prove that the underlying convex relaxation is exact under moderate noise, which to our knowledge is the first stability guarantee for any relaxation for the MLE of PnP. Furthermore, we reduce the relaxation by exploiting chordal sparsity pattern and quotient ring reduction such that the relaxation is tractable and scalable. The stability and scalability results are verified numerically, as PnP* returns a provably correct camera pose at over 10 Hz.
126. 【2610.31791】PaperScorer: How Predictable Is Paper Acceptance?
链接：https://arxiv.org/abs/2610.31791
作者：Sachin Konan,Jonathan Liu,Zhuang Liu
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：research rarely reduces, Automated research, benchmark performance, largely evaluated, evaluated by benchmark
备注： Accepted to NeurIPS 2026
点击查看摘要
Abstract:Automated research is largely evaluated by benchmark performance, but the value of research rarely reduces to a single score. Humans judge a work's holistic contribution through peer review, which is hard to model because it is noisy and depends on many factors. However, what if, given only the paper, we could predict its peer-review decision directly? We introduce PaperScorer, a family of models that predict a paper's accept or reject decision from its extracted text or page screenshots, training only on the decision after removing author identity and formatting shortcuts. Vision models are the most predictive (68% accuracy on ICLR papers and 77% on ML papers from arXiv), beating text-only and frontier reasoning models. Unlike plain text, page images retain figures, layout, and presentation. This signal is robust, surviving smaller models and even compressing the whole paper into a single image. But accurate predictions are not evenly spread. PaperScorer is strongest on the lowest and highest rated papers, while papers rated in the middle stay unpredictable for our models and frontier systems alike. Additionally, its confidence is calibrated, so its most confident predictions are also its most accurate. Overall, PaperScorer shows how much of the decision a paper carries on its own, marking a first step toward AI-driven research evaluation.
127. 【2610.31765】SyncVid: World-Equivariant Diffusion for Synchronized Video Generation
链接：https://arxiv.org/abs/2610.31765
作者：Farhad G. Zanjani,Animesh Karnewar,Fatih Porikli,Amirhossein Habibian
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Generating multiple videos, Generating multiple, unobserved content consistently, single reference video, reference video requires
备注： 28 pages, 8 figures, 9 tables. Project page: [this https URL](https://qualcomm-ai-research.github.io/SyncVid-Webpage)
点击查看摘要
Abstract:Generating multiple videos of a dynamic scene from a single reference video requires synthesizing both observed and unobserved content consistently across viewpoints. Existing camera-control methods for video diffusion typically rely on architectural mechanisms, including camera embeddings, cross-view attention, and geometric conditioning. Although effective for static scene content, these approaches often struggle with the fine-grained, dynamic geometry that must remain coherent across views and over time. We synchronize the diffusion process itself by sampling the Gaussian noise prior in a canonical 3D space derived from the source video and rasterizing it into target cameras, rather than sampling independently in each 2D image plane. Our method, SyncVid, lifts a monocular video into a canonical 4D representation, associates noise with scene geometry and unseen space, and rasterizes the resulting structured noise into arbitrary views. Because rendering can introduce local correlations, we further propose a cross-view-consistent whitening procedure that decorrelates neighboring pixels while preserving correspondence across views. The structured noise serves as the diffusion prior for a LoRA-adapted pretrained video diffusion model, requiring no architectural modifications. By enforcing spatiotemporal and cross-view coherence at the source of stochasticity, SyncVid generates synchronized videos and improves both perceptual quality and cross-view consistency in our experiments. Project page: this https URL.
128. 【2610.31762】See What I Need, Dream What I Want: A Navigation Foundation Model on a Self-Constructed Representation Space
链接：https://arxiv.org/abs/2610.31762
作者：Jiawei Chen,Yinxi Wang,Zihan Yang,Meijun Gao,Yaowei Liu,Shuming Zhang,Zecheng Li,Xiangju Mi,Yuxuan Liu,Runzhong Huang,Tianlin Li,Xun Zhang,Zhengyang Wang,Xu Miao,Tong Yang
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：vision foundation models, navigation policy act, navigation foundation model, foundation models, vision foundation
备注： 28 pages. Project page: [this https URL](https://wang-yinxi.github.io/representnav/)
点击查看摘要
Abstract:What visual representation should a navigation policy act on? Navigation policies built on vision foundation models largely leave representation design to the encoders' pretraining objectives. We present RepresentNav, a navigation foundation model built on a self-constructed representation space: a visual representation constructed by the policy's own objectives from vision foundation models. RepresentNav builds this space with Representation Residuals, a compact three-layer transformer that attends over features spanning the full depth of multiple complementary vision foundation models, so that the policy learns to see what it needs for navigation. In the same space it dreams what it wants: before every action a latent chain-of-thought predicts the representation of the scene a moment ahead. The dream is trained end-to-end with the policy as a joint-embedding predictive architecture (JEPA), with a next-representation prediction loss and a regularizer on its targets. RepresentNav sets a new state of the art on VLNVerse, VLN-CE R2R, EVT-Bench, and two point-goal benchmarks, and its gains carry over to a physical robot amid clutter and moving people. On VLNVerse fine-grained, RepresentNav achieves 83.80% success, outperforming the previous state of the art by 20.05 percentage points, and on EVT-Bench distracted tracking it reaches 85.5% with a single camera (+10.1). With the same encoders, the self-constructed space clearly outperforms concatenating their outputs and learns to weight their layers unevenly, and a dream in it cuts collisions by a quarter. A single dreamed latent decodes into the depth, semantics, and 3D occupancy of the scene a moment ahead, more accurately than pretrained encoders applied to the real future frame, although occupancy is never supervised, and the rollout tracks the robot's own motion over the next second: the dream emerges as a compact latent world model.
129. 【2610.31747】AudioLift: Audio-Driven Single Image to Full-Head Gaussian Avatar via Multi-view Video Generation
链接：https://arxiv.org/abs/2610.31747
作者：Zhuoyuan Jiang,Weijie Lyu,Xiaoyuan Wang,Tiancheng Shen,Ming-Hsuan Yang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：face models including, parametric face models, compact motion representations, motion representations limit, parametric face
备注： Project page: [this https URL](https://zhuoyuanjiang.github.io/audiolift-page/)
点击查看摘要
Abstract:Existing 3D talking avatar methods mainly rely on parametric face models including 3DMM or FLAME, whose compact motion representations limit their ability to synthesize extreme expressions and to model accessories such as headwear. We introduce AudioLift, a two-stage framework that uses generated multi-view videos as the intermediate representation for audio-driven avatar generation without parametric face models or per-instance optimization. Our framework combines a synchronized multi-view video generation stage with an inconsistency-robust Gaussian reconstruction stage to recover coherent full-head geometry from a single portrait image. Extensive experiments demonstrate that AudioLift produces 3D talking avatars capable of capturing more extreme facial expressions than existing methods, with improved geometric completeness and strong multi-view consistency across the full $360^\circ$ viewing range.
130. 【2610.31734】DirCast: Live Esports Directing and Commentary with a Single Streaming Video-Language Model
链接：https://arxiv.org/abs/2610.31734
作者：Zixian Gao,Lixin Xiu,Penghao Luo,Xiangcheng Cao,Ziqi Cai,Zhen Li,Erwin Wu,Kaipeng Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：live esports broadcast, caster who talks, Streaming video language, live esports, esports broadcast
备注： 18 pages, 6 figures
点击查看摘要
Abstract:A live esports broadcast needs a director who chooses which camera goes on air and a caster who talks over that choice, every second and without knowing what comes next. Streaming video language models have learned to commentate, but only over a broadcast that a human director has already produced. We study live broadcast production, in which a model receives the raw camera of every player and must both direct and commentate from the past alone. We present DirCast, a single streaming video language model that does both. Every second it scans all cameras at low resolution, decides with a hold-or-switch director whether and where to cut, and reads the chosen camera at high resolution before it speaks. Its context keeps what went on air and what was said and lets the other views expire, which bounds the cost of a stream of any length. We build a dataset of 27 professional Dota 2 matches with a camera for every hero, the human director's choices and the casters' commentary. DirCast directs better than rule-based and zero-shot directors including GPT-5, and its commentary wins 29.2 percent of comparisons against GPT-4o under the Proact-VL protocol, against 19.4 percent for the strongest of eleven streaming commentators that watch the human broadcast.
131. 【2610.30652】Residual Calibration via Local Feature-Space Refinement
链接：https://arxiv.org/abs/2610.30652
作者：Xihao Wang,Chengyao Yu,Ruixing Ming
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Machine Learning (stat.ML)
关键词：Deep neural networks, reliable confidence estimates, provide reliable confidence, Deep neural, reliable decision-making
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:Deep neural networks often struggle to provide reliable confidence estimates, making post-hoc calibration essential for reliable decision-making. Existing post-hoc methods largely rely on score-based transformations, which improve marginal calibration but often fail to capture spatially varying miscalibration in local regions of the learned feature space. To address this gap, we propose Local Adaptive Probability Estimation (LAPE), a post-hoc residual calibration framework. Specifically, LAPE treats the global calibrator output as a stable anchor and refines the individual prediction by leveraging non-parametric local evidence from neighboring calibration samples. As a plug-and-play refinement module, LAPE effectively utilizes the information about feature-space geometry and can reuse the calibration data that are used to construct the global calibrator. Furthermore, we extend LAPE to the setting with multi-view inputs through Cascade Feature Augmentation Fusion (CFAF). Extensive experiments demonstrate that the proposed methods can improve the calibration quality of various existing baselines and remain efficient and robust across different settings.
132. 【2610.23955】Physics-Aware Self-Supervised Pretraining on Multi-Domain Raman Spectra
链接：https://arxiv.org/abs/2610.23955
作者：Charalampos Davalas,Georgios Levantinos,Anastasios Dimitriou,Nikolaos Papanikolaou,Georgios Th. Papadopoulos,Dimitrios Michail
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)
关键词：generates large volumes, Raman spectroscopy generates, spectroscopy generates large, generates large, large volumes
备注：
点击查看摘要
Abstract:Raman spectroscopy generates large volumes of unlabeled data that are difficult to exploit with conventional supervised learning. This work introduces a multi-domain self-supervised learning framework based on a masked autoencoder (MAE) for learning transferable Raman spectral representations from heterogeneous biological, chemical, forensic, and materials datasets. The proposed pretraining strategy incorporates physics-aware objectives by combining masked intensity reconstruction with a sparse Voigt-profile decoder that models spectral peak structure through differentiable peak centers, widths, and amplitudes. A denoising objective is further included to improve robustness to spectral corruption. The learned encoder is evaluated on substance classification, component identification, concentration estimation, and spectral denoising under linear probing, attention-based probing, end-to-end fine-tuning, and training from scratch. Experimental results show that self-supervised pretraining is most beneficial for challenging tasks with limited labeled data. Attention-based probing also reveals substantially more useful information in the frozen representation than linear probing, indicating that conventional linear evaluation may underestimate representation quality. In addition, the benefits of pretraining become more pronounced with increasing encoder capacity. Overall, the proposed framework demonstrates that physics-aware, multi-domain self-supervised pretraining can improve label efficiency, robustness, and transferability across diverse Raman spectroscopy tasks.
133. 【2610.32758】ARENA: Active Region attENtion Aggregation for interpretable solar flare prediction
链接：https://arxiv.org/abs/2610.32758
作者：Luis Bauer,Annalena Kofler,Andrés Asensio Ramos,Aparna Venkataramanasastry,Valentín Martínez Pillet,Bernhard Schölkopf
类目：olar and Stellar Astrophysics (astro-ph.SR); Instrumentation and Methods for Astrophysics (astro-ph.IM); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Earth upper atmosphere, Predicting solar flares, challenging space-weather forecasting, space-weather forecasting problem, potentially significant impacts
备注： 7+12 pages (2+8 figures), accepted at the "Representations for the Physical Sciences" workshop at NeurIPS 2026
点击查看摘要
Abstract:Predicting solar flares is a challenging space-weather forecasting problem with potentially significant impacts on Earth's upper atmosphere, including disruptions to radio communications. We propose Active Region attENtion Aggregation (ARENA), a neural network architecture that predicts solar flares from a variable number of active-region cutouts while learning to identify the region most relevant to the prediction. ARENA is trained using multiple-instance learning under weak supervision, requiring only a flare/no-flare label for the observation and no labels specifying the flare origin. The learned attention mechanism therefore provides a means of localizing the active region driving the prediction without explicit origin annotations. ARENA achieves a heidke skill score of 0.45 which is comparable to other flare prediction approaches. These results demonstrate that active-region-based aggregation can provide an efficient and interpretable approach to solar flare prediction. The code is available at this https URL.
134. 【2610.32646】Computational imaging through turbid, bubbly and flowing water near the telescope
链接：https://arxiv.org/abs/2610.32646
作者：Alexander Ingold,Sabina D. Menon,Aadhi Umamageswaran,Alec Ikei,May H. Hlaing,Syed N. Qadri,Rajesh Menon
类目：Optics (physics.optics); Computer Vision and Pattern Recognition (cs.CV)
关键词：moving water close, surf zone, ship wakes, moving water, displayed images
备注：
点击查看摘要
Abstract:Cameras in the surf zone or behind ship wakes look through turbid, bubbly, moving water close to the lens, yet restoration networks are usually scored only on displayed images. We introduce a measured dataset of a telescope viewing displayed images and physical objects through a 25~mm water layer 45~mm in front of its objective, under seven combinations of flow, bubbles and turbidity, with clear-water recordings as a second reference. Because the suspension scatters light far outside the 1.3\textdegree{} field of view, turbidity mainly removes contrast, 4.4- to 4.8-fold on a Siemens star. Restoring the mean of eight frames improves structural similarity (SSIM) by 0.032 over a single frame, and learned fusion of the frames adds little. One raw frame supports five-category recognition (96.8\%) as well as restored images. Adding synthetic training pairs leaves display-image scores unchanged but raises the correlation of a restored Siemens star with its clear-water recording from below 0.5 to above 0.9. These networks also improve ordinary underwater photographs without retraining, where training on measured pairs alone fails. Scoring against the digital source or a clear-water recording reverses the ranking of raw and restored images. These results support a simple pipeline: average the frames, classify raw frames directly, and restore with networks trained on measured and synthetic pairs.
