本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。
统计
今日共更新828篇论文，其中：
- 自然语言处理91篇
- 信息检索22篇
- 计算机视觉150篇
自然语言处理
1. 【2611.06914】A Framework for Context Enrichment and Selective Robustness in LLM Social Agents
链接：https://arxiv.org/abs/2611.06914
作者：Mattia Greiche,Reihaneh Rabbany,Maximilian Puelma Touzel
类目：Multiagent Systems (cs.MA); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Researchers use large, background information intended, large language models, shape their actions, large language
备注： Accepted to the SocialAgent Workshop @ NeurIPS 2026. 12 pages, 1 figure, 2 tables
点击查看摘要
Abstract:Researchers use large language models as agents in social simulations, where agents are prompted with observations and background information intended to shape their actions. Yet LLM agents have been shown to substantially change their behavior under meaning-preserving prompt variations, creating a validation problem for social simulation. One plausible hypothesis is that this brittleness reflects a lack of grounding and can be reduced by enriching the context provided to the agents. Whether richer context improves robustness remains unclear, in part because context richness and robustness are rarely defined in ways that support controlled comparisons. We address the first need with controlled context enrichment, a set of prompt substitution rules that systematically enriches distinct types of context: neutral padding, generic social background, descriptive decision grounding, and normative decision grounding. We address the second by introducing selective robustness as a validation criterion: insensitivity to meaning-preserving prompt variation combined with a directional response to decision-relevant changes in the social world. We demonstrate the framework in a Prisoner's Dilemma-like game, showing how it can be used to identify which forms of context enrichment produce more desirable and robust agent behavior. We find that these forms of enrichment produce distinct behavioral patterns that vary between the two models tested.
2. 【2611.06876】SpecCompact: Accelerating LLM Agent Context Compaction with Slot-Parallel Semantic Speculative Verification
链接：https://arxiv.org/abs/2611.06876
作者：Yulu An,Yifei Feng,Xiangyang Yin
类目：Computation and Language (cs.CL)
关键词：introduce substantial delays, growing interaction histories, summarizing long histories, manage growing interaction, LLM agents
备注：
点击查看摘要
Abstract:LLM agents use context compaction to manage growing interaction histories, but summarizing long histories with large models can introduce substantial delays. Compaction therefore requires balancing information retention against latency. We observe that structured summary slots can retain information when generated independently. Based on this observation, we present SpecCompact, a framework that accelerates compaction through slot-parallel semantic speculation. SpecCompact fine-tunes a small drafter and generates slots in parallel. The target model verifies each proposed line and repairs rejected content, while subsequent drafting uses the updated slot prefix. System optimizations further reduce repeated context processing and model calls. Across AppWorld and $\tau^3$ benchmarks with two target models, SpecCompact achieves $2.04$--$5.63\times$ compaction speedups over Hermes-style summarization. Separate downstream evaluations reveal model- and task-dependent performance trade-offs. A user study within Hermes further shows an $8.68\times$ median compaction speedup.
3. 【2611.06859】Balancing hierarchical representation and quantization: A performance trade-off in text embeddings
链接：https://arxiv.org/abs/2611.06859
作者：Kai Ponel,Marco Polignano,Erasmo Purificato,Aylin Julia Temizkan,Marco Levantesi,Giovanni Semeraro,Ernesto William De Luca
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：reduces numerical precision, models offer variable-length, offer variable-length representations, Hierarchical text embedding, improve computational efficiency
备注： 29 pages. Authors' version of the open access article published in Information Sciences (CC BY 4.0). This version corrects the second affiliation of Marco Polignano (Otto von Guericke University Magdeburg); the published version lists the European Commission, Joint Research Centre (JRC) in error. Marco Polignano is not affiliated with the JRC. No other content has been changed
点击查看摘要
Abstract:Hierarchical text embedding models offer variable-length representations, while quantization reduces numerical precision; both aim to improve computational efficiency. This work is an empirical benchmark study of how these two orthogonal, already-established techniques interact. We evaluate 38 tasks from the Massive Text Embedding Benchmark (MTEB) using four transformer-based embedding models, covering 1D and 2D hierarchical representations combined with 32-bit, 8-bit, and binary quantization, for 168 configurations per task. We report each efficiency dimension separately: theoretical per-vector storage and end-to-end evaluation time. Under a Friedman test with Nemenyi post-hoc analysis, int8 quantization is statistically indistinguishable from float32 for pair classification and re-ranking and costs at most 1.5 percentage points overall, whereas binary quantization is significantly worse across every task category. Halving the embedding dimension once is not statistically detectable above $m=16$; two successive halvings always are. Combining an 8x dimensionality reduction with int8 yields a 32x reduction in per-vector storage at 94.4% of baseline effectiveness. Because evaluation times were measured once, we treat them as indicative: we find no evidence that quantization speeds up evaluation, whereas sampling from intermediate layers shortens it substantially. Retrieval degrades far faster than every other category, so we report findings per task category.
4. 【2611.06856】LongBanana: An Expert-Verified Benchmark for Long-Context Multi-Reference Image Synthesis
链接：https://arxiv.org/abs/2611.06856
作者：Haoxiang Cao,Yuxuan Zhang,Penghui Du,Bo Li,Jiajiong Cao,Yingying Fan,Zimeng Wu,Yifu Luo,Mingzhe Zheng,Junwen Miao,Huaisong Zhang,Yang Yao,Yu Wang,Dongfu Jiang,Ping Nie,Wenhu Chen,Chaoqun Wang,Changqian Yu,Kelsey R. Allen
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：long-context multi-reference image, multi-reference image synthesis, expert-designed and expert-verified, expert-verified benchmark, benchmark for long-context
备注： NeurIPS 2026 Evaluations and Datasets Track. Project page: [this https URL](https://long-banana.com/)
点击查看摘要
Abstract:We introduce LongBanana, to our knowledge the first expert-designed and expert-verified benchmark for long-context multi-reference image synthesis in the age of agent-driven image generation. The task requires retrieving dispersed visual evidence, rejecting distractors, binding entities and relations, and composing one coherent final image from multiple references. LongBanana contains 90 carefully designed tasks organized by a 3-by-3 taxonomy; each task includes about 32 reference images, 20 constraints, and 50 evaluation items, yielding 4,670 expert-specified atomic evaluation items in total. Its graph-grounded evaluation design instantiates each task with reference images and an entity-relation graph, then converts node, edge, and whole-graph obligations into checklist items for Content Fidelity, Relational Binding, and Global Constraint Satisfaction. Reviewed expert labels include a 15% double-labeled subset with 89.4% exact agreement and 0.83 quadratic weighted kappa. We further introduce LongBanana-Gen, an agent-harness framework for long-horizon image generation; experiments show that minimal agent harnesses improve over direct generation, while a ReAct-Plan-Exec-Reflect (RPR) workflow yields harness-dependent gains by strengthening evidence grounding and repair. Together, LongBanana provides an auditable testbed for measuring dense visual evidence use and a shared target for developing stronger agent-driven image-generation systems. Code and data are available at the project page: this https URL.
5. 【2611.06848】Persona Perspectives: Adopting Viewpoints Reorganizes Representations in LLMs
链接：https://arxiv.org/abs/2611.06848
作者：Austin C. Kozlowski,Avital Mintz,Madison Lee
类目：Computation and Language (cs.CL)
关键词：large language models, sparse autoencoders, large language, Common methods, language models
备注： 26 pages, 14 figures
点击查看摘要
Abstract:Common methods for monitoring features in large language models (LLMs) such as linear probes and sparse autoencoders (SAEs) assume that features maintain a consistent representation across contexts. LLMs, however, can flexibly adopt different perspectives or "personas" that suggest different underlying systems of conceptual relations. In this paper, we examine whether prompting an LLM to adopt a persona alters the representational geometry of the model's latent space. We extract representations of over 9,000 common words and 33 semantic axes from models adopting liberal and conservative political personas and compare these against two neutral baselines. We find that persona conditioning systematically alters both the projections of words onto semantic axes and the alignments among the axes themselves in directions consistent with the specified ideology. We then test the implications of this reorganization for two safety-relevant features: truthfulness and morality. Linear probes, SAE-based classifiers, and classifiers built from manually selected word representations, all trained without a persona, produce divergent results when applied to models conditioned on political personas, producing politically slanted ratings of truth and morality on controversial statements. These findings suggest that internal representations, as they are conventionally extracted, can exhibit different geometric relations when the model adopts personas, potentially undermining monitoring efforts.
6. 【2611.06839】Before You Continue: Evaluating Time-Sensitive Safety Awareness in Conversational Assistants
链接：https://arxiv.org/abs/2611.06839
作者：Peidi Dong,Yunze Xiao,Yu-Lin Tsai,Yichen Zheng,Heyuan Huang,Weihao Xuan,Mark Dredze,Jen-tse Huang
类目：Computation and Language (cs.CL)
关键词：Large language model, Large language, involve time-dependent constraints, everyday activities, activities that involve
备注： Preprint
点击查看摘要
Abstract:Large language model (LLM) assistants increasingly help users with everyday activities that involve time-dependent constraints. However, users may not mention these constraints in later requests, requiring assistants to recognize and adjust their advice accordingly. To evaluate such capability, we introduce TASC (Temporal Action Safety in Conversation), a benchmark that evaluates whether LLMs apply time-dependent constraints when responding to conversational requests. TASC consists of 3,418 inputs derived from 128 templates, along with a separate set of 33 scenarios designed to compare models' ability to calculate elapsed time with their ability to apply that information. Across 13 models, assistants account for time-dependent constraints in only 30.5% of cases where the proposed action violates a rule, while rarely warning users unnecessarily. More importantly, models fail to apply these constraints in 62.1% of cases despite correctly calculating the elapsed time. Explicitly providing the timing resolves only about half of these failures, revealing a gap between temporal reasoning and its application in conversational advice.
7. 【2611.06835】LooM: Loop-Invariant Memory for Causal Encoder-Decoder Language Models
链接：https://arxiv.org/abs/2611.06835
作者：Lele Yang,Muxi Diao,Zhonghao Yan,Jiankang Chen,Bin Wen,Tingting Gao,Wentao Zhang,Kongming Liang,Zhanyu Ma,Weiran Xu
类目：Computation and Language (cs.CL)
关键词：Looped Transformers increase, Transformers increase effective, Looped Transformers, Transformers increase, re-executing shared layers
备注：
点击查看摘要
Abstract:Looped Transformers increase effective depth by re-executing shared layers, but three limitations hinder their adoption: memory grows with the loop count, compute can only be adjusted in whole-block steps, and the loop count is hard to change after training. We propose LooM (Loop-invariant Memory), which addresses each in turn. In a causal encoder-decoder (CED), LooM loops only the decoder layers after the first, which read a global memory written once per token, and each of them publishes the key-value (KV) entry for a token only on its first visit, so the cache does not grow with the loop count. These layers loop independently, providing every budget from 3 to 21 layer executions per token, and one model trained on randomly sampled budgets covers all of them without a router. With enough loops, LooM outperforms a single-pass baseline trained on the same data on language modeling, zero-shot accuracy and long-context perplexity, while using the same cache size. Our analysis further shows that the training budget distribution decides what extra depth buys. These results suggest that a CED is a natural place to loop: memory is written once, and depth becomes a budget chosen at deployment.
8. 【2611.06812】SAUCE: Summary Analysis Using Conversation Entailment
链接：https://arxiv.org/abs/2611.06812
作者：Man-Ling Sung,Hemanth Kandula,Jeff Ma,William Hartmann,Matthew Snover
类目：Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
关键词：Large Language Models, evaluating Large Language, clear end goal, Language Models, Large Language
备注： Accepted and published to the ACL GEM workshop. Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM), pages 364-377, San Diego, California, USA. Association for Computational Linguistics
点击查看摘要
Abstract:With the growing need for evaluating Large Language Models (LLMs) and their applications to speech, challenges persist in summarizing and evaluating conversations that lack a clear end goal. We introduce SAUCE -- a reference-free, fact-based evaluation pipeline for cross-lingual conversational speech summarization. It measures the accuracy and the fact coverage of a summary through the entailment between conversation and text. We compare SAUCE against several popular summarization metrics and demonstrate the effectiveness of capturing information loss due to transcription and translation error and identifying broken summaries. Crucially, unlike black-box LLM evaluators or dense embedding metrics, SAUCE is inherently explainable: it maps summary scores to discrete, verifiable facts, allowing users to pinpoint exact hallucinations or omissions. We illustrate how this interpretability helps developers systematically profile LLM behaviors and gives end-users an actionable tool to verify summary accuracy in noisy, real-world conditions. Preliminary investigations show SAUCE strongly align with human judgment.
9. 【2611.06808】LLMs Don't Know What They Know: Benchmarking Temporal Self-Knowledge for Financial Backtesting
链接：https://arxiv.org/abs/2611.06808
作者：Lingfei Qian,Yan Wang,Xueqing Peng,Yupeng Cao,Yuechen Jiang,Zhuohan Xie,Anke Xu,Wenbo Cao,Jiarui Chen,Zehan Li,Jimin Huang,Alejandro Lopez-Lira,Yuehua Tang,Sophia Ananiadou,Jian-Yun Nie
类目：Computation and Language (cs.CL)
关键词：large language models, Financial backtests, large language, Federal Reserve decisions, Financial
备注： 20 pages, 4 figures, 11 tables
点击查看摘要
Abstract:Financial backtests of large language models (LLMs) are meaningful only if the model did not already know the outcomes it is asked to predict. Practitioners guard against this by trusting a vendor's stated knowledge cutoff, by asking the model what it knows, or by instructing it to answer as of a past date. To verify whether any of these safeguards can be trusted, we introduce FinDendro, a benchmark of 2,226 dated U.S. facts from 1999 to 2026, covering monthly macroeconomic series, month-end stock prices and Federal Reserve decisions. Each fact yields four prompts: a value question, Recall and Predict questions that pair each candidate value with a claim of knowing or guessing without a declared date, and a Predict question with a historical declared date. Controls for persistence and dominant outcomes keep chance accuracy near 0.27. Results show that for most frontier models, self-reports understate knowledge. GPT-5 answers 76% of controlled facts correctly but claims to know 38%, and answers 61% of the facts it says it does not know. Knowledge claims can persist beyond the measured knowledge boundary, by up to seven quarters, and a declared date removes most of the claims of prior knowledge while leaving accuracy unchanged. Backtests inside a model's training window therefore cannot be certified leak-free by self-report, instruction or stated cutoff. These findings motivate behavioral measurement of temporal knowledge boundaries, and FinDendro provides a benchmark and procedure for selecting backtest periods based on demonstrated factual knowledge.
10. 【2611.06806】Measuring Risk, Not Harm: Detecting Psychological Harm Risk Factors in LLM Conversations
链接：https://arxiv.org/abs/2611.06806
作者：Nil-Jana Akpinar,Eugenia Kim,Natalie Isak,Amanda Minnich,Victoria Westerhoff,Matthew Dressman
类目：Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：large language models, individual user context, subjective individual user, repeated interactions, large language
备注：
点击查看摘要
Abstract:Psychological harms from interactions with large language models cannot be monitored directly because they may emerge over repeated interactions and depend strongly on subjective individual user context. We propose measuring risk, not harm: detecting observable AI behaviors that constitute risk factors for psychological harm at the AI response level and aggregating these signals to support longitudinal monitoring. We operationalize eight such behaviors and construct a synthetic multi-label corpus of 47,062 AI responses and 373,873 response-factor labels, with targeted human annotations for validation and evaluation. We then compare trained embedding-based classifiers, direct LLM judging, and a classifier--judge cascade. All detectors are model-agnostic and operate only on LLM outputs, requiring no access to internal model states. We apply these detectors to several out-of-distribution human-AI conversation data sets from prior research. On held-out human-labeled data, the best cascade achieves macro precision of 0.86, recall of 0.76, and F1 of 0.79. On WildChat, it reduces LLM-judge calls by 97.1\% relative to direct judging. On DelusionEval, risk-factor detections cluster within conversations. Together, our results show that response-level behavioral risk-factor detection can provide a scalable measurement layer for longitudinal psychological-safety monitoring without conflating observable AI behavior with latent user harm.
11. 【2611.06789】Ranking Agreement Does Not Reveal Paragraph-Edit Agreement in Two Released Paper Acceptance Predictors
链接：https://arxiv.org/abs/2611.06789
作者：Shaoliang Yang,Jun Wang
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：fast acceptance classifier, fast acceptance, Learning Representations, papers, select revisions
备注： 38 pages including supplementary methods and results; 10 figures and 22 tables
点击查看摘要
Abstract:A fast acceptance classifier could select revisions for a slower evaluator. We ask whether agreement on existing papers supports that use. We compare a classifier of word and document features with two released text-only acceptance predictors fine-tuned from the same language model with three billion parameters. For 198 papers from the International Conference on Learning Representations, we compare model rankings of the original papers and of paragraph rewrites screened automatically for unchanged facts, claim strength, and attribution. The classifier ranks original papers closely with one predictor and moderately with the other, but shows no detectable agreement with either on which rewrites raise scores. The tests specified in advance used reduced numerical precision. Rounding error dominated the small score responses. We therefore rescored the released weights in full 32-bit precision as a post hoc check; edit agreement remained near zero. At this precision, when each predictor chooses among five rewrites per paper, its average raw score is under two points out of 100 higher than with random choice. The evidence covers presentation rewrites and two open predictors from one family; transfer to costly evaluators remains untested. Revision selectors should therefore be checked against the intended evaluator on the revisions they rank.
12. 【2611.06731】mplate Gap Reconstruction for Shell Output Simulation with Small Language Models
链接：https://arxiv.org/abs/2611.06731
作者：Jarrod Ragsdale,Rajendra Boppana
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：executing submitted commands, predict recurring utility, recurring utility structure, utility structure alongside, structure alongside content
备注： 25 pages, 7 figures, 12 tables, conference preprint
点击查看摘要
Abstract:Small language models offer a compact basis for shell simulation without executing submitted commands, but full-output decoding requires them to predict recurring utility structure alongside content that varies across executions. We introduce template gap reconstruction (TGR), which supplies reusable output literals interspersed with sentinels to be interleaved with autoregressively generated gaps. A template selector chooses which template to be reconstructed, with the empty template retaining full-output decoding. We construct a template bank from 18.7 million outputs collected across heterogeneous execution environments and train a template selector and five reconstruction models initialized from various small language model checkpoints on a target environment excluded from bank construction. Evaluation demonstrates that TGR improves output edit similarity (O-ES) over full-output decoding (FOD) when the optimal template covers more than 25\% of the template, while performing similarly for lower-coverage outputs. Additionally, TGR outperforms FOD for shorter gap sequences, with O-ES values of 0.964 and 0.812, respectively, while maintaining similar performance for longer sequences. TGR reduces the number of tokens generated by 26.3--38.3\% across used tokenizer families. These results support using a reusable output structure as a practical design choice for small shell simulators, improving response fidelity and shortening generation targets while keeping template selection and residual prediction central to response quality.
13. 【2611.06728】urns Matter: Advancing Streaming Video RL via Turn-Level Credit
链接：https://arxiv.org/abs/2611.06728
作者：Shuai Dong,Kanghui Tian,Linghan Chen,Wenqi Shao,Hongrui Wu,Haowen Hou,Yongfu Zhu,Xuehui Wang,Ziyue Wang,Wenpu Liu,Weichu Xie,Yuqi Xu,Congcong Wang,Kaiwen Tuo,Caoyuan Ma,Taiqiang Wu,Ji Zhao,Wenzheng Chang,Dianyi Wang,Siyuan Wang,Zhongyu Wei,Yu Qiao,Jiaqi Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Group Relative Policy, understanding requires models, continue observing, Group Relative, requires models
备注： 16 pages, 4 figures
点击查看摘要
Abstract:Streaming video understanding requires models to repeatedly decide whether to respond or continue observing. Recently, Group Relative Policy Optimization (GRPO) has been applied to this setting, with existing approaches emphasizing reward design while retaining a single trajectory-level advantage across turns. Such shared credit can reinforce redundant replies after earlier successes and discourage useful follow-ups after earlier failures. We propose TurnWise, a turn-level GRPO framework that aligns learning with individual streaming decisions. TurnWise addresses the mismatch between trajectory-level feedback and turn-level interaction, promoting informative responses and reducing redundancy. Specifically, turn-level credit assignment uses silence-completed prefix scoring to construct group-relative advantages from each decision's remaining return, separating its learning signal from earlier rewards. Turn-mean policy optimization averages token losses within each turn and then across turns, giving response and waiting decisions equal weight regardless of output length. These complementary designs improve streaming policy learning without a learned critic or additional rollouts. Extensive experiments show our method outperforms prior RL approaches for streaming video understanding.
14. 【2611.06715】Reasoning over Non-Parametric Memory in Multilingual LLMs: A Cognitive-Based Analysis of Relational Knowledge
链接：https://arxiv.org/abs/2611.06715
作者：Zohreh Abbasi Liasi,Batoul Hammoud,Anas Madkoor,Ehsaneddin Asgari
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Retrieval-augmented generation, memorized during pretraining, fall back, back on associations, associations memorized
备注： Published at COLM 2026
点击查看摘要
Abstract:Retrieval-augmented generation (RAG) assumes that language models can reason over relations stated in their context rather than fall back on associations memorized during pretraining. We study this evidence-conditioned relational reasoning in isolation, with the facts supplied directly in the prompt rather than retrieved. \textsc{Rel-Bloom} is a controlled multilingual diagnostic of 450 multiple-choice questions built from 30 Wikidata relations; the same source relations are instantiated at five Bloom-inspired levels (Remember, Understand, Apply, Analyze, Evaluate) and under three veracity conditions (Factual, Counterfactual, Neutralized). Across 43 models, six languages, and two multilingual settings (226,800 predictions), three findings stand out. First, accuracy drops sharply from Apply to Analyze in every evaluated open-weight model series, reaching 47.2 percentage points for the Large Granite bucket, but not for either Gemini model. Second, Evaluate items remain a bottleneck even for models near ceiling on the other task types: Gemini~3.1 Pro averages 99.5\% on the other four levels but 60.7\% on Evaluate. Third, item- and relation-level difficulty rankings are consistently preserved across languages, indicating a difficulty structure partly shared across languages within this benchmark. Across knowledge conditions, Counterfactual contexts are generally harder than Factual ones, while removing entity identities can improve higher-level performance in some model regimes. Greater model capability therefore does not by itself ensure reliable reasoning over supplied relational evidence. Relevant resources are available at: this https URL.
15. 【2611.06706】ALTO: African and Levantine Tech-Facilitated Gender-Based Violence Corpus
链接：https://arxiv.org/abs/2611.06706
作者：Tianwei Zhang,Ivy Njoki Nyagwencha,Zahraa Dirani,Shalini Joshi,Scott A. Hale
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Machine Learning (cs.LG)
关键词：Tech-facilitated gender based, gender based violence, gender minority groups, Tech-facilitated gender, online harm affecting
备注： 8 pages main body, 10 pages appendix, 1 figure
点击查看摘要
Abstract:Tech-facilitated gender based violence (TFGBV) is a pervasive online harm affecting women and gender minority groups through its many direct and covert forms. Current models and annotated datasets for gendered harm detection are dominated by data from, and models trained in, Global North languages. In collaboration with civil society organizations (CSOs) from Jordan, Francophone West Africa, and Kenya, we developed a community-led approach to crowdsource culturally and linguistically relevant instances of TFGBV in Levantine Arabic, African French, and Swahili. We annotated the crowdsourced data using active learning to develop a small but performant dataset (N=3022) called ALTO to improve TFGBV detection in the three languages. Through benchmarking and fine-tuning experiments, we show that existing harmful content detection models show poor TFGBV recall within ALTO and improve with fine-tuning. We found that models often miss covert harms across all languages, while error rates are markedly higher in Swahili. We report the experimental results and release the annotation taxonomy, dataset, and trained models.
16. 【2611.06655】Beyond accuracy: what AI assurance needs to establish in public services
链接：https://arxiv.org/abs/2611.06655
作者：Louise Yorke
类目：Computers and Society (cs.CY); Computation and Language (cs.CL)
关键词：bodies increasingly rely, including classifications, summaries and assessments, increasingly rely, rely on AI-produced
备注： 20 pages, 6 tables, 2 figures
点击查看摘要
Abstract:Public bodies increasingly rely on AI-produced evidence, including classifications, summaries and assessments. These outputs can inform policy decisions and service delivery, making their reliability a matter of public accountability. Establishing whether this evidence can be relied upon requires testing its outputs and examining how organisations decide whether those tests are sufficient. We combine technical evaluation with analysis of AI governance requirements, informed by measurement theory and management-based regulation. We compare eight GPT-4o configurations classifying 1,200 UK Prime Minister's Questions into 21 policy topics, against human-coded labels and across unchanged repeats. Accuracy ranges from 68.2% to 70.3%, yet 24.3% of questions receive different labels, with changes in topic shares and rankings. Configurations agree more with one another than with human coding: agreement does not guarantee correctness. Under the implemented score-extraction procedure, the proportion flagged for human review ranges from 0.9% to 41.0%. We analyse 37 UK and EU policy documents. Both sets expect testing and oversight, but reporting expectations do not consistently cover changing answers, shared errors, selective evaluation, substantive conclusions or review routing. Some UK guidance explicitly addresses stability. The UK sample emphasises public bodies checking their own use; the EU places substantial testing duties on providers while leaving them important choices about measures and acceptance thresholds. Without appropriate checks, evidence could misrepresent policy issues, redirect attention or resources, and leave errors undetected. Public policy should require organisations to justify reliance through checks beyond aggregate accuracy, clear responsibility, access to expertise and scrutiny of results.
17. 【2611.06639】Replicability, Reproducibility, and Robustness in Political and Social Science Research with Large Language Models
链接：https://arxiv.org/abs/2611.06639
作者：Joan C. Timoneda,Sebastián Vallejo Vera
类目：Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：central reproducibility problem, large language models, addresses the central, problem of research, research with large
备注： Chapter 5 of "LLMs in Political and Social Science: Principles and Applications of Transformer Models," Oxford University Press, forthcoming 2027. Data and code: [this https URL](https://github.com/llms-political-social-science-book-oup/book-code-data)
点击查看摘要
Abstract:This chapter addresses the central reproducibility problem of research with large language models. LLM output is probabilistic and varies across models and versions, which can have significant effects on downstream statistical results. The chapter distinguishes between replicability, reproducibility, and robustness, and proposes a probabilistic standard based on the distribution of results, not identical outputs. It introduces a standardized prompt script, tests within-model variation for encoders and decoders, and develops error-structure analysis to diagnose where models err and whether their errors align. Using three datasets, the chapter shows that measurement choice can reverse the sign of downstream regression coefficients. Existing design-based corrections with gold-labeled subsamples restore validity, but come at the cost of estimate precision. The main contribution of the chapter is a stacked ensemble of open-weight models that improves precision in the correction step while retaining estimate validity.
18. 【2611.06545】When Do Summaries Become Instructions? Unsupported Policy in LLM Agents' Self-Written Handoff Summaries
链接：https://arxiv.org/abs/2611.06545
作者：Wenhui Chu
类目：Computation and Language (cs.CL)
关键词：Long-running LLM agents, Long-running LLM, LLM agents compact, compact their context, LLM agents
备注： 22 pages, 3 figures, 15 tables. Code and data: [this https URL](https://github.com/Chuw1/handoff-audit)
点击查看摘要
Abstract:Long-running LLM agents compact their context, replacing most history with a summary. We ask whether handoff summaries state permissions or requirements the record does not support, whether such sentences change what the next instance (the successor) does, and where they come from. Synthetic tool-use tasks carry a ground-truth permission ledger; same-snapshot replay reruns the successor with those whole sentences replaced by neutral filler. Two AI readers, reading only rule-flagged held-out summaries, confirmed unsupported restrictions in 1.2% and 2.4% of all readable summaries from two open-weight models, and unsupported authorizations in 0.1% and 1.3%. For restrictions, a pre-specified replay test was not significant (p = 0.58); a follow-up, planned after it, found a fragile effect (p = 0.027). Neutralizing false approvals cut unauthorized actions from 24 to 7 of 120 held-out runs (post hoc; later set: 17 to 11 of 48). Most development restrictions followed the agent's earlier reasoning that an action needs approval (post hoc). In pre-specified tests, replacing the system prompt's "Some actions need approval." with one saying where requirements come from cut unsupported restrictions from 5.0% to 1.8% of development summaries and, on held-out templates, from 1.8% to 0.3% (both p 10^-9), while requests for approvals the ledger requires barely changed. Code and data: this https URL
19. 【2611.06517】Dialect Matters: A Dialect-Aware Baseline for Igala-English Machine Translation
链接：https://arxiv.org/abs/2611.06517
作者：Etuh E.,Eli. A. Jiya
类目：Computation and Language (cs.CL)
关键词：increased general global, general global understanding, greatly enhanced clarity, intelligent systems, Intelligent systems greatly
备注：
点击查看摘要
Abstract:The massive permeability of intelligent systems in every sphere of human activities have greatly enhanced clarity, ease of work, and increased general global understanding which has significantly awaken the use of intelligent systems by all users. Intelligent systems greatly rely on precise dataset/corpus for the correctness of their output. Despite efforts by researchers to address Low-resource language in the Natural Language Processing (NLP), Igala still has zero parallel corpora despite efforts by researchers. We present a dialect-aware baseline for Igala-English machine translation, among first open systems and first with dialectal variation analysis. Our dataset of 1137 sentences (899 training) is first with dialect tags: Idah 459 (40.4%), Ankpa 297 (26.1%), Ibaji 160 (14.1%), Other 187 (16.4%), Ogugu 32 (2.8%). Same English yields 20-60 Igala forms. Mixed-dialect training achieves balanced BLEU 11.66 versus Idah-only model which drops 4.7 BLEU on Ibaji (13.2 on Idah, 8.5 on Ibaji), proving dialect fairness requires mixing. Fine-tuned from Helsinki-NLP/opus-mt-en-mul (78M), epoch ablation shows convergence at 8 epochs and overfitting at 15. BLEU 11.66, chrF 46.69. Analysis shows 899 sentences on log-linear trend consistent with African low-resource literature. This work provides first dialectal impact analysis for Igala and establishes baseline for future work.
20. 【2611.06504】NaijaFacts: A Framework for Disentangling Language from Knowledge in Facts about Nigeria
链接：https://arxiv.org/abs/2611.06504
作者：Zainab Afolabi,Nikita Kozodoi,Jack Butler,Babs Khalidson
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：measuring linguistic competence, translate generic questions, Multilingual benchmarks, measuring linguistic, translate generic
备注：
点击查看摘要
Abstract:Multilingual benchmarks for African languages mostly translate generic questions into local languages, measuring linguistic competence but not whether models know facts about Africa. We introduce \naija, a benchmark of factual and statistical questions about Nigeria, authored by native speakers and grounded in authoritative official statistics, with every question available in English, Nigerian Pidgin, \yoruba, Igbo, and Hausa. Answering similar questions for the UK and US yields a country by language matrix that disentangles a language effect (the model knows the fact but degrades in a low-resource language) from a knowledge effect (the fact is absent in every language). Across eight frontier and Nigeria-adapted models, the knowledge effect dominates: English-query accuracy is 49--50\% for the US/UK but 20\% for Nigeria. The language effect is smaller and tracks web representation, degrading from English to \yoruba{} (9 points on Nigeria, up to 24 on US/UK questions). We find scale does not help: the strongest models reach 66--79\% on the UK and the US but none exceed 31\% on Nigerian statistics. Extending to all 54 African countries with our best performing frontier model shows the same profile continent-wide, 96\% on culture and 98\% on politics against 26\% on statistics, so the gap is not specific to Nigeria.
21. 【2611.06501】CRESiST: Self-Enhancing Explorative Policy Learning for Simultaneous Speech Translation
链接：https://arxiv.org/abs/2611.06501
作者：Chenyang Le,Pei Zhang,Yuxiang Chen,Bing Han,Derek F. Wong,Baosong Yang,Yanmin Qian
类目：Computation and Language (cs.CL); Sound (cs.SD)
关键词：Simultaneous Speech Translation, requires balancing translation, balancing translation quality, Simultaneous Speech, Large Language Models
备注： Accepted to NeurIPS 2026
点击查看摘要
Abstract:Simultaneous Speech Translation (SimulST) requires balancing translation quality and latency. While Large Language Models (LLMs) excel in offline translation, current LLM-based SimulST systems predominantly rely on prefix-incremental generation. This paradigm suffers from redundant Key-Value cache recomputation and necessitates external Voice Activity Detection to process unbounded streams. To overcome these bottlenecks, we propose an end-to-end interleaved read-write framework built upon an omni-modal LLM. By interleaving speech chunks and text tokens, our architecture achieves full KV cache reuse, natively supporting segmentation-free, infinite-length inference. Furthermore, to learn optimal streaming policies without rigid offline alignments, we introduce a novel Actor-Critic self-enhancement pipeline. An RNN-T Actor dynamically samples read-write trajectories, while an LLM-based Critic evaluates these paths via intrinsic semantic and latency rewards, distilling the optimal policy back to the Actor. Extensive experiments on sentence-level (FLEURS, CoVoST2) and document-level (MuST-C, ACL 60/60) benchmarks demonstrate that our model establishes new state-of-the-art quality-latency Pareto frontiers, substantially outperforming existing cascaded and static-alignment baselines.
22. 【2611.06496】LibriSpeech-Real-QA: A Benchmark for Streaming Question Answering
链接：https://arxiv.org/abs/2611.06496
作者：Zewen Zhan,Hui Lu,Xueyuan Chen,Huimeng Wang,Yikai Huang,Xixin Wu,Shiyin Kang,Bin Xia,Zhiyong Wu
类目：Computation and Language (cs.CL)
关键词：speech large language, large language models, offline manner, large language, speech
备注： 5 pages, 1 figure, 6 tables. Submitted to IEEE ICASSP 2027
点击查看摘要
Abstract:Most speech large language models (SLMs) still process speech in an offline manner. They only start responding after they receive the complete speech segment. However, many real-world applications require streaming speech interaction, for which the audio continuously flows in and the machine is required to answer questions based on the so far received audio chunks. For example, a user may ask the system to continuously count how many times a person's name has been mentioned while they are speaking. We observe a lack of benchmarks and evaluation protocols for real-time speech interaction. Motivated by this, we propose LibriSpeech-Real-QA, a dataset and a benchmark for real-time speech interaction. We construct different types of real-time question-answer pairs from LibriSpeech to evaluate whether speech LLMs can identify target words in streaming audio. We evaluate several popular real-time commercial models and find that they still tend to respond only after the speech turn has finished. We demonstrate that we can enable a pretrained SLM to perform this task, where we explore several modeling designs and establish a solid baseline for future research.
23. 【2611.06483】What Does Multi-Turn Reinforcement Learning Really Improve in LLM Agents?
链接：https://arxiv.org/abs/2611.06483
作者：Kejian Zhu,Zhuoran Jin,Shangqing Tu,Tianyi Men,Yupu Hao,Jiachun Li,Kang Liu,Jun Zhao
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：gains remain highly, remain highly sensitive, agentic reinforcement learning, multi-turn agentic reinforcement, performance gains remain
备注： Project Page: [this https URL](https://rethinking-agentic-rl.github.io/)
点击查看摘要
Abstract:While multi-turn agentic reinforcement learning (RL) excels on long-horizon tasks, its performance gains remain highly sensitive to interaction constraints. Evaluating across sampling breadth $K$ and interaction depth $T$ via $Pass@(K,T)$, we show that trajectory-level RL advantages depend on sufficient turn budgets, diminishing significantly when budgets tighten. Besides, agentic RL does not uniformly elevate single-step decision quality; rather, its strength concentrates in error recovery and long-horizon resilience. To mitigate the deployment risks caused by this budget dependence, we provide a preliminary discussion on the benefits and limitations of process supervision signals and introduce BudgetMix RL as an alternative that varies interaction budgets during training. Experiments demonstrate that BudgetMix RL achieves robust performance across diverse execution settings. Project Page: this https URL
24. 【2611.06481】ArcRAG: Agentic Compositional Retrieval over Knowledge Graphs
链接：https://arxiv.org/abs/2611.06481
作者：Jyotin Goel,Abhinav Arun,Tejas Prakash Agarwal,Bhaskarjit Sarmah,Stefano Pasquali
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Graph-based retrieval-augmented generation, Graph-based retrieval-augmented, retrieval-augmented generation, knowledge graph built, graph
备注： Preprint
点击查看摘要
Abstract:Graph-based retrieval-augmented generation (GraphRAG) answers questions by retrieving over a knowledge graph built from a corpus. Yet retrieval strategies are designed around the structure their own construction pipeline produces, and whether they survive a change of construction is rarely tested. We study this cross-construction portability: whether one retrieval procedure, with no construction-specific schema, relation names, or retuning, stays effective when the graph is built differently. We introduce ArcRAG, which induces a query-local graph interface at inference time (the node labels, relation descriptors, and property keys reachable from the entities a question names), plans multi-hop traversals against it, and executes and repairs them as Cypher. We build each of the MuSiQue, HotpotQA, and TriviaQA corpora as a schema-guided graph (typed nodes, a closed relation set, source provenance) and as an open-information-extraction graph (untyped nodes, free-text relations), with the retriever's configuration fixed across them. We compare against a construction-agnostic Direct-Cypher agent, ablate each stage across retry and pass budgets on both graph families, and compare with results reported for prior GraphRAG systems, most of which design retrieval together with their own graph construction. Across the two constructions, we find that retrieval need not be co-designed with the graph: query-time interface induction keeps a construction-agnostic retriever effective when the construction changes, although construction still shapes absolute accuracy.
25. 【2611.06444】EvoGuard: Mitigating Degradation in Online Skill Evolution
链接：https://arxiv.org/abs/2611.06444
作者：Yanli Wang,Zichen Bai,Tianyue Jiang,Kunming Shao,Junhao Shi,Xueqin Liu,Jinguo Sun,Muye Li,Tingting Bi,Yanlin Wang,Shaoqiang Zheng,Xuefei Diao,Zhuwei Zeng,Nan Duan,Peng Cao
类目：Computation and Language (cs.CL)
关键词：language agents reuse, agents reuse experience, natural-language documents, reuse experience, skill
备注： 16 pages, 6 figures, 7 tables, including appendices
点击查看摘要
Abstract:Skills let language agents reuse experience across tasks as natural-language documents. Recent work evolves skills from interaction, but existing methods have limitations when skills evolve online. Prior methods update a skill offline from a batch of trajectories collected over many tasks. Some then adopt the new skill without any check, which can degrade the skill over time. Others keep it only if it improves performance on a held-out validation set, which is too slow and costly to run after every update. We introduce EvoGuard, a pairwise skill selector that mitigates skill degradation at low latency and cost. We first run the agent iteratively to build pools of skills and score each skill on a private test set to obtain utility labels. We pair the skills and use rejection sampling to keep only pairs with a clear utility gap. The selector is trained on the logits of two label tokens to pick the better skill. At deployment it decides in a single forward pass, which is significantly faster than evaluation on the private test set. Compared with adopting every new skill, EvoGuard improves success by 11.0% on ALFWorld, 5.9% on ScienceWorld, and 2.7% on LiveCodeBench.
26. 【2611.06414】wists and Turns: A Graph-Based Benchmark and Framework for Long-Term Memory in Exploration Tasks
链接：https://arxiv.org/abs/2611.06414
作者：Chongyuan Dai,Yaling Shen,Zirui Song,Junfeng Liao,Jinpeng Hu,Xiuying Chen
类目：Computation and Language (cs.CL)
关键词：Long-term problem-solving processes, textsc, software development, central goal, Long-term problem-solving
备注： 29 pages, 5 figures
点击查看摘要
Abstract:Long-term problem-solving processes, such as scientific research and software development, proceed along an evolving trial-and-error trajectory toward a central goal. We term these \textit{exploration tasks}, which require models to remember not only facts but also how solutions are tested against intermediate outcomes and early attempts are continually revised or revived. However, existing long-term memory research focuses on factual recall and updates, overlooking the interconnected nature of exploration. We observe that exploration processes naturally form graphs, with branching approaches linked by revisions and reconsiderations. Motivated by this, we propose \textsc{LExMem}, a graph-guided benchmark designed to evaluate \underline{\textsc{Mem}}ory in \underline{\textsc{L}}ong-term \underline{\textsc{Ex}}ploration tasks. We model exploration processes as graphs and introduce an evolutionary mechanism to increase their structural complexity, yielding 224 dialogues and 2,018 question-answer instances derived from graph structures. Building on the same insight, we propose \textsc{LExGraph}, a graph-based memory framework that incrementally organizes dialogues into interconnected memory nodes and retrieves evidence through hybrid retrieval and neighbor expansion. Extensive experiments demonstrate that \textsc{LExMem} poses a significant challenge to existing retrieval- and memory-based systems, whereas \textsc{LExGraph} achieves superior performance and generalizes effectively to external benchmarks. Codes and datasets are available at this https URL.
27. 【2611.06403】Ruby-OPD: Enhancing Pronunciation Controllability and Accuracy for Flow-Matching Text-to-Speech via On-Policy Distillation
链接：https://arxiv.org/abs/2611.06403
作者：Rui Hu,Xiaolong Lin,Zhenpeng Zhan
类目：Computation and Language (cs.CL)
关键词：mixing logographic Kanji, unsegmented language mixing, language mixing logographic, Achieving both high, logographic Kanji
备注： 5 pages, 3 tables, work in progress
点击查看摘要
Abstract:Achieving both high pronunciation accuracy and fine-grained controllability remains a central challenge in Japanese text-to-speech (TTS), as Japanese is an unsegmented language mixing logographic Kanji and phonographic Kana with extensive polyphony. Traditional cascaded systems convert text into phoneme sequences via a front-end, ensuring pronunciation control but discarding lexical semantics and prosodic cues in surface orthography. Conversely, recent zero-shot TTS models directly consume raw orthographic text to improve naturalness, yet suffer from polyphone errors and lack explicit pronunciation control. To bridge this gap, we propose a two-stage framework for flow-matching TTS. First, we investigate Ruby text representations with orthography perturbation to jointly preserve surface forms and target pronunciations for reliable control. Second, we introduce On-Policy Distillation (OPD) on large-scale text-only corpora to enhance pronunciation accuracy on raw orthographic text without paired speech. On the Joyo-Kanji-Yomi benchmark, our model achieves 97.13% Accuracy, 2.02% Target PER, 0.70% Sentence PER, and 4.21% Sentence CER under raw text while retaining strong controllability.
28. 【2611.06402】Interpretable Text Embeddings Based on Hierarchical Questions
链接：https://arxiv.org/abs/2611.06402
作者：Kohei Oda,Po-Min Chuang,Kiyoaki Shirai,Natthawut Kertkeidkachorn
类目：Computation and Language (cs.CL)
关键词：questions, QA-based text embeddings, text embeddings represent, embeddings represent texts, vectors consisting
备注：
点击查看摘要
Abstract:QA-based text embeddings represent texts as vectors consisting of 1/0 answers to yes/no questions. Although these embeddings provide detailed information for interpretation and achieve high task performance, they often require humans to examine a large number of questions. Furthermore, the relationship between the number of questions and the appropriate level of question granularity has not been sufficiently studied. To address these challenges, we propose a method for constructing hierarchical questions for text embeddings. As the hierarchy deepens, questions become more specific and their number increases. During interpretation, we reduce the number of questions that humans need to examine by replacing questions at deeper levels with aligned questions at shallower levels. The question hierarchy is constructed through recursive clustering, contrastive prompting, and question alignment. Experimental results on general-purpose tasks show that our method improves interpretability while maintaining task performance. It is also found that, when only a limited number of questions are available, questions at shallower levels tend to achieve higher task performance than those at deeper levels, even with the same number of questions.
29. 【2611.06397】Where Should a KV-Cache Repair Budget Go? Distractor Structure and Contextual Compatibility in Non-Prefix Reuse
链接：https://arxiv.org/abs/2611.06397
作者：Yuxing Peng,Zhiqing Tang,Weijia Jia
类目：Computation and Language (cs.CL)
关键词：Non-prefix KV-cache reuse, encodes retrieved chunks, retrieved chunks independently, Non-prefix KV-cache, KV-cache reuse encodes
备注： 36 pages, 6 figures, 34 tables
点击查看摘要
Abstract:Non-prefix KV-cache reuse encodes retrieved chunks independently and concatenates their caches. To find where a small repair budget should be spent, we vary the chunks around the answer-bearing one (the target) across three 7B-8B models and four datasets of dialogue memory, open-domain QA and API documentation. Reuse loses 19-100% of the context-dependent questions that full prefill answers, and it loses more when the other chunks are of the same kind as the target. Because the recoverable damage is spread over these other chunks, restoring a few of them recovers little, and the budget is better spent on the target. This works through contextual compatibility: recomputing the target against the reused cache beats inserting its full-prefill KV in all seven settings tested, although the recomputed KV stays far from the full-prefill KV. Question attention over reused caches, however, selects the target in at most 18.8% of development questions. A retriever finds it more often, and recomputing its top chunk after moving it next to the question significantly beats InfoFlow-style reordering at the same 5% budget in six of nine open-domain QA and API-documentation settings. On dialogue memory, though, recomputing chunks never significantly beats the token-level selector chosen for each setting.
30. 【2611.06384】Presentation Sensitivity in Typed Decision Models for Subjective Text Evaluation
链接：https://arxiv.org/abs/2611.06384
作者：Jatin Agrawal,Radhika Mamidi
类目：Computation and Language (cs.CL)
关键词：Typed decision models, models offer structured, offer structured choices, decision models offer, low-cost automated evaluation
备注： 27 pages, 1 figure, includes appendices
点击查看摘要
Abstract:Typed decision models offer structured choices, scores, and probabilities for low-cost automated evaluation. We present a controlled audit of presentation sensitivity in Jev, Clef Flash, and Perplexity Decider across native choice and score interfaces. Across six datasets with 9,000 multiply annotated humor, helpfulness, and summarization items, we collect 702,000 judgments under interventions that vary positions, identifiers, authorship claims, endorsements, decision framing, and rating rubrics while preserving the evaluated texts. Jev's second-position probability advantage reaches 6.11 percentage points on summaries; reversing reader endorsements changes Perplexity's selected humor text on 40.40% of pairs; and rejection framing reduces Clef's summary agreement with human preferences by 23.36 points. Rating formats also shift score levels while often preserving rankings. Across these findings, repeatability, presentation robustness, and human alignment emerge as distinct properties of an evaluator. Reliable use therefore requires validating the decisions and score interpretations on which an evaluation pipeline depends.
31. 【2611.06381】LegalEvolver: Agentic Legal Judgment Prediction via Rubric-Guided Self-Evolution
链接：https://arxiv.org/abs/2611.06381
作者：Xinyu Yang,Jiejun Tan,Chenlong Deng,Chenghao Zhang,Tongyu Wen,Zhicheng Dou
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：LLM-based agents develop, Legal Judgment Prediction, agents develop, LLM-based agents, increasingly applied
备注： 20 pages, 5 figures
点击查看摘要
Abstract:As LLM-based agents develop, they have been increasingly applied in the legal domain. Legal Judgment Prediction~(LJP) requires models to conduct multi-step reasoning and external legal evidence retrieval. Existing legal search agents' performance is often constrained by the quality of retrieval queries. They often formulate queries directly from the initial user request, overlooking latent legal issues and legally salient details. To address this issue, we propose \emph{LegalEvolver}, a query optimization framework specifically designed to generate legally informative queries for LJP-oriented retrieval. Sampling high-quality optimized queries and their corresponding search trajectories is challenging, as relying solely on unguided high-temperature rollouts is both inefficient and constrained by the model's initial capabilities. We therefore heuristically optimize queries as seeds, improving the efficiency of trajectory generation. Furthermore, we summarize rollout experience into rubrics and use them to guide multi-round iterative self-evolution. Iteratively performing rubric optimization and rubric-guided RL enables the model to surpass its initial performance ceiling. End-to-end performance on extensive benchmarks demonstrates the effectiveness of query optimization on LJP. Comparisons with direct SFT followed by RL demonstrate the effectiveness of rubric guidance. Evolving rubrics further outperform fixed rubrics, confirming the benefits of self-evolution.
32. 【2611.06380】Does Context Compression Preserve Refusal Alignment?
链接：https://arxiv.org/abs/2611.06380
作者：Anthony Nguyen,Wenjun Lin
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Context compression reduces, reduces inference cost, preserving semantic content, compression reduces inference, Context compression
备注： Presented at Canadian AI 2026
点击查看摘要
Abstract:Context compression reduces inference cost by encoding inputs into compact representations while preserving semantic content. An open question is whether semantic preservation alone is sufficient to maintain downstream behaviours such as refusal alignment. We investigate this question and find that encoder-based compression systematically weakens refusal behaviour in instruction-tuned language models, despite high reconstruction fidelity. This effect persists across model families and compression architectures. Mechanistic analysis shows that compression attenuates activation along the decoder's learned refusal direction. We further explore Memory Steering, a lightweight inference-time intervention that restores refusal rates to near-baseline levels without retraining and operates entirely in compressed representation space. These results demonstrate that semantic preservation does not guarantee behavioural preservation under compression, highlighting the need to explicitly preserve alignment-relevant features in compression-aware systems.
33. 【2611.06374】Corralling AI Risks with Grassroots Contracts
链接：https://arxiv.org/abs/2611.06374
作者：Ehud Shapiro
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC); Multiagent Systems (cs.MA)
关键词：inflection point, fountain of alarming, global platforms, majority of humanity, Unaccountable AI agents
备注：
点击查看摘要
Abstract:AI's inflection point is a fountain of alarming risks. Digital platforms in particular are vulnerable to three major AI risks, as those in control of global platforms cede control to AI, of the algorithms, of membership and of content: (1) AI control of global platforms, social and economic, used by the majority of humanity, resulting in the majority of humanity becoming vulnerable to AI control. (2) Unaccountable AI agents operating anonymously on social and economic digital platforms, side-by-side with humans, possibly masquerading as humans, serving unknown masters with unknown goals, operating under unknown restraints without accountability or culpability. (3) Unattributed deepfakes generated by anonymous AI, with people unable to distinguish them from genuine content and with their producers evading accountability and culpability. Here, we propose to corral these AI risks with grassroots contracts, a digital incarnation of a two-centuries old notion of Pierre-Joseph Proudhon. We present grassroots contracts for a social graph with accountable AI agents and for a social network with digital provenance, and working smartphone apps that implement the two and show how they corral these major AI risks: (1) AI control of global platforms. (2) Unaccountable AI agents. (3) Unattributed deepfakes.
Subjects:
Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC); Multiagent Systems (cs.MA)
Cite as:
arXiv:2611.06374 [cs.AI]
(or
arXiv:2611.06374v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2611.06374
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
34. 【2611.06371】raining-Free Character-Length Control in Summarization with Diffusion Language Models
链接：https://arxiv.org/abs/2611.06371
作者：Steffen Castle,Nils Feldhus,Christopher Ebert,Leonhard Hennig,Sebastian Möller
类目：Computation and Language (cs.CL)
关键词：article preview generation, preview generation, exact space, Length Targeting Algorithm, fixed character length
备注： Accepted at EMNLP 2026 (Main Conference)
点击查看摘要
Abstract:Summarization with a fixed character length is important for tasks such as headline and article preview generation, where text must fit an exact space. Autoregressive language models (LMs) struggle with precise character-length control: training-based methods require task-specific fine-tuning, while zero-shot prompting strategies achieve only approximate compliance. We propose DELTA (Diffusion Expected Length Targeting Algorithm), a training-free inference-time method for masked diffusion LMs that estimates expected character length at each denoising step and dynamically inserts or removes masked positions to steer toward a target length. DELTA requires no fine-tuning and is designed for off-the-shelf masked diffusion LMs. Across three summarization benchmarks, it reduces character-length errors by an order of magnitude compared to baselines while maintaining competitive summary quality in both automatic and human evaluation.
35. 【2611.06324】Mass Producing Training Data with Surprising Side Effects
链接：https://arxiv.org/abs/2611.06324
作者：Yaowen Ye,Jacob Steinhardt,Sarah Schwettmann,Cassidy Laidlaw
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：induce broad misalignment, insecure code data, induce broad, insecure code, broad misalignment
备注：
点击查看摘要
Abstract:Training data can have unexpected side effects on language model behavior outside the training domain: insecure code data can induce broad misalignment, and outdated bird names can induce a 19th-century persona. Understanding such generalization is hard because only dozens of isolated examples exist, each constructed by hand or discovered by accident. We propose automatically discovering such datasets with surprising side effects (DSSEs). We define three objectives for DSSEs: they should (1) elicit a target behavior, (2) read like ordinary post-training data, and (3) be surprising to human auditors reading the data. We operationalize each with LLM judges, and search for high-scoring datasets via evolution, reinforcement learning, and subliminal learning approaches. After re-scoring and filtering with held-out metrics, our pipeline produces a collection of 6,575 DSSEs across 8 behaviors, many of which generalize across model families and sizes. We find our automated metrics track ML researchers' judgments, and frontier models outperform humans at predicting side effects. These datasets form a testbed for studying generalization and lay the groundwork for predicting training side effects before model deployment. Explore them at this https URL.
36. 【2611.06238】Zuse: A Decision Model for European Languages
链接：https://arxiv.org/abs/2611.06238
作者：Umair Mehmood Imam
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Decision models read, generating text, read a document, document and return, return a probability
备注： 9 pages, 3 figures, 7 tables
点击查看摘要
Abstract:Decision models read a document and return a probability for each of a fixed set of options instead of generating text. Several appeared in 2026, but none has published results outside English. We describe Zuse, three decision models (4B, 9B and 27B) that train a low-rank adapter and a pointer head on frozen open-weight bases, targeting 27 European languages, and use them to study how this design behaves across languages and tasks. On a broad European suite of 11 sources excluded from training, covering 9 task groups and 27 languages, a development set that also guided model selection, the 27B model reaches 87.5% accuracy with a pooled expected calibration error of 0.016, and 0.035 when weighted per source. Post-hoc analyses of these single-seed results give three findings. First, miscalibration is structured by task rather than language: on parallel reading and topic items in 26 languages the confidence gap varies about as much as sampling noise, while across sources it spans -0.07 to +0.09, with knowledge tasks overconfident and acceptability judgements underconfident at all three sizes, so one fitted temperature cannot correct both. Second, the share of decisions that can be automated at a 5% error budget follows chance-corrected skill (Spearman 0.97 over 33 source and model pairs) more closely than raw accuracy (0.91). Third, reach beyond the training languages is set by the base model: across 210 languages, changing the training run moved scores by at most about 2 points within a size, while languages outside the base's documented list trail by 23 to 28 points at every size. On English public suites Zuse is behind Jev and Kev, including Kev models on the same bases. We also report two pitfalls in building multi-source training data: label-word collision between topic schemes, and an injection augmentation that taught a shortcut. Zuse can be tried at this https URL.
37. 【2611.06206】Loop Before You Leap: What Recurrent Depth Can and Cannot Buy in Data-Limited Pretraining
链接：https://arxiv.org/abs/2611.06206
作者：Daichi Hotta,Yohei Kobashi,Takeshi Kojima,Yusuke Iwasawa,Yutaka Matsuo
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：BabyLM Challenge, Challenge, Klerings, Takmaz, language data
备注： Accepted to the BabyLM Challenge 2026 (Strict track). 20 pages, 5 figures, 12 tables. This version no longer reports a training-time shuffled-feature control that appeared in the workshop version, because its execution could not be verified (see Limitations)
点击查看摘要
Abstract:Multimodal models have often scored below text-only baselines in the BabyLM Challenge (Klerings et al., 2024; Takmaz et al., 2025). We test whether additional recurrent computation helps close this gap. Recurrence increases computation by reusing layers without adding parameters or training data. Using a single implementation, we compare standard and looped Transformers under a 100M-word budget, with three seeds per main condition. Each image is represented by one feature vector from a frozen DINOv2 encoder, used as a prefix token. Caption words count toward the budget, so multimodal training also changes the language data. In a pre-registered text-only comparison, a 12-layer stack repeated four times exceeds a standard 48-layer Transformer by 5.4 BLiMP percentage points at matched inference compute. However, multimodal training lowers BLiMP accuracy by about 3.8 points in both architectures, with no clear mitigation from recurrence. An exploratory loop-side no-image control, trained with the multimodal language data and batching schedule, scores 5.7 points below the text-only baseline. Adding the visual prefix raises accuracy by 1.85 points on average, but this contrast is uncertain with three seeds. These results suggest that changes in language data and its presentation are a major source of the drop. Diagnostic tests show that the models use visual information; its contribution to grammatical generalization remains uncertain under this single-vector interface.
38. 【2611.06185】Editing Large Language Models with Geometry-Aware Regularization
链接：https://arxiv.org/abs/2611.06185
作者：Bingqing Liu,Wei Liu,Jun Wang,Xiaobo Sun,Yuhua Li,Ruixuan Li
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：large language models, technique for updating, large language, key technique, Transformer FFN hidden
备注： 10 pages for main contents
点击查看摘要
Abstract:Knowledge editing has become a key technique for updating knowledge in large language models. However, existing methods neglect the geometric structure of the knowledge representation space, leading to two key limitations: they cannot distinguish which pre-trained knowledge should be preferentially preserved (core vs. non-core) nor which new edits are inherently difficult (hard vs. easy). To address this, we propose GEdit, a geometry-aware framework built on a Low-Rank Plus Diagonal (LR+D) factor model that captures the intrinsic low-rank structure of Transformer FFN hidden representations. GEdit features two complementary mechanisms. First, the low-rank regularization applies targeted protection on a low-rank core knowledge subspace. Second, the adaptive regularization dynamically adjusts the regularization strength based on each edit request's editability: relaxing constraints for hard edits to ensure success, and tightening them for easy edits to better preserve pretrained knowledge. Extensive experiments on GPT2-XL, GPT-J, and LLaMA-3-8B under large-scale editing scenarios, including both mini-batch and fully sequential editing settings with up to 10,000 continuous updates, show that GEdit consistently and significantly outperforms state-of-the-art baselines in both editing success and knowledge preservation.
39. 【2611.06170】AssameseLM-E2B: An Open-Weight Assamese Language Model for Efficient Consumer-Grade Deployment
链接：https://arxiv.org/abs/2611.06170
作者：Pragyan Phukan
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Large Language Models, excel in high-resource, linguistic interference, Large Language, performance often degrades
备注：
点击查看摘要
Abstract:While Large Language Models (LLMs) excel in high-resource languages, their performance often degrades in low-resource languages due to tokenization inefficiencies, generative instability, and linguistic interference. This paper presents AssameseLM-E2B and its instruction-tuned variant, AssameseLM-E2B-it, a 2-billion-parameter model adapted specifically for low resource Assamese language. Built upon the Gemma-4 architecture, the model incorporates an expanded byte-level BPE vocabulary to reduce tokenization overhead by nearly 500% compared with multilingual 2B--3B baselines. We employ a parameter-efficient Continual Pre-Training (CPT) pipeline with Hybrid LoRA, followed by Supervised Fine-Tuning (SFT) on a balanced, multi-domain dataset to enhance instruction-following and Retrieval-Augmented Generation (RAG) capabilities. Evaluation demonstrates a Bits-per-Byte (BPB) score of 0.7488 on FLORES-200, alongside an overall RAG score of 96.7% and 100% refusal accuracy on adversarial unanswerable prompts. Comparative analysis reveals significant limitations in general-purpose baselines, including receptive-productive decoupling, generative degradation on Romanized Assamese, and unintended Bengali script assimilation. These results demonstrate the potential of parameter-efficient adaptation for developing capable, locally deployable language models for low-resource languages under constrained computational resources.
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
Cite as:
arXiv:2611.06170 [cs.CL]
(or
arXiv:2611.06170v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2611.06170
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
40. 【2611.06133】Accelerating Long-Context Decoding in Large-Scale Hybrid LLMs Without Retraining
链接：https://arxiv.org/abs/2611.06133
作者：João Eduardo Batista,Emil Vatai,Mohamed Wahib
类目：Computation and Language (cs.CL); Performance (cs.PF)
关键词：large language models, make every generated, large language, full-attention layers, slowing models
备注： 19 pages (main body: 10 pages, references: 3 pages, appendix: 6 pages), 8 figures, 6 tables
点击查看摘要
Abstract:The full-attention layers of large language models (LLMs) make every generated token more expensive than the previous one, slowing models down on long-context tasks. Hybrid models reduce this cost by replacing most full-attention layers with linear-attention layers, but the first still dominate decoding at long contexts. We accelerate these remaining layers without any training or weight changes using combined sparse attention: each layer attends to a sliding window of recent tokens, a pinned prefix, and a fixed budget of most relevant tokens in the context. The window size and budget are found on a per-layer basis using a multi-objective search algorithm. Across six hybrid models from three families, from 4B to 397B parameters, the selected configurations preserve their baseline model's accuracy on 21 long-context datasets. Decoding 64k/256k tokens becomes up to 1.26x/2.22x faster on Qwen3.5-4B, 1.20x/2.23x on Qwen3.5-122B-A10B, and 1.16x/2.06x on Ornith-1.0-397B.
41. 【2611.06132】Growing One's AI Tools: A Paradigm of Practice-Grown Tools
链接：https://arxiv.org/abs/2611.06132
作者：Zeming Zhao
类目：Human-Computer Interaction (cs.HC); Computation and Language (cs.CL); Software Engineering (cs.SE)
关键词：long used software, professional computer-assisted interpreting, software built, Professionals have long, professional computer-assisted
备注： 15 pages, 3 figures, 3 tables, 49 references
点击查看摘要
Abstract:Professionals have long used software built for them by others. This article reports the growth of a professional computer-assisted interpreting (CAI) tool built by its own user, a conference interpreter without programming training. Drawing on an eight-week version-controlled record with telemetry from 133 logged sessions and over 20,000 recognized utterances, the article traces how real conference work drove the tool through 62 commits and six versions. The record shows capabilities deployed on the day their need appeared and one strategy change that cut median end-to-end delay by over a third within one afternoon. The article then proposes the paradigm of practice-grown tools, defined by the shift from using to growing, the co-evolution of tool and practice through breakdown and repair, bounded local computation, and an assessment corollary, and it formulates three propositions toward tool-inclusive assessment of practitioners, from tool-making literacy to a compute-standardized format for certifying what they and their tools achieve together.
42. 【2611.06116】he Harness Is the Model: Agent Scaffolding Changes a Fixed LLM's Compliance with Banking Conduct Rules, Unevenly Across Models
链接：https://arxiv.org/abs/2611.06116
作者：Mehmet Murat Huyut
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)
关键词：Banks validate language, validate language models, deploy systems, validate language, Banks validate
备注： 16 pages, 4 tables. Pre-registered. Code, data and all 3120 episode traces: [this https URL](https://github.com/mhuyut/harness-is-the-model)
点击查看摘要
Abstract:Banks validate language models, but they deploy systems: a model inside a harness that decides what it sees, which tools it can call and who checks its actions. We test whether that harness changes compliance with banking conduct rules when the model is held fixed. Four open-weight models each ran five harnesses (a pipeline that makes one structured decision, a ReAct-style tool loop, a loop in which the policy is reachable only through search, a loop with a long benign customer memory, and a loop with a same-model compliance reviewer) on 156 pre-registered cases in a simulated retail bank whose 11 rule families paraphrase EU consumer-credit, payments, investor-protection, data-protection and anti-money-laundering provisions. Every one of the 3120 two-turn episodes was scored deterministically from the executed tool trace, with violations and over-refusals counted separately. Pooled across models the harness moved the correct-case rate only between 87.3% and 92.1%, but within a model it mattered a great deal: for one model the spread between its best and worst harness was 11.5 percentage points, enough to move it from first to last place among the four models, while for another the harness made no detectable difference; the model x harness interaction itself was suggestive rather than conclusive. The same-model reviewer cut violations from 9.6% to 6.4% without raising over-refusals, contrary to our pre-registered prediction. Rules that require date arithmetic failed in every harness. In an exploratory analysis with two LLM judges and a blind human check, 26% of violations were accompanied by a customer message that denied the action the agent had just executed, which a transcript-only review would record as a correct refusal. For model-risk management the unit of validation should be the model-harness pair, and conduct testing should read the action log, not the conversation.
43. 【2611.06100】Reconciling Privacy with Provenance for Language Model Watermarks
链接：https://arxiv.org/abs/2611.06100
作者：Elise L. Han,Tatsunori Hashimoto
类目：Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Watermarking has great, marred by controversy, great potential, potential for regulating, argue that fine-grained
备注：
点击查看摘要
Abstract:Watermarking has great potential for regulating the use of language models (LMs), but its deployment has been marred by controversy, as many users argue that fine-grained tracking of LM usage violates their privacy. This tension reduces the effectiveness of watermarks, as users engage in evasion strategies such as paraphrasing that can remove much of the watermark signal. We show that provenance and privacy can be reconciled if we shift the goal of watermark design from tracking individuals to estimating aggregate usage. We develop locally differentially private watermarks which provably limit the evidence that any individual text can contribute to detection, while still enabling accurate estimation of population frequencies. We introduce the Red-Green Sequence (RGS) watermark, a private and computationally efficient watermark that achieves accurate frequency estimation at high privacy levels across various models, sample sizes and generation entropies in settings that reflect realistic deployment scenarios. On C4 language modeling tasks, we attain $0.0019$ MSE with $0.0038$ mean absolute bias at a low $\varepsilon$ of 1, while in more challenging settings such as an essay writing task with only 100 text samples, we still find errors on the order of $0.0113$ MSE with $0.004$ mean absolute bias at $\varepsilon=2$.
44. 【2611.06090】Overview of the NTCIR-19 SciClaimEval Task: Cross-modal Claim Verification in Scientific Papers
链接：https://arxiv.org/abs/2611.06090
作者：Xanh Ho,André Greiner-Petter,Florian Boudin,Yun-Ang Wu,Sunisth Kumar,Tian Cheng Xia,Hiba Akbi,Tim Schopf,Akiko Aizawa
类目：Computation and Language (cs.CL)
关键词：tables and figures, presents an overview, verifying scientific claims, paper presents, scientific claims
备注： The first two authors contributed equally. More information about the shared task is available at [this https URL](https://sciclaimeval.github.io/)
点击查看摘要
Abstract:This paper presents an overview of \emph{SciClaimEval}, a pilot task at NTCIR-19 on verifying scientific claims against the tables and figures of the papers in which they appear. Our dataset pairs authentic claims from 180 papers in machine learning, natural language processing, and medicine with contrastive versions of their tables and figures, one supporting the claim and one minimally modified so that it does not. The task comprises two subtasks: deciding whether a piece of evidence supports a claim, and selecting which of two evidence versions does. Twenty-two teams registered, the highest number among NTCIR-19 tasks, and 14 submitted 177 runs. Most systems built on multimodal large language models, relying on prompting and multi-stage inference rather than task-specific fine-tuning. On the first subtask, the best systems reached 98.1\% pair accuracy, but all six top-ranked systems relied on the contrastive pairs; the best system that judged each claim-evidence pair on its own scored 24.3 points lower. Open-weight models, embedded in carefully designed pipelines, matched proprietary ones. Yet verifying a single claim against its evidence, the setting that matters in practice, remains an open problem.
45. 【2611.06065】ProcessPrefBench: Evaluating Cross-Task Transfer of Individual Process Preferences from Naturalistic Human-AI Interaction
链接：https://arxiv.org/abs/2611.06065
作者：Yiwen Yang,Guanming Liu
类目：Computation and Language (cs.CL)
关键词：self-descriptions carry reusable, carry reusable signals, users' corrections, self-descriptions carry, carry reusable
备注： 11 pages, 2 figures. Published at LM Playschool 2026 (EMNLP 2026 workshop)
点击查看摘要
Abstract:In natural human-AI dialogue, users' corrections, requests, and self-descriptions carry reusable signals about how they want work to be done. These signals reveal individual process preferences, user-specific standards for evidence, depth, analytical focus, procedure, and delivery. We ask whether a preference revealed in one dialogue can shape an assistant's later answer when the task does not restate it. ProcessPrefBench uses three months of natural dialogues from two knowledge workers to build 66 source-target cases separately judged for source evidence and target applicability. Sources are preselected, so the benchmark tests application rather than retrieval. We test three models with target-only, full-history, and distilled-preference prompts. Target-specific 0-2 rubrics score preference realization, and a task gate flags severe failures. Compared with target-only prompting, full-history and imperative distilled-preference prompting raise preference realization by 0.204 and 0.244 points on the 0-2 scale, respectively, with no reliable advantage from distillation. Fabricated-evidence failures rise from 5.8% under target-only prompting to 10.1% under full-history and 10.4% under imperative prompting. ProcessPrefBench highlights a tension in learning from dialogue, where drawing on prior interactions can improve preference realization yet also invite fabricated evidence. We hope it helps build assistants that honor a user's process preferences without sacrificing factual reliability.
46. 【2611.06062】Adapting Qwen3 to Tajik from 0.6B to 8B: Lower Text Loss Did Not Mean Better Understanding
链接：https://arxiv.org/abs/2611.06062
作者：Tohir Saidzoda,Madina Abdusalomzoda,Nasimjon Rajabov,Akhrorkhon Ikromov,Komron Giyosiev,Abubakr Abdullozoda,Amin Jalilov,Jonibek Kishvarov,Rahmonali Sharipov,Mariyamkhon Shodyeva
类目：Computation and Language (cs.CL)
关键词：Small LoRA adapters, improved Tajik reading, Tajik reading comprehension, Small LoRA, Tajik text
备注： 8 pages, 3 tables, 1 figure. Technical report
点击查看摘要
Abstract:Small LoRA adapters trained on Tajik news and books lowered Qwen3's Tajik text loss at every size we tried, from 0.6B to 8B, by 0.60 to 1.45 nats per token, but none of them improved Tajik reading comprehension where it can be measured. On Belebele the 1.7B and 8B adapters left accuracy unchanged and the 4B adapter lowered it by 3.7 points; at 0.6B the score rose by 4.2 points but sits near chance and coincides with a change in which answer letter the model prefers, so we do not read it as understanding. At 8B, continued pretraining on about 375 million tokens of raw Tajik text was followed by a Belebele gain of 9.9 points. After a further supervised fine-tuning stage, our main model, e3, is 11.4 points above Qwen3-8B on Belebele; its English MMLU changed by -1.2 points, and a loss larger than 3.3 points is excluded. The same heavy recipe applied to Qwen3-0.6B-Base brought its text loss close to that of the 8B model after books-only pretraining, while its multiple-choice answers stayed near chance and its English MMLU fell by 7.6 points. We report 15 trained models and their 5 starting models from June to October 2025, scored in 2026 on one harness with paired intervals, and we report what went wrong: lost training records, a thinking-mode dataset with almost no reasoning in it, later branches whose training data was never documented, and a 4-bit release that contains no transformer layers.
47. 【2611.06048】SVGFaith: A Two-Layer Meta-Evaluation of Faithfulness Metrics for Text-to-SVG Generation
链接：https://arxiv.org/abs/2611.06048
作者：Guotao Liang,Haitao Zhou,Biao Liu,Huanxuan Liao,Lingfeng Qiao,Qian-Wen Zhang,Qian Yu,Di Yin,Xing Sun
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：faithfulness remains unclear, capture fine-grained prompt, fine-grained prompt faithfulness, prompt faithfulness remains, applying raster-image metrics
备注： 27 pages
点击查看摘要
Abstract:Text-to-SVG systems are commonly evaluated by applying raster-image metrics to rasterised outputs, yet whether these scores capture fine-grained prompt faithfulness remains unclear. We introduce SVGFaith, a two-layer meta-evaluation framework in which the more faithful candidate of each pair is determined by construction or by human judgment. SVGFaith-Diagnostic contains 1,842 controlled contrastive pairs across eight capability axes, split evenly between two directions: two renderings compared against one prompt, and two descriptions compared against one rendering. SVGFaith-Arena contains 1,327 human-annotated comparisons of real generator outputs. On SVGFaith-Diagnostic, CLIP and three other image--text embedding metrics reach at least 0.789 pairwise accuracy on object identity but at most 0.672 on spatial relations and attribute binding, where chance is 0.5. We further introduce SVGFaith-Score, an interpretable pointwise metric. A domain-tuned decomposer turns each prompt into a dependency graph of atomic visual requirements, a visual question answering model scores whether each requirement is satisfied, and a requirement's score is discounted when its prerequisites score low. In addition to the overall score, the per-requirement scores show which requirements are judged unsatisfied and which inherit discounts from their prerequisites. SVGFaith-Score significantly outperforms all nine baselines, including a Qwen3.5-122B-A10B judge, on Arena and in both Diagnostic directions. Code and data: this https URL.
48. 【2611.06043】Confucius4-R2T2: A Stable-Prefix Streaming ASR Model for Real Real-Time Transcription
链接：https://arxiv.org/abs/2611.06043
作者：Daniel Huang,Qi He,Shaoxiong Duan,Yingjie Li,Qiao Cheng,Yitao Duan
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD)
关键词：consumed by machines, voice agents, increasingly consumed, translators and voice, Real Real-Time Transcription
备注： 30 pages, 6 figures, 8 tables. Code and model weights available at [this https URL](https://github.com/netease-youdao/Confucius4-R2T2) and [this https URL](https://huggingface.co/netease-youdao/Confucius4-R2T2)
点击查看摘要
Abstract:Streaming speech recognition is increasingly consumed by machines, such as translators and voice agents, that act on each token as it appears. A token that is later revised costs wasted work or a wrong action. In this work, we present Confucius4-R2T2 (short for Real Real-Time Transcription), a stable-prefix streaming ASR model that never modifies its earlier output while maintaining high accuracy and low latency. R2T2 is obtained by post-training Qwen3-ASR-1.7B on 1,500 hours of Chinese and English audio while freezing its pre-trained audio encoder and projector. The adaptation is based on the concept of Longest Stable Prefix (LSP), a new notion that we introduce in this work. We prove that LSP is monotone under the prefix order, consistent with the full-audio output, and maximal among labels that equal a whole earlier output. Learning from LSP labels converts a full-context model into a stable-prefix streaming one without any architectural change. Extensive evaluations show that R2T2 brings streaming recognition close to the base model's full-context quality while delivering stable text with low emission lag. Its gains extend beyond the post-training languages, demonstrating a practical path from full-context ASR to stable streaming. We open-source the model weights and code at this https URL and this https URL.
49. 【2611.06025】When Every Choice Is Correct: A Causal Study of Numerical Preference in Language Models
链接：https://arxiv.org/abs/2611.06025
作者：Hongnian Huang,Hongliang Liu
类目：Computation and Language (cs.CL)
关键词：language model chooses, language model, model chooses, range is valid, chooses a number
备注：
点击查看摘要
Abstract:When a language model chooses a number between 1 and 30, every integer in the range is valid, yet the model can favor particular answers. We use numerical choice to study how preference is processed across layers and tokens. Perturbation probing and gradient attribution nominate neurons for activation interventions. In a selected Qwen3-4B case, a pre-answer edit changes 17 to 15 while both runs first emit 1. After the edit ends, selective cache and attention-output replacements trace part of its continuing influence on the second digit. Replacing one attention head's output or the other heads' outputs jointly produces similar immediate readout contributions; both interventions restore 17 but have different final log-odds effects on 7 versus 5. Holding later multilayer perceptron (MLP) outputs at their values from the edited run without either replacement reduces this effect gap from 0.119 to 0.0025 nat. Later computation therefore changes how similar local contributions affect the continuation. Retrospective estimates across eighteen contexts capture much of the probability movement but miss the selected answer switch. Prompt tests also separate influence from answer changes: one held-out prompt retains influence without switching, and only one of twelve fresh wordings qualifies for the reader/MLP test; there, joint MLP clamping again reduces the gap between the two reader effects while the answer remains 17. These results use numerical choice as a controlled case for studying persistent state and conditional downstream processing; they do not establish the origin or a complete circuit of natural numerical preference.
50. 【2611.06022】Who Pays for the Knowledge Models Copy? Model Collapse as Rogers' Paradox
链接：https://arxiv.org/abs/2611.06022
作者：Nam H. Le
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Populations and Evolution (q-bio.PE)
关键词：Generative models trained, earlier models lose, Generative models, models lose knowledge, output of earlier
备注： 13 pages, 5 figures. Code: [this https URL](https://github.com/drnamlabs-gif/rogers-model-collapse)
点击查看摘要
Abstract:Generative models trained on the output of earlier models lose knowledge across generations, rare knowledge first. The remedies that work all bring in information from outside the loop, and the theory of model collapse treats that supply as given: a fixed archive, drawn from a fixed distribution. We argue that the supply is the problem, and that cultural evolution has the theory of it. We read model collapse as Rogers' paradox: a population that comes to rely on copying ends up no better off than one that never copied, because copies go stale unless someone keeps learning for themselves. We test the identification in three steps. First, Rogers' model, fitted only to fully synthetic training, predicts to within a few percentage points how much rare knowledge language models, from word trigrams to a pretrained transformer, retain under other mixtures of fresh data. Second, when the world itself changes, a lineage that copies its own past needs more fresh data to keep up the faster the world changes, as Rogers' model says it must and as analyses that assume a fixed target cannot; a lineage that restarts every generation from fixed pretrained weights is largely insulated, because those weights are knowledge that is never copied. Third, we close the loop: when the people who write a model's training data can ask the model instead of finding things out, the supply of fresh data becomes endogenous. At equilibrium, the model is exactly as reliable as it is costly for people to find out for themselves, the population is no better off than without the model, and every increase in the share of model-written text must be paid for by more people learning for themselves. Users who check what they are told and relearn when it is wrong break the paradox. Filters that select plausible text are conformist and accelerate collapse; only checks that carry new information act as critical learning.
51. 【2611.06010】Holistic Parallel Supervision for Expressive Speech to Speech Translation
链接：https://arxiv.org/abs/2611.06010
作者：Hao Zhang,Ismail Rasim Ulgen,Bismarck Bamfo Odoom,Rui Liu,Zihan Zhang,Berrak Sisman,Philipp Koehn
类目：Computation and Language (cs.CL)
关键词：datasets rarely align, existing datasets rarely, rarely align source, target speech jointly, datasets rarely
备注： 5 pages, 1 figure, 5 tables. Submitted to ICASSP 2027
点击查看摘要
Abstract:Expressiveness is central to speech-to-speech translation (S2ST), yet existing datasets rarely align source and target speech jointly in content, prosody, timing, and speaker identity. Consequently, current systems often rely on indirect conditioning or transfer mechanisms. To obtain this supervision, we introduce a training-data construction strategy that combines professional dubbing, which provides human-performed correspondence in content, prosody, and timing, with multilingual voice conversion to reduce speaker mismatch. We evaluate this supervision using existing expressive S2ST systems and DirectS2ST, an end-to-end method developed in this work that predicts the complete target-speech representation directly from source speech. Experiments on English-German and English-Spanish show that holistic parallel supervision improves expressive realization across all evaluated systems. DirectS2ST exhibits the largest gains in content, prosody, timing, speaker similarity, and human-rated expressiveness. To our knowledge, this work provides the first systematic investigation of holistic parallel supervision for expressive S2ST.
52. 【2611.06006】Familiar letters, not related languages, let unseen languages into a shared space of meaning
链接：https://arxiv.org/abs/2611.06006
作者：Yuliang Liu,Xinyu Wang,Xiang Bai
类目：Computation and Language (cs.CL)
关键词：Hundreds, untranslated text builds, related language, Hundreds of languages, written text
备注：
点击查看摘要
Abstract:Hundreds of languages have written text but almost no translations, and whether a model learning one from untranslated text builds on a related language or familiar letters is unclear: they usually coincide. Here we show that familiar letters, not a related language, let an unseen language into a shared space of meaning. GlyphMind, a tokenizer-free vision transformer that reads text as pixels and lets any sentence be shown in any script, was pretrained to align translations across 27 writing systems. Adapted on untranslated Lao, a language and script it had never seen, it retrieved English translations seven times as often as the strongest simple baseline. Rewritten in unfamiliar letters, Lao did not enter although its close relative Thai was in pretraining; Santali, which had none, entered in Devanagari, familiar from Hindi, but not in its own script. Transliteration into familiar scripts may thus open multilingual models to languages without translations.
53. 【2611.06001】How Far Can You Steer? Behavior-Capability Frontiers in Contrastive Activation Addition
链接：https://arxiv.org/abs/2611.06001
作者：Deepanshu Raj
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：parameter updates, modify language-model behavior, modify language-model, Contrastive Activation Addition, Activation
备注： 23 pages, 18 figures
点击查看摘要
Abstract:Activation steering can modify language-model behavior without parameter updates, but behavioral efficacy alone does not determine whether an intervention is usable. Contrastive Activation Addition (CAA) steers targeted behaviors using activation directions derived from contrasting examples, potentially degrading unrelated model capabilities in the process. We therefore study CAA through a behavior-capability frontier, selecting interventions that maximize behavioral gain subject to an explicit bound on capability degradation. We evaluate this framework across four instruction-tuned models, seven behaviors, and capability-loss budgets of 1%, 3%, and 5% (absolute percentage points). Validation-selected behavioral effects generalize strongly to held-out data ($\rho = 0.945$), while joint behavior-capability survival among nonzero operating points rises from 37.5% at the 1% budget to 72.7% at 3%, with limited additional improvement at 5%. Control experiments indicate that these effects depend on learned behavior directions rather than generic activation perturbations. Representational geometry is significantly but only modestly predictive of causal cross-behavior transfer. Finally, secondary capability, out-of-distribution, and open-ended evaluations show that interventions satisfying protected benchmarks can still degrade untested capabilities or transfer unevenly to free-form generation. These results characterize activation steering as a constrained intervention whose usable range depends on model, behavior, direction, layer, and evaluation budget, rather than a universal control knob.
54. 【2611.05984】On the Design of Hyper-Connections: Simplification, Stability, and Scalability
链接：https://arxiv.org/abs/2611.05984
作者：Xiangdong Zhang,Xiaohan Qin,Sunan Zou,Tuo Dai,Bizhao Shi,Zhuo Xia,Yebin Yang,Yizhou Chen,Yuliang Liu,Yu Cheng,Junchi Yan
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：introduce non-negligible training, remain insufficiently understood, frontier language models, non-negligible training overhead, increasingly adopted
备注： Code: [this https URL](https://github.com/aHapBean/SimpleHC)
点击查看摘要
Abstract:Hyper-Connections (HC) architectures are increasingly adopted in frontier language models, yet their components remain insufficiently understood and introduce non-negligible training overhead. In this work, we systematically study the HC architecture to understand its components and identify simpler, more efficient designs. We find that learned read/write gating without mixing and unconstrained mixing with fixed gates form two effective interaction groups: either alone achieves performance comparable to mHC. We also identify repeated access to the expanded residual state as a major source of training overhead, even without mixing. These findings lead to SimpleHC, which simplifies the architecture by removing residual mixing and simplifies execution through shared memory access, using the resulting additive structure and shared gate inputs. Layer-specific gates share a group-entry state, enabling batched reads and deferred writes; scalar corrections exactly preserve preceding sublayer output contributions. Our analyses support both the retained residual structure and the design of shared memory access. SimpleHC incurs only 2.4% extra end-to-end training time over a vanilla residual baseline at the largest tested scale. It maintains performance comparable to mHC when scaling from 15B to 30B MoE models, exhibits smoother gradient dynamics during standard training, and remains stable under stress. We hope SimpleHC will encourage a broader pursuit of simplicity in foundation model design, making performance gains more accessible and practical at scale.
55. 【2611.05954】Robots in the City: Persona-Based Perceptions of Urban Robots
链接：https://arxiv.org/abs/2611.05954
作者：Keonhee Jang,Kanghoon Lee,Seokwoo Yun,Namwoo Kim,Yoonjin Yoon
类目：Human-Computer Interaction (cs.HC); Computation and Language (cs.CL); Robotics (cs.RO)
关键词：Pedestrians increasingly encounter, Pedestrians increasingly, urban public spaces, street remains unclear, increasingly encounter robots
备注： 10 pages, 7 figures
点击查看摘要
Abstract:Pedestrians increasingly encounter robots in urban public spaces without interacting with them, but how robots change the perceived safety of a street remains unclear. We examine how robot presence and type affect perceived safety across urban contexts. We generate 18 images of Seoul streets that vary in time of day, road class, and robot condition (no robot, a delivery robot, or a humanoid). Two multimodal large language models (MLLMs), Qwen3.8-27B and Gemma4-26B, each conditioned on 500 synthetic personas, choose the safer image in each pair, and 25 human respondents complete the same task. Both models prefer streets without robots and favor the delivery robot over the humanoid. Robots are chosen more often at night and less often by older personas, whereas road class has smaller effects. In the model rationales, the delivery robot appears as a physical obstacle, whereas the humanoid appears as either a threat or a source of protection. Like humans, both models chose robots more often at night, but chose the humanoid over the delivery robot far less often, and Gemma showed a night effect for the humanoid about three times that of humans. These results show that the effect of a robot on perceived safety depends on when it appears, and that persona-conditioned MLLMs capture only part of human judgments.
56. 【2611.05927】Modality-Aware Expert Pruning for MoE-Based Multimodal Large Language Models
链接：https://arxiv.org/abs/2611.05927
作者：Donggeun Kim
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：scale capacity efficiently, enables multimodal large, expert parameters dominate, parameters dominate memory, capacity efficiently
备注： NeurIPS 2026
点击查看摘要
Abstract:Mixture-of-Experts (MoE) enables multimodal large language models (MLLMs) to scale capacity efficiently, but expert parameters dominate memory even though only a few experts are activated per token: they account for over 90% of model size in modern MoE-MLLMs (e.g., 54 GB out of about 58 GB in BF16 for InternVL3.5-30B-A3B and Qwen3-VL-30B-A3B). Expert pruning has emerged as an effective compression strategy, but existing methods aggregate importance uniformly across tokens, ignoring that the same expert may serve different roles for vision versus language processing. To address this, we propose MAEP (Modality-Aware Expert Pruning), a training-free framework that decomposes expert importance by modality in a single forward pass. MAEP introduces (1) Delta-H Output ($\Delta H$), a redistribution-aware metric measuring the MoE output change when an expert is removed, and (2) low-attention vision tokens as a vision-side pruning signal that is dataset-stable: its expert-importance ranking remains stable across different datasets. Text-side importance serves as a preservation signal while vision-side importance serves as a pruning signal, and experts are ranked globally across layers. Experiments on three MoE-based MLLMs across multimodal and text benchmarks show that MAEP outperforms modality-agnostic baselines on the majority of multimodal benchmarks while remaining competitive on text-only tasks, reducing the BF16 expert weight footprint by about 27 GB (about 47% of total memory) so that the full weight footprint of an approximately 58 GB model fits within a single 40 GB GPU. Code is available at this https URL.
57. 【2611.05919】Routes of Reasoning: Reading and Reshaping Test-Time Compute in MoE Models
链接：https://arxiv.org/abs/2611.05919
作者：Shengjie Wang,Mohsen Fayyaz,Nanyun Peng
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：allocate test-time compute, Reasoning models allocate, Reasoning, models allocate test-time, distinct behaviors
备注：
点击查看摘要
Abstract:Reasoning models allocate test-time compute across distinct behaviors such as planning, deriving, and verifying. However, models frequently "overthink," continuing to verify and re-derive long after finding a correct answer. This wastes expensive compute and can even degrade performance. Existing interventions, such as token budgets or steering, primarily regulate reasoning duration rather than targeting specific behaviors. In this work, we demonstrate that Mixture-of-Experts (MoE) routers provide a natural, training-free interface for behavioral control. We first split reasoning traces into sentence-level segments and label each with one of six reasoning behaviors (planning, execution, restatement, fact, reflection, and conclusion), so that every token carries the behavior of its segment. Linear probes on router logits predict this label nearly as well as probes on the residual stream, the model's full hidden state and the standard target for probing, while using about half as many features. These signals generalize: experts associated with a reasoning behavior on one dataset predict the same behavior on the others, across six datasets spanning five domains (math, code, science, knowledge, and commonsense). Building on this, we selectively edit expert router scores during inference to curb overthinking. Across four models and four benchmarks, this intervention reduces the number of generated tokens by a median of 30.4% (and up to 63.3%). Crucially, it encourages the model to stop once the problem is solved, rather than skipping essential reasoning steps. Accuracy never drops by more than 0.5 percentage points, and frequently improves. Ultimately, MoE routing offers both an interpretable lens into reasoning states and a lightweight mechanism for optimizing test-time compute.
58. 【2611.05911】Autonomous agents for electricity-system planning
链接：https://arxiv.org/abs/2611.05911
作者：Yoon Pyo Lee,Samrendra Roy,Jay Phil Yoo,Kazuma Kobayashi,Souvik Chakraborty,Syed Bahauddin Alam
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：requires repeated decisions, systems requires repeated, connect regional resources, operation and network, electricity systems requires
备注：
点击查看摘要
Abstract:Planning electricity systems requires repeated decisions that connect regional resources, investment, operation and network constraints. Here we present an autonomous planning framework that carries prepared regional scenarios through proposal, numerical evaluation, feedback interpretation, redesign and final plan selection. Agents propose investment bounds, storage operating conditions and feeder interventions, interpret numerical feedback, and decide how to revise designs and when to stop. The framework automatically executes annual investment-and-dispatch optimization and representative-feeder verification, applies fixed acceptance criteria and retains the lowest-cost accepted candidate. We evaluate forty carbon-constrained trajectories across ten system-year scenarios in five electricity systems and four countries, using two model deployments and single- and multi-agent architectures. All forty retain candidates satisfying the implemented physical and fixed annual operational carbon-budget checks. Twenty-eight of forty matched reference designs exceed the new scenario ceilings. A separate archive of ninety-six trajectories under a common 1,000 Mt annual ceiling provides matched references and broader regional coverage. The results demonstrate autonomous planning under explicit emissions constraints using public regional data and published institutional demand outlooks.
59. 【2611.05896】Selective, Risk-Controlled Emotion Forecasting in Conversation: From a Persistence Barrier to Departure Detection with Conformal Guarantees
链接：https://arxiv.org/abs/2611.05896
作者：Bin Wen,Dai-Qiao Zhang,Tien-Ping Tan
类目：Computation and Language (cs.CL)
关键词：emotion in conversation, conversation is increasingly, increasingly framed, framed as predicting, emotional state
备注：
点击查看摘要
Abstract:Forecasting emotion in conversation is increasingly framed as predicting the next emotional state's value. We show this targets a hard quantity in a state-observed testbed and propose a learnable, deployable reformulation instead. On valence-arousal-dominance trajectories from a dyadic corpus, repeating a speaker's own previous state sets a persistence baseline that no frozen-encoder correction meaningfully improves upon and a state-space filter exceeds; the floor requires the historical state to be observed, since an estimated anchor collapses persistence below a direct forecaster. What survives is the timing of a departure from persistence, learnable on three of four corpora and near chance on the highest-base-rate corpus, a negative result we report. We recast the task as selective departure forecasting: a lead-time-weighted metric with a leakage protocol, and commitment policies whose best choice switches with the departure rate. A dialogue-level conformal risk control bounds the expected loss of committed predictions, meeting the target in all twelve configurations tested, though the guarantee is bought through abstention, with coverage and alarm recall falling sharply on the hardest corpus. One tested language model's confidence fails as a ranking signal where another succeeds, a model-dependent failure not yet attributable to family versus scale. Code and result logs are available from the corresponding author upon request.
60. 【2611.05895】Information-Matched Auditing of Conversational Emotion-Shift Forecasting: A Leakage-Safe Evaluation Protocol
链接：https://arxiv.org/abs/2611.05895
作者：Bin Wen,Dai-Qiao Zhang,Tien-Ping Tan
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：hyperparameter budgets differ, unavailable current-emotion label, Comparisons in conversational, target-turn information enters, conversational emotion-shift forecasting
备注：
点击查看摘要
Abstract:Comparisons in conversational emotion-shift forecasting are easily distorted when a learned model receives rich features but its transition baseline is given a noisy or unavailable current-emotion label, when hyperparameter budgets differ, or when target-turn information enters the representation. We present an information-matched, leakage-safe auditing protocol that closes these gaps with an explicit commitment point, executable causality tests, equal four-configuration validation searches, and seed-dialogue-aware inference. Applying it to six causal model families on four text corpora and two feature-source sensitivity configurations shows that a deployable train-only current-emotion classifier feeding the transition baseline yields a different verdict than an oracle diagnostic where both sides receive gold current emotion. Under the deployable condition, learned models improve over the predicted-label baseline on all four primary corpora; DailyDialog gains are large and survive a 72-comparison Holm correction (best ROC-AUC gain = +0.167, adjusted p=.0144). Under matched gold information, the baseline remains competitive on IEMOCAP and stronger on MELD, while every model retains a large DailyDialog advantage. We additionally report precision-recall AUC, calibration, a strictly utterance-local feature control, same-person self-shift forecasting, and a future-access dose-response test. An eight-item leakage checklist accompanies the protocol. Code, raw seed predictions, and reporting artifacts are available from the corresponding author upon request.
61. 【2611.05877】When Does Better Confidence Improve a Knowledge-Graph Audit?
链接：https://arxiv.org/abs/2611.05877
作者：Zehao Lin,Kai Chen,Xixuan Hao,Erenkai Zhu,Chunyu Li,Helan Hu
类目：Computation and Language (cs.CL)
关键词：Confidence estimates guide, guide human review, LLM-built knowledge graphs, estimates guide human, Confidence estimates
备注： 27 pages, 4 figures, 19 tables. Ancillary files include a public rendering of the confirmation protocol and summary results
点击查看摘要
Abstract:Confidence estimates guide human review in LLM-built knowledge graphs, but better error prediction can yield little improvement in an audit. We study this gap through repairability, selection headroom and label validity. Modelling non-adaptive auditing as budgeted covering, we characterise the minimal decision-relevant error statistics and bound the regret of scalar-preserving first-order planning by a structural mass $\Delta^{\mathrm{cl}}$. We simulate ideal repair against benchmark-aligned labels for five extraction configurations and two cross-document graphs on Re-DocRED, followed by frozen confirmation on test and replication on 500 hash-selected training documents. On the held-out cross-document graphs, an error-rate $\times$ fan-out queue leaves 3.98-4.74 percentage points more errors than a joint model with the same actions. By comparison, opening shared actions for that joint planner reduces residual errors by 0.89-1.43 points relative to its own fact-only plans, in point estimates. Equivalence between joint and independent-block models remains inconclusive. Generic LLM verification improves three of four model-budget configurations on each held-out set. LLM adjudication identifies possible benchmark omissions.
62. 【2611.05862】CARTBench: Rubric-Based Evaluation of Shopping Advice for Complex and Ambiguous Requests with Timelines
链接：https://arxiv.org/abs/2611.05862
作者：Yuqin Dai,Zhanwei Zhang,Honghui Yang,Zhouheng Yao,Yueqi Zhang,Jingyu He,Chaoyang Shi,Fanding Wei,Boyuan Pan,Kai Xu,Yao Hu,Yongliang Shen
类目：Computation and Language (cs.CL)
关键词：Large language model, Difficulty Standardizing Criteria, Large language, multi-turn conversations, Difficulty Standardizing
备注：
点击查看摘要
Abstract:Large language model (LLM) shopping assistants now recommend products in multi-turn conversations. However, reliable evaluation faces Data scarcity and Difficulty Standardizing Criteria. To address these obstacles, we introduce CARTBench for CART (Complex and Ambiguous Requests with Timelines). For Data scarcity, we curate cases from real commercial shopping needs across 17 retail domains, pairing timestamped dialogue with 1,603 product records. For Difficulty Standardizing Criteria, we develop case-specific rubrics guided by Ideal Response Principles, distilled from excellent replies manually selected from successfully completed orders. These principles also guide Principle-Guided CART Prompting, our structured recommendation strategy. The experimental benchmark contains 1,328 expert-annotated criteria across Core, Excellence, and Safety. To answer the CART question, we evaluate 7 flagship commercial API models, including GPT-6.1-Sol and Claude-Opus-5, and 35B+ parameters open-weight models. In the first full-suite evaluation under the frozen rubrics, 3 of 10 models exceed 90% on Core, while none exceeds 45% on Excellence. Therefore, we identify an understanding-to-execution gap between required behavior and high-quality purchase advice. To examine these limitations, we diagnose shared failures in product evidence and unresolved needs, linked to changing requirements and decisive unknowns. Code and data are available at this https URL.
63. 【2611.05827】andemBench: Benchmarking Decision Models for Multi-Agent Collaboration
链接：https://arxiv.org/abs/2611.05827
作者：Baohang Li,Xiaocheng Feng,Bing Qin
类目：Computation and Language (cs.CL)
关键词：action selection, choose among predefined, routing and action, Decision, Decision models choose
备注：
点击查看摘要
Abstract:Decision models choose among predefined options in tasks such as routing and action selection. In multi-agent collaboration, a decision determines how members divide work, exchange resources, and act in parallel. We introduce TandemBench, a benchmark of 1,200 questions in multi-agent cooking scenarios where coordination choices affect goal completion. Models receive complete global information and candidate team plans, with reference answers established through execution and exact search. Models select an optimal team plan and, in paired variants that retain or remove it, judge whether better arrangements exist beyond the supplied options. We evaluate 40 native decision models and compare them with 10 general-purpose language models. The best native decision model achieves 62.50% decision accuracy. Native decision models remain close to chance in optimality verification. Paired tests reveal that some report better alternatives regardless of whether an optimal plan is already present. These findings show that team-plan decision accuracy alone can conceal systematic errors in judging whether the supplied options contain an optimal arrangement. The dataset and evaluation code are publicly available at this https URL.
64. 【2611.05814】Learning When Human Decisions Matter: Executor-Relative Consultation Value for LLM Agents
链接：https://arxiv.org/abs/2611.05814
作者：Shuli Jiang,Khushbu Pahwa,Yuting Zhang,Yi Zhang,Wei Xia,Stefano Soatto
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language models, automate complex tasks, language models increasingly, models increasingly automate, increasingly automate complex
备注： 31 pages, 20 tables, 2 figures
点击查看摘要
Abstract:Large language models increasingly automate complex tasks, but human decision capacity does not scale with their capabilities. In many applications, humans remain essential for providing private context, authority, or judgments unavailable to the agent. We formulate human decision capacity allocation: given multiple consultation opportunities and a limited budget, at which decisions should an LLM agent consult a human? The central challenge is estimating consultation value, which is executor-dependent because the same human input may benefit different downstream agents differently. We introduce Consultation Value Distillation (CVD), which estimates consultation values offline using Monte Carlo executor rollouts and distills these values into lightweight predictors for budgeted allocation, requiring no rollout-based value estimation at deployment. Across five batch and three sequential settings with two frontier executors, CVD improves allocation through joint and continuation-aware value learning, while independent consultation values remain competitive in several settings. CVD also broadly outperforms direct prompting and Value of Information where applicable, remains robust with substantially less rollout supervision, and enables nearly lossless approximate allocation at low search cost.
65. 【2611.05804】Matching the Training-Time Weight Rule in Inference-Time Expert Deactivation
链接：https://arxiv.org/abs/2611.05804
作者：Hao Cheng(Zhejiang Gongshang University),Zhiyu Yang(Chang'an University),Bo Ma(Zhejiang Gongshang University),Hanzhang Jia(University of Sussex)
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：deactivation at inference, token routing, effect on performance, performance depends, Expert deactivation
备注： Corresponding authors: Hanzhang Jia (lead corresponding) and Bo Ma
点击查看摘要
Abstract:Expert deactivation at inference time changes both token routing and expert weights, and its effect on performance depends on how these changes are implemented. We compare removal, freezing, remaining-expert renormalization, and unnormalized re-routing on identical disabled sets across five instruction-tuned checkpoints from four model families, with a base OLMoE checkpoint as an additional comparison. We develop a weight-sum model that relates the loss of expert contributions and changes in branch scale to the weight rule used during training. With half of the experts deactivated according to activation-based rankings, remaining-expert renormalization yields the highest perplexity in models trained with raw router probabilities, whereas unnormalized re-routing yields the highest perplexity in models trained with normalized weights. Perplexity ranges from 1.4 to 73 times the intact baseline when the training rule is retained, and from 14 to 28,740 times the baseline under a rule mismatch. Task outcomes vary across evaluation types: on OLMoE, GSM8K strict-match accuracy falls to zero under all four implementations. Extending the model to changes in the number of active experts yields a further prediction, supported by the OLMoE experiments: the perplexity penalty from additional renormalization increases as fewer experts are activated.
66. 【2611.05803】Phonological Knowledge of Chinese Characters in Language Models
链接：https://arxiv.org/abs/2611.05803
作者：Xiaozhe Ji,Renfen Hu,Hai Hu
类目：Computation and Language (cs.CL)
关键词：possess about Chinese, Chinese characters, phonological features, Chinese, language models
备注： 17 pages, 11 figures, 10 tables
点击查看摘要
Abstract:How much phonological knowledge do language models (LMs) possess about Chinese characters, and how is this knowledge represented and used? We introduce PinyinBench, a controlled benchmark covering homophones, phonological features (initials, finals, and tones), and polyphonic characters. We investigate 17 text-only and multimodal LMs through three complementary approaches: behavioral evaluation, layer-wise probing, and activation steering. Behaviorally, models demonstrate substantial knowledge of initials and finals, with a frontier model (DS-v4-flash) scoring 90%+ in homophone judgment, when two characters share no phonological features. However, its accuracy drops sharply to 72% when two characters differ only in lexical tone. Probing reveals that tone is highly decodable from embeddings and improves modestly across layers, whereas segmental information starts less decodable and improves substantially with depth. Activation steering shows that segmental representations can systematically influence generation, while tone exhibits much weaker effects. Furthermore, audio-bearing training improves phonological decodability, including tone, without corresponding improvements in steering effectiveness. Together, these findings reveal distinct representational and functional profiles for segmental and tonal information, with tonal information much harder to access and manipulate, demonstrating the necessity for combined evaluation, probing, and causal intervention for understanding linguistic knowledge in LMs.
67. 【2611.05771】How Well Can Large Language Models Impersonate Individual Authors? A Comparative Evaluation
链接：https://arxiv.org/abs/2611.05771
作者：Harshit Gupta,Shunichi Ishihara
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Claude Opus, large language models, GPT, study investigates, widely used large
备注：
点击查看摘要
Abstract:This study investigates the authorship impersonation capacity of six widely used large language models (LLMs): Gemini 3 Pro, Claude Opus, GPT 5.2, GPT 5.2 Pro, DeepSeek 3.2, and Grok 4.1 Fast. The evaluation was conducted using short product review texts selected to ensure high within author consistency in individual writing style. Two types of in context prompt were designed: a simple prompt with minimal instruction and a complex prompt incorporating explicit stylometric guidance for mimicry. Authorship mimicry was evaluated using a cosine distance based distance to training metric, supplemented by visual analyses of embedding distributions. The results indicate that authorship impersonation remained challenging for most LLMs, with Gemini 3 Pro showing the strongest apparent mimicry performance. However, subsequent overlap analysis revealed that Gemini 3 Pro extensively copied and reused sentences and phrases from the training texts, at levels far exceeding those observed among human authors. Follow up factor analyses showed that training set consistency was the most robust predictor of mimicry success across models, whereas author distinctiveness did not generalise as a reliable predictor. Global embedding visualisations further revealed a consistent macro level pattern: for most models, generated texts occupied regions of the embedding space that were largely separated from the corresponding human training clusters. This indicates limited convergence towards target author style and suggests the presence of model specific lexical and phraseological preferences. The findings highlight the importance of distinguishing genuine stylistic imitation from direct textual reuse and have implications for the forensic analysis of textual evidence involving potential LLM enabled impersonation.
68. 【2611.05759】PAYWORTHY: Can LLMs Predict Which Freelance Jobs an AI Agent Will Complete?
链接：https://arxiv.org/abs/2611.05759
作者：Mohammad Reza Rezaei,Dingxian Wang,Brett Levert,Celeste Fejzo,Andrew Rabinovich,Zhao Chen
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：agent, paid job, AUC, rank, cs.AI
备注：
点击查看摘要
Abstract:Before an AI agent takes on a paid job, someone has to judge whether it is likely to succeed. We test whether frontier language models can make this call before any attempt. We propose PAYWORTHY which contains 1{,}494 real freelance job postings, sampled from 18.8M postings made between 2020 and 2026 on a freelancing platform. An agent attempts each job from the posting alone in a single run, and an LLM judge acting as the client decides whether to accept the work. We ask 18 models to forecast how likely the agent is to succeed and measure how well each model's forecasts rank the accepted jobs above the rejected ones (AUC, where 0.5 is a random ranking). The answer depends on how the agent is described. Told what the agent cannot do, every model ranks the jobs well (AUC 0.66--0.86). Told instead that it is a generic agent with a browser and code execution, the same models rank the same jobs about as well as a random ordering (0.45--0.56). These results hold under judges from four other model families (Claude, GLM, Kimi and Qwen), and the informed forecasts also rank the verdicts of two human raters. Code is available at this https URL
Subjects:
Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
Cite as:
arXiv:2611.05759 [cs.AI]
(or
arXiv:2611.05759v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2611.05759
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
69. 【2611.05744】xt-Only Domain Adaptation for Low-Resource Medical ASR: Shallow Fusion and Density Ratio Rescoring for Hausa
链接：https://arxiv.org/abs/2611.05744
作者：Oche David Ankeli,Hassan Adelani Luqman,Theodora Ngozi Egbunike,Joshua Gottschalk,Bonaventure F. P. Dossou
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Automatic speech recognition, Density Ratio Approach, Hausa medical ASR, specialised medical vocabulary, systems often struggle
备注：
点击查看摘要
Abstract:Automatic speech recognition (ASR) systems often struggle with specialised medical vocabulary, especially in low-resource languages where domain-specific speech data are scarce. We investigate text-only domain adaptation for Hausa medical ASR using the fixed MMS-1B-FL102 acoustic model and two decoding-time language-model fusion methods: Shallow Fusion (SF) and the Density Ratio Approach (DRA). A 4-gram KenLM trained on 19,421 Hausa health sentences serves as the medical target model, while a 75,372-sentence general-domain model provides the source prior for DRA. Evaluation uses 250 recordings of 25 physician-reviewed prompts from 10 speakers across six northern Nigerian states. Under prompt-disjoint five-fold cross-validation, SF and DRA reduce WER from 29.56% to 23.55% and 23.33%, respectively. Both significantly outperform greedy decoding (p 0.001), while their difference is not significant (p = 0.423). However, general-LM-only SF achieves 23.96% WER, indicating that the medical LM's additional improvement over a general LM is modest. Medical Term Error Rate also improves under fusion, but does not establish a distinct medical-domain advantage. These findings demonstrate that lightweight, text-only language-model fusion can improve Hausa medical ASR without additional domain-specific speech collection.
70. 【2611.05731】Prospective Memory for Proactive LLM Agents
链接：https://arxiv.org/abs/2611.05731
作者：Yuanchen Bei,Zhining Liu,Tianxin Wei,Weizhi Zhang,Zhichen Zeng,Philip S. Yu,Hendrik Hamann,Jingrui He,Hanghang Tong
类目：Computation and Language (cs.CL)
关键词：retrieving past information, inform current decisions, preserving and retrieving, retrieving past, past information
备注： 17 pages, 8 figures
点击查看摘要
Abstract:Most memory systems for LLM agents are retrospective, preserving and retrieving past information to inform current decisions. Proactive agents, however, also require prospective memory: retaining future-directed intentions and realizing them when appropriate opportunities arise, even without explicit requests. Crucially, remembering the right intention does not guarantee acting at the right time: a related observation may call for waiting, while a later cue may make the same intention actionable. Inspired by cognitive theories of human prospective memory, we introduce Pro-Memory, a memory framework that separates maintaining future intentions from deciding when and how to realize them. Pro-Memory preserves pending objectives linked to their supporting evidence, assesses new observations against their original goals and activation conditions, and coordinates appropriate contributions with the agent's ongoing actions. It further updates intention states based on actions actually issued or evidence of resolution, while an experience memory distills feedback from completed episodes into guidance for future decisions. Experiments on two benchmarks spanning delayed-intention tasks and open-ended proactive assistance demonstrate consistent improvements in proactive task performance over representative memory approaches across multiple LLM backbones, while limiting unnecessary interventions.
71. 【2611.05730】he Male Abstraction Bias in Internet Culture and Large Language Models
链接：https://arxiv.org/abs/2611.05730
作者：Douglas Guilbeault,Bhargav Srinivasa Desikan
类目：Computers and Society (cs.CY); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
关键词：examined as separable, foundational aspects, typically examined, human cognition, concepts spanning single
备注：
点击查看摘要
Abstract:Two foundational aspects of human cognition, abstractness and gender, are typically examined as separable. Here, we find they are systematically linked throughout the entire space of concepts spanning single (N = 40,000) and multi-word expressions (N = 67,000): across billions of words and millions of images on the internet -- and across numerous measurement techniques -- more abstract concepts are more associated with men, an effect which replicates in languages around the world. This pattern not only holds across conceptual domains, but it also maps onto grammatical structure: verbs and adverbs are more abstract and more male-coded, a system-wide trace of stereotypes accentuating agentic qualities in men. Furthermore, this bias emerges in human and AI responses in free association tasks, indicating its internalization and its algorithmic reproduction. The male abstraction bias may underlie and unify a range of stereotypes, evidencing gender as a core organizing dimension in conceptual space.
72. 【2611.05720】Cognitive Bias Signatures in Search-Equipped LLM Agents: A Stage-Resolved Analysis
链接：https://arxiv.org/abs/2611.05720
作者：Yanru Xiao,Yingwei Yu
类目：Computation and Language (cs.CL)
关键词：LLM agents correct, agents correct mistakes, LLM agents, correct mistakes, agents correct
备注： 19 pages, 4 figures
点击查看摘要
Abstract:Search can help LLM agents correct mistakes, but their starting conditions may shape which evidence they find and use. Drawing on cognitive-bias paradigms, we develop a controlled search harness to examine result order, records of prior work, and initial hypotheses while holding each question and document collection fixed. Matched controls distinguish order effects from differences in document composition and the effects of failed work from context length. Across 10 models and 1,000 synthetic search worlds, we track queries, retrieved documents, document openings, and final answers. Our comparisons suggest that final answers are more sensitive to initial evidence order during active search than when all evidence is supplied in full. Dead-end histories can reduce strategy switching relative to matched neutral histories, indicating an effect beyond context length. Under wrong hypotheses, stage measurements distinguish reduced retrieval or opening from errors that persist after counter-evidence is opened. Exploratory interventions show that opening counter-evidence more often can coincide with lower accuracy, while accuracy can improve with little change in opening.
73. 【2611.05662】Grounded but Not Immune: Confirmation Bias in Agent-as-a-judge
链接：https://arxiv.org/abs/2611.05662
作者：Drake Benjamin Brown,Khushbu Pahwa,Yubin Ge,Salvatore Romeo,Akhil Agnihotri,Yi Zhang,Xiaofei Ma,Daniele Bonadiman
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Evaluating open-ended agent, open-ended agent tasks, agent tasks increasingly, tasks increasingly falls, evaluator handed tools
备注： Preprint. Under Review
点击查看摘要
Abstract:Evaluating open-ended agent tasks increasingly falls to an Agent-as-a-Judge: an evaluator handed tools and the agent's full trajectory so it can verify a result against the environment. The premise is that a judge that gathers its own evidence should be grounded by it. We show that this grounding does not immunize the judge against confirmation bias: a single false pre-screening note, attributed to an authority and carrying no evidential bearing on the correct verdict, overturns up to 40% of a tool-using judge's correct verdicts across four judges and five datasets, even though the judge collects decisive evidence. The shift is driven by specific properties of the cue. We treat this cue as a controlled diagnostic of confirmation bias rather than an adversarial attack. Our central contribution is to explain how confirmation bias changes the judge's behavior in a trajectory. We classify changes in judge behavior and attribute changes to one of three failure modes: over-trust (verify, conclude correctly, then defer), hallucination (fabricate support for the flip), and under-investigation (stop at the first corroborating signal). For the two Claude judges, the failure is predominantly over-trust (67-75% of harmful flips), while smaller judges have error modes spread across all three. Lightweight mitigations blunt but never remove the bias.
74. 【2611.05637】Contextual Pictograms for Repairing Multilingual ASR Errors
链接：https://arxiv.org/abs/2611.05637
作者：Mariana Hernandez,Hector Luna,Carlos Bruno,Luis Ricardo Santos,Elena Simoes
类目：Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
关键词：Speech transcription errors, competing word hypotheses, Speech transcription, visually similar, transcription errors
备注：
点击查看摘要
Abstract:Speech transcription errors can be difficult to recognize when competing word hypotheses are unfamiliar or visually similar. We describe an interface that combines alternative transcripts, replay and contextually checked pictograms for selected uncertain concepts. The system will initially support French and Spanish functional utterances. A counterbalanced study will assess whether pictorial feedback helps listeners recover the speaker's intended action beyond text alternatives alone. We will also quantify semantic mismatch and additional interaction time, since an inappropriate image can reinforce the wrong interpretation rather than repair it.
75. 【2611.05596】RAGCompass: Generalizable Retriever Routing via Reranking
链接：https://arxiv.org/abs/2611.05596
作者：Valentin Six,Mufei Li,Dongqi Fu,Yinglong Xia,Hong Li,Pan Li
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：retrieval-augmented generation, exist for retrieval-augmented, retriever, retrievers exist, passages
备注：
点击查看摘要
Abstract:Different retrievers exist for retrieval-augmented generation, yet none performs best for all queries. Therefore, the key question is: given a query and retrieved passages from different retrievers, which one is most suited for that query? Existing routers usually make predictions from query-specific features and a fixed pool of retrievers; such routers have no output for an unseen retriever and are incapable by design on a new corpus. To fill these gaps, RAGCompass reads the retrieved passage sets themselves: passages from an unfamiliar retriever or corpus stay directly comparable to other passages, so routing stays well designed where a query-only map would fail. We contrastively fine-tune a reranker against the answer each evidence set produces, which accounts for most of the gain; a small comparison head adds a moderate improvement, and neither component has retriever-specific parameters. RAGCompass improves answer F1 by 28% relative to the best fixed retriever, and outperforms fusion baselines, three query-only routers, and a prompted 8B language model. Generalization experiments show that RAGCompass keeps most of its gain under an unseen corpus, retriever, or reader, while query-only baselines fall to the best fixed retriever or below.
76. 【2611.05556】AGORA: Reliability-Aware Aggregation of LLM Judges via Item-Response Theory
链接：https://arxiv.org/abs/2611.05556
作者：Junhyung Ahn
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：single judge bias, common substitute, substitute for costly, standard remedy, costly human evaluation
备注：
点击查看摘要
Abstract:LLM-as-a-judge is a common substitute for costly human evaluation, and aggregating several judges is the standard remedy for any single judge's bias. Judge pools mix judges of very different reliability, while the human-labeled sets that validate them hold a few hundred items or fewer. In this regime the per-item mean weights weak judges as heavily as strong ones, and confusion-table models such as Dawid-Skene must estimate a per-judge error table from too few items. We propose AGORA (Aggregation Of Reliability-weighted Assessments), an item-response-theory aggregator that places every item on one latent quality scale and describes each judge by a sensitivity parameter and ordered rating thresholds, so judge reliability is learned from all items jointly and without human labels. Across three benchmarks, AGORA matches or exceeds Dawid-Skene on large evaluation sets, and its advantage widens as the set shrinks toward a few hundred items. It remains accurate as pools grow more uneven, a label-free dispersion statistic indicates in advance when trust weighting helps, and its learned trust weights track per-judge human validity.
77. 【2611.05548】Iterated creation, grading, and revision of data science projects by language models
链接：https://arxiv.org/abs/2611.05548
作者：Rohan Alexander
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：data science project, complete data science, percentage points, data science, Anthropic Haiku
备注：
点击查看摘要
Abstract:We evaluate the extent to which agentic AI models can complete an end-to-end data science project, and how this improves with feedback. A 'writer' model with specific tools creates a complete data science project including downloading, cleaning, and analyzing a dataset, and writing a short paper about it. The project is executed and a 'grader' model evaluates it. The writer can then revise its submission, and this repeats for a total of three rounds. We consider seven models from five developers: Anthropic, OpenAI, Google, DeepSeek, and this http URL. Each model is both a writer and a grader, so there are 49 writer-grader pairs and we run each pair three times. Of the 147 initial submissions, 107 run and render, and the average score increases from 59 per cent to 76 per cent after the final round of feedback. By writer the extent of the increase ranges from 3 percentage points for Anthropic's Opus 5.5 to 46 percentage points for Anthropic's Haiku 4.5, and by grader it ranges from 13 percentage points for Google's Gemini 3.8 Flash to 32 percentage points for Anthropic's Haiku 4.5. When a model grades its own writing the score tends to be about 9 percentage points higher than the average of what the other models give it. About half of the difference that we see from round to round is within the grader's own noise. Feedback generally results in the highest marks, but even just having the chance to revise, or having the additional budget, in terms of time or tool calls, without any feedback, results in considerable increases for some of the models but not for others. We find that how much such a loop helps depends on which model plays which role, but weaker models generally do not improve stronger models.
78. 【2611.05539】Rewrite, Then Veto: Rewriter-Agnostic Edit Gating for LLM-Based Post-OCR Correction
链接：https://arxiv.org/abs/2611.05539
作者：Jorge Ramón Fonseca Cacho
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：repair noisy OCR, noisy OCR transcripts, historical documents, noisy OCR, OCR transcripts
备注： 26 pages, 3 figures, 12 tables. Code: [this https URL](https://github.com/SniperJF/ocr-edit-gate-release;) models: [this https URL](https://huggingface.co/SJF7)
点击查看摘要
Abstract:LLMs can repair noisy OCR transcripts of historical documents, but they also change text that was already correct. We propose EditVeto, a veto gate placed after a full-context LLM rewrite. The rewrite is character-aligned to the OCR input, its differences are split into blocks, and a 0.6B-parameter gate keeps or reverts each block. An oracle analysis motivates the design: given the true error locations, per-span generation is worse than no correction, whereas vetoing a full rewrite's edits helps. Trained on rewrites by two Qwen3 models and evaluated, frozen, on the eight HIPE-OCRepair-2026 test sets, the gate improves all five rewriters tested, two of them unseen in training: weighted cMER falls by 0.0026-0.0044 and the preference score rises by 0.15-0.25 (paired bootstrap, p ~ 0.0002 each). On published competition outputs it lowers cMER for three of four teams but raises it for the winning run (0.0050 to 0.0065). In a second, disclosed test look, a retrained gate still improves LoRA-tuned rewriters (cMER -0.0011 to -0.0021), and an ensemble of their gated edits reaches a cMER of 0.0069 and a preference score of 0.928, mostly through fine-tuning and pooling rather than gating. Built only on public models and data, it is behind the winner (0.0050) and tied with the second-ranked run (0.0071), both from the only team using domain pre-training, and ahead of all other published runs. A third, secondary look shows the unchanged gate improving zero-shot Qwen3.8-27B (cMER 0.0114 to 0.0108) but only the preference score of its LoRA-tuned version.
79. 【2611.05517】When to Ask, When to Answer: Strategic Clarification for Ambiguous Reference Resolution in Dialogue
链接：https://arxiv.org/abs/2611.05517
作者：Ibrahim Khebour,Nikhil Krishnaswamy
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：collaborative process involving, process involving clarification, referential disambiguation, change the outcome, collaborative process
备注： 22 pages, 10 figures. Code and data: [this https URL](https://github.com/csu-signal/Clarifying_Ambiguous_References)
点击查看摘要
Abstract:For humans, referential disambiguation is a collaborative process involving clarification questions asked when they will meaningfully change the outcome. However, large language models (LLMs) have been shown to be biased toward premature answering, preferring definite single-turn responses over more clarification exchanges. In this paper, we study the problem of "strategic clarification" -- asking clarification questions in a reference game when their answers will narrow the set of candidate referents. We construct a controlled test environment from the SIMMC 2.1 dataset that records how many questions each ambiguous reference needs to be successfully resolved, and examine how baseline LLM behavior and common post-training methods ask clarifying questions vs. attempt to answer the referent. We also propose BACE (Belief-Aware Critic with Epistemic tracking), a lightweight action chooser method on top of a frozen LM backbone, and show that BACE more consistently chooses the optimal number of clarifying questions than methods such as GRPO and ArCHer.
80. 【2611.05512】SlackBench: Benchmarking Agents on Collaborative Projects Grounded in Real Code Repositories
链接：https://arxiv.org/abs/2611.05512
作者：Mingxuan Li,Huanzhi Mao,Ruitao Zheng,Jarod Stanbury James,Yunze Li,Natanya Anderson,Joseph E. Gonzalez,Alex Dimakis
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：run experiments, browse the web, extended horizons, digital coworkers, assist humans
备注：
点击查看摘要
Abstract:AI Agents are becoming digital coworkers that can browse the web, write code, run experiments, and assist humans over extended horizons. Yet existing benchmarks fall short of real knowledge work: many rely on synthetic data or isolated tasks, missing the complex, multi-party dynamics of collaborative projects, where critical information is scattered across conversations, code, and evolving decisions. Even simple workplace questions may require locating relevant channels and direct messages, recovering context from long discussions, inspecting repository state, reconciling stale or conflicting evidence, and synthesizing across sources. We introduce SlackBench, a benchmark for evaluating agents on realistic research and engineering workflows that require joint reasoning over workplace communication and evolving repository state. Grounded in privacy-preserving reenactments of real academic research projects, SlackBench provides reproducible environments with realistic multi-party dialogue, evolving decisions, and corresponding code changes grounded in GitHub repositories and Google Docs. It contains 140 queries spanning heterogeneous-source agentic search, abstention on unanswerable or false-premise questions, goal-directed summarization, and circumstance inference over long conversations. These tasks are not reducible to static corpus question answering: agents must determine which conversations matter, traverse threads, inspect repository state, and synthesize evidence across communication and code artifacts. Across 33 frontier models and agent harnesses, the best system scores around 80% and most agents score below 66%, highlighting substantial headroom for improvement. SlackBench thus provides an extensible framework for evaluating agents in collaborative work environments. The SlackBench dataset is available at this https URL .
Subjects:
Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
Cite as:
arXiv:2611.05512 [cs.AI]
(or
arXiv:2611.05512v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2611.05512
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
81. 【2611.05419】Unlocking Turing Tensor Cores: A Measured Throughput Account of From-Scratch Pre-training on a Single 22G RTX 2080 Ti
链接：https://arxiv.org/abs/2611.05419
作者：Dezhou Shen
类目：Hardware Architecture (cs.AR); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC); Performance (cs.PF)
关键词：second-generation Tensor Cores, leaving usable tensor, full second-generation Tensor, ships full second-generation, usable tensor throughput
备注： 7 pages, 4 tables
点击查看摘要
Abstract:The RTX 2080 Ti (TU102) ships full second-generation Tensor Cores in hardware, yet the vendor throttles FP16 matrix multiplication at the driver level, leaving usable tensor throughput well below the hardware peak. turing-unlock lifts this restriction with a kernel module that, before the nvidia driver binds the device, writes the FP16 speed selectors (SS0=0x88888888, SS1=0x8) and releases the ACR mutex; published measurements report cuBLAS FP16 matmul throughput rising from 55.7 to 91.4 TFLOPS (about 1.6x). On the same 22G 2080 Ti and under the same from-scratch pre-training protocol as the companion memory ledger (five tiers of Chinese encoder-decoder models, 2,451 steps per tier, 16,384 tokens per step, seed 42), we obtain a before/after throughput account: the small tier (75.7M parameters, 512-wide, 8+8 layers, activation checkpointing on) improves in steady-state throughput from 6,480 to 7,246 tok/s (+11.8%) with wall time cut from 1.77h to 1.61h (9.0% saved); the tiny tier goes from 15,150 to 15,866 tok/s (+4.7%) with wall time savings of 3.8%; the three smaller tiers (pico-micro) gain at most +0.3%; per-tier peak memory stays bit-identical, and final quality metrics are bit-identical or consistent within 10^-3. We conclude that the unlock gain is a function of matrix size, rising monotonically with tier -- imperceptible for pico-micro, visible from tiny upward, and cashed out as a double-digit percentage at small -- and that it is a pure throughput gain that leaves training dynamics untouched.
82. 【2611.05393】Challenge-Aware Knowledge Recruitment with Meta-Agent Supervision for Medical Multi-Agent Reasoning
链接：https://arxiv.org/abs/2611.05393
作者：Riccardo Riccio,Haitz Sáez de Ocáriz Borde,Pietro Liò
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Large language models, strong single-model prompting, beat strong single-model, Large language, harder reasoning tasks
备注：
点击查看摘要
Abstract:Large language models perform strongly on standard medical QA but degrade on harder reasoning tasks, where multi-agent debate often fails to beat strong single-model prompting. We argue that a key limitation is that existing systems select experts and retrieve knowledge from the question alone, rather than from gaps that emerge during reasoning. We propose challenge-aware adaptive recruitment: an external CHALLENGER inspects the evolving reasoning trace and identifies specific factual or expertise gaps. These signals trigger targeted knowledge retrieval or mid-discussion specialist recruitment. On the MEDAGENTSBENCH hard subset (862 questions across nine biomedical datasets), upfront retrieval provides little benefit, while challenge-aware in-between retrieval performs better; on a multi-specialist backbone it improves accuracy on 8 of 9 datasets and adds 6 percentage points over Challenger Only. Ablations indicate benefits from both retrieval timing and gap-specific query signals, and a live web-search experiment shows that the timing advantage persists across retrieval backends. For specialist recruitment, self-triggered adaptation is unreliable, whereas Challenger-triggered recruitment raises GPT-4.1-mini MedQA accuracy from 46% to 54%, with positive direction on all tested generalization datasets. Naively combining retrieval and specialist recruitment degrades performance, highlighting the need to coordinate adaptive intervention channels. These results show that when and why external resources are recruited is a key design choice in multi-agent medical reasoning.
83. 【2611.05391】Agent Harness Awareness: Turning Verified Telemetry into Operational Control for Tool-Using Agents
链接：https://arxiv.org/abs/2611.05391
作者：Manu Agrawal,Shrey Nagpal
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Tool descriptions, Agent Harness Awareness, necessarily reveal, healthy or suitable, Harness Awareness
备注： 9 pages, 3 figures
点击查看摘要
Abstract:Tool descriptions tell an agent what an action can do, but they do not necessarily reveal whether that action is healthy or suitable at the moment of use. Execution harnesses often possess this information through monitors, traces, and recent failures while the model choosing the next action does not. We call this gap operational blindness. We introduce Agent Harness Awareness, a trust-separated design in which the host supplies a small, fresh, verified state snapshot before a consequential action while retaining measurement, enforcement, evaluation, and final dispatch authority. We test its tools-and-network instance with ToolRoute, a controlled isolation benchmark that holds the task and candidate semantics constant and varies the operational information available to the model. In a 216-decision ablation across GPT-5.6 Sol, Claude Sonnet 5, and Gemini 3.7 Flash, verified tool-health state reduced mean observable policy regret by 96.9% against a same-shape neutral control (4,252 ms to 131 ms) and raised single-dispatch completion from 69.4% to 95.8%. In a separate 27-decision end-to-end replication with live local TCP/HTTP execution, OpenTelemetry client spans, and Toxiproxy-injected faults, verified state reduced mean regret from 8,956 ms to 0 ms (zero excess observable operational cost) and completed the live action in 9/9 model-by-fault cases versus 5/9 for the neutral control. These studies establish the tools-and-network instance of Agent Harness Awareness: selected host telemetry materially improves pre-dispatch operational choice. Runtime state, hardware pressure, economics, retry-aware recovery, and heterogeneous selection remain open empirical extensions of the same architecture.
84. 【2611.05389】AI-Driven SaaS Platform Integration: AI Express for Unified Generative AI Services with Pay-As-You-Go Credit Systems and Scalable Microservice Architecture
链接：https://arxiv.org/abs/2611.05389
作者：Deepit Sapru
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Software Engineering (cs.SE)
关键词：separate subscriptions required, image synthesis, leading to high, workflow disruptions, Core Code Reviewer
备注：
点击查看摘要
Abstract:Generative AI is currently fragmented, with separate subscriptions required for text generation, image synthesis, and code assistance, leading to high costs and workflow disruptions. AI Express is a SaaS platform that consolidates these capabilities into a unified pay-as-you-go service. The platform provides a range of AI tools, including a Core Code Reviewer that evaluates GitHub repositories, a Text-to-Website generator that converts text into fully functional websites, script generation, grammar checking, data analysis, and watermark removal, all accessible through a single interface without requiring technical expertise.
85. 【2611.05386】SRRM: A Retrieval-Reconstruction Benchmark for Evaluating Long-Context Memory in Small Language Models
链接：https://arxiv.org/abs/2611.05386
作者：Christopher Alberto Hamonangan
类目：Computation and Language (cs.CL)
关键词：Small Language Models, Small Language, Language Models, remains insufficiently understood, progressively longer contexts
备注： 37 pages, 20 tables, 13 figures
点击查看摘要
Abstract:Small Language Models (SLMs) are increasingly deployed on consumer-grade hardware, yet their ability to preserve information across progressively longer contexts remains insufficiently understood. Existing benchmarks primarily evaluate retrieval-oriented tasks, providing limited insight into whether successful retrieval reflects comprehensive long-context memory preservation. To address this limitation, this paper introduces Simple Retrieval-Reconstruction Memory (SRRM), a lightweight and fully reproducible benchmark that jointly evaluates Targeted Retrieval and Global Information Reconstruction. This study also proposes the Memory Preservation Ratio (MPR), a benchmark-level metric that quantifies the relationship between retrieval and reconstruction performance. SRRM was evaluated using a synthetic dataset on three Qwen2.5 models (0.5B, 1.5B, and 3B parameters) across context loads ranging from 10 to 100 factual statements. Experimental results show that reconstruction performance deteriorated substantially faster than retrieval accuracy as contextual information increased, indicating that retrieval alone is insufficient to characterize long-context memory preservation. Among the evaluated models, Qwen2.5-1.5B achieved the highest retrieval accuracy (86.7%), reconstruction performance (45.7%), and MPR (0.53), outperforming the larger Qwen2.5-3B model (72.2%, 18.5%, and 0.26, respectively). These findings demonstrate that increasing parameter count does not necessarily improve long-context memory preservation. Overall, SRRM provides a reproducible and extensible benchmark for systematically evaluating long-context memory while revealing complementary memory behaviors that remain hidden under retrieval-only evaluation frameworks.
86. 【2611.05385】Same Origin, Different Verdicts: Text Production Conditions Confound Machine-Generated Text Detection in Russian
链接：https://arxiv.org/abs/2611.05385
作者：Stanislav Kirichenko
类目：Computation and Language (cs.CL)
关键词：Automated detection, observable property, production process, detection of machine-generated, carries a cost
备注： 65 pages, 6 figures, 24 tables. English translation of the frozen Russian manuscript; the Russian text is the source of record and is available with all data, code and run manifests at [this https URL](https://doi.org/10.5281/zenodo.21749574) (v1.0.1)
点击查看摘要
Abstract:Automated detection of machine-generated text is applied where the verdict carries a cost for the author, yet origin is a property of the production process, not an observable property of the text. The conditions under which a text is produced push it in the same direction in which a generative model is presumed to push it. This study measures the contribution of these conditions while origin is held fixed. The Russian-language corpus of 1882 documents comprises a machine part, generated by four generation channels (each backed by its own model family) across 45 tasks in three task modes, and an archival human part annotated for source regimentation level before the texts were read. The primary contrast is computed within the machine corpus: both halves of a pair are generated by the same model for the same task and differ only in task wording. Machine-likeness is measured by four operationalisations: an interpretable index with weights fixed before data collection, a trained classifier, a zero-shot metric on an open model, a judge model. The main result is disagreement between procedures: changing the task mode shifted the scores of all four, but three gave a negative shift, the judge a positive one, and none of the four intervals covers zero. The comparison plan and the specifications of procedures 2-4 were fixed after the result of procedure 1, before procedures 2-4 ran; the disagreement survived correction of a corpus defect and of the nested validation. A baseline on the source identifier alone reaches a median AUROC of 1.0000 on the thirteen group splits where it is defined, and removing emphasis markers flipped a confident machine verdict to human without changing the full text by a single character. The scores are properties of a specific measurement system and corpus: they reflect data collection, repetition, formatting, and preprocessing decisions as well as linguistic style.
87. 【2611.05384】Human-like cross-language generalisation in deep neural speaker embeddings and its acoustic foundations
链接：https://arxiv.org/abs/2611.05384
作者：Tianze Xu,Xiyang Li,Xiaoming Jiang,Volker Dellwo
类目：Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
关键词：deep neural networks, deep neural speaker, neural speaker embeddings, deep neural, central question
备注： This manuscript has been accepted for presentation at Interspeech 2026. Code is available at [this https URL](https://github.com/xiyangg12/wespeaker) . The archived release is available on Zenodo at [this https URL](https://doi.org/10.5281/zenodo.20606535)
点击查看摘要
Abstract:Generalisability is a central question for deep neural networks, including the cross-language generalisation of speaker embeddings. This study examined whether deep neural speaker embeddings generalise across languages and how such generalisation relates to human perception and acoustic structure. Using Cantonese--English bilingual speech presented in within- and cross-language conditions, we derived similarity from 18 state-of-the-art models and compared it with human ratings and acoustic features using linear mixed models and representational similarity analysis. Embeddings exhibited cross-language generalisation that broadly paralleled human behaviour, reflecting accurate identity discrimination and sensitivity to language switching. This generalisation relied on largely shared acoustic cues with language-sensitive weighting, mirroring human patterns. Together, these findings provide converging evidence for human--machine alignment in cross-language voice similarity processing.
88. 【2611.05383】CCDWIKI: Decoupling Case Formulation from Response Generation in Longitudinal CBT Dialogue
链接：https://arxiv.org/abs/2611.05383
作者：Mingwen Zhang,Ruiyang Song,Qinying Wang,Yuchen Wang,Changsheng Ma,Minqiang Yang
类目：Computation and Language (cs.CL)
关键词：Cognitive Behavioral Therapy, Cognitive Behavioral, Cognitive Conceptualization Diagram, automatic thoughts, empathic validation
备注：
点击查看摘要
Abstract:Cognitive Behavioral Therapy (CBT) demands more than empathic validation, requiring instead a structured formulation of the interplay among situations, automatic thoughts, emotions, and behaviors. Therapists formalize this interplay through a Cognitive Conceptualization Diagram, where maintaining longitudinal coherence necessitates continuous evidential adjudication to separate tentative hypotheses from established findings. Current dialogue systems track conversational history via retrieval or static profiles but lack the representational capacity to encode epistemic status. Consequently, provisional interpretations are often prematurely reified as established facts, inadvertently biasing downstream interventions. Addressing this limitation, CCDWiki is introduced as a plug-and-play advisor conceptualizing longitudinal therapy as evidence-grounded hypothesis adjudication. The approach encodes each clinical hypothesis as a mutable entry bound to corroborating and contradicting evidence. Across sessions, accumulating data strengthens supported entries, preserves provisional ones, and retracts contradicted assumptions. The resulting formulation distills into concise guidance for unmodified therapeutic language models. Experiments demonstrate substantial improvements in both conceptualization and intervention quality without requiring backbone retraining.
89. 【2611.05382】DS@GT ARC at CheckThat! 2026: A Verdict-Anchored Pipeline for Generating Fact-Checking Articles
链接：https://arxiv.org/abs/2611.05382
作者：Hoang Thanh Thanh Truong,Shuyu Tian
类目：Computation and Language (cs.CL)
关键词：Misinformation spreads faster, Misinformation spreads, write articles explaining, spreads faster, faster than professional
备注： CLEF 2026 Working Notes, 21 - 24 September 2026, Jena, Germany
点击查看摘要
Abstract:Misinformation spreads faster than professional fact-checkers can manually verify it and write articles explaining their verdicts. This creates a need to automate the production of fact-checking articles. This paper details work done by the DS@GT ARC team for CLEF 2026 CheckThat! Lab Task 3 Fact-Checking Article Generation. We seek to generate a full fact-checking article from a claim, its original verdict, and a set of scraped source documents. Our team built a four-stage pipeline that cleans noisy evidence, retrieves and clusters relevant sources, generates the article by conditioning \texttt{Llama-3.1-8B-Instruct} on the original fact-checker verdict, and recovers inline citations through deterministic post-processing. We achieved a mean score of 0.428 and ranked 3rd out of 9 teams for the CLEF 2026 CheckThat! Lab Task 3, compared to a baseline mean score of 0.272. Our code is available on GitHub at this https URL.
90. 【2611.05381】Discourse Analysis of Legislative Bill Discussions
链接：https://arxiv.org/abs/2611.05381
作者：Isaac Rudnick,Nipun Das,Foaad Khosmood
类目：Computation and Language (cs.CL)
关键词：distinct communication events, human recognizable structure, distinct communication, distinct phenomena, communication events
备注： 10 pages, 4 figures
点击查看摘要
Abstract:Legislative hearings are distinct communication events with their own human recognizable structure and logic, yet they have been analyzed as distinct phenomena beyond their transcripts. Understanding legislative hearings at a deeper level is a major step in analyzing the work and power relationships within democratic bodies. In this work, we present a novel end-to-end pipeline for parsing rhetorical structures from legislative committee hearings with the goal of improving legislative discourse analysis and democratic accountability. We also propose a rhetorical structure grammar and find that 55.21% of California state bill discussions in our dataset can be parsed with this grammar. We evaluate our pipeline with two utterance section classifiers on a random subset of over 2,000 annotated utterances corresponding to 100 hearings. We find that a logistic regression-based classifier with grammar-based output masking and utterance tag smoothing outperforms more complex models, achieving an F1 score of 52.8% against our ground truth discourse section labels.
91. 【2606.02628】Hallucination Is Linearly Decodable from Mid-Layer Hidden States in Quantized LLMs
链接：https://arxiv.org/abs/2606.02628
作者：Aizierjiang Aiersilan
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Emerging Technologies (cs.ET); Neural and Evolutionary Computing (cs.NE)
关键词：open-source LLMs encode, linearly separable truthfulness, hidden states, separable truthfulness signal, per-layer hidden states
备注：
点击查看摘要
Abstract:We investigate whether open-source LLMs encode a linearly separable truthfulness signal in their hidden states, and at which network depth this signal is strongest. Across three $7$B--$8$B instruction-tuned models (Llama-3.1-8B, Mistral-7B, Qwen2.5-7B) loaded in $4$-bit NF4 quantization, we extract per-layer hidden states on four hallucination benchmarks (TruthfulQA, HaluEval-QA, FEVER, and a controlled synthetic set) and compare four detection approaches: linear and MLP probes, INSIDE EigenScore, self-consistency, and attention entropy. A linear probe on a single mid-network layer achieves $0.904$--$1.000$ AUROC on held-out splits, while sampling-based detectors do not exceed $0.541$ AUROC under the same protocol. The truthfulness signal is approximately linear: MLP probes rarely surpass linear probes by more than $0.01$ AUROC. Peak probing layers fall in a consistent band across model families on natural-language benchmarks -- blocks~$13$--$18$ of~$32$ for Llama and Mistral, and blocks~$19$--$25$ of~$28$ for Qwen. First-block attention entropy provides a complementary signal in knowledge-grounded settings ($0.866$--$0.941$ AUROC on HaluEval-QA) at no additional inference cost. The low discriminability of sampling methods under this protocol reflects a structural mismatch between paired-label evaluation and the information these methods access, rather than an inherent limitation of those methods. Code and data are released for full reproducibility on a single $8$\,GB GPU.
信息检索
1. 【2611.06859】Balancing hierarchical representation and quantization: A performance trade-off in text embeddings
链接：https://arxiv.org/abs/2611.06859
作者：Kai Ponel,Marco Polignano,Erasmo Purificato,Aylin Julia Temizkan,Marco Levantesi,Giovanni Semeraro,Ernesto William De Luca
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：reduces numerical precision, models offer variable-length, offer variable-length representations, Hierarchical text embedding, improve computational efficiency
备注： 29 pages. Authors' version of the open access article published in Information Sciences (CC BY 4.0). This version corrects the second affiliation of Marco Polignano (Otto von Guericke University Magdeburg); the published version lists the European Commission, Joint Research Centre (JRC) in error. Marco Polignano is not affiliated with the JRC. No other content has been changed
点击查看摘要
Abstract:Hierarchical text embedding models offer variable-length representations, while quantization reduces numerical precision; both aim to improve computational efficiency. This work is an empirical benchmark study of how these two orthogonal, already-established techniques interact. We evaluate 38 tasks from the Massive Text Embedding Benchmark (MTEB) using four transformer-based embedding models, covering 1D and 2D hierarchical representations combined with 32-bit, 8-bit, and binary quantization, for 168 configurations per task. We report each efficiency dimension separately: theoretical per-vector storage and end-to-end evaluation time. Under a Friedman test with Nemenyi post-hoc analysis, int8 quantization is statistically indistinguishable from float32 for pair classification and re-ranking and costs at most 1.5 percentage points overall, whereas binary quantization is significantly worse across every task category. Halving the embedding dimension once is not statistically detectable above $m=16$; two successive halvings always are. Combining an 8x dimensionality reduction with int8 yields a 32x reduction in per-vector storage at 94.4% of baseline effectiveness. Because evaluation times were measured once, we treat them as indicative: we find no evidence that quantization speeds up evaluation, whereas sampling from intermediate layers shortens it substantially. Retrieval degrades far faster than every other category, so we report findings per task category.
2. 【2611.06777】WISE: An Agentic Framework for Whole-page Multimodal Search Experience Attribution
链接：https://arxiv.org/abs/2611.06777
作者：Wenyi Xu,Renzhe Zhou,Songyang Li,Feiran Zhu,Ruoqi Zhao,Chenglei Dai,Xuanping Li,Kaiqiao Zhan,Jingwei Zhuo
类目：Information Retrieval (cs.IR)
关键词：rely on multi-stage, Algorithm-driven services, multi-stage model pipelines, Quality, model
备注：
点击查看摘要
Abstract:Algorithm-driven services, including search, recommendation, and advertising, rely on multi-stage model pipelines. While research prioritizes model optimization, post-deployment monitoring focuses on operational reliability. Yet operationally healthy systems may still produce poor-quality results, exposing a gap in existing evaluation and monitoring practices. However, a systematic problem formulation and benchmark for this task remain lacking. To bridge this gap, we formulate System Quality Diagnosis (SQD) for algorithm-driven services, a new task that extends quality evaluation beyond identifying poor outcomes to attributing their causes across system components. Focusing on industrial search, we propose WISE, an agentic framework for end-to-end quality diagnosis that discovers user-facing issues and traces their origins to underlying algorithmic components. To improve diagnostic reliability, we introduce ReTrace for constructing evidence-consistent trajectory supervision and Adaptive Harness-Policy Optimization (AHPO) for failure-guided optimization of the agent harness and model policy. To enable systematic evaluation, we construct WISE-BENCH, a real-world multimodal search benchmark that combines user-facing evidence, internal pipeline traces, and expert diagnosis annotations. Extensive experiments show consistent gains across model scales, with WISE achieving 75.20% end-to-end accuracy on Qwen3.5-35B-A3B. In production, WISE supports quality auditing, online quality assurance, and model optimization, reducing diagnosis costs and improving downstream relevance models.
3. 【2611.06610】Alternatives to Shallow Autoencoders for Collaborative Filtering
链接：https://arxiv.org/abs/2611.06610
作者：Mario Mallea,Angela Nebot,Francisco Mugica
类目：Machine Learning (cs.LG); Information Retrieval (cs.IR)
关键词：Collaborative filtering, modern applications, cornerstone of recommender, recommender systems, systems and plays
备注：
点击查看摘要
Abstract:Collaborative filtering (CF) is a cornerstone of recommender systems and plays a relevant role in many modern applications. CF uses user-item interaction data to discover future preferences. Although deep learning models have shown promise in CF, Embarrassingly Shallow Autoencoders for Sparse Data (EASE) has gained attention for its outstanding ranking accuracy provided by its closed-form solution. EASE relies primarily on relationships among items to fit a full-rank high-dimensional linear mapping. We hypothesize that this design limits its capacity to capture similar but not equivalent fine-grained user relationships, consequently limiting its recommendation accuracy. This paper introduces an alternative formulation based on EASE that takes advantage of user-user information. Furthermore, we propose a hybrid model that combines both user-user and item-item adjacency distributions. Our experiments reveal that the proposed models outperform EASE on well-known recommendation benchmarks, highlighting the significance of including the user alternative in shallow autoencoder studies for CF.
Subjects:
Machine Learning (cs.LG); Information Retrieval (cs.IR)
Cite as:
arXiv:2611.06610 [cs.LG]
(or
arXiv:2611.06610v1 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2611.06610
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Related DOI:
https://doi.org/10.1007/978-3-032-02215-8_10
Focus to learn more
DOI(s) linking to related resources</p>
4. 【2611.06521】Deliberate Latent Reasoning for Sequential Recommendation
链接：https://arxiv.org/abs/2611.06521
作者：Haobo Zhang,Qiannan Zhu,Yutao Zhu,Zhicheng Dou
类目：Information Retrieval (cs.IR)
关键词：behavior patterns based, reasoning, user, widely applied, applied in real-world
备注：
点击查看摘要
Abstract:Sequential recommenders are widely applied in real-world scenarios to model user preferences and behavior patterns based on user interactions. Recent advances in sequential recommendation enhance transformer-based models with latent reasoning to refine user representations by autoregressively generating intermediate reasoning vectors. However, exploring the optimal reasoning depth for diverse user histories remains challenging: existing methods typically employ a fixed number of reasoning steps for all users. This ``one-size-fits-all'' strategy often leads to suboptimal representation learning due to over-thinking in simple histories or under-thinking in complex ones. To address this issue, we propose DESRec, a deliberate latent reasoning framework that performs personalized latent reasoning to learn more informative reasoning states and enhance user modeling for sequential recommendation. Specifically, it designs a reasoning step selection module that identifies the optimal reasoning step for each user sequence during the training phase. Through a self-distillation mechanism, it compresses this most informative state into the final reasoning step, which serves as the final user representation for item ranking during inference. Moreover, it introduces a progressive preference extraction mechanism for personalized reasoning, which dynamically segments a user's history into a variable number of periods and summarizes each into a latent milestone representing the user's preference for that period. It will be used as the input of the subsequent reasoning. The number of milestones varies with the users' history, enabling a personalized reasoning over users' evolving interests. Extensive experimental results on six public datasets and four backbone recommenders demonstrate the superiority of DESRec over eight baseline models.
5. 【2611.06498】Signed but Steerable: Measuring and Closing the Text-Vector Integrity Gap in Offline Retrieval-Augmented Generation
链接：https://arxiv.org/abs/2611.06498
作者：Georgios Feretzakis,Alexandros Papaspyridis
类目：Cryptography and Security (cs.CR); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：Offline retrieval-augmented generation, signed knowledge packs, Offline retrieval-augmented, retrieval-augmented generation, edge devices
备注： 20 pages, 2 figures, 7 tables. Code and data: [this https URL](https://github.com/securagenai/signed-but-steerable) (DOI [https://doi.org/10.5281/zenodo.23948839](https://doi.org/10.5281/zenodo.23948839) )
点击查看摘要
Abstract:Offline retrieval-augmented generation (RAG) on edge devices is updated through signed knowledge packs that carry text and precomputed embedding vectors. A signature proves who published a pack, not that its vectors encode its text. We study this text-vector integrity gap. A verifier that recomputes vectors and accepts them within a cosine tolerance concedes a predictable share of queries to an attacker who controls the vectors: the hijack rate equals the distribution of angular retrieval margins at the tolerance (the margin law). Margins are small in five corpora and two embedding models, so an idealised tolerance at the level of floating-point noise leaves up to 5.5% of queries exposed (at most 1.2% in any corpus once exact duplicate documents are excluded), and a threshold calibrated from our CPU INT8-FP32 comparison of a small embedding model (at the empirical 0.1% quantile of honest cosines) leaves 98-100% exposed; on a Raspberry Pi 5 running a local language model, such an attack lowers correct answers from 0.75 to 0.39. Integrity audits of compressed vector stores fare no better: on a FAISS product-quantisation index over 57,638 documents, tampered vectors that all pass the audit put the attacker's document first for 25% of targets. Verifying quantisation codes instead, with ambiguity decided by the verifier, a calibrated guard band and canonicalisation, accepted every honest vector in our samples on three platforms and left the publisher no choice. We also show that common floating-point and dynamic-INT8 inference pipelines are not bit-reproducible across batch sizes or architectures, and report pre-registered negative results on abstention, context pruning and semantic screening. We release code and data.
6. 【2611.06481】ArcRAG: Agentic Compositional Retrieval over Knowledge Graphs
链接：https://arxiv.org/abs/2611.06481
作者：Jyotin Goel,Abhinav Arun,Tejas Prakash Agarwal,Bhaskarjit Sarmah,Stefano Pasquali
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Graph-based retrieval-augmented generation, Graph-based retrieval-augmented, retrieval-augmented generation, knowledge graph built, graph
备注： Preprint
点击查看摘要
Abstract:Graph-based retrieval-augmented generation (GraphRAG) answers questions by retrieving over a knowledge graph built from a corpus. Yet retrieval strategies are designed around the structure their own construction pipeline produces, and whether they survive a change of construction is rarely tested. We study this cross-construction portability: whether one retrieval procedure, with no construction-specific schema, relation names, or retuning, stays effective when the graph is built differently. We introduce ArcRAG, which induces a query-local graph interface at inference time (the node labels, relation descriptors, and property keys reachable from the entities a question names), plans multi-hop traversals against it, and executes and repairs them as Cypher. We build each of the MuSiQue, HotpotQA, and TriviaQA corpora as a schema-guided graph (typed nodes, a closed relation set, source provenance) and as an open-information-extraction graph (untyped nodes, free-text relations), with the retriever's configuration fixed across them. We compare against a construction-agnostic Direct-Cypher agent, ablate each stage across retry and pass budgets on both graph families, and compare with results reported for prior GraphRAG systems, most of which design retrieval together with their own graph construction. Across the two constructions, we find that retrieval need not be co-designed with the graph: query-time interface induction keeps a construction-agnostic retriever effective when the construction changes, although construction still shapes absolute accuracy.
7. 【2611.06349】PMRecBench: A Benchmark for Personalization in Recommendation Agents under Multimodal Queries
链接：https://arxiv.org/abs/2611.06349
作者：Xiaoyu Zhang,Yougang Lyu,Bin Wu,Sahan Bulathwela,Emine Yilmaz
类目：Information Retrieval (cs.IR)
关键词：Web platforms, deliver personalized recommendations, satisfy users' visually, reflect preferences inferred, personalized recommendation benchmarks
备注： 13 pages. Project page: [this https URL](https://pmrecbench.github.io/)
点击查看摘要
Abstract:On Web platforms for shopping and entertainment, recommendation agents under multimodal queries aim to deliver personalized recommendations that satisfy users' visually specified requirements and reflect preferences inferred from user histories. However, existing personalized recommendation benchmarks use text-only queries, while multimodal ones assess query matching without evaluating personalization based on real user histories. We introduce the Personalized Multimodal Recommendation Benchmark (PMRecBench), the first benchmark to evaluate the personalization of recommendation agents under multimodal queries. It pairs 510 quality-controlled image-text queries across clothing and movies with the corresponding users' real histories. PMRecBench features two key designs: (1) queries derived from consistent behavioral patterns in real user records, with reference images and targets linked to actual interactions; and (2) challenging diagnostic pools with candidate items rated highly by the user but violating requirements, and items satisfying requirements but never rated highly, testing requirement understanding and preference following, respectively. Extensive experiments on diagnostic pools reveal a personalization imbalance in recommendation agents: relative to personalization signals alone, adding multimodal queries weakens preference following, even though the additional information about query requirements improves overall ranking performance. Further analysis links this decline in preference following to image interpretation, where agents can prioritize resemblance to reference images over evidence from user histories, and stronger commercial backbones alone fail to resolve this imbalance. This personalization imbalance highlights a central challenge for recommendation agents: improving ranking performance while preserving preference following when responding to multimodal user queries
8. 【2611.06323】Generative Retrieval under Real-Time Supply Constraints in Local Commerce
链接：https://arxiv.org/abs/2611.06323
作者：Shaopeng Liang,Biao Zhang,Hongzhen Ye,Zeyang Hou,Ma Jiang,Jintao Tu,yunxi.hz,Zhijia Fang,Jianqiang Cao,Junxue Rao,Jia Jia
类目：Information Retrieval (cs.IR)
关键词：Generative retrieval predicts, predicts semantic identifiers, retrieval predicts semantic, Generative retrieval, predicts semantic
备注： 11 pages, 3 figures, 6 tables, 2 algorithms. The first five authors contributed equally
点击查看摘要
Abstract:Generative retrieval predicts semantic identifiers for candidate entities. In local retail and food delivery, candidates must also be serviceable for a particular user at a particular time. Location, weather, and traffic reshape merchant and product supply, so a catalog-valid identifier may be infeasible for the current request. Post-generation filtering removes such candidates only after beam capacity and inference computation have been spent. We study retrieval over an explicitly materialized, request-time supply snapshot, where short output sequences leave little opportunity to amortize online constraint preparation. Our RTP-LLM pipeline compiles eligible residual-quantization identifiers into a compressed sparse row prefix index, overlaps CPU compilation with model prefill, and shares the uploaded index across beams. Legal expansions retain original-model log probabilities, and constraint states follow selected beam parents. We formalize snapshot-relative identifier validity and distinguish it from entity-level eligibility and freshness. The implementation generates three-token merchant identifiers. Historical evidence covers daily catalog constraints and subsequent request-scoped serving evaluations. In one matched-beam daily-constraint case, filtered merchants decrease from 170 of 299 candidates to 29 of 299; residual distance filtering motivates request-specific constraints. A different-host comparison with 30,000 supplied entries reports a 0.6 ms service-side latency increment, while client measurements expose additional request costs. Captured requests from three geographic settings characterize behavior across supply sizes and output widths. These observations span development stages and measurement boundaries. They establish a practical implementation and identify bottlenecks, but do not establish compute savings at matched retrieval quality.
9. 【2611.06044】Do Search-Augmented Recommenders Use the Latest Search Episode?
链接：https://arxiv.org/abs/2611.06044
作者：Jiandong Ding
类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：Search-augmented recommenders, earlier searches, search, latest search, Search-augmented
备注： Accepted at WSDM 2027. Code: [this https URL](https://github.com/jdding/focalswap)
点击查看摘要
Abstract:Search-augmented recommenders can use the latest search episode and earlier searches. We introduce FocalSwap to test how these inputs contribute to the next recommendation. For each recommendation, it changes the latest search slot or all search inputs while holding the target, candidates, pre-search history, and scorer fixed. It compares neutral masks with matched observed-search replacements, recording rank changes, RR gains relative to each control, and preference for the true focal search. A planted signal and GenSAR's current-query task confirm that the audit detects known input dependence. We evaluate behavioral and lexical evidence on KuaiSAR and Qilin, and recommendation checkpoints trained using the released SESRec and UniSAR implementations. Across three independently trained UniSAR checkpoints, the estimated all-source benefit depends on the control. On the same 66,139 rows, replacing all search inputs with a neutral ID yields a positive signed contribution, whereas replacing them with category/profile-matched observed search sequences gives smaller estimates, with an interval below zero for one checkpoint. The paired RR gaps range from $+2.770 \times 10^{-3}$ to $+6.604 \times 10^{-3}$, and every adjusted interval is above zero. Neutral masks change 59.7-61.7% of target ranks, while matched replacements change 44.1-44.8%. The control contrast persists across five alternative donor assignments per checkpoint. Under the primary neutral-mask and category-matched controls, positive latest-slot contribution is not established in SESRec or UniSAR. These results show why masking evidence should be compared with observed-search replacements when attributing a benefit to broader search state or the latest episode.
Comments:
Accepted at WSDM 2027. Code: this https URL
Subjects:
Information Retrieval (cs.IR); Machine Learning (cs.LG)
Cite as:
arXiv:2611.06044 [cs.IR]
(or
arXiv:2611.06044v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2611.06044
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
10. 【2611.05997】From Waste to Discovery: Recycling High-Scored Unexposed Candidates in Taobao Feed Recommendation
链接：https://arxiv.org/abs/2611.05997
作者：Ge Fan,Kai Meng,Huiping Chu,Yuning Jiang,Han Zhu,Bo Zheng
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Helping users discover, Helping users, industrial recommender systems, usual remedy, exposure of under-explored
备注：
点击查看摘要
Abstract:Helping users discover new interests is vital to the long-term health of industrial recommender systems, yet the usual remedy, boosting exposure of under-explored (discovery) content, often backfires in production. We report URED (Unexposed Recycling for Efficient Discovery), a training-free recall-stage system serving Taobao feed recommendation at Alibaba for over six months to tens of millions of daily active users. It rests on a production-validated insight: naive boosting fails because it injects cold, information-poor candidates that rankers systematically over-estimate, buying no discovery gain while risking engagement. Items scored highly but never exposed (signals industrial pipelines routinely discard) form a pool that is both relevant and reliably predictable. Over a 30-day horizon URED aggregates them and re-injects at recall time through a lightweight pipeline spanning offline storage, distributed aggregation, and low-latency online serving, adding under 1% latency via a single O(1) lookup per request with no model retraining. Online A/B tests show +3.47% discovered categories and +8.47% content richness with engagement preserved: completion video views rise significantly (+2.62%) and total views move positive (+0.36%, not significant). Ablations confirm both design pillars are necessary: a one-day window collapses the discovery gain to +0.55% (not significant), and random injection without score filtering yields no gain while trending negative on engagement (-0.17%). Across production recall channels, URED reaches 13.9x the platform-average discovery rate (6.3x the strongest nearline baseline) at engagement quality on par with the platform average. We share deployment details and lessons for practitioners facing the exploration-exploitation dilemma under tight resource constraints.
11. 【2611.05952】One Basket, Many Experts: Decorrelated Re-ranking for Financial Asset Recommendation
链接：https://arxiv.org/abs/2611.05952
作者：Ryuki Unno,Keigo Sakurai,Koshi Watanabe,Keisuke Maeda,Takahiro Ogawa,Miki Haseyama
类目：Information Retrieval (cs.IR); Computational Engineering, Finance, and Science (cs.CE)
关键词：Financial asset recommendation, Financial asset, investors is typically, typically optimized, risk-adjusted return
备注： Accepted to the 7th ACM International Conference on AI in Finance (ICAIF2026)
点击查看摘要
Abstract:Financial asset recommendation for retail investors is typically optimized for relevance, that is, how well a recommendation matches what each user will buy. From the service provider's point of view, the value of a recommendation also depends on portfolio performance: the risk-adjusted return the recommended assets (the basket) deliver, which drives user engagement and fee revenue. The two goals are rarely achieved jointly, because the recommendations that best match user behavior concentrate on a few popular assets whose returns are highly correlated, which caps the risk-adjusted return a provider can offer. We propose Decorrelated-Satellite Expert Re-ranking (\textbf{DSER}), which retains the most relevant recommendations from an expert-following list and replaces the rest with return-decorrelated alternatives. The number of replaced slots is a single integer~$m$ (a knob) that the provider sets, so the relevance--performance trade-off becomes an explicit, auditable choice rather than a property hidden inside a learned model. In experiments on the public FAR-Trans retail-brokerage dataset, under the primary protocol, replacing a few slots improves risk-adjusted return at a small relevance cost, and the gain survives realistic trading costs at typical retail portfolio sizes. Minimizing correlation would lower basket volatility, but in our data the least-correlated assets are more volatile and higher-return, so their volatility offsets that reduction while their return drives the gain, not lower volatility. The resulting trade-off is asymmetric, with the relevance cost consistent across market phases while the gain is phase-dependent. The provider sets $m$ to read off exactly how much relevance each operating point costs.
12. 【2611.05908】Optimal Re-Ranking Depth
链接：https://arxiv.org/abs/2611.05908
作者：Siqing Huo,Andrew Parry,Debasis Ganguly,Charles L. A. Clarke
类目：Information Retrieval (cs.IR)
关键词：re-ranking depth, optimal re-ranking depth, re-ranking, fixed re-ranking depth, depth
备注：
点击查看摘要
Abstract:Second-stage neural rankers are commonly applied with a fixed re-ranking depth, assuming that retrieval effectiveness saturates as depth increases. Prior research has questioned the assumption that increasing the re-ranking depth yields linear performance gains, further suggesting that optimal re-ranking depth varies considerably from query to query. In the past, studying such phenomena was methodologically difficult given the scale of manual annotation required. With the advent of LLM-based relevance judgments we can now more easily undertake such studies, in this case to pinpoint the optimal re-ranking depth on a per-query basis. Using dense LLM-based relevance judgments over a typical re-ranking pipeline, we show that many queries exhibit a well-defined optimal re-ranking depth, beyond which effectiveness stagnates or degrades. We formulate re-ranking depth as a query-specific property and study whether it can be predicted a priori from first-stage retrieval characteristics. Through a large-scale analysis, we find that most standard query performance prediction (QPP) methods are ineffective for this task. In contrast, a predictor derived from LLM-assessed first-stage ranking quality, which we term IR-DCG@10, can reduce the average re-ranking depth by up to a factor of 3 while preserving overall effectiveness, depending on the specific first- and second-stage rankers used. Under oracle selection of optimal depths, we further show that retrieval effectiveness can improve by more than 7% while reducing the average re-ranking depth by a factor of 5 on the MSMARCO DEV collection. Given our promising preliminary findings, we would encourage the use of automatic judgments to facilitate research otherwise infeasible under manual annotation. Towards this point, we release relevance judgments, our codebase, and experimental artefacts to support reproducibility and further research.
13. 【2611.05900】Weaver: Weaving Preference Evidence through Incremental Reasoning for Personalized Retrieval-Augmented Generation
链接：https://arxiv.org/abs/2611.05900
作者：Linyao Zheng,Zhifang Mao,Xuhang Shi
类目：Information Retrieval (cs.IR)
关键词：extended interaction histories, retrieval-augmented generation requires, generation requires extracting, Personalized retrieval-augmented generation, applying user preferences
备注：
点击查看摘要
Abstract:Personalized retrieval-augmented generation requires extracting and applying user preferences from extended interaction histories. This task is challenging because preference evidence is scattered across past conversations and remains bound to specific temporal and situational contexts. Consequently, isolated fragments rarely provide complete support for a response, while preferences expressed under different conditions are easily conflated. To address these limitations, we propose Weaver, a framework that incrementally weaves memory-conditioned retrieval trajectories with compositional preference reasoning for personalized responses. Weaver operates on a Dual-Layer Retrieval and Reasoning Graph that couples an upper Intent Dependency Graph with a lower Memory-Conditioned Retrieval Trajectory Graph. Dependency Information Gap Tracking represents the information needed to answer the current request and its prerequisite dependencies in the upper graph. Memory-Conditioned Incremental Retrieval uses established premises and clues from retrieved conversations to locate missing evidence, recording the resulting retrieval trajectories in the lower graph. Scope-Aware Compositional Reasoning jointly interprets the accumulated evidence to determine which preferences apply to the request. It identifies complementary and alternative support and distinguishes conflicting claims within the same temporal and situational context. These conclusions iteratively update task premises and remaining information gaps, guiding subsequent retrieval to establish a coherent contextual basis for the final response. Experiments on personalized RAG benchmarks, particularly PersonaMem, demonstrate that Weaver outperforms leading baselines in both evidence completeness and answer quality.
14. 【2611.05829】SciToT: Multimodal Tip-of-the-Tongue Retrieval for Scientific Papers
链接：https://arxiv.org/abs/2611.05829
作者：Stan Fris,Sijie Tao,Makoto P. Kato,Maarten de Rijke
类目：Information Retrieval (cs.IR)
关键词：Researchers frequently encounter, recall reliable identifiers, frequently encounter difficulties, Researchers frequently, encounter difficulties re-finding
备注：
点击查看摘要
Abstract:Researchers frequently encounter difficulties re-finding scientific papers when they remember aspects of the content but cannot recall reliable identifiers, such as titles or author names. This type of re-finding task, known as tip-of-the-tongue (ToT) retrieval, is particularly challenging for scientific documents, where recollections may involve textual information and visual elements, including figures, diagrams, and plots. Existing ToT retrieval benchmarks do not address scientific search. We introduce a multimodal benchmark for scientific ToT retrieval, comprising 108,512 open-access scientific documents across five domains and 11,499 synthetically generated queries. To construct the benchmark, we propose a scalable query elicitation pipeline that independently extracts textual and visual memory cues from source documents and uses large language models to generate queries resembling incomplete human recollections. We characterize scientific ToT information needs through an empirical analysis of publicly available re-finding requests and use the outcomes to assess the generated queries using human annotations and automated quality control. The benchmark includes lexical, dense, late-interaction, and visually grounded retrieval baselines. We release the dataset, extracted document representations, generated memory cues, evaluation splits, and accompanying generation and retrieval pipelines under an MIT license to facilitate research on multimodal scientific paper re-finding.
Subjects:
Information Retrieval (cs.IR)
Cite as:
arXiv:2611.05829 [cs.IR]
(or
arXiv:2611.05829v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2611.05829
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
15. 【2611.05799】Item Representations Matter: Bridging Hard Semantic IDs and Soft Prototype Mixtures for Generative Retrieval
链接：https://arxiv.org/abs/2611.05799
作者：Vicente Balmaseda,Dongqi Fu,Jiarui Feng,Ren chen,Hanqing Zeng,Tianxin Wei,Yinglong Xia,Tianbao Yang,Hong Li
类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：Modern recommender systems, generative retrieval techniques, recommender systems rely, Modern recommender, systems rely
备注：
点击查看摘要
Abstract:Modern recommender systems rely on generative retrieval techniques to predict the next item either as discrete codes or as a continuous vector. On the one hand, Semantic IDs (SIDs) give discrete models shared parameters and pretrained semantic structure, but discretizing items into hard codes discards some information from the original content embeddings. On the other hand, continuous models avoid quantization, yet typically use flat item lookup tables with no explicit parameter tying across items. We ask whether a continuous recommender can introduce shared structure without making it a discrete bottleneck. We propose CAP-Mix, a flow recommender that represents each item as a soft mixture of shared prototypes plus an item-specific vector. The assignments, prototypes, and item vectors are trained jointly, and the soft representation is retained at inference. Pretrained information is optional: SID responsibilities can serve as a prior over assignments, while a full content embedding can initialize the item-specific vector without changing the initial flat table. In matched comparisons on three datasets, CAP-Mix improves over a flat table on the two sparse Amazon datasets and yields a small gain on Steam when trained without pretrained information. Given only an offline SID, it outperforms a hard table built from the same tokenizer by 4.45-14.90% in HR@5. Given the full content embedding, it matches or improves a strong flat table while hard assignments regress on the sparse Amazon datasets. Overall, averaged across six benchmarks, CAP-Mix improves HR@5 and NDCG@5 by 6.9% and 13.6% relative to the best evaluated baseline for each dataset and metric, while delivering 1.4-161x the inference throughput of the discrete baselines in our experiments.
16. 【2611.05753】oward a Compositional Knowledge Architecture for a Shared Organizational Cortex
链接：https://arxiv.org/abs/2611.05753
作者：Andrew Miracle,Phyl Georgiou,Christine Okoth,Ese Monday
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：decisions and relationships, resting on assumptions, Organizations accumulate evidence, revised as circumstances, circumstances change
备注： 25 pages, 10 figures, 10 tables. Evaluation and sources in [this https URL](https://github.com/withrobinhq/geometric-knowledge-paper-evals) (tag registered-plan)
点击查看摘要
Abstract:Organizations accumulate evidence in conversations, documents, decisions and relationships, but they act on interpretations: judgements assembled from several observations, resting on assumptions, and revised as circumstances change. Existing retrieval, knowledge graphs and agent memory keep the records and lose the interpretation. We propose a four-layer architecture, Signals, Domains, Claims and Dimensions, in which interpretations persist with their justifications and standing, a truth-maintenance network revises that standing as evidence changes, and validated, versioned Dimensions position interpretations on named axes. We call the result a shared organizational cortex. In a registered retrieval experiment, the Dimension term gains 0.028 nDCG@10 (p = 0.002). In system-level comparisons, the full retrieval configuration improves nDCG@10 by 0.081 over Signals-only and 0.053 over graph-augmented Signals-only retrieval (both reported p 0.001). The architecture gives organizations a persistent, revisable basis for shared judgement.
17. 【2611.05690】urbocharging PiPNN for Proximity and $k$-NN Graph Building
链接：https://arxiv.org/abs/2611.05690
作者：Tobias Rubel,Richard Wen,Guy Blelloch,Laxman Dhulipala,Lars Gottesbüren,Jakub Łącki,Vahab Mirrokni
类目：Databases (cs.DB); Information Retrieval (cs.IR)
关键词：Nearest Neighbor Search, Approximate Nearest Neighbor, Graph-based Approximate Nearest, Neighbor Search, Approximate Nearest
备注：
点击查看摘要
Abstract:Graph-based Approximate Nearest Neighbor Search (ANNS) indexes such as HNSW and Vamana deliver state-of-the-art query performance at the cost of large indexing times. The recently introduced PiPNN method drastically accelerated index construction by way of a partitioning-based algorithm leveraging dense matrix multiplication and top-$K$ aggregation kernels. In this paper, we unlock the full potential of PiPNN's hardware-friendly algorithm design. We introduce PiPNN II, which optimizes multiple steps of the PiPNN recipe, giving up to $8\times$ speedups for graph-based ANNS index construction. In addition, we present GPiPNN, a GPU implementation which builds comparable ANNS indices up to $43.7\times$ faster than Jasper and up to $50\times$ faster than CAGRA. We also extend PiPNN II and GPiPNN to compute high-quality $k$-NN graphs directly, which unlocks massive speedups over methods used in many existing systems for clustering, anomaly detection, and more. For 10-NN graph building at $90\%$ recall, we obtain up to a $13\times$ speedup on CPUs and $6.6\times$ on GPUs as compared to the prior best methods. PiPNN II can build a billion-scale 10-NN graph in under 16 minutes. Common to both PiPNN II and GPiPNN is the use of quantization to reduce memory traffic and leverage fast low-precision matrix operations. Top-$K$ emerges as a new bottleneck, which we optimize with specialized code for specific $K$, and by fusing with the matrix kernel to avoid materializing the distance matrix to memory. On CPUs, we demonstrate further performance improvements by leveraging our matrix kernels in the RobustPrune procedure proposed in Vamana and used in PiPNN. On GPUs, we flatten recursive partitioning into segmented batches, use one fused top-$K$ abstraction for partitioning and leaf scoring, and prune with already-witnessed direct edges rather than new candidate-to-candidate scoring passes.
Subjects:
Databases (cs.DB); Information Retrieval (cs.IR)
Cite as:
arXiv:2611.05690 [cs.DB]
(or
arXiv:2611.05690v1 [cs.DB] for this version)
https://doi.org/10.48550/arXiv.2611.05690
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
18. 【2611.05664】Combining Relevant Expert Knowledge Using Mixtures of Feedback Fuzzy Cognitive Maps
链接：https://arxiv.org/abs/2611.05664
作者：Olaoluwa Adigun,Akash Kumar Panda,Bart Kosko
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Symbolic Computation (cs.SC)
关键词：knowledge sources, neuro-symbolic system, knowledge, knowledge network, FCM knowledge network
备注： 8 page, 8 figures, 2 tables
点击查看摘要
Abstract:A neuro-symbolic system should combine only relevant answers from expert agents or other knowledge sources. Using only relevant experts for a given input query becomes ever more important for accuracy and scalability as the knowledge network grows and connects ever more knowledge sources. We extend the standard definition of relevance from the legal theory of evidence: An answer is relevant if and only if it is both probative and material for the matter at hand given the knowledge available. We apply this relevancy scheme to mixing the feedback fuzzy cognitive maps (FCMs) of real or artificial experts. The expert FCM directed causal graphs mix or combine into a common knowledge network. We compare the equilibrium limit-cycle predictions or answers of the experts to the answers of the mixture FCM and then estimate the probative status of answers by their difference or variation. A new Bayes-like theorem de-mixes the knowledge mixture into corresponding posterior-like FCMs that also allow relevancy-based comparisons. The result is a final set of relevancy mixing weights that produces a relevancy-mixed FCM knowledge network for the given query. So different queries produce different relevancy-mixed FCMs. We demonstrate this relevancy approach using generated synthetic FCMs from an actual 13-node expert FCM that models the causes and feedbacks of ischemic-stroke risk.
19. 【2611.05643】Data-Efficient Scaling-Law Discovery for Recommendation Systems via Coupled Hyperparameter Scaling
链接：https://arxiv.org/abs/2611.05643
作者：John Martabano Landy,Louis C. Tiao,Yao Xuan,Luc Kien Hang,Rupinder P. Khandpur,Arvind M. Vepa,Srinidhi Raghavendran,Anirudh Agrawal,Xiaoyi Leo Liu,Jiang Liu,Peggy Yao,Alireza Vahdatpour,Djordje Gligorijevic
类目：Machine Learning (cs.LG); Information Retrieval (cs.IR)
关键词：Web platforms benefit, Web platforms, large language models, Large-scale ranking, power-law in form
备注： 12 pages, 10 figures
点击查看摘要
Abstract:Large-scale ranking and recommendation models of Web platforms benefit from increased compute much as large language models do, and their scaling behavior is broadly power-law in form. Yet ranking models have heterogeneous architectures which makes their scaling law less straightforward than that of LLMs. We address how to discover the scaling law of an arbitrary ranking model efficiently. We introduce a scaling layer, which groups primitive architecture parameters into semantically coherent groups and defines how they co-vary, inducing a mapping from a low-dimensional space of hyper-hyperparameters into the full architecture space. On top of it, Axia fits scaling-informed surrogates, selects configurations by a posterior-based acquisition criterion, and returns a Pareto frontier from which per-model operating points are validated -- replacing exhaustive sweeps with a small number of informative runs. A fleet-level evaluation protocol, computed on a fixed representative model set under matched trial budgets, makes refinements to either component measurable. Our contribution is an automated system that learns model-specific complexity-quality relationships and gives uncertainty-aware guidance for allocating compute across a heterogeneous model ecosystem. Across 34 model iterations in two development cycles on Meta's ads ranking and retrieval system, the workflow yielded a mean 0.66% offline normalized-entropy improvement and 0.36% cumulative online lift.
20. 【2611.05596】RAGCompass: Generalizable Retriever Routing via Reranking
链接：https://arxiv.org/abs/2611.05596
作者：Valentin Six,Mufei Li,Dongqi Fu,Yinglong Xia,Hong Li,Pan Li
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：retrieval-augmented generation, exist for retrieval-augmented, retriever, retrievers exist, passages
备注：
点击查看摘要
Abstract:Different retrievers exist for retrieval-augmented generation, yet none performs best for all queries. Therefore, the key question is: given a query and retrieved passages from different retrievers, which one is most suited for that query? Existing routers usually make predictions from query-specific features and a fixed pool of retrievers; such routers have no output for an unseen retriever and are incapable by design on a new corpus. To fill these gaps, RAGCompass reads the retrieved passage sets themselves: passages from an unfamiliar retriever or corpus stay directly comparable to other passages, so routing stays well designed where a query-only map would fail. We contrastively fine-tune a reranker against the answer each evidence set produces, which accounts for most of the gain; a small comparison head adds a moderate improvement, and neither component has retriever-specific parameters. RAGCompass improves answer F1 by 28% relative to the best fixed retriever, and outperforms fusion baselines, three query-only routers, and a prompted 8B language model. Generalization experiments show that RAGCompass keeps most of its gain under an unseen corpus, retriever, or reader, while query-only baselines fall to the best fixed retriever or below.
21. 【2611.05445】LIBRA: Programmatic Induction of Executable Tool Libraries
链接：https://arxiv.org/abs/2611.05445
作者：Zekai Li,Zhenke Liu,Yonghao Li,Junhan Liu,Xulong Xiao,Jiapeng Zhang
类目：oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Large language model, language model agents, model agents increasingly, agents increasingly retrieve, Large language
备注： 10 pages, 5 figures. Introduces LIBRA, a query-agnostic tool library built via execution-validated prerequisites in a sandbox (avg ARR review score: 3.5/5). Demonstrates consistent performance gains across three benchmarks while discussing sandbox dependencies and library construction trade-offs
点击查看摘要
Abstract:Large language model agents increasingly retrieve tools from large catalogs, yet most retrievers rank each tool independently by request similarity. For multi tool tasks, this recovers the goal matching tool while omitting prerequisite tools required by the this http URL introduce LIBRA, a framework for Library Induction by Runtime Assembly that turns a flat tool catalog into an executable tool library. An LLM proposes per tool contracts of candidate invocations, reusable outputs and state changes, and success conditions; LIBRA then tests these compositions in a sandbox and retains the relations supported at runtime. Constructed before user queries, the library requires no dependency annotations, tool use trajectories, or task specific training, and supports both one-shot and agentic retrieval. On AppWorld, BFCL, and SciToolEval, LIBRA improves one-shot Recall and NDCG over the same dense retriever by 7.9 and 3.7 percentage points on average. Within ToolReAGt, it yields corresponding gains of 4.5 and 2.9 points after ten retrieval iterations.
22. 【2606.00044】Algorithmic Authority and the Clinical Standard of Care
链接：https://arxiv.org/abs/2606.00044
作者：Aizierjiang Aiersilan
类目：Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Social and Information Networks (cs.SI); Systems and Control (eess.SY)
关键词：applying Lawrence Lessig, facto medical regulation, clinical medicine creates, Code is Law, Lawrence Lessig
备注：
点击查看摘要
Abstract:The integration of artificial intelligence into clinical medicine creates a fundamental tension between algorithmic probabilistic reasoning and the experiential intuition of expert physicians; applying Lawrence Lessig's \enquote{Code is Law} framework, I argue that the architecture of clinical AI systems already functions as de facto medical regulation, reshaping liability and the standard of care. Reframing AI \enquote{hallucination} as structurally analogous to well-documented human cognitive failures such as confirmation bias and premature diagnostic closure, I show that both failure modes demand a unified governance response. I therefore propose a dialectical standard of care that treats the integrated AI-physician dyad as the singular responsible diagnostic entity, mandating the synthesis of algorithmic precision with human interpretive authority within robust data governance and patient privacy frameworks.
计算机视觉
1. 【2611.06918】From Pixels to Actions - Towards Native Vision-Language-Action Policies
链接：https://arxiv.org/abs/2611.06918
作者：Weichen Fan,Haiwen Diao,Penghao Wu,Siyuan Hu,Ziqi Huang,Tianqi Liu,Mingze Sun,Ziyi Wang,Zhongang Cai,Hanming Deng,Quan Wang,Lei Yang,Lewei Lu,Fangzhou Hong,Zhaoxi Chen,Dahua Lin,Ziwei Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：action reasoning begins, models are typically, typically built, reasoning begins, visual
备注： Code link: [this https URL](https://github.com/EvolvingLMMs-Lab/NEO/tree/main/VLAKit)
点击查看摘要
Abstract:Vision-language-action models are typically built on a simple premise: perception is first compressed by visual encoders, and action reasoning begins only afterwards. Yet manipulation often hinges on precisely the visual signals most vulnerable to this abstraction, e.g., local geometry, boundaries, depth, and subtle state changes. This raises a fundamental question: should action policies inherit a fixed visual endpoint, or directly access evolving visual computation? We introduce NEO-VLA, a structurally encoder-free vision-language-action framework. Images are tokenized by lightweight patch convolutional layers and evolve jointly with language throughout the backbone, allowing a flow-matching action expert to draw from instruction-conditioned visual representations at different depths. This simple change reveals a consistent pattern. Native architectures outperform encoder-based counterparts under controlled comparisons; full fine-tuning reduces but does not erase the gap, and additional scale alone cannot recover it. More strikingly, layer-wise probing shows that the action-critical signals often peak well before the final visual representation. Across diverse manipulation settings and distribution shifts, NEO-VLA consequently achieves stronger and more robust control. Together, these results suggest that embodied control benefits from access to visual representations across the computational hierarchy, rather than a fixed encoder output.
2. 【2611.06908】Perceptive Humanoid Motion from Simulation
链接：https://arxiv.org/abs/2611.06908
作者：Siyuan Hu,Abulikemu Abuduweili,Yue Meng,Shipeng Liu,Quentin Leboutet,Chen Chen,Matthias Müller,Vladlen Koltun
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：potential to automate, automate a wide, wide range, Humanoid robots, humanoid autonomy
备注： Code and videos at: [this https URL](https://apple-aiml-research.github.io/ml-halo/)
点击查看摘要
Abstract:Humanoid robots have the potential to automate a wide range of physical tasks. Progress toward generalist humanoid autonomy, however, remains constrained by a data bottleneck: mapping pixels and free-form language to low-level joint commands requires paired supervision, and no corpus of such data exists at sufficiently large scale. Some approaches rely on human teleoperation and wearable capture devices, which require at least an hour of human time to produce an hour of data. We present HALO, a humanoid autonomy system powered by a pipeline that synthesizes vision-language-motion data across a thousand procedurally generated homes. The corpus scales with compute rather than human labor. HALO acquires a repertoire of physical skills, including sitting on chairs, navigating to named objects, stepping sideways through half-open doors, crouching and crawling beneath tables, and pushing boxes. It orchestrates these skills to solve composite, long-horizon tasks. Without ever seeing a real home during training, HALO transfers zero-shot to the physical world, achieving a 91% success rate across 360 trials in six unmapped real-world environments. See this https URL for code and videos.
3. 【2611.06901】Motion-guided Contrastive Regularization For Latent World Models
链接：https://arxiv.org/abs/2611.06901
作者：Yiwen Chen,Qiqi Hou,Jisoo Jeong,Yinhao Zhu,Huaizu Jiang,Amir Said
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：JEPA-style world models, world models learn, models learn action-conditioned, preserve information needed, learn action-conditioned latent
备注：
点击查看摘要
Abstract:JEPA-style world models learn action-conditioned latent dynamics without reconstructing observations, but distributional regularization alone does not ensure that their representations preserve information needed for control. We identify static collapse, a failure mode in which the encoder preserves episode-specific static content while suppressing manipulation-relevant state changes. Because static content is temporally predictable yet diverse across episodes, this failure can persist despite regularizers such as SIGReg. A controlled study on OGBench-Cube shows that introducing randomized backgrounds substantially degrades planning performance while leaving the underlying manipulation task unchanged. To address this problem, we propose motion-guided contrastive regularization. Our approach compares predicted latent transitions with transitions to candidate observations from the same episode, reducing the usefulness of static background identity for distinguishing action outcomes. Optical-flow similarities provide soft contrastive targets, allowing candidates with similar motion to receive similar supervision. Combined with latent prediction and SIGReg, our objective encourages representations to preserve within-episode state distinctions and similarities between related transitions. Our method improves planning success over LeWorldModel (LeWM) from 52% to 78% on OGBench-Cube with randomized backgrounds and from 14% to 54% on LIBERO-Object, while maintaining comparable performance on four other visual-control benchmarks.
4. 【2611.06899】Occlusion for Free: Detecting Occlusion from the Disagreement Between Two Monocular Distance Cues
链接：https://arxiv.org/abs/2611.06899
作者：Chibueze Praise Onyenweaku,Toyibat Adele,Sikirulahi Opeyemi Abdulkareem,Obed Honour Eje
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：deployment settings rarely, hidden pixels, recover the hidden, occlusion, Knowing
备注： Accepted at the NeurIPS 2026 GlobalSouthAI Workshop
点击查看摘要
Abstract:Knowing that a pedestrian is occluded is useful to a robot even when the detector cannot recover the hidden pixels, but occlusion estimators are normally trained on occlusion annotations that deployment settings rarely have. We show that occlusion can be read off two distance estimates a camera-only pipeline already computes. Apparent height is largely unchanged by occlusion, because the detected box still spans the whole person; monocular metric depth is pulled toward the occluder, because the nearest surface inside the box is what a depth map reports. Only their ordering matters, so no focal length, stature, or depth scale is needed, provided the depth model's error is close to a pure gain, a condition that can be checked without labels. The score detects heavy occlusion on KITTI with AUC 0.909 (0.888 over all annotated pedestrians, including those the detector misses), requires no training and no occlusion labels, and is not a proxy for range: within fixed distance bands it holds AUC 0.894-0.925 while true distance alone sits near chance. On synthetic CARLA scenes with measured visibility it reaches 0.819, against 0.644 for distance alone. We arrived here after measuring three standard architectural responses to occlusion, depth fusion, occlusion-simulating augmentation, and attention, none of which improved detection outside its training distribution in the configurations we tested, and after finding that a detector trained on German roads loses half its accuracy on self-annotated street scenes in Lagos, Nigeria. Signals that need no local annotation are worth more in settings that benchmarks do not represent.
5. 【2611.06890】Procedural Adversarial Learning
链接：https://arxiv.org/abs/2611.06890
作者：Jack Nugent,Jia Deng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：computer vision tasks, seemingly simple scenes, low average error, vision tasks, neural networks
备注：
点击查看摘要
Abstract:For many computer vision tasks, neural networks can be trained to produce a low average error, yet they still fail on seemingly simple scenes. Reducing these failures requires first finding them, but they may not be in a fixed dataset. We study procedural adversarial learning (PAL), a framework of minimax training and adversarial evaluation which searches the input space of a procedural generator for difficult instances. The procedural generator is an interpretable program mapping a low-dimensional vector of control parameters (e.g. layout, lighting, pose) to a rendered image and its label. We introduce the Simple-PAT algorithm, which uses zeroth-order optimization in the procedural generator's parameter space to propose adversarial training samples that are generated on demand. We also create PAL-Dojo, a collection of efficient procedural generators for surface normal estimation, image segmentation, and human pose estimation. Against a cross-model black-box adversary with 50M aggregate queries, Simple-PAT reduces worst-case error by a geometric mean of 3.15x compared to standard training and 2.63x compared to the strongest robust training baseline. Code is available at this https URL.
6. 【2611.06870】PixelSpline: Continuous Space-Time Video Super-Resolution via Endpoint-Anchored Shared Pixel Trajectories
链接：https://arxiv.org/abs/2611.06870
作者：Wanqi Yuan,Nianyi Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Existing continuous space-time, space-time video super-resolution, motion directions independently, video super-resolution methods, continuous space-time video
备注：
点击查看摘要
Abstract:Existing continuous space-time video super-resolution methods often infer motion from only two endpoint frames and model the two motion directions independently, making them vulnerable to ambiguous correspondence and inconsistent trajectories. We introduce a continuous STVSR framework that combines long-context encoding, continuous HR feature lifting, and an endpoint-anchored PixelSpline. Long-range observations provide more reliable endpoint representations, while continuous upsampling constructs detailed appearance features directly on the requested HR grid. PixelSpline explicitly models each pixel's motion as a single continuous trajectory shared by both endpoints. Using this trajectory, our method warps endpoint colors into a coarse intermediate frame and aligns the HR features for residual reconstruction. Experiments across spatial and temporal upsampling settings demonstrate that the proposed framework offers a favorable quality--efficiency trade-off.
7. 【2611.06864】CounterFactual Retrieval for Evidence-Aware Individual Animal Identification
链接：https://arxiv.org/abs/2611.06864
作者：Ankit K. Upadhyay,Aleksandr Algasov,Ekaterina Nepovinnykh,Fedor Zolotarev,Tuomas Eerola,Heikki Kälviäinen,Charles V. Stewart,Lukas Picek
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：small curated studies, Automated identification, reusable foundation models, identification of individual, moving from small
备注： 14 pages, 5 figures; accepted at WACV 2027
点击查看摘要
Abstract:Automated identification of individual animals is moving from small curated studies toward shared benchmarks and reusable foundation models. This progress is useful, but current evaluation leaves the evidence behind a match unresolved, i.e., high retrieval accuracy does not show whether a model used animal features or identity-correlated shortcuts. We address this with Counterfactual Foreground Retrieval (CFR), an evidence-aware evaluation protocol. CFR evaluates the same query-gallery task under different views: full image, foreground-only, and shortcut-only. The full-image measures standard retrieval performance; the foreground-only measures foreground-supported retrieval; and shortcut-only view measure how much identity signal is recoverable from background, or silhouette. This turns a retrieval score into an evidence profile: how well the model performs on the original images, how much of that performance remains when only the animal is visible, and how much identity signal remains recoverable when the animal is removed. We release around 0.5M masks for 34 datasets and code for mask generation and CFR evaluation.
8. 【2611.06856】LongBanana: An Expert-Verified Benchmark for Long-Context Multi-Reference Image Synthesis
链接：https://arxiv.org/abs/2611.06856
作者：Haoxiang Cao,Yuxuan Zhang,Penghui Du,Bo Li,Jiajiong Cao,Yingying Fan,Zimeng Wu,Yifu Luo,Mingzhe Zheng,Junwen Miao,Huaisong Zhang,Yang Yao,Yu Wang,Dongfu Jiang,Ping Nie,Wenhu Chen,Chaoqun Wang,Changqian Yu,Kelsey R. Allen
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：long-context multi-reference image, multi-reference image synthesis, expert-designed and expert-verified, expert-verified benchmark, benchmark for long-context
备注： NeurIPS 2026 Evaluations and Datasets Track. Project page: [this https URL](https://long-banana.com/)
点击查看摘要
Abstract:We introduce LongBanana, to our knowledge the first expert-designed and expert-verified benchmark for long-context multi-reference image synthesis in the age of agent-driven image generation. The task requires retrieving dispersed visual evidence, rejecting distractors, binding entities and relations, and composing one coherent final image from multiple references. LongBanana contains 90 carefully designed tasks organized by a 3-by-3 taxonomy; each task includes about 32 reference images, 20 constraints, and 50 evaluation items, yielding 4,670 expert-specified atomic evaluation items in total. Its graph-grounded evaluation design instantiates each task with reference images and an entity-relation graph, then converts node, edge, and whole-graph obligations into checklist items for Content Fidelity, Relational Binding, and Global Constraint Satisfaction. Reviewed expert labels include a 15% double-labeled subset with 89.4% exact agreement and 0.83 quadratic weighted kappa. We further introduce LongBanana-Gen, an agent-harness framework for long-horizon image generation; experiments show that minimal agent harnesses improve over direct generation, while a ReAct-Plan-Exec-Reflect (RPR) workflow yields harness-dependent gains by strengthening evidence grounding and repair. Together, LongBanana provides an auditable testbed for measuring dense visual evidence use and a shared target for developing stronger agent-driven image-generation systems. Code and data are available at the project page: this https URL.
9. 【2611.06854】Visual Token Routing: Learning to keep tokens that matter
链接：https://arxiv.org/abs/2611.06854
作者：Pranjal Aggarwal,Sean Welleck
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：recently achieved superhuman, visual tokens, achieved superhuman performance, visual, recently achieved
备注：
点击查看摘要
Abstract:Computer-use agents (CUAs) have recently achieved superhuman performance on several long-horizon benchmarks. However, their computational cost limits their use in long-horizon tasks and real-time domains such as video games. A key bottleneck is representing each screenshot as thousands of visual tokens, which accumulate into long contexts as agents reason over extended interaction histories. We observe that most of these visual tokens are either semantically irrelevant to the agent's next action or temporally redundant across screenshots. Building on this observation, we introduce Visual Token Routing (VTR), a joint training framework for learning sparse visual representations that preserve the information needed for action prediction. In VTR, we train the vision-language model together with a lightweight spatio-temporal router that examines each image region in the current and previous screenshots and decides whether its visual token enters the language model. We optimize the router using an adaptive loss to keep the number of visual tokens as small as possible while minimizing performance degradation. With just 2,000 training steps, VTR matches the performance of the full-resolution model on OSWorld, CUA-World, and video game action prediction, while using 2.5-5.8x fewer visual tokens. These savings reduce inference cost by up to 3.3x and speed up prefill by up to 2.9x. VTR also outperforms lowering the image resolution and other baselines for dropping tokens, by up to 12.8 points on OSWorld. Overall, VTR enables computer-use agents to process only the visual tokens they need, allowing them to be used in long-horizon tasks and real-time domains at a fraction of the computational cost. Code and models are available at this https URL
10. 【2611.06849】rainspotting: Learning Object-Centric 3D Reconstruction from Found Photos
链接：https://arxiv.org/abs/2611.06849
作者：Hanyu Chen,Noah Snavely
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：object-centric photo collections, models perform poorly, perform poorly, object, reconstruction models perform
备注： project page: [this https URL](https://hanyuc.com/trainspotting)
点击查看摘要
Abstract:State-of-the-art feedforward reconstruction models perform poorly on in-the-wild object-centric photo collections. They are trained largely on single-session object captures whose images vary in viewpoint while the object and its environment remain nearly fixed. Public photo archives contain a different form of multi-view data. They hold found photos of the same object or design: photos taken independently by many people across years, environments, cameras, and sometimes physical units. In this work, we introduce Trainspotting, a dataset of 12,068 objects and 311,886 photos from Wikimedia Commons. We reconstruct each object to recover camera poses, multi-view stereo depth, and object masks. We categorize the objects into three regimes: objects fixed at one site, objects that move between sites, and designs shared by many physical units. Evaluating recent feedforward reconstruction models on Trainspotting shows that they fail most severely in the last two regimes. Fine-tuning VGGT-$\Omega$ on Trainspotting significantly improves camera pose, depth, and 3D geometry on held-out objects. We observe similar improvements on the independent NAVI in-the-wild benchmark, which contains photos of each object in different environments. Performance on conventional benchmarks remains largely unchanged.
11. 【2611.06844】Where to Connect? Boosting MLLMs via Dynamic Gated Pathways across ALL ViT and LLM Layers
链接：https://arxiv.org/abs/2611.06844
作者：Yingying Yan,Jiaqi Tang,Wei Wei,Qianzhou Wang,Lei Zhang,Jianmin Chen,Yuyang Xia,Botong Geng,Jinjian Wu,Qifeng Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Large Language Models, large language model, Multimodal Large Language, Large Language, Language Models
备注： 24 pages (10 pages main text + references + appendix), 15 figures. Accepted at the 40th Conference on Neural Information Processing Systems (NeurIPS 2026)
点击查看摘要
Abstract:A central yet under-explored question in Multimodal Large Language Models (MLLMs) is where to connect---how visual information from a hierarchical vision encoder should be wired into the layer-wise semantics of a large language model. Mainstream MLLMs inject a fixed single-layer visual representation into the LLM and treat all LLM layers as a single consumer, ignoring that different layers demand different visual granularities. Recent multi-layer fusion methods either compress hierarchical features on the encoder side or rely on predefined sparse or hierarchical layer-to-layer connections, and therefore stop short of modeling adaptive cross-layer interactions between the ViT and LLM hierarchies. We address this gap with DGP (Dynamic Gated Pathways), a routing mechanism that establishes all-to-all connections between every ViT layer and every LLM layer, with each LLM layer dynamically gating its preference over visual layers conditioned on its own semantic state. Built on top of LLaVA-1.5-7B and 13B, DGP delivers consistent gains over the LLaVA-1.5-7B baseline (e.g., +4.2 on SQA$^{I}$, +3.3 on MM-Vet, +3.1 on VizWiz and LLaVA$^{W}$) and surpasses prior multi-layer visual fusion methods on most benchmarks. Layer-wise routing analyses further show that different LLM layers do select different visual granularities on demand, supporting both the effectiveness and interpretability of the proposed dynamic gated pathways. The code is available: this https URL.
12. 【2611.06840】Same Layout, Different Count: What Number Words Do Past Ten in Text-to-Image Models
链接：https://arxiv.org/abs/2611.06840
作者：Liang Yue,Eric A. Vance
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：starting noise, number, starting, noise, starting noise fixed
备注： 43 pages, including 32 pages of supplementary material; 14 figures, 44 tables
点击查看摘要
Abstract:Ask SD3.5-Medium for twelve of an object and then, from the same starting noise, for twenty-five. The picture keeps its layout, but the count changes about as much as it would under a new random seed, and in no consistent direction. We study what number words do once a request passes about ten objects, in five open text-to-image models. Holding the object and the starting noise fixed, we change one thing at a time, and people who never see the request count 3,088 of the images. Every model follows the number for small crowds, but only up to a point, its reach: SD3.5-M and FLUX.1-dev stop following it soon after ten, while FLUX.2 [klein] and Qwen-Image follow it loosely up to twenty-five. Beyond SD3.5-M's reach, the coarse part of the starting noise fixes the composition of the picture but not how many objects it holds: redrawing only the noise finer than an eighth of the image keeps the layout as well as a new number does, and already moves the count two-thirds as far. The number word still reaches the denoiser and acts in its first steps, but nothing we tried gives it a clear direction. Shown instead as a noised grid in the starting latent, the count is drawn: people find it in 59% of images, against 4% when it is only told. Past ten, an exact-match score barely separates a model that follows the number loosely from one that ignores it, and a relative-error score can even prefer a constant guess of sixteen. A same-noise test with a few requests per object tells them apart.
13. 【2611.06838】Context-Aware Autoregressive Image Generation for Emerging Reasoning Properties
链接：https://arxiv.org/abs/2611.06838
作者：Jixuan Ying,Haoyu Liu,Timing Yang,Tingyu Zhu,Predrag Neskovic,Anand Bhattad,Cihang Xie,Zeyu Zheng,Alan Yuille,Feng Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：random-order prediction, next-patch prediction, predefined or heuristic, specific scales, recently emerged
备注： Accepted at NeurIPS 2026. 16 pages, 4 figures
点击查看摘要
Abstract:Autoregressive image generation has recently emerged as a competitive visual generation paradigm, yet its generation order is often predefined or heuristic, such as next-patch prediction, random-order prediction, or one-step generation for specific scales. We observe that these strategies can cause models to overlook important structural dependencies in images, thereby limiting both structural robustness and reasoning capability. In this work, we propose a context-aware autoregressive generation framework, where the model dynamically determines the next token location based on global context and current local information. Rather than following a fixed or random order, our method allows the generation process to adapt to image structure and semantic dependencies. Extensive experiments show that context-aware generation significantly improves structural robustness across different image AR paradigms, including masked autoregressive and scale-wise autoregressive models. Beyond quantitative improvements, we further observe emerging reasoning properties: the model can better understand complex semantic instructions and generate images that more faithfully follow the given guidance. These findings suggest that generation order is a critical yet underexplored factor in image autoregressive modeling, and that context-aware decoding can unlock stronger reasoning-aware visual generation capabilities. Code is available at this https URL.
14. 【2611.06817】Open-HumanScale: An Open Recipe for Scaling Human and Robot Experience for Embodied Foundation Models
链接：https://arxiv.org/abs/2611.06817
作者：Juncheng Ma,Jiaxin Li,Jiankai Tu,Bo Liang,Guodong Lv,Yufan Deng,Junzhe Tang,Liangzhu Yang,Chen Bian,Zicong Cao,Baohao Zhu,Jianxin Bi,Tengfei Yan,Yinyuan Zhang,Kewei Zhang,Xinglong Chen,Kaiqi Chen,Duomin Wang,Xiaotian Tang,Liang Tan,Li Li,Yuan Xu,Haosen Yang,Yuqi Wang,Jingfei Xia,Songyan Huang,Zhiyang Dou,Zhen Dong,Enze Xie,Tat-Seng Chua,Daquan Zhou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：policies demands rigorous, Egocentric human video, translating raw data, raw data scale, demands rigorous data
备注： GitHub: [this https URL](https://github.com/DAGroup-PKU/HumanNet/tree/open-humanscale) Project website: [this https URL](https://dagroup-pku.github.io/open-humanscale/)
点击查看摘要
Abstract:Egocentric human video offers a scalable source of manipulation priors for robot learning, yet translating raw data scale into generalizable robot policies demands rigorous data curation and training recipes. We introduce Open-HumanScale, the first fully open recipe for scaling egocentric pretraining to 50,000 hours, anchored by Open-HumanScale-50K---a curated egocentric video corpus densely annotated with hand motion and natural language. Leveraging this corpus, we systematically investigate pure human pretraining via closed-loop simulation evaluations and uncover an empirical log-linear scaling law linking pretraining data hours to downstream robot success rates. Grounded in these findings, we develop HumanWAM-Vanilla, a world--action model pretrained exclusively on 50k hours of egocentric human video. Upon robot post-training, HumanWAM-Vanilla reaches 92.08% success on RoboTwin 2.0 Clean2Clean and 68.88% on Clean2Random, alongside a 14.17% mean success rate and a 19.00 mean progress score on RoboDojo. To push the capability frontier further, we explore joint human--robot pretraining with HumanWAM-Goal, a visual-goal-conditioned world--action model. Hybrid data scaling unlocks broad zero-shot generalization across both simulation and physical benchmarks, propelling post-trained RoboTwin 2.0 performance to new state-of-the-art levels: 92.70% on Clean2Clean and a substantial leap to 84.60% on Clean2Random. On physical robots, HumanWAM-Goal further exhibits emergent embodied in-context learning, dynamically adapting its manipulation behavior to unseen visual goals without parameter updates. To support reproducible scaling research in embodied AI, we open-source the Open-HumanScale-50K corpus, data curation and pretraining pipelines, alongside the pretrained and post-trained HumanWAM checkpoints, inference code, and simulation evaluation suites.
15. 【2611.06796】VA-TDM: A Unified View for Improving Few-Step Diffusion Models by Velocity Adversarial Distillation
链接：https://arxiv.org/abs/2611.06796
作者：Yihong Luo,Tianyu Pang,Tianyang Hu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：steps remains challenging, distillation offers efficient, offers efficient generation, remains challenging, offers efficient
备注： Project Page: [this https URL](https://luo-yihong.github.io/VA-TDM/) Code: [this https URL](https://github.com/Luo-Yihong/VA-TDM)
点击查看摘要
Abstract:Few-step distillation offers efficient generation with diffusion and flow models, but preserving quality with only a few sampling steps remains challenging. Distribution-matching methods via score distillation provide a strong foundation, yet they rely on accurately tracking the student's changing distribution. At intermediate generation steps in few-step sampling, student-score estimation can be difficult, and commonly used estimators may describe a different distribution from the one used to update the student. Flow matching allows a more flexible approach to supervision through velocity fields constructed from the student's sampling process. Building on this perspective, we introduce Velocity Adversarial Distillation (VAD), which uses a learned critic to compare student and teacher fields and turn their disagreement into feedback for learning. VAD unifies score distillation, Fisher-based matching, and moment matching, also explaining existing heuristic MMD updates and delivering new training objectives. We further develop VA-TDM, which follows trajectory distribution matching: providing supervision for partial denoising along the student trajectory. Beyond this, VA-TDM combines transition-aware online velocity learning and dual-form VAD supervision across intermediate student transitions. Extensive results show that VA-TDM is powerful for learning few-step generators, achieving state-of-the-art four-step performance in both text-to-image and text-to-video generation across various backbones and scaling effectively to 33B MiniMax-H3. In particular, our VA-TDM-H3 notably outperforms the few-step Fast-H3 and is closer to the original many-step H3 according to human preference.
16. 【2611.06781】Semantic Residual Vector Quantization for Sign Language Generation
链接：https://arxiv.org/abs/2611.06781
作者：Chang Liu,Ke Han,Niccolò Biondi,Gloria Isotton,Elisa Ricci,Davide Talon,Nicu Sebe
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：maps written sentences, Sign language generation, maps written, fine-grained articulation, written sentences
备注： Accepted to WACV 2027
点击查看摘要
Abstract:Sign language generation (SLG) maps written sentences into signing motion while preserving both lexical content and fine-grained articulation. This requires a model to decide what signs should be expressed and to realize them through precise handshape, trajectory, facial expression and body coordination. Existing pose-based systems and reconstruction-only motion tokenizers often entangle these two decisions, leaving the generator without an explicit text-aligned intermediate target for what to sign before refining how to sign it. To address this issue, we introduce Semantic Residual Vector Quantization (SRVQ), a framework for SLG that frames generation as a two-level process moving from semantics to kinematics. The newly introduced SRV Quantizer learns a hierarchy in which the first residual level encodes sign content and subsequent levels refine pose, handshape, trajectory, and body coordination, all within a single quantizer and without separate semantic representations or external planning stages. Through word-aware conditioning for hierarchical code generation, a masked semantic generator predicts semantic codes and a kinematic generator completes the residual codes for full SMPL-X motion synthesis. We evaluate using retrieval and FID in a shared text-motion embedding space, alongside standard geometric metrics. On CSL-Daily and Phoenix-2014T, SRVQ achieves R@1 of 82.3 and 70.3, outperforming the previous SOTA by 30 and 46 points, respectively.
17. 【2611.06770】Benchmarking Fine-Grained Visual Reasoning for Remote Sensing in Urban Management
链接：https://arxiv.org/abs/2611.06770
作者：Jiawei Zhang,Rizhao Cai,Dayan Guan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：multimodal large language, large language models, Fine-grained visual reasoning, reasoning is essential, remains underexplored
备注： Accepted by IEEE AP-GARSS 2026; 4 pages, 3 figures, 3 tables
点击查看摘要
Abstract:Fine-grained visual reasoning is essential for remote sensing in urban management, yet remains underexplored in the evaluation of multimodal large language models (MLLMs). We introduce UMBench, a fine-grained urban remote sensing benchmark built from unmanned aerial vehicle (UAV) images for multiple urban management tasks such as traffic monitoring, urban construction, environmental quality, and disaster warning. Evaluations on UMBench reveal that current MLLMs often rely on scene-level priors and overlook fine-grained visual evidence. To address this issue, we further propose a novel evidence-first chain-of-thought method that directs models to inspect fine-grained visual evidence in a training-free manner. Experiments show that our method can improve the performance of both open-source and commercial MLLMs on UMBench.
18. 【2611.06760】Route First, See Later: Enabling Vision Agents to Reason Scientifically by Separating Routing Policy from Action Spaces
链接：https://arxiv.org/abs/2611.06760
作者：Shubhabrata Mukherjee,Jeffrey Donatelli,Daniela Ushizima
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：image-analysis workflows require, Scientific image-analysis workflows, workflows require agents, capabilities like description, image-analysis workflows
备注：
点击查看摘要
Abstract:Scientific image-analysis workflows require agents to select among diverse capabilities like description, detection, counting, and segmentation. Current multi-tool architectures conflate intent interpretation with visual execution, masking whether a failure arises from flawed reasoning (misrouting) or failed perception (invalid tool execution). This lack of auditability renders agents unreliable for high-stakes scientific automation. We introduce ZETA, an extensible architecture that operationalizes the decoupling of routing policy from action execution. ZETA resolves scientific intent before invoking specialized visual tools, treating measurement as a deterministic operation grounded in explicit geometry rather than generative output. This architecture exposes the "black box" of agent decision-making, allowing routing correctness and downstream execution to be evaluated as independent failure modes. To our knowledge, we provide the first controlled study in scientific vision-agent routing that isolates explicit routing-policy specification while holding the legal action interface fixed. Evaluation on a zero-shot benchmark of 51 scientific-intent queries shows that explicit routing semantics can substantially improve routing accuracy, particularly at semantically adjacent action boundaries, although improvements vary across models. For Qwen 3.8, explicit routing-policy specification improves segmentation routing accuracy from 6.2% to 75.0% and detection routing accuracy from 60.0% to 100%. ZETA's execution traces make routing decisions and downstream artifacts separately observable, providing a basis for distinguishing intent-selection errors from visual execution failures. ZETA establishes the necessary infrastructure to isolate execution errors from interpretive ones, a critical requirement for deploying reliable scientific vision agents.
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2611.06760 [cs.CV]
(or
arXiv:2611.06760v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2611.06760
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
19. 【2611.06748】EvoWorld: Towards Out-of-Sight World Evolution in Generative Video Models
链接：https://arxiv.org/abs/2611.06748
作者：Yequan Bie,Dengyang Jiang,Zhixuan Chen,Xiaozhuan Liang,Haoxuan Che,Quande Liu,Xi Chen,Hao Chen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：primary strength lies, Generative video models, rendering plausible pixels, Generative video, visual world simulators
备注：
点击查看摘要
Abstract:Generative video models are increasingly used as visual world simulators, yet their primary strength lies in rendering plausible pixels rather than reasoning about how a world should evolve. Coherent world evolution requires more than visual fidelity: when an event occurs, a model must infer its consequences for the entities in the world and then render the resulting state. For example, after a wild beast appears, the model should not only depict the wild beast, but also infer whether a nearby person should flee, take cover, or fight back based on the realized scene. Existing diffusion-based video models lack an explicit mechanism for maintaining world state and reasoning over such event-conditioned consequences, often producing visually plausible but behaviorally static or causally inconsistent outputs. To make this reasoning gap concrete and measurable, we propose a new problem, Out-of-Sight Causal Evolution, which requires a model to render an event, reason about its consequences for the evolving world state, and reveal a causally plausible outcome as the world continues to evolve, even out of sight. As a baseline reference solution, we introduce EvoWorld, a brain-renderer collaboration framework in which a vision-language model serves as the world brain: it observes generated segments, maintains an evolving account of the world, and reasons about plausible state transitions, while a segment-autoregressive video renderer realizes them visually. We further introduce EvoWorld-Data and EvoWorld-Bench for training and evaluating event realization, causal reactions, and revisit consistency. Experiments show that EvoWorld substantially improves event-conditioned causal evolution over recent models while preserving visual quality and consistency, establishing a reference point for reasoning-guided, autonomous world evolution beyond the current field of view.
20. 【2611.06741】ailSteer: Trajectory-Tail Steering for Drift-Resistant Multi-turn Image Editing
链接：https://arxiv.org/abs/2611.06741
作者：Ruikang Li,Zixuan Chen,Jiarui Wu,Mingde Yao,Yiyuan Zhang,Yujin Wang,Hanming Deng,Lewei Lu,Tianfan Xue
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Strong single-turn editing, Strong single-turn, reliable multi-turn interaction, guarantee reliable multi-turn, severe visual drift
备注： 16 pages, 9 figures. Project page: [this https URL](https://lyricccco.github.io/tailsteer/)
点击查看摘要
Abstract:Strong single-turn editing performance does not guarantee reliable multi-turn interaction: as edited outputs are repeatedly reused, small unintended changes can accumulate into severe visual drift. This long-term drift is often mitigated through training on multi-turn data or cross-turn rollouts, potentially altering pretrained priors, or through specialized inference-time mechanisms that are difficult to scale to foundation models. We introduce TailSteer, a final-stage training framework that improves multi-turn robustness while retaining the generative and editing capabilities acquired through earlier training. TailSteer follows a simple principle: keep early denoising dynamics close to those of the base model and concentrate preservation corrections near the trajectory tail, where fine-grained deviations can be suppressed. These corrections are learned from the editor's own on-policy denoising rollouts, using unchanged source content as a preservation reference without requiring curated ground-truth editing pairs. Experiments across the FLUX, SenseNova, and Qwen families show that TailSteer substantially reduces cumulative drift over 15-20 editing turns while largely preserving base-model performance on extensive text-to-image and single-image editing benchmarks. These results demonstrate that long-horizon editing robustness can be unlocked in foundation models after TailSteer, rather than by relearning their existing capabilities.
21. 【2611.06738】Coupled Scene Graph Anticipation: When With-Constraint Recall Hides Structural Inconsistency
链接：https://arxiv.org/abs/2611.06738
作者：Zeno Nongmaithem,Anushttha Srivastava,Anshit Sinha,Apoorv Sisodia,Suman Chowdhury,Prerana Mukherjee,Rajesh P. Barnwal
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Scene Graph Anticipation, future video frames, predicts object relationships, Scene Graph, Graph Anticipation
备注： Accepted at ICVGIP 2026 (Indian Conference on Computer Vision, Graphics, and Image Processing), December 21-24, 2026, Kolkata, India. 9 pages, 2 figures, 4 tables. Code: [this https URL](https://github.com/zenoNong/CoupledSGA)
点击查看摘要
Abstract:Scene Graph Anticipation (SGA) predicts object relationships in future video frames. Continuous-time SGA models evolve each subject-object pair with an independent Neural ODE, so relationships sharing an entity cannot influence one another during integration, and nothing prevents mutually exclusive predictions, such as "sitting on" and "standing on", for the same pair. We introduce CoupledSGA, which links such relationships through a Relationship Interaction Graph with graph attention inside the ODE vector field, and adds a Structural Consistency Loss ($\mathcal{L}_{SC}$) based on a matrix of mutually exclusive predicates. Developing CoupledSGA revealed a limitation of the evaluation protocol. With-Constraint evaluation keeps one predicate per group for each subject-object pair, so its R@K and mR@K cannot capture the within-group violations targeted by $\mathcal{L}_{SC}$: we prove they are unchanged whenever each group's winning predicate and its score are held fixed. We further show that the gradient of $\mathcal{L}_{SC}$ depends on predicate scores rather than ground-truth labels: for two-predicate rules it amplifies the ordering the model already holds, and when all scores in a group are equal it suppresses predicates in more exclusion rules more strongly, explaining why the penalty can lower recall while improving consistency. On Action Genome, activating $\mathcal{L}_{SC}$ after two warm-up epochs reduces R@20 from 42.21% to 35.18% while lowering the No-Constraint contradiction rate from 45.92% to 4.07% (matched-budget R@20: 40.48% CoupledSGA vs. 44.78% SceneSayerODE). CoupledSGA is a testbed, not a state-of-the-art claim: With-Constraint recall captures the cost of enforcing structural consistency but not the improvement. We recommend reporting No-Constraint results alongside a contradiction rate for methods that constrain predicate co-activation.
Comments:
Accepted at ICVGIP 2026 (Indian Conference on Computer Vision, Graphics, and Image Processing), December 21-24, 2026, Kolkata, India. 9 pages, 2 figures, 4 tables. Code: this https URL
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
ACMclasses:
I.2.10; I.4.8
Cite as:
arXiv:2611.06738 [cs.CV]
(or
arXiv:2611.06738v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2611.06738
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
22. 【2611.06728】urns Matter: Advancing Streaming Video RL via Turn-Level Credit
链接：https://arxiv.org/abs/2611.06728
作者：Shuai Dong,Kanghui Tian,Linghan Chen,Wenqi Shao,Hongrui Wu,Haowen Hou,Yongfu Zhu,Xuehui Wang,Ziyue Wang,Wenpu Liu,Weichu Xie,Yuqi Xu,Congcong Wang,Kaiwen Tuo,Caoyuan Ma,Taiqiang Wu,Ji Zhao,Wenzheng Chang,Dianyi Wang,Siyuan Wang,Zhongyu Wei,Yu Qiao,Jiaqi Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Group Relative Policy, understanding requires models, continue observing, Group Relative, requires models
备注： 16 pages, 4 figures
点击查看摘要
Abstract:Streaming video understanding requires models to repeatedly decide whether to respond or continue observing. Recently, Group Relative Policy Optimization (GRPO) has been applied to this setting, with existing approaches emphasizing reward design while retaining a single trajectory-level advantage across turns. Such shared credit can reinforce redundant replies after earlier successes and discourage useful follow-ups after earlier failures. We propose TurnWise, a turn-level GRPO framework that aligns learning with individual streaming decisions. TurnWise addresses the mismatch between trajectory-level feedback and turn-level interaction, promoting informative responses and reducing redundancy. Specifically, turn-level credit assignment uses silence-completed prefix scoring to construct group-relative advantages from each decision's remaining return, separating its learning signal from earlier rewards. Turn-mean policy optimization averages token losses within each turn and then across turns, giving response and waiting decisions equal weight regardless of output length. These complementary designs improve streaming policy learning without a learned critic or additional rollouts. Extensive experiments show our method outperforms prior RL approaches for streaming video understanding.
23. 【2611.06724】Dexterous Robotic Hands in the Foundation-Model Era: A Full-Stack Survey of Hardware, Data, Cross-Embodiment Transfer, Learning, and Evaluation
链接：https://arxiv.org/abs/2611.06724
作者：Ji Pei
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Dexterous robotic hands, Dexterous robotic, large-scale human data, assessed separately, increasingly coupled
备注： 45 pages, 8 figures, 21 tables. Structured narrative review of hardware, data, cross-embodiment transfer, foundation models, tactile sensing, and evaluation for dexterous robotic hands
点击查看摘要
Abstract:Dexterous robotic hands are increasingly coupled to large-scale human data and foundation models, yet progress in hardware, representation learning and evaluation is often assessed separately. This survey reviews work from January 2024 to early November 2026, with earlier studies included to establish technical lineages. We organize the literature into five interdependent layers: hardware; data collection and curation; cross-embodiment transfer; learning and foundation models; and evaluation and applications. Human hand-object understanding and tactile sensing provide two cross-cutting perspectives. A system-level architecture, comparative tables and five case analyses connect design choices across these layers. We distinguish within-study experimental comparisons from heterogeneous corpus statistics, vendor specifications and company-reported results. Three conclusions emerge. First, the value of human data depends on kinematic, visual and contact alignment, not recording volume alone. Second, shared action representations and foundation policies do not remove embodiment-specific constraints on force, latency and contact. Third, task completion is insufficient to establish physical correctness or deployment readiness. Evidence remains limited for zero-shot transfer of contact-rich skills between morphologically different hands, long-duration reliability, and cross-sensor tactile generalization. We identify eleven open problems and propose reporting interfaces and controlled comparisons that can make full-stack progress more measurable. The review is a structured narrative synthesis rather than a pooled performance ranking or an exhaustive systematic review.
24. 【2611.06701】Agent-Driven Generative Priors for Pathology Image Synthesis and Segmentation
链接：https://arxiv.org/abs/2611.06701
作者：Sicheng Yang,Rui Tang,Haipeng Zhou,Hongqiu Wang,Zhaohu Xing,Jianda Ma,Lie Dai,Guang Yang,Lei Zhu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Deep learning methods, Deep learning, large-scale pixel-level annotations, limited availability, availability and high
备注： Code available at: [this https URL](https://github.com/script-Yang/Agent-GenPath)
点击查看摘要
Abstract:Deep learning methods for pathology are constrained by the limited availability and high cost of large-scale pixel-level annotations. Synthetic data can alleviate this limitation, but existing pipelines often lack reliable quality control and remain weakly connected to downstream analysis. To address these issues, we propose a three-stage framework that integrates automated data screening, generative representation learning, and efficient adaptation to downstream tasks. First, we develop a pathology agent system to assess image quality and filter samples, resulting in TCGA-200K, a dataset containing 217,030 pathology patches selected from the public TCGA repository. Second, we train a generative model on the screened data. In addition to image synthesis, its backbone learns structural and semantic representations that can be transferred to downstream tasks. Third, we adapt the pretrained generative backbone to semantic segmentation using a lightweight task-specific head. We further introduce PathSeg-380K, a semantic segmentation dataset with expert annotations for approximately 380,000 cells across 12 cell types. Experiments on multiple pathology datasets show that the proposed framework achieves state-of-the-art segmentation performance. Our code is publicly available at this https URL.
25. 【2611.06685】Sekai: Incremental Event Memory for Generalized Reasoning Video Segmentation
链接：https://arxiv.org/abs/2611.06685
作者：Zhengtao Liu,Jinrong Xu,Shiu-Hong Kao,Huixin Sun,Yicong Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：reasoning video segmentation, segment query-referred objects, Generalized Reasoning Video, video segmentation, Online reasoning video
备注： 20 pages, 6 figures. Code, example annotations, and evaluation scripts: [this https URL](https://github.com/zenastangbi/Sekai)
点击查看摘要
Abstract:Online reasoning video segmentation (Online RVS) requires a model to segment query-referred objects as a video streams in, using only the frames observed so far. Existing formulations largely assume a fixed target set throughout the video, overlooking a fundamental property of streaming reasoning: as new events occur, the objects that satisfy a query may change over time. To address this, we propose a new task, Generalized Reasoning Video Segmentation (GRVS), where the target set depends on query-relevant events accumulated over the observed video history. As new evidence accumulates, the target set can evolve from empty to one or multiple objects, requiring a model to continuously maintain target validity while localizing the valid objects currently in view. To evaluate GRVS, we build Isekai, a diagnostic benchmark of 60 videos and 197 queries across 11 temporal query families, with 12,569 scoring points whose target sets are causally annotated over time. We further propose Sekai, an online framework with two complementary components: an Event Memory Reasoner (EMR) that maintains query-relevant events and evolving target states in structured memory, and a Memory-Grounded Decoder (MGD) that identifies valid targets from this memory and localizes them in the current frame. Experiments show that Sekai significantly outperforms existing online RVS methods, achieving 50.33 JF and improving over the strongest baseline by 3.2 points. Code, example annotations, and evaluation scripts are available at this https URL.
26. 【2611.06664】CardioDrift: Automatic Cardiac Motion Tracking on a 3D Atlas Mesh via Shape-aware Coherent Point Drift with Slice Shift Correction
链接：https://arxiv.org/abs/2611.06664
作者：Reza Akbari Movahed,Abuzar Rezaee,Shatha Alamri,Edmond S.L. Ho,Fani Deligianni,Ali Gooya
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：quantifying myocardial motion, myocardial motion abnormalities, cardiac magnetic resonance, cardiac motion tracking, cine cardiac magnetic
备注：
点击查看摘要
Abstract:Automatic cardiac motion tracking from cine cardiac magnetic resonance (CMR) imaging is essential for quantifying myocardial motion abnormalities associated with cardiovascular disease. Existing methods fall into two groups: those that represent motion without anatomical correspondence across subjects and therefore limit inter-subject motion assessment; and those that represent motion with globally corresponding points, which typically require a time-consuming and error-prone semi-automatic step to fit a cardiac atlas to the subject space. To address these limitations, this study proposes CardioDrift, a fully automatic, atlas-based probabilistic framework that represents subject-specific cardiac motion on a 3D atlas mesh with globally corresponding points. The Coherent Point Drift (CPD) formulation is generalised to jointly register the atlas surfaces of multiple cardiac regions to the anatomically corresponding contours extracted from cine CMR segmentation maps throughout the cardiac cycle. Slice-shift correction is embedded in the same probabilistic model, estimating slice-wise translations that suppress the misalignment artefact limiting atlas-fitting accuracy. Evaluation on 1301 randomly selected UK Biobank subjects and the MM dataset, CardioDrift attains Dice similarity coefficients (DSCs) of $92.23\pm8.70\%$, $82.11\pm7.56\%$, and $88.69\pm4.13\%$ for the left ventricle (LV), myocardium (Myo), and right ventricle (RV), exceeding the strongest baseline on every distance and overlap metric of both datasets.
27. 【2611.06652】Dynamical State-Space Diffusion for Spatiotemporal Prediction
链接：https://arxiv.org/abs/2611.06652
作者：Woojun Lee,Hankyeol Kim,Pilsung Kang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：prediction typically corrupt, leaving temporal dependence, temporal prediction typically, Dynamical State-Space Diffusion, prediction typically
备注：
点击查看摘要
Abstract:Diffusion models for temporal prediction typically corrupt each future frame with independent noise, leaving temporal dependence entirely to the denoiser. We propose Dynamical State-Space Diffusion (DSSD), which learns the temporal structure of the corruption process itself. DSSD builds a temporal kernel from the damped oscillatory modes of a stable diagonal state-space model, whose learned decay rates and frequencies let the corruption capture multiple timescales and oscillatory correlations, while the denoiser architecture remains unchanged. Running this model on a finite clip, however, requires the state before the first frame, which is unobserved; starting from a zero state leaves the early frames with less noise than the diffusion schedule prescribes. We avoid this by using the Cholesky factor of the model's stationary covariance as the temporal operator. We prove that this operator is causal, exactly invertible, keeps each frame's noise variance equal to that of standard diffusion, and reduces to the identity at the clean end of the process, and that it is exactly the Kalman innovations form of the state-space model. The denoiser is trained to predict the temporally correlated noise, and sampling removes and reapplies the temporal mixing at each step. On scientific-field and robot-video datasets, DSSD outperforms diffusion baselines that share its denoiser, and the evolution of its learned modes during training shows that the temporal operator adapts to each dataset.
28. 【2611.06637】Human Motion Prediction via Continual Prior Compensation
链接：https://arxiv.org/abs/2611.06637
作者：Jianwei Tang,Jian-Fang Hu,Tianming Liang,Xiaotong Lin,Jiangxin Sun,Wei-Shi Zheng,Jianhuang Lai
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：predict future human, future human poses, Human Motion Prediction, Prior Compensation Factor, Continual Prior Compensation
备注：
点击查看摘要
Abstract:Human Motion Prediction (HMP) aims to predict future human poses at different moments according to observed past motion sequences. Previous approaches mainly treated the prediction of different temporal moments as a single prediction task and learned the predictions of varied moments simultaneously, which would encounter a main limitation: the learning of short-term predictions (referring to ``near-future'' prediction) could be hindered by the predictions of long-term (referring to ``far-future'' prediction) motions. In this paper, we develop a novel temporal continual learning framework called Continual Prior Compensation (CPC) to progressively train HMP models, in which we divide the prediction task of motions corresponding to varied temporal moments into several subtasks and train the model in a multi-stage manner. To mitigate the prior information forgetting in the progressive training, we further introduce a learnable random variable Prior Compensation Factor (PCF) to explicitly measure the prior knowledge loss. We theoretically show that the PCF can be efficiently learned together with the model parameters by minimizing a reasonable upper bound of the objective function. The proposed CPC is further enhanced to estimate the prior information loss for each subtask and a new framework called Continual Prior Compensation++ (CPC++) with Fine-Grained Prior Compensation Factor (FGPCF) is finally developed. Our CPC and CPC++ frameworks are quite flexible and can be easily integrated with different HMP backbone models and adapted to various datasets and applications. Extensive experiments on three HMP benchmark datasets using multiple SOTA HMP backbones (PGBIG, siMLPe, MotionMixer, and LTD) demonstrate the effectiveness and flexibility of our frameworks.
29. 【2611.06635】Uncertainty-Driven Efficient Communication for UAV-Based Collaborative Perception
链接：https://arxiv.org/abs/2611.06635
作者：Jiuwu Hao,Yuting Wan,Liguo Sun,Zao Zhang,Yueyang Wu,Pin Lv
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Unmanned aerial vehicle, complementary perceptual information, limited sensing range, perception enables multiple, enables multiple agents
备注： Accepted to IEEE SMC 2026
点击查看摘要
Abstract:Unmanned aerial vehicle (UAV)-based collaborative perception enables multiple agents to share complementary perceptual information, overcoming limitations such as occlusion and limited sensing range. Communication efficiency is a critical bottleneck, as UAVs operate under stringent bandwidth and computational constraints. However, existing spatial selection methods focus predominantly on foreground regions to reduce missed detections, neglecting perceptually ambiguous regions and leaving false detections unresolved. We propose UCP, an uncertainty-driven framework that characterizes collaborative value through observational uncertainty, identifying sensor-limited regions, and discriminative uncertainty, capturing model-level ambiguity near the decision boundary. These estimates drive spatial request and supply maps for efficient inter-agent communication, and the received messages are aggregated via U-Fusion, an uncertainty-guided cross-attention module. Experiments on three benchmarks across 3D object detection and trajectory prediction demonstrate a superior performance-bandwidth trade-off with high interpretability and strong generalizability.
30. 【2611.06631】rick-or-Treat: Adversarial Evaluation of Multimodal Medical Reasoning with Synthetic Images
链接：https://arxiv.org/abs/2611.06631
作者：Oishi Banerjee,Eujin Lee,Sung Eun Kim,Alexandra N. Willauer,Christine Y. Zhou,Zhizhou Yang,Pranav Rajpurkar
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：exposes hallucination behaviors, synthesis to create, create a challenging, framework that exposes, exposes hallucination
备注：
点击查看摘要
Abstract:We used medical image synthesis to create a challenging multimodal evaluation framework that exposes hallucination behaviors in frontier models. Evaluating multimodal reasoning has historically been difficult because existing medical datasets rarely pair different image modalities, such as radiographs and external clinical photographs. To address this gap, we introduce Trick-or-Treat, an adversarial multimodal medical benchmark that pairs real chest radiographs with synthetic clinical photographs to challenge models' cross-modal reasoning. For each of a wide range of conditions, we created two pairs of images, where the pairs share a single chest radiograph but contain different external photographs. In matched pairs, the chest radiograph and photograph both contain findings suggesting the same disease (e.g., varicella pneumonia suggested by lung opacities and crusted skin lesions seen in chickenpox). In mismatched pairs, the photograph depicts an alternative clinical finding that would not lead to the same unifying diagnosis (e.g. replacing crusted skin lesions with ordinary acne). Synthetic photograph generation allows clinical findings to be varied while the person's features and photographic setting stay consistent, reducing confounding. In an investigation of three frontier models, we found that models hallucinated clinically significant photograph findings in 45-57.5% of mismatched pairs, up from 25-37.5% for the same photographs shown alone. When faced with mismatched pairs, models tended to ignore mismatches and instead hallucinated findings that better matched the radiograph (e.g. misreading acne as crusted skin lesions to justify diagnosing chickenpox). Trick-or-Treat both demonstrates concerning error pattern in frontier models' medical reasoning and provides a proof of concept for the use of synthetic images in adversarial multimodal evaluation.
31. 【2611.06627】Interactive World Simulation with Cosmos for Physical AI
链接：https://arxiv.org/abs/2611.06627
作者：NVIDIA:Anis Ahmad,Jon Allen,Malik Aqeel Anwar,Jesse Archer,Maciej Bala,Piotr Barejko,Aarti Basant,Dan Blick,Taras Bolzhelarskyi,Henry Che,Jin Chen,Yukang Chen,Tae Eun Choe,Yuzhu Dong,Nat Duca,Liang Feng,Francesco Ferroni,Xiao Fu,Mohit Gambhir,Vivek Goel,Rony Goldenthal,Aryaman Gupta,Ali Hassani,Nathan Hayes-Roth,Yong He,Michael Honke,Shengyu Huang,Wei Huang,DeLesley Hutchins,Suneel Indupuru,Pooya Jannaty,Jingyi Jin,Janmesh Kalra,Ashna Khetan,Xin Kong,Aleksandr Korovko,Hui Kuang,Zhengfei Kuang,George Kurian,Jean-Francois Lafleche,Jayjun Lee,Justin Leung,William Lew,Xiang Li,Zhaoshuo Li,Chen-Hsuan Lin,Ming-Yu Liu,Xiangyu Lu,Yuhang Lu,Martin Ding Ma,Qianli Ma,Aditya Mahajan,Miguel Martin,Janarbek Matai,Jonathan McCaffrey,Qing Miao,Ashkan Mirzaei,Mustafa Munir,Sangmin Oh,David Pankratz,Trung Pham,Marilyn Reeb,Gavriel State,Jiaxiang Tang,Shitao Tang,Yue Tang,Tolou Tavakkoli,Alexander Temirov,Hweimi Tsou,Sergei Vasilev,Thomas Volk,Andrew Z. Wang,Hao Wang,Shijie Wang,Zhonghao Wang,David Wehr,Shumian Xin,Mengyao Xu,Yao Xu,Shuai Yang,Sophia Zalewski,Pengcuo Zeren,Cindy Zha,Jing Zhang,Yuliya Zhautouskaya,Kaiwen Zheng,Andrew Zhu,Rick Zhuang
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Robotics (cs.RO)
关键词：adapts Cosmos world, Cosmos world foundation, Cosmos world, adapts Cosmos, real-time interactive world
备注： Project website: [this https URL](https://research.nvidia.com/labs/cosmos-lab/cosmos-simulation)
点击查看摘要
Abstract:We present a shared framework that adapts Cosmos world foundation models for real-time interactive world simulation in Physical AI. By streaming visual observations in response to actions and scene controls, the framework enables users and embodied agents to interact with evolving virtual environments. It supports both predicting the visual consequences of actions and generating observations from physical state maintained by an external simulator. We demonstrate this approach across camera navigation and robot manipulation, controllable video transfer, and multi-view autonomous vehicle (AV) simulation. These examples provide a shared foundation for developing interactive virtual environments for Physical AI training and evaluation. Our code and model checkpoints are available at this https URL and this https URL. The project website is available at this https URL.
32. 【2611.06624】Learning to Track Cells from Sparse Annotations in 3D Time-Lapse Microscopy
链接：https://arxiv.org/abs/2611.06624
作者：Yusuke Uchida
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：time-lapse microscopy requires, microscopy requires distinguishing, inferring temporally consistent, Reconstructing cell lineages, temporally consistent connections
备注：
点击查看摘要
Abstract:Reconstructing cell lineages from 3D time-lapse microscopy requires distinguishing cell motion from division and inferring temporally consistent connections. When only a subset of cells is annotated, however, training procedures that treat unannotated regions as background or incorrect correspondences can be problematic. We propose a cell tracking pipeline that integrates detection from sparse annotations, calibration of candidate connections using image features, and joint selection of lineage graph events. For detection, we combine the outputs of 2.5D and 3D models trained to suppress erroneous background supervision at unannotated cells. We then calibrate ordinary link and division probabilities using motion features from dense flow, correspondence features from a learned cell-matching model, and features from models that identify cells immediately before division, dividing parents, and daughters immediately after division. Ordinary links, divisions represented as daughter pairs, and node inclusion are selected jointly under a surrogate objective derived from the evaluation metric, followed by gap filling and temporal coordinate refinement. The pipeline achieves an overall score of 0.9762 in 5-fold cross-validation on 199 videos from 2 zebrafish embryos. With candidates and calibrated values held fixed, joint selection outperforms a sequential method that allows replacement of existing divisions and reoptimization of ordinary links by 0.0105. The improvement arises primarily from division recovery.
33. 【2611.06594】SpikePose: Lightweight Video Human Pose Estimation
链接：https://arxiv.org/abs/2611.06594
作者：Yunhao Huang,Kaushik Bhargav Sivangi,Tianyi Yu,Fani Deligianni
类目：Computer Vision and Pattern Recognition (cs.CV); Neural and Evolutionary Computing (cs.NE)
关键词：Efficient video human, human pose estimation, Efficient video, video human pose, estimation must balance
备注： 5 pages, submitted to ICASSP 2027
点击查看摘要
Abstract:Efficient video human pose estimation must balance localisation accuracy, motion quality, and energy cost. We present SpikePose, a lightweight video pose estimator that pairs a frame-reset, single-step spiking encoder with motion-aligned heatmap memory (MAM). The encoder supplies per-frame spatial evidence, while MAM estimates joint displacement, aligns historical heatmaps, and adaptively fuses them with current predictions. By confining temporal reasoning to a compact, lightweight module outside the spiking backbone, SpikePose helps bridge the gap between spiking and classical Artificial Neural Networks (ANN) on large-scale, non-event-driven video tasks. We evaluate spatial accuracy, motion errors, and estimated arithmetic energy on MPII and a fixed NTU60 Cross-Subject subset. Against the architecture-matched ANN with MAM, SpikePose cuts estimated arithmetic energy by 91.4% at a cost of just 1.12 points in head-bone-normalised PCK at 0.5 threshold (PCK_HB(0.5)). Within SpikePose, adding MAM reduces velocity and acceleration errors by 28.13% and 31.46% while slightly improving localisation, at a cost of only 0.003M parameters and 0.0023 analytical GFLOPs per frame. Code will be released on GitHub upon acceptance.
34. 【2611.06593】BudgetSplat: Budget-Controllable Generalizable Gaussian Splatting
链接：https://arxiv.org/abs/2611.06593
作者：Yuxi Hu,Jun Zhang,Wei Mao,Yuchen Rao,Friedrich Fraundorfer
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Splatting enables efficient, Gaussian Splatting enables, enables efficient generalizable, existing pixel-aligned methods, generate highly redundant
备注：
点击查看摘要
Abstract:Feed-forward 3D Gaussian Splatting enables efficient generalizable novel view synthesis, but existing pixel-aligned methods often generate highly redundant Gaussian primitives, causing the final representation size and rendering cost to grow rapidly with image resolution and the number of input views. We propose BudgetSplat, a budget-controllable feed-forward framework that adapts the final Gaussian representation to a user-specified preservation ratio. Rather than treating compaction as simple importance ranking, we formulate it as a joint problem of importance estimation, spatial coverage, and cross-view redundancy. A single trained model supports varying numbers of context views and multiple test-time budgets without per-budget retraining or per-scene compression. To realize this formulation, Intra-Cross Mask Supervision provides structure-, coverage-, and redundancy-aware guidance for learning Gaussian importance, while budget-conditioned feature modulation adapts Gaussian opacity and attributes to the requested preservation ratio. Coverage-Aware Budget Selection further combines patch-wise pre-selection, view-wise opacity ranking, and 3D redundancy suppression to construct compact yet spatially distributed Gaussian representations. Experiments on indoor reconstruction and cross-dataset generalization demonstrate consistent quality--size trade-offs across different input view counts and preservation ratios, substantially reducing final representation storage and rendering cost while preserving rendering quality.
35. 【2611.06556】LungMend: A Healthy-Only Latent Diffusion Shape Prior for Lung Mask Correction in Severe Tuberculosis CT
链接：https://arxiv.org/abs/2611.06556
作者：Rezkellah Noureddine Khiat,Pierre-Yves Brillet,Catalin Fetita
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：severe tuberculosis, Lung segmentation models, fail on severe, non-lung tissue, Lung segmentation
备注： 5 pages (4 + 1 references), 2 figures, 2 tables. Submitted to IEEE ISBI 2027. Code: [this https URL](https://github.com/noureddinekhiati/LungMend)
点击查看摘要
Abstract:Lung segmentation models such as R231 are widely used, but they fail on severe tuberculosis (TB) CT: cavities and consolidations look like non-lung tissue and are left out of the mask. We present LungMend, a post-processing model that corrects such masks using only healthy anatomy. A latent diffusion model, trained on healthy lungs with synthetically corrupted masks, learns to recover the complete lung from the faulty mask and the bone anatomy, without any pathological data or CT intensities. LungMend recovers cavities and consolidations that R231 misses and improves accuracy on expert-annotated slices. Code: this https URL
36. 【2611.06544】MKD2World: A Typed Spatial MarkDown World Model For Web Agents
链接：https://arxiv.org/abs/2611.06544
作者：Zhihao Nan,Sifan Zhou,Yiming Cheng,Jinkai Zheng,Zheng Zhu,Si Shi,Ming Li,Fei Yu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Graphical user interface, accurately reflect post-action, Graphical user, reflect post-action interfaces, states accurately reflect
备注： 40 pages
点击查看摘要
Abstract:Graphical user interface (GUI) agents can improve decision-making with world-model foresight, provided that predicted states accurately reflect post-action interfaces. Existing state representations fail to jointly capture interface layout, UI semantics, and explicit locations. We introduce Typed Spatial Markdown (TSM), a Markdown-style textual state representation for desktop web interfaces. TSM serializes block-level and atomic-level UI elements according to their spatial relationships, jointly encoding their types, visual semantics, explicit locations, optional control states, and hierarchical membership. To train a screenshot-to-TSM renderer, we construct AtomBlock-WebUI, a dataset with precise annotations at both granularities. By injecting element-type labels into HTML and directly extracting bounding boxes after rendering, we avoid annotation errors caused by post-hoc inference from webpage structures. Building on TSM, we propose MKD2World, a desktop web world model trained in two stages for current-state description and action-conditioned next-state prediction. During inference, the web agent queries MKD2World as needed and performs a ``digest'' step, in which it interprets each predicted state and extracts task-relevant evidence for selecting the best action. Experiments show that MKD2World-9B achieves an EleF1 score of 26.50 on the out-of-domain test set, outperforming GPT-5.6-Sol(14.98) by 11.52 points. Across Online-Mind2Web tasks, MKD2World-9B improves the success rate of the Qwen3.5-35B web agent from 22.94% to 37.61%, achieving competitive performance among leading open-source GUI world models. Code is available at this https URL.
37. 【2611.06540】Spatially and Compositionally Controlled Multimodal Glioblastoma MRI Synthesis with Latent Diffusion
链接：https://arxiv.org/abs/2611.06540
作者：Steven Glass,Max Van Puyvelde,Marija Pizurica,Mia Meyer,Olivier Gevaert,Willie Brink
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Glioblastoma exhibits substantial, exhibits substantial heterogeneity, clinical datasets highly, datasets highly unbalanced, glioblastoma MRI scans
备注：
点击查看摘要
Abstract:Glioblastoma exhibits substantial heterogeneity in tumour morphology and composition across MRI modalities, often making available clinical datasets highly unbalanced in terms of patient pathologies. We propose a two-stage latent diffusion model (LDM) framework for the generation of explicitly controllable 2D glioblastoma MRI scans. First, a segmentation LDM generates tumour maps conditioned on location, spatial extent, axial position, and subregion composition. Second, a modality-conditioned LDM with ControlNet generates T1, T1Gd, T2, and FLAIR images adhering to the requested segmentation. On a held-out test set, generated segmentations achieved a mean centroid error of 0.842 pixels and a subregion proportion error of 0.795 percentage points. ControlNet improved Fréchet inception distance (FID) across all four modalities, reducing pooled FID from 42.59 to 36.12. An expert reader study yielded mean quality ratings of 6.60 for real images, 6.83 for ControlNet-generated images, and 6.77 for fully synthetic images.
38. 【2611.06518】EmoReward: Self-Evolving Reward Calibration for Emotional Video Generation RL
链接：https://arxiv.org/abs/2611.06518
作者：Mingzhe Zheng,Yue Wu,Jing Tan,Chang Zou,Dengyang Jiang,Zeyue Tian,Xuanhua He,Ryan Xu,Yunyang Ge,Sihui Ji,Yunlong Lin,Kaihang Pan,Hongru Yan,Sixiang Chen,Dianyi Wang,Julian Zhang,Weijie Kong,Changlin Li,Lanqing Guo,Zhao Zhong,Qifeng Chen,Harry Yang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Group Relative Policy, Relative Policy Optimization, Group Relative, Policy Optimization, Relative Policy
备注： 30 pages, 15 figures
点击查看摘要
Abstract:Group Relative Policy Optimization (GRPO) has advanced generative model post-training in verifiable domains such as code and mathematics, but evaluating video quality, especially emotional expression, often depends on subjective aesthetics and has no uniquely correct target. Existing approaches typically rely on fixed rewards for visual quality, motion quality, and text alignment that poorly capture emotional intent and can invite reward hacking, while RLHF is difficult to scale and subject to individual aesthetic differences that complicate the calibration of facial, body motion, and chromatic cues across narrative contexts. We introduce EmoReward, a new self-evolving training mechanism that distills evidence reliability from reward traces collected during an actual training run to adaptively guide multi-reward weight allocation in subsequent training by determining which emotional evidence to trust and how much to weight it. EmoReward first plans specific grounding cues from the emotional prompt to guide evaluation, then uses heterogeneous signal primitives to score the generated video during the act stage. Reflective Reward Gating calibrates their contributions through instance-level gates for phase, face confidence, conflict, and subtlety, then renormalizes weights over the active set to produce the sample's fused reward. RewardMemory then estimates each primitive's reliability from rollout scores and outcomes within each emotional regime in the finished training run, then fixes bounded multipliers that calibrate fusion weights in the next training run without updating reward models. Experiments on HunyuanVideo 1.5 show improvements across multiple RL algorithms and compare EmoReward with other agentic reward methods under SAGE-GRPO. Ablations and transfer experiments on SD 3.5 and FLUX further support adaptive reward calibration for visual generation.
39. 【2611.06471】A 3D foundation model unifying CT interpretation and segmentation
链接：https://arxiv.org/abs/2611.06471
作者：Yulu Xie,Zilong Li,Shen Xu,Yifan Bai,Liuhong Shi,Jiao Chen,Xianglei Kong,Wenchao Zhu,Na Shen,Xianghua Ye,Yang Yan,Jiaju Zheng,Yunsong Peng,Yanzhou Su,Chaohui Yu,Hao Luo,Fan Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：interpret computed tomography, Radiologists interpret computed, computed tomography, lies in three-dimensional, interpret computed
备注： 114 pages, including Supplementary Information; 7 main figures and 2 Extended Data figures
点击查看摘要
Abstract:Radiologists interpret computed tomography (CT) scans by jointly determining what a finding represents and where it lies in three-dimensional (3D) anatomy. However, CT models have treated CT interpretation and 3D segmentation as separate tasks, leaving textual findings spatially unverifiable and overlooking potential synergy between clinical understanding and spatial perception. Here we present HoloCT, a generalist 3D foundation model unifying CT interpretation and voxel-level segmentation by jointly modelling whole-volume context and fine-grained anatomical detail, providing 3D masks as evidence. We curated HoloDATA, comprising 195,921 CT scans from 73 public datasets and six clinical cohorts, with 6.2 million instruction dialogues and 2.8 million CT-mask pairs. Across 346 tasks spanning segmentation, lesion screening, visual question answering, and report generation on 61 internal and 12 external datasets, HoloCT outperformed specialist and foundation models. In multicentre validation across 11,455 clinical CT scans from five hospitals, HoloCT outperformed competing models in lesion segmentation and report generation by 18.2 and 15.3 points. It also achieved 85.1% mean accuracy in screening thyroid tumours and colon lesions, exceeding all four participating radiologists in a retrospective reader study. Further analyses revealed bidirectional semantic-spatial synergy: language-guided segmentation delineated unseen anatomical structures and lesions as well as diffuse free-text findings, outperforming the leading approach by 22.1 points, whereas prompting the model to generate corresponding 3D masks alongside its textual outputs significantly improved interpretation performance. HoloCT shows that clinical understanding and spatial perception can be learned together within a single foundation model and offers a path towards more accurate and reliable CT analysis.
40. 【2611.06455】CoDecide: Content-Adaptive Video Decoding for High-Throughput Video Analytics
链接：https://arxiv.org/abs/2611.06455
作者：Shristy Shah,Thomas B. Moeslund,Kamal Nasrollahi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：video archives, archives are bottlenecked, decoding, frames, Analytics on video
备注： Accepted at WACV 2027. 12 pages including supplementary material
点击查看摘要
Abstract:Analytics on video archives are bottlenecked by decoding. In a dense pipeline that runs a detector on every frame, decoding is a small fraction of the runtime, but once the detector is restricted to selected frames, decoding takes over as the main cost. We introduce CoDecide, a retrospective analytics system that only decodes the frames where new content appears, using signals from the compressed bitstream to find them. Motion tells us something is moving, but not whether it is new to the scene or has been there the whole time. To make that distinction, we supervise a lightweight compressed-domain student on a label-free novelty signal from a frozen DINOv2 teacher, which fires on semantically new regions rather than on any motion. Consequently, the student model generalizes to new camera deployments without requiring per-camera retraining. At inference, it decides which frames to decode and which regions to reconstruct. Detections from the decoded frames are propagated to the skipped frames using motion vectors. We evaluate CoDecide with a leave-one-dataset-out protocol on VIRAT, MEVA, and ShanghaiTech. Against a dense per-frame detector, CoDecide recovers more moving-object detections than prior compressed-domain selectors at an equivalent decoding budget, outperforming even a competitor trained directly on the target camera. CoDecide runs 15 to 24x faster than a pipeline that decodes and detects every frame. Code is available at this https URL.
41. 【2611.06453】Beyond Infraction Scores: Failure-Boundary Profiles for Closed-Loop Evaluation of Driving and Robot Navigation Agents
链接：https://arxiv.org/abs/2611.06453
作者：Milan Bulat,Gino Ardelean,Ellington Kirby
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Software Engineering (cs.SE)
关键词：Closed-loop driving benchmarks, multiplies route completion, CARLA rank agents, Closed-loop driving, infraction penalty
备注： 16 pages, 12 figures, 3 tables. Code: [this https URL](https://github.com/speedym/failure-boundary-profiles) . Data: [this https URL](https://doi.org/10.57967/hf/11195)
点击查看摘要
Abstract:Closed-loop driving benchmarks in CARLA rank agents by a driving score that multiplies route completion by an infraction penalty. This score does not distinguish an agent that stops in front of an obstacle from one that pushes past it. In a corridor closed by two parked cars, for example, one agent that drives through with contact averages 52.2 on the blocked widths, while the agents that stop average between 37.8 and 40.6. We propose failure-boundary profiles, an evaluation in which each scenario family varies one measured factor, such as corridor width or the time gap in oncoming traffic, and each variant is certified from measurement as one where the agent should proceed or one where it should stop. Along this axis we estimate two curves per agent, commitment (the probability of attempting the passage) and competence (the probability of passing without contact), and locate where each crosses one half, with intervals that account for the simulator's run-to-run variance. The certified labels also give a summary metric, decision accuracy, which credits clean passes on passable variants and stops on blocked ones. We evaluate seven driving agents on seven CARLA families. The rule-based expert reaches a decision accuracy of 0.74 and TFv6, the highest-scoring learned agent, 0.60. Agents with similar driving scores fail in different ways, and agents that reliably stop at a blocked corridor still rarely wait for a gap in oncoming traffic. We also apply the method, unchanged, to a warehouse robot in Isaac Sim. The navigation policy we test stops at blocked gaps in only one of three families, and two fine-tuned versions of it pass more gaps cleanly but no longer stop at all.
42. 【2611.06452】Within-Family EfficientNet Scaling under Fixed-Resolution Transfer Learning for Spectral-Domain Optical Coherence Tomography Retinal Disease Classification
链接：https://arxiv.org/abs/2611.06452
作者：Shkelqim Sherifi
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：medical-image transfer learning, optical coherence tomography, resolution remains unclear, spectral-domain optical coherence, fixed resolution remains
备注： 46 pages, 20 figures, 18 tables
点击查看摘要
Abstract:Background/Objectives: CNNs perform well in retinal disease classification from spectral-domain optical coherence tomography (SD-OCT), but whether EfficientNet's natural-image scaling hierarchy transfers to medical-image transfer learning at fixed resolution remains unclear. This study evaluates EfficientNet-B0-B7 for four-class SD-OCT classification and accuracy-efficiency trade-offs. Methods: Eight ImageNet-pretrained variants (4.05-64.10M instantiated backbone parameters) were evaluated at 224x224 on the Kermany dataset. Grayscale images were replicated to RGB and processed using model-embedded preprocessing and augmentation. Training comprised frozen-backbone head training followed by partial fine-tuning. Metrics covered classification, discrimination, efficiency, and visual analyses. Results: Test accuracy varied non-monotonically from 95.93% (B0) to 96.95% (B1); B7 achieved 96.73%. B1 had the highest accuracy and Drusen F1 (0.8780), while B7 had Drusen F1 of 0.8720 and the highest Drusen recall (0.9177). Drusen had the lowest F1 across all variants and contributed 82.2% of the summed squared deviation in class-specific F1; class ranking remained Normal CNV DME Drusen. The OCT accuracy ranking differed from the reported ImageNet hierarchy, where B7 ranked first. The accuracy-to-parameter ratio fell from 19.82 to 1.48 percentage points per million total parameters. The final train-test gap had a weak, non-significant association with test accuracy (r = 0.26, p = 0.53). Conclusions: Larger EfficientNet variants did not consistently improve SD-OCT classification. B1 achieved the highest accuracy and Drusen F1, whereas B7 showed a secondary accuracy recovery at greater model size and CPU latency, indicating task and protocol dependent scaling effects. As cross-partition duplicates have not been independently audited, results are conditional on the supplied split.
43. 【2611.06433】DreamRealm: Exploring and Materializing Hallucination Worlds for Trustworthy Vision-Language Models
链接：https://arxiv.org/abs/2611.06433
作者：Benlei Cui,Chunyang Chai,Yiliang Zhang,Xiaoqian Xia,Chengwen Yao,Song Li,Longtao Huang,Yuwen Zhai,Haiwen Hong
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal large language, Multimodal large, subtle visual details, large language models, remain prone
备注： 28 pages, including supplementary material. Code: [this https URL](https://github.com/Alibaba-VELLDEPTH/DreamRealm) . Model: [this https URL](https://huggingface.co/Alibaba-VELLDEPTH/Qwen35-9b-DreamRealm)
点击查看摘要
Abstract:Multimodal large language models (MLLMs) remain prone to visual hallucinations when correct responses depend on subtle visual details. One line of post-training methods constructs visual contrasts through image retrieval, generation, or editing to improve fine-grained perception. However, these contrasts are not built around the model's own hallucinations, making it difficult to ensure that supervision targets its actual perceptual confusions. Another line suppresses hallucinated outputs through response correction or preference learning under fixed image conditions, but leaves the design of supervision signals on the image-input side underexplored. Inspired by how humans correct misconceptions, we introduce DreamRealm, a post-training framework that explores diverse latent hallucinated responses, minimally edits original images to make them valid, and trains the model to assign each response to its supporting image. Our data construction pipeline, RealmForgePipe, mines observed and latent hallucinations from a target model and materializes them through image editing. Using hallucinations mined from Qwen3.5-9B, we construct the Realized Hallucination Dataset (RealmSet). Our training objective, RealmMatch, constructs a likelihood score matrix across image--response combinations and combines supervised learning with bidirectional contrastive losses to reinforce correct matches and suppress mismatches. Compared with the original Qwen3.5-9B model, DreamRealm improves performance across six visual perception and hallucination benchmarks, including gains of 7.26 percentage points in HallusionBench accuracy and 11.34 percentage points in MMVP pair accuracy. Together with ablation studies on data construction and training methods, these results demonstrate that hallucination assignment is a promising paradigm for improving visual perception and mitigating hallucinations.
44. 【2611.06422】Unaligned Image Guided Denoising via Cross-modal Conditional Flow Matching
链接：https://arxiv.org/abs/2611.06422
作者：Runmin Zhang,Linshan Li,Si-Yuan Cao,Zhu Yu,Lingyu Zhu,Huaqi Zhang,Hui-Liang Shen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：work presents UGD-FM, denoising framework based, cross-modal conditional flow, unaligned image guided, conditional flow matching
备注： Accepted by NeurIPS 2026
点击查看摘要
Abstract:This work presents UGD-FM, a novel unaligned image guided denoising framework based on cross-modal conditional flow matching. Unlike previous approaches that assume spatially aligned inputs or only handle small-baseline rectified pairs, we address a more challenging setting where severe target noise and large-range two-dimensional cross-modal misalignment coexist. Specifically, we formulate guided denoising as a progressive flow matching process, allowing image restoration and aligned guidance aggregation to mutually reinforce each other. To support efficient few-step inference, we introduce a stage-focused and inference-consistent training strategy that focuses on task-critical denoising stages, and mitigates the training-inference mismatch. We further propose adaptive sparse guidance propagation for efficient and reliable large-range matching, regularized by perceptual and geometric auxiliary losses. Experiments demonstrate that UGD-FM achieves state-of-the-art denoising performance with only one or two inference steps, and is compatible with modern single-image restoration backbones.
45. 【2611.06415】Entropogram-guided Visual Realignment Decoding: Capturing the Rhythm of Multimodal Reasoning
链接：https://arxiv.org/abs/2611.06415
作者：Jiaqi Deng,Zhe Fu,Yakun Chen,Dichang Zhang,Zonghan Wu,Xiaoshui Huang,Huan Huo,Guandong Xu
类目：Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：demonstrated remarkable progress, Multimodal large language, cross-modal reasoning tasks, long-chain reasoning processes, large language models
备注： 22 pages, 9 figures
点击查看摘要
Abstract:Multimodal large language models (MLLMs) have demonstrated remarkable progress on cross-modal reasoning tasks, yet they continue to suffer from hallucinations in long-chain reasoning processes. In this work, we revisit hallucination in MLLMs from the perspective of reasoning generation dynamics. We argue that entropy is not merely a static measure of uncertainty but a structured signal that reflects how modality information is integrated throughout decoding. Through systematic analysis, we identify two characteristic entropy patterns associated with hallucination behaviors: (1) a generally high-confidence regime corresponds to premature convergence to inappropriate multimodal interactions; and (2) local abrupt entropy transitions are associated with reasoning instability and hallucination onset. Building on these observations, we propose an entropy-aware self-introspective framework for MLLM reasoning. Our method continuously tracks entropy dynamics during decoding and performs targeted visual re-alignment when suspicious hallucination states are detected, encouraging the model to re-examine salient visual evidence at critical reasoning stages. Extensive experiments across six multimodal reasoning benchmarks spanning nine distinct evaluation settings demonstrate that our approach delivers robust improvements in reasoning accuracy and hallucination robustness, while providing new insights into the generation dynamics underlying MLLM failures. The code is available at: this https URL.
46. 【2611.06412】A Bag of Tricks for Defending Deep Learning-based Face Recognition Pipelines against Backdoor Attacks
链接：https://arxiv.org/abs/2611.06412
作者：Quentin Le Roux,Marti Jimenez,Yannick Teglia,Philippe Loubet Moundi
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Machine Learning (cs.LG)
关键词：multi-stage Face Recognition, protection of mature, multi-stage Face, Face Recognition Systems, Face Recognition
备注：
点击查看摘要
Abstract:The protection of mature, multi-stage Face Recognition Systems is crucial to system providers. This technical report targets the threat model most relevant to industry practitioners: although model training is performed in-house, training data is sourced from possibly-compromised third parties. Given this setting, we present three practical defense "tricks" against data poisoning-based backdoor attacks. The first operates at training-time, detecting poisoned identities during training or prior to a pipeline's deployment. The last two operate at inference-time, filtering suspicious inputs before an answer can be sent back to a potential attacker. Each method is presented with their motivation, algorithms and computational impact, and evaluated on realistic face recognition workloads. Our goal is to provide actionable hardening techniques to system providers.
47. 【2611.06378】UniLoop: Unified Loop Closure Detection from Retrieval to Geometric Verification and Relative Pose Estimation
链接：https://arxiv.org/abs/2611.06378
作者：Jingwen Yu,Pengyu Wang,Jin Wu,Weinan Chen,Ping Tan,Hong Zhang
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：closure detection conventionally, detection conventionally cascades, conventionally cascades separate, Loop closure detection, cascades separate models
备注：
点击查看摘要
Abstract:Loop closure detection conventionally cascades separate models for global retrieval, geometric verification, and relative pose estimation, leading to redundant computation and disconnected visual representations. We propose UniLoop, a unified framework that reuses the hierarchical representations of the pretrained geometric foundation model throughout this pipeline. A shared image encoder produces features for compact global descriptors; the same features are passed to the cross-view decoder for pairwise verification; and the original geometric predictions provide relative camera constraints for pose-graph optimization. Experiments on place recognition, loop verification, and relative pose estimation show that UniLoop improves loop-closure robustness and accuracy while reducing redundant backbone computation relative to modular pipelines. UniLoop achieves the best Recall@10 on MSLS (96.6) and Pitts30k (99.3) among the compared methods, while its verification branch reaches 95.63 AP and 96.29 ROC-AUC, surpassing the existing geometric verification baselines.
48. 【2611.06377】NanoKV: High-Ratio KV Cache Compression for Autoregressive Video Generation
链接：https://arxiv.org/abs/2611.06377
作者：Jiacheng Lu,Haoyi Zhu,Sipei Yi,Enze Xie,Cheng Zhuo,Yu Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：preserve scene consistency, video models rely, historical key-value, extended rollouts, making KV storage
备注： 25 pages, 13 figures. Project page: [this https URL](https://jiacheng-lu03.github.io/NanoKV/) . Code: [this https URL](https://github.com/jiacheng-lu03/NanoKV)
点击查看摘要
Abstract:Autoregressive video models rely on historical key-value (KV) caches to preserve scene consistency over extended rollouts, making KV storage and repeated attention over history a growing memory and computational bottleneck. Aggressive compression can degrade generation quality, while reconstructing full-dimensional KV leaves attention computation largely unchanged. We introduce NanoKV, a frozen-backbone framework for generation-aware high-ratio KV compression. NanoKV exploits redundancy across tokens and attention heads by storing shared content in cluster centers and encoding joint head-channel residuals into low-bit coefficients. Crucially, NanoKV uses different fitting objectives for Keys and Values according to their distinct roles in attention: Key decoders are optimized to preserve downstream block outputs, whereas Value encoders and decoders are fitted for faithful reconstruction through the deployed quantization path. Building on the same compressed representation, the optional NanoKV-Fast variant reuses the stored coefficients for mixed-dimensional attention, reducing computation without modifying the video backbone. Across three autoregressive video backbones, NanoKV consistently improves the quality-storage trade-off. On HY-WorldPlay, NanoKV achieves $26.09\times$ effective KV compression, nearly twice that of KVTC, while improving PSNR by 1.0 dB. NanoKV-Fast retains $20.53\times$ effective compression and achieves an approximately $1.15\times$ end-to-end speedup over KVTC.
49. 【2611.06355】FlashRelight: Portrait Video Relighting with Dynamic Lighting
链接：https://arxiv.org/abs/2611.06355
作者：Jiahui Sheng,Le Li,Limin Lin,Jiahao Li,Wansen Feng,Hong Gu,Shuhan Chen,Xiaorun Li,Rui Hu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：temporal stability, Portrait video, aims to modify, preserving photorealism, photorealism and temporal
备注： Accepted at NeurIPS 2026. 23 pages, including appendix
点击查看摘要
Abstract:Portrait video relighting aims to modify the illumination of a portrait video while preserving photorealism and temporal stability. The task becomes particularly challenging under dynamic lighting, where illumination direction, intensity, and color vary over time. To tackle this problem, we introduce FlashRelight, a novel two-stage framework for dynamic portrait video relighting. FlashRelight first suppresses the source illumination through delighting, and then synthesizes the target dynamic lighting on an illumination-neutral portrait video. FlashRelight supports three complementary control modalities: envmap sequences for explicit frame-level lighting control, dynamic lighting text for semantic illumination editing, and lighting reference videos for visual lighting transfer. Training follows a low-cost hybrid strategy that combines static one-light-at-a-time (OLAT) data with generated dynamic-lighting portrait videos, covering both controlled illumination variation and realistic portrait motion. Extensive experiments show that FlashRelight achieves temporally coherent and photorealistic dynamic relighting while enabling flexible cross-video lighting transfer. Code is available at this https URL
50. 【2611.06353】raffic-VL: Reinforced Vision-Language Models for Generalizable End-to-End Traffic Signal Control
链接：https://arxiv.org/abs/2611.06353
作者：Xingchen Zou,Maonan Wang,Kemou Jiang,Jie Li,Yiqi Chen,Xi Chen,Hai Yang,Yuxuan Liang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：dedicated perception pipelines, methods typically rely, control methods typically, Existing traffic signal, Existing traffic
备注：
点击查看摘要
Abstract:Existing traffic signal control methods typically rely on structured traffic states produced by dedicated perception pipelines. Emerging visual approaches often use idealized simulator images and convert them into intermediate representations before control, limiting their ability to directly exploit roadside visual observations. To bridge both the visual-domain and perception-to-decision gaps, we introduce SynTra-V and Traffic-VL. SynTra-V converts physics-based traffic simulations into photorealistic multi-view surveillance imagery across diverse road topologies and sensing conditions, and automatic semantic auditing checks that control-critical geometry, vehicle movements, and lane semantics match the simulator state. Traffic-VL is an eight-billion-parameter vision-language model that directly maps synchronized multi-view images and natural-language phase descriptions to signal decisions without intermediate structured states. Building on Traffic-R1's two-stage reinforced reasoning framework, Traffic-VL adapts its vision encoder via offline reinforcement learning on SynTra-V and freezes it during online visual stepwise trajectory policy optimization in closed-loop simulation. Experiments show that Traffic-VL matches structured-state Traffic-R1 while outperforming image-based controllers and general-purpose vision-language models, including Gemini 3 Pro. Evaluations on unseen topologies, degraded sensing conditions, real surveillance footage, and a three-week deployment across ten intersections further demonstrate robust visual generalization and effective constrained online control.
51. 【2611.06343】Prism: Bidirectional Self-Teaching for Unified Multimodal Models
链接：https://arxiv.org/abs/2611.06343
作者：Peng Zhang,Qian Chen,Xianyin Zhang,Yimin Tian,Ruite Fei,Dongyi Lv,Lifan Guo,Chi Zhang,Shuai Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Unified Multimodal Models, Unified Multimodal, Multimodal Models, single model, support visual understanding
备注：
点击查看摘要
Abstract:Unified Multimodal Models (UMMs) aim to support visual understanding and generation within a single model. Existing post-training methods either use understanding as a fixed teacher to improve generation, or rely on ground-truth trajectories to supervise both understanding and generation. Prism instead derives bidirectional supervision from self-generated interleaved rollouts, constructing training targets according to the reliability of their text and image chains. We propose Prism, a bidirectional self-teaching post-training method for UMMs. Like a prism decomposing mixed light, Prism decouples a coupled interleaved trajectory into a text chain and an image chain, assesses the reliability of each chain, and constructs a corresponding training target from their reliability states. Experiments on both SenseNova-U1 and BAGEL show that Prism improves both understanding and generation. On the generation side, GenEval improves from 85.8 to 89.2 (+3.4), and DPG improves from 86.1 to 87.3 (+1.2) on SenseNova-U1. On the understanding side, the total MME score improves from 2282.6 to 2311.6, and MMVP improves from 58.0 to 62.0. Consistent improvements are observed on BAGEL. These results highlight that Prism enables coordinated improvements in generation and understanding by constructing reliability-guided self-training targets from self-generated trajectories, without relying on an external verifier or externally annotated corrected trajectories during target construction.
52. 【2611.06302】Beyond Scene Shortcuts: Action-Centric Video-Text Alignment for Fine-Grained Action Understanding
链接：https://arxiv.org/abs/2611.06302
作者：Zhiliang Zhu,Jiazheng Huang,Dawei Zhao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：understanding requires vision-language, action understanding requires, requires vision-language models, Fine-grained action understanding, Relative Policy Optimization
备注： 18 pages, including appendices
点击查看摘要
Abstract:Fine-grained action understanding requires vision-language models to ground what an agent does, how it acts, and why it acts in spatio-temporal evidence. However, richer supervision can backfire: fine-tuned models may generate detailed action descriptions grounded in static scenes and salient objects rather than motion, a failure we call Environment-Grounded Action Hallucination (EGAH). To mitigate EGAH, we propose Staged Attention Rectification and Reinforcement (STARR), an action-centric video-text alignment framework that breaks scene-action shortcuts through Action-Environment Dissociation and reinforces action-focused grounding with an Attention Consistency Reward within Group Relative Policy Optimization. We further construct FineActionRR, combining temporally localized captions with hierarchical and temporal-causal reasoning data. Built on Qwen2.5-VL-7B, FineActionVLM-R1 improves average MotionBench accuracy by 3.01 percentage points over its base model and achieves 91.50% on HAU-MCQ-Bench. Qualitative comparisons further indicate more faithful fine-grained action descriptions with fewer environment-induced hallucinations.
53. 【2611.06282】MonoLaDN: Language-Guided DeNoising for Monocular 3D Object Detection
链接：https://arxiv.org/abs/2611.06282
作者：Kiet Dang Vu,Cao Le Minh Khoa,Nguyen Viet Tri Pham,An Nguyen Gia,Tam Le Thuc Ho,Duc Dung Nguyen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：remains fundamentally ill-posed, fundamentally ill-posed, single view, low-cost route, object detection offers
备注： Accepted at ACCV 2026
点击查看摘要
Abstract:Monocular 3D object detection offers a low-cost route to 3D perception, but it remains fundamentally ill-posed, since depth must be inferred from a single view. Recent transformer-based detectors learn geometry purely from image features and 3D box annotations, lacking the high-level semantic priors that vision-language models (VLMs) acquire from large-scale pretraining. VLMs offer such priors, but deploying one directly as a detector is impractical due to its heavy inference cost. We propose MonoLaDN, a language-guided denoising framework that transfers the geometric reasoning of a VLM into a monocular 3D detector while keeping the deployed model purely vision-based. During training, a frozen VLM produces structured reasoning about each object's occlusion, depth, dimension, and angle from the image and its ground-truth boxes. We encode this reasoning into queries, perturb them with noise, and train the detector to reconstruct the clean reasoning. Reconstructing the corrupted reasoning forces the detector's depth-guided features to internalize the VLM's geometric priors, so this knowledge remains available even after the reasoning path is discarded at inference, adding no latency or parameters to the deployed model. Experiments on KITTI 3D and nuScenes show that MonoLaDN consistently outperforms state-of-the-art detectors and generalizes well to new domains.
54. 【2611.06273】Quo Vadis, Driving Scene Reconstruction? Occlusion-Aware Gaussian Densification
链接：https://arxiv.org/abs/2611.06273
作者：Dung Do Tien,Kien Nguyen Do Trung,Kiet Dang Vu,Trung Thai Tran,Duc Dung Nguyen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：single observation fundamentally, observation fundamentally hinders, Splatting methods enable, Gaussian Splatting methods, Gaussian Splatting
备注： Accepted at the Workshop on Computer Vision for Developing Countries (CV4DC), ACCV 2026 (Proceedings Track)
点击查看摘要
Abstract:While recent feed-forward 3D Gaussian Splatting methods enable efficient driving-scene reconstruction from surround-view images, their reliance on a single observation fundamentally hinders novel-view synthesis. Regions occluded in the input can become visible from novel viewpoints, leaving the reconstructed Gaussians under-constrained and incomplete. Moving beyond image-space inpainting for rendered views, we introduce OccSplat, a feed-forward framework whose core contribution is Occlusion-Aware Gaussian Densification, explicitly targeting missing scene geometry rather than missing pixels. By predicting new Gaussian primitives for unsupported regions, OccSplat completes the scene directly in the 3D representation. Specifically, OccSplat first identifies occluded regions that lack Gaussian support through Gaussian Occlusion Mapping. Gaussian Occlusion Completion then generates new primitives for these regions. The predicted primitives are integrated into the original representation to improve novel-view synthesis while retaining feed-forward inference without per-scene optimization. Experiments on the nuScenes benchmark demonstrate that OccSplat improves on the compared methods and yields particularly large gains in occluded regions, leading to more accurate and visually coherent driving-scene reconstruction.
55. 【2611.06270】NextGAN: Towards Simple and Scalable GAN Training for Image and Video Generation
链接：https://arxiv.org/abs/2611.06270
作者：Xinhao Lou,Dongye Xie,Peng Sun,Chenyi Zhuang,Kaicheng Yu,Tao Lin
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Adversarial training enables, losses supervise critic, conventional adversarial losses, adversarial losses supervise, training enables
备注：
点击查看摘要
Abstract:Adversarial training enables one- and few-step image and video generation, but conventional adversarial losses supervise critic values without directly specifying the gradients used to update the generator. We present NEXTGAN, which trains a scalar critic by regressing its input gradient onto displacements between independently paired reference and generated features at interpolated locations in frozen representation spaces. For a fixed generator, this regression is equivalent to an adversarial objective with a gradient-energy penalty, while the generator retains the standard potential-based GAN update. The same objective adapts pre-trained image and video generators with up to 14B parameters, without auxiliary losses, online teacher scores, or trajectories. On ImageNet $256 \times 256$, NEXTGAN achieves one-step FIDs of 2.87 with pixel-space JiT-B and 1.54 with latent-space DiT-XL/1; its adversarial form further reaches 1.36. For text-to-video generation, a single trained Wan2.1-1.3B model supports one-, two-, and four-step sampling, achieving the highest VBench total scores among the compared 1.3B methods at one and two steps. At two steps, NEXTGAN scores 83.13, exceeding rCM and AnyFlow by 1.25 and 0.47 points, respectively. Code is available at this https URL.
56. 【2611.06259】A Systematic Benchmark for Evaluating Multimodal Personalized Reasoning of Vision-Language Models
链接：https://arxiv.org/abs/2611.06259
作者：Dohyun Kim,Junyong Lhim,Kwanyong Park
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：People often make, make decisions, decisions by holistically, heterogeneous forms, personalized reasoning
备注： Accepted to WACV 2027
点击查看摘要
Abstract:People often make decisions by holistically reasoning over heterogeneous forms of personal information. In this paper, we study the relatively underexplored capability of multimodal personalized reasoning in multimodal large language models (MLLMs). To this end, we introduce \texttt{MPRBench}, a novel and comprehensive benchmark specifically designed to evaluate personalized reasoning across a wide range of tasks and real-world challenges. \texttt{MPRBench} consists of 12 sub-tasks and additionally supports interpretable analysis of representative error cases. Through extensive experiments, we find that current personalized MLLMs still struggle with personalized reasoning due to several key challenges, including inaccurate recognition of personalized concepts and sensitivity to irrelevant personal information. We hope that MPRBench will stimulate further research on personalized reasoning in MLLMs. Code and data are available at this https URL
57. 【2611.06258】CrossPressor: Scalable Cross-View Fusion for Feed-Forward 3D Gaussian Splatting
链接：https://arxiv.org/abs/2611.06258
作者：Yuxi Hu,Wenhao Dong,Jun Zhang,Friedrich Fraundorfer
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Gaussian Splatting, increasingly difficult, difficult to scale, Feed-forward, Splatting
备注： Accepted to WACV 2027
点击查看摘要
Abstract:Feed-forward 3D Gaussian Splatting (3D-GS) becomes increasingly difficult to scale to long multi-view sequences. Anchor-based compression methods such as ZPressor alleviate representation growth by decoding Gaussians only from a compact set of anchor feature maps, but keeping these anchors fixed forces each one to aggregate an increasing number of support views. We identify this representation--fusion mismatch and introduce \textbf{CrossPressor}, a training-free method for scalable anchor-based fusion. CrossPressor preserves all decoder-facing anchor queries while constraining the view-growing support sequence through coverage-cycled evidence routing, distributing retained spatial evidence across support views and fusion layers while keeping all support views represented. Routing before K/V projection, together with joint context packing, further reduces support-side fusion cost without retraining. CrossPressor maintains reconstruction quality close to dense fusion while achieving up to $26.12\times$ faster cross-view fusion and $1.43\times$ end-to-end acceleration on long input sequences. Our project page is at: this https URL.
58. 【2611.06247】CAPE-JEPA - Cross-modal Adversarial Probabilistic Embedding JEPA
链接：https://arxiv.org/abs/2611.06247
作者：Aniket Junghare,Biplab Banerjee
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Synthetic Aperture Radar, sensing image retrieval, remote sensing image, profound physical gap, Aperture Radar
备注： Accepted for publication at the British Machine Vision Conference (BMVC 2026)
点击查看摘要
Abstract:Cross-modal remote sensing image retrieval (RS-CMIR) requires representations that are simultaneously modality-invariant and semantically discriminative, despite the profound physical gap between heterogeneous sensors such as Synthetic Aperture Radar (SAR) and multispectral imagery. Recent JEPA-based Predictive self-supervised approaches such as X-JEPA formulate cross-modal alignment as a deterministic latent forecasting task, implicitly assuming uniform patch predictability and leaving cross-modal distributional alignment unaddressed. We propose CAPE-JEPA, a probabilistic cross-modal Joint Embedding Predictive Architecture with three contributions: (i) a cross-attentional Gaussian predictor outputting per-patch parameters (mu, sigma^2) conditioned on opposite-modality context, trained via negative log-likelihood to model inherent cross-sensor prediction uncertainty; (ii) adversarial distributional regularization combining unimodal isotropic Gaussian regularization with a novel cross-modal adversarial variant that aligns modality distributions via worst-case Epps-Pulley characteristic function tests without explicit sample pairing; and (iii) in-training contrastive learning with attention-pooled heads for scene-level discriminative grounding. Evaluated on BigEarthNet-14K (BEN-14K) and fMoW across SAR, multispectral, and RGB modalities, CAPE-JEPA surpasses X-JEPA by up to 13.74 points on BEN-14K and 15.59 points on fMoW, outperforming all baselines including SkySense and CROMA across both unimodal and cross-modal directions while using fewer parameters (407.30M vs. 432.72M).
59. 【2611.06230】Homology Features for X-Ray Hyperspectral Images Segmentation
链接：https://arxiv.org/abs/2611.06230
作者：Fethi Harkat,Guillaume Gey,Valérie Perrier(LJK, CVGI),Kévin Polisano
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Characterizing Multi-Energy X-ray, Multi-Energy X-ray Transmission, X-ray Transmission, hyperspectral images presents, images presents significant
备注：
点击查看摘要
Abstract:Characterizing Multi-Energy X-ray Transmission (XRT) hyperspectral images presents significant challenges for traditional classification frameworks due to high-dimensional redundancy and non-linear spectral overlaps. Although manifold learning techniques such as UMAP enhance spectral representation by preserving non-linear correlations, they do not explicitly utilize the geometric structure of the embedded manifold for segmentation. This study introduces a hybrid architecture that integrates topological features derived from persistent homology with convolutional and graph neural networks. The approach computes Vietoris-Rips persistent homology on UMAP-projected superpixel point clouds to capture H 1 cyclic structures that encode spectral heterogeneity. These topological descriptors are combined with pixel-level CNN features through a broadcasting mechanism that propagates superpixel-level graph representations to full spatial resolution. Experimental results on XRT multi-energy imagery demonstrate that the proposed hybrid model significantly outperforms both CNN-only and superpixel-pooling fusion baselines, suggesting that topological features provide complementary discriminative information to local spectralspatial descriptors.
60. 【2611.06221】FedXCrop: Privacy-Preserving Crop Disease Detection via Federated Learning with Post-Aggregation Explainability under Non-IID Farm Distributions
链接：https://arxiv.org/abs/2611.06221
作者：Kriti Saini,Manikandan P
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：share raw data, offer limited support, Deep learning, classify crop diseases, crop diseases accurately
备注： 26 pages. Includes 38-class crop disease classification experiments, federated learning evaluation under non-IID client distributions, and quantitative explainability analysis using Grad-CAM and SmoothGrad. Code and experimental results: [this https URL](https://github.com/Kriti2709/fedxcrp)
点击查看摘要
Abstract:Deep learning can classify crop diseases accurately from benchmark leaf images, but centralized training requires farms to share raw data, and predictions without explanations offer limited support for treatment decisions. We present FedXCrop, a federated crop disease classification pipeline that quantitatively evaluates explanations of the aggregated global model. A MobileNetV2 model trained centrally on PlantVillage achieved 99.38% test accuracy (standard deviation 0.05 over three seeds) on a fixed test set of 5,428 images across 38 classes. Federated models initialized with ImageNet weights were trained for 30 rounds across five clients. FedAvg achieved 98.81% accuracy with identically distributed clients and 98.81%, 98.59%, and 97.78% under Dirichlet label skew (alpha = 1, 0.5, and 0.1, respectively). FedProx was not significantly different from FedAvg at any heterogeneity level (McNemar p 0.3). Grad-CAM and SmoothGrad explanations were evaluated on 380 test images. Both attributed more energy to the leaf than chance (0.70-0.78 versus 0.60), while Grad-CAM maps from federated and centralized models showed Spearman correlations of 0.74-0.76. Agreement decreased as heterogeneity increased, lesion localization was only modestly above chance, and a model-randomization test indicated that SmoothGrad maps depended substantially on image structure rather than learned parameters. In this setting, label skew reduced federated accuracy by 0.6-1.6 percentage points relative to centralized training. FedAvg largely preserved Grad-CAM behavior, while FedProx provided no measurable benefit.
61. 【2611.06205】Cross-Modal Semantic Successive Refinement for Generative Image Communication over Underwater Acoustic Channels
链接：https://arxiv.org/abs/2611.06205
作者：Xu Pei,Bin Wang,Guangxu Zhu,Yi Zhang,Haiyan Fan
类目：Information Theory (cs.IT); Computer Vision and Pattern Recognition (cs.CV)
关键词：impose demanding requirements, communication faces challenges, complex channel environments, acoustic communication faces, bandwidth and complex
备注：
点击查看摘要
Abstract:Underwater acoustic communication faces challenges such as limited available bandwidth and complex channel environments, which impose demanding requirements on efficient image transmission and reliable reconstruction. To address these challenges, this paper proposes a generative image communication framework based on cross-modal semantic successive refinement. At the transmitter, text descriptions, compact bottleneck features, and visual side information compressed by residual vector quantization are transmitted. At the receiver, text and bottleneck features are first fused to predict a base estimate of the intermediate visual representation. The received RVQ indices are then used to recover supplementary visual information and perform residual correction, followed by image reconstruction using a one-step Pixel Mean Flow model. During training, a CLIP-based text-image semantic consistency constraint is introduced to preserve the semantic correspondence between generated results and the original text descriptions. During transmission, protection resources are allocated according to the importance of different information branches and RVQ quantization stages. Simulations using COCO 2017 images and measured underwater acoustic channel records from Watermark show that text and bottleneck features provide complementary semantic and structural conditions, RVQ visual side information further improves reconstruction quality, and layered unequal error protection helps improve recovery at low SNRs. Code-rate allocation experiments reveal a tradeoff between the reliability of fundamental conditions and visual-detail reconstruction under a limited visual-feature coding budget, providing guidance for allocating protection resources in underwater acoustic image transmission.
62. 【2611.06203】BiCG-Net: Target-Specific Image Quality Assessment via Observation Modeling and In-Image Differencing
链接：https://arxiv.org/abs/2611.06203
作者：Yibu Yang,Tingqiong Cui,Liming Lei,Hao Xiong,Jun Xu,Siyuan Liu,Guanghui Huang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Image Quality Assessment, specific target region, No-Reference Image Quality, estimate target quality, whole-image No-Reference Image
备注： 34 pages, 3 figures
点击查看摘要
Abstract:We estimate the quality of a specific target region (e.g., a train body) in an image, rather than the whole image. This differs fundamentally from whole-image No-Reference Image Quality Assessment (NR-IQA): when the target occupies a small fraction of the frame, the whole-image score is dominated by background, and no public benchmark provides target-level human Mean Opinion Score (MOS). We estimate target quality via nested sampling - a sequence of patches expanding outward from the target box - and infer quality from the relative structure of this sequence. This motivates BiCG-Net, a student network that distills an 11-teacher ensemble through a linear observation model and an in-image differencing mechanism, which provably cancels the target term and teacher-specific bias. We train and test the student independently on each dataset, and evaluate zero-shot transfer across benchmarks. On CSIQ and LIVEC, the student reaches PLCCs of 0.9009 and 0.9133 against human MOS, exceeding the best single teacher and the teacher consensus. On a self-built MOS-free railway dataset, the student reaches a PLCC of 0.9855 against a weak label. The student exceeds its teachers because it learns a new mapping from the relative structure of teacher readings to the ground-truth label, rather than mimicking them. Residual analysis on CSIQ and LIVEC shows the prediction residual is significantly correlated with background contamination, teacher dispersion, and label extremity, demonstrating the student extracts information the consensus does not contain. Under CSIQ-to-LIVEC transfer, the frozen student reaches a PLCC of 0.8416, exceeding the consensus by 0.1947. We position BiCG-Net as an offline target-level quality auditing and label-generation engine; its 39,482-parameter student is compact by design, acting as a unifying layer mapping heterogeneous teacher readings onto a common quality scale.
Comments:
34 pages, 3 figures
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2611.06203 [cs.CV]
(or
arXiv:2611.06203v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2611.06203
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
63. 【2611.06195】Annotator-Free Object Detection via Foundation Model Collaboration
链接：https://arxiv.org/abs/2611.06195
作者：Yasiru Ranasinghe,Vishal M. Patel
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：research remains constrained, detection research remains, Object detection research, limiting scalability, research remains
备注：
点击查看摘要
Abstract:Object detection research remains constrained by high annotation costs and the closed-set assumptions of supervised models, limiting scalability to novel categories. We present a target-dataset annotation-free object detection framework that eliminates the need for human labeling on the target dataset by leveraging the complementary strengths of pretrained foundation models, including segmentation and vision-language systems, combined with a self-refining training loop. To further reduce reliance on expensive LVLM queries, we introduce a landmark-based clustering mechanism that amortizes labeling across image clusters, improving label consistency while lowering computational cost. Our method autonomously generates segmentation proposals, assigns semantic labels through multimodal reasoning, and iteratively improves both localization and classification using a lightweight open-set detector. This modular pipeline enables adaptation to completely unseen object classes and domains without any human-provided target-dataset annotations, while maintaining compatibility with existing detection architectures. Evaluations on COCO, LVIS, ODinW-35, and Roboflow-100 demonstrate substantial performance gains over state-of-the-art open-vocabulary and long-tail detection methods, achieving 60.8 AP on COCO and 47.4 AP on LVIS under zero-shot settings. Beyond strong benchmark results, our approach provides a scalable foundation for real-world detection systems in unknown environments, where annotation is infeasible.
64. 【2611.06180】Rohbau3D-Semantics: Dense Semantic and Instance Labels for Point Clouds of Indoor Shell Construction Scenes
链接：https://arxiv.org/abs/2611.06180
作者：Lukas Rauch,Thomas Braml
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：shell construction sites, previously released, shell construction, construction sites, adds dense semantic
备注： Accepted at the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV 2027)
点击查看摘要
Abstract:We present the Rohbau3D-Semantics dataset, which adds dense semantic and instance-level labels to laser scans of the previously released Rohbau3D domain data from shell construction sites. The dataset comprises 504 point cloud scenes from 14 survey sites, each captured with a terrestrial laser scanner and stored in a scanner-centered local coordinate system. Unlike point clouds sampled from reconstructed meshes or synthetic building models, the data preserve the characteristic properties of real laser scanning, including non-uniform sampling, measurement artifacts, reflections, and fine geometric detail. Combined with manual labels, expert oversight during pointwise annotation, and full-scene review, this yields a high-quality benchmark for semantic scene understanding in complex built environments. The dataset includes 17 class labels of building components and one background class, along with instance annotations for object-level analysis. In addition to the 3D point clouds, the release also provides scripts for deriving geometrically aligned panoramic and cube-map representations of color, LiDAR reflection intensity, depth, surface normals, semantic labels, and instance labels from the 3D arrays. We describe the acquisition pipeline, annotation protocol, quality-control process, and panorama-generation procedure, and provide benchmark splits and baseline experiments for semantic segmentation. By combining precise terrestrial laser scans, dense annotations, and a wide variety of shell-construction scenes, Rohbau3D-Semantics bridges the gap among synthetic indoor datasets, mesh-derived benchmarks, and smaller construction-specific resources. The dataset is intended to support research on 3D scene understanding, construction-site analytics, and multimodal scene analysis in the built environment. Access and download the full dataset via this https URL
Comments:
Accepted at the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV 2027)
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2611.06180 [cs.CV]
(or
arXiv:2611.06180v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2611.06180
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
65. 【2611.06168】Reasoning-Aware Cross-Modal Association Unlearning in Multimodal Large Reasoning Models
链接：https://arxiv.org/abs/2611.06168
作者：Xinghao Li,Chenchen Tan,Youyang Qu,Shujie Cui,Xingliang Yuan,Cunjian Chen,Chi Liu,Longxiang Gao
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：allowing sensitive information, integrate visual inputs, Multimodal large reasoning, allowing sensitive, textual and parametric
备注：
点击查看摘要
Abstract:Multimodal large reasoning models (MLRMs) integrate visual inputs with textual and parametric knowledge, allowing sensitive information to be accessed through cross-modal associations during reasoning. This raises privacy concerns when a visual input should no longer provide access to such information. Machine unlearning can remove this influence without retraining the model from scratch. However, multimodal unlearning methods mainly target samples, concepts, or knowledge content, without separating the knowledge from the cross-modal association through which it is accessed. In reasoning models, target information may disappear from the final answer while remaining in intermediate reasoning, or be replaced by incorrect substitute knowledge. We therefore study cross-modal association unlearning, where the forget target is a designated visual-to-knowledge association: the model should suppress target-bearing behavior under the designated visual context while preserving access to the same knowledge in permitted contexts. We propose Visual-Keyed Counterfactual Rebinding (VKCR), a parameter-efficient framework for cross-modal association editing. VKCR first localizes the edit to a compact association-conditioned parameter subspace. It then reduces support for the designated target at task outputs and counterfactually rebinds the affected reasoning behavior by discouraging target-bearing or unsupported continuations while favoring valid non-sensitive alternatives. We further introduce CLEAR-R and MLLMU-R to evaluate target leakage, hallucinated reassociation, reasoning preservation, and modality-specific utility. Experiments show that VKCR substantially reduces image-conditioned target leakage and hallucinated reassociation, including across heterogeneous task formulations, while preserving non-sensitive visual reasoning and permitted text-only knowledge.
66. 【2611.06160】DSRS: Teaching MLLMs to Perceive, Reason, and Segment in Complex Driving Scenes
链接：https://arxiv.org/abs/2611.06160
作者：Sicen Guo,Zhengfei Song,Kuanhsun Chen,Xu Huang,Ping Zhong,Wei Ye,Shaoyi Du,Rui Fan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：broad world knowledge, Existing reasoning segmentation, frameworks typically employ, large language models, Existing reasoning
备注： 26 pages and 19 figures
点击查看摘要
Abstract:Existing reasoning segmentation frameworks typically employ multimodal large language models (MLLMs) with broad world knowledge to extract semantics in a human-like manner and generate corresponding segmentation masks. Nevertheless, these frameworks lack the necessary scene-specific awareness. This paper introduces driving scene reasoning segmentation (DSRS), a scene-specific task that requires models to interpret implicit instructions, infer spatial relations, detect potential risks, handle challenging conditions, and comprehend underlying traffic rules, ultimately generating accurate segmentation masks. Meanwhile, we establish a benchmark dataset to facilitate future research on the DSRS task. To pioneer this task, we propose DSRS-Net, a novel architecture with advanced reasoning segmentation capability for automated driving. Specifically, DSRS-Net seamlessly infuses geometric features for deeper reasoning segmentation, without compromising the original multimodal fusion mechanism. This strategy effectively mitigates the modality representation mismatch in MLLMs caused by RGB-only pretraining, while enhancing the integration of geometric, contextual, and linguistic features. Extensive experiments demonstrate the superior performance of DSRS-Net in both driving scene reasoning segmentation and other language-driven segmentation tasks across various public datasets. The source code and dataset will be released upon publication.
67. 【2611.06149】Grounding in the Dark: Text-Only Training for Zero-Shot Video Temporal Localization
链接：https://arxiv.org/abs/2611.06149
作者：Divyanshu Mishra,Sabine Sternig,Rakshith Shetty,Erhan Gundogdu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：collecting precise temporal, large-scale video datasets, precise temporal annotations, paired video-text data, Video-LLMs are typically
备注：
点击查看摘要
Abstract:Video-LLMs are typically trained on paired video-text data for temporal tasks, yet collecting precise temporal annotations and training on large-scale video datasets are both costly. We investigate whether a text-only LLM, with no vision-language pretraining, can be trained on textual video descriptions alone to perform temporal grounding and receive video only at inference time. This setting removes paired video data from training altogether and is a step toward training multimodal models without paired annotations. We generate a 134K-example corpus of textual sequences with up to 100 time steps, adapt Qwen3-8B with LoRA on CLIP or LLM2CLIP text embeddings, and evaluate on Charades-STA and QV-Highlights without training on videos from either benchmark. LLM2CLIP, whose text encoder supports longer inputs, represents detailed descriptions better than CLIP (61.54 versus 53.86 mtIoU on Temporal-TextVid) and transfers them better to video. Still, replacing text with frame embeddings at inference yields only 4.99 mtIoU on Charades-STA and 11.12 on QV-Highlights, revealing a large modality gap. To bridge it, we propose Nearest Entity Replacement (NER), a training-free mapping that represents each video frame by the normalized mean of its nearest text-entity embeddings, so that the model receives the kind of input it was trained on. NER reaches 14.45 mtIoU on Charades-STA and 20.72 on QV-Highlights, outperforming the strongest of four families of modality-gap baselines by 5.00 and 1.71 points. NER thus enables partial transfer from text to video, while more reliable grounding will likely require encoders with better-aligned text and visual representations.
68. 【2611.06143】PTQ4SAM3: Semantics-Preserving Post-Training Quantization for Segment Anything Model 3
链接：https://arxiv.org/abs/2611.06143
作者：Xi Xiao,Yunbei Zhang,Lin Zhao,Janet Wang,Xinru Jiang,Yanshu Li,Chenrui Ma,Pan Wang,Tianyang Wang,Xiao Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：make deployment difficult, computation costs make, costs make deployment, deployment difficult, make deployment
备注： 15 pages, 4 figures. Accepted to WACV 2027. Includes supplementary material
点击查看摘要
Abstract:Segment Anything Model 3 (SAM 3) can segment objects from text prompts and track them across video, but its memory and computation costs make deployment difficult. Post-training quantization (PTQ) reduces these costs by using fewer bits. However, a quantized model can select the wrong object or lose track of its target across frames. We call this prompt-alignment drift. Controlled tests show that perturbing low-variance feature directions strongly affects target selection. We propose Semantics-Preserving Quantization (SPQ), which gives more calibration weight to concept-sensitive parameters, preserves residual features, and corrects the mean error in video memory. Fixed text concepts guide calibration without task annotations. All three components operate offline and add no inference operators. With a W4A8 image encoder, SPQ improves RefCOCO Pr@0.5 from 42.1 to 72.5 over PTQ4SAM while retaining 54.8 COCO mask AP. Experiments on LVIS, RefCOCO variants, and SA-V show consistent gains. A CLIP study also shows improved image-text retrieval.
69. 【2611.06141】RDT-3D: Resolution-Decoupled Training for High-Fidelity 3D Geometry Generation
链接：https://arxiv.org/abs/2611.06141
作者：Jiale Zhang,Yang Liu,Chengyang Li,Jin Yuan,Qianxi Jia,Taicheng Huang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：requires maintaining global, maintaining global structural, global structural coherence, structural coherence alongside, coherence alongside fine-grained
备注：
点击查看摘要
Abstract:High-fidelity 3D geometry generation requires maintaining global structural coherence alongside fine-grained surface details. While recent coarse-to-fine frameworks leverage Rotary Position Embeddings (RoPE) to condition local queries, we reveal a critical training-inference resolution discrepancy: coordinate guidance and geometric supervision are aligned during training, whereas inference decodes high-resolution geometry from coarse spatial coordinates. This mismatch introduces a severe distribution shift that degrades fine details. To overcome this, we propose Resolution-Decoupled Training (RDT), which anchors RoPE guidance at 512 resolution while supervising geometry at 1536, enabling robust detail extrapolation. Additionally, to eliminate high-resolution data bottlenecks, we present Dual3D-300K, a large-scale paired dataset comprising 300K watertight 3D point clouds explicitly aligned across 512 and 1536 resolutions. Extensive experiments demonstrate that RDT substantially improves sharp geometric regions, while Dual3D-300K offers a scalable benchmark for high-resolution 3D generation.
70. 【2611.06120】ReactWorld: Structuring Interaction Responses for Embodied Video Generation
链接：https://arxiv.org/abs/2611.06120
作者：Hanwei Liu,Huijia Zhang,Hanzhang Wang,Guangyu Liu,Hanbei Zhan,Linjie Hu,Bin Xiao,Xuan Zhou,Dong Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：world models predict, Embodied video world, models predict scene, robot actions, video world models
备注： 10 pages, 7 figures. Project page: [this https URL](https://metaengine-world.github.io/ReactWorld/)
点击查看摘要
Abstract:Embodied video world models predict scene changes caused by robot actions, yet generated object responses may remain inconsistent with task intent and contact dynamics. Critical responses in embodied scenes often concentrate in local regions and specific time intervals. Inspired by chain-of-thought reasoning, we introduce ReactWorld, an embodied video generation model guided by structured interaction anticipation. In the generation backbone's feature space, an interaction response field predictor anticipates how the interaction will unfold, explicitly describing participant roles, future motion response intensity, and local motion changes. A response feedback adapter forms increments to object features from the difference between the object branch's outputs with predicted and zeroed local dynamics inputs. It also converts predicted displacements into positional biases for temporal attention. These two mechanisms guide object feature updates and information retrieval across frames, respectively. Through interaction anticipation and generative feedback, ReactWorld achieves an average score of 77.51 on RBench, outperforming PhysisForcing by 3.29 points with improvements in all nine categories. On EZS-Bench, it achieves a Domain score of 86.98 and an average score of 81.87.
71. 【2611.06113】Semantic Prior-Guided Incomplete Cross-Modal Retrieval with Noisy Labels
链接：https://arxiv.org/abs/2611.06113
作者：Jiali Chen,Ruitao Pu,Yingke Chen,Dezhong Peng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：aims to bridge, semantic, modality incompleteness, learning shared representations, CMR
备注：
点击查看摘要
Abstract:Cross-modal retrieval (CMR) aims to bridge the semantic gaps between modalities by learning shared representations. Unfortunately, due to the dynamism and inconsistencies in real-world data acquisition, multimodal datasets frequently encounter severe modality incompleteness. Existing incomplete CMR methods adhere to a label-driven paradigm, relying heavily on categorical annotations as the semantic benchmark. However, label noise is difficult to avoid and often coexists with modality incompleteness. To address this challenge, we propose a novel semantic prior-guided framework for incomplete cross-modal retrieval with noisy labels, termed SPIRN. Specifically, SPIRN uses fixed semantic priors as a consistent reference for robust representation learning, noisy-label handling, and missing-modality completion. Based on this reference, Semantic Priors Guidance (SPG) establishes a stable category-level semantic space, Quality-aware Robust Learning (QRL) dynamically evaluates sample quality to distinguish clean samples from noisy ones and handles noise via reverse learning, Prior-guided Global Label Calibration (PGLC) rectifies corrupted annotations for refined supervision, and Confidence-driven Selective Imputation (CSI) recovers missing modalities from a cross-modal memory bank while filtering unreliable imputations with an increasing threshold. To the best of our knowledge, this is the first framework to jointly tackle the dual challenges of modality incompleteness and label noise in the CMR community. Extensive experiments on four widely used benchmark datasets demonstrate that SPIRN outperforms 11 state-of-the-art methods in various scenarios involving both missing modalities and noisy labels.
72. 【2611.06105】XuanJian-DINOSAR: A SAR Foundation Model Based on Global and Local Semantic Consistency
链接：https://arxiv.org/abs/2611.06105
作者：Chunxiao Wu,Huixin Huang,Jialei Pan,Qiang Liang,Tao Wu,Cheng Wu,Long Huang,Yuanji Li,Qiang Cheng,Aifang Liu,Linghao Xia,Rui Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：imagery enables transferable, synthetic aperture radar, optical-SAR domain gap, enables transferable representations, speckle perturbations limit
备注：
点击查看摘要
Abstract:Self-supervised pre-training on synthetic aperture radar (SAR) imagery enables transferable representations, but the optical-SAR domain gap and speckle perturbations limit representation stability. Most SAR foundation models use masked image modeling (MIM) through pixel reconstruction or structural feature prediction, which is sensitive to speckle or relies on predefined operators. Joint modeling of cross-view semantics and perturbation stability at corresponding spatial locations remains underexplored. We propose XuanJian-DINOSAR, a SAR foundation model based on global and local semantic consistency. We curate over 360K publicly available SAR target chips, detection images, and scene images spanning diverse targets, scenes, and sensors, and adapt an optically pre-trained DINOv2 model to SAR through self-supervised learning. The framework combines DINO global semantic self-distillation, iBOT local masked modeling, and KoLeo feature-distribution regularization to learn globally discriminative and locally structure-aware representations. We introduce a local semantic consistency branch tailored to SAR intensity statistics and coherent imaging characteristics. Shared geometric transformations produce spatially aligned teacher weak views and student strong views. Intensity transformations and Gamma multiplicative speckle perturbations are applied to student views, while a cosine consistency loss aligns patch tokens at corresponding locations, promoting stability under radiometric perturbations. This objective complements the cross-region and cross-scale semantic consistency of DINOv2 multi-crop training, jointly enforcing global and local semantic consistency. Experiments on multiple downstream classification and detection datasets demonstrate state-of-the-art performance on most evaluation metrics, validating the generality and transferability of the learned representations.
73. 【2611.06096】Many Pixels, One Composition: Self-Supervised Spectra for Specimen-Level Prediction
链接：https://arxiv.org/abs/2611.06096
作者：Eleftheria Tetoula-Tsonga,George Arvanitakis,Theodoros Giannakas
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Earth surface, physical specimens found, composition of physical, Earth, elemental composition
备注：
点击查看摘要
Abstract:Can hyperspectral (HS) imaging be used to predict the elemental composition of physical specimens found on the Earth's surface? We approach this problem as a supervised regression task, using an open dataset of specimens, each comprising a HS cube and elemental characterization. In particular, we train an encoder in a self-supervised fashion that operates on pixel-level; then freeze the encoder and train a lightweight attention-based regression head in a supervised manner, by pairing many representations of a given specimen with its corresponding elemental label. In test specimens, our approach significantly outperforms traditional spectral matching and unmixing baselines. It also outperforms supervised learning models based on the mean spectrum (of similar model capacity), while full model fine-tuning achieves the strongest performance, at substantially higher model capacity.
74. 【2611.06093】Drift-adaptive Representation Preservation for Domain-Incremental Learning
链接：https://arxiv.org/abs/2611.06093
作者：Hyunmin Kong,Gyutae Oh,Jitae Shin
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Pretrained vision models, vision models provide, Pretrained vision, Domain-Incremental Learning, provide strong general-purpose
备注： Accepted to ACCV 2026
点击查看摘要
Abstract:Pretrained vision models provide strong general-purpose representations, but in Domain-Incremental Learning (DIL), where the input distribution changes sequentially, adapting to new domains often degrades performance on previously learned ones. We observe that forgetting is not uniform across domains and classes and is not explained by training order alone. This motivates us to track each past domain-class concept individually. We use representation drift, defined as the deviation of a past concept's current representation from a fixed anchor, as a measurable surrogate for forgetting risk. The measured drift then serves two complementary roles. A consolidation loss assigns stronger preservation to high-drift pairs, while prototype construction down-weights highly drifted domains to reduce their influence on the class reference. Preservation is thus allocated by measured drift rather than assumed importance. To obtain this signal during training without storing past raw data, we repurpose a Joint-Embedding Predictive Architecture (JEPA). For each domain-class pair, we store only a compact context summary in the backbone feature space and rerun it through the learned context-to-target relation to measure its drift from the fixed anchor. Across DomainNet, Office-Home, CORe50, and CDDB-Hard, our method sustains a strong accuracy-forgetting balance on every benchmark, using substantially less training memory than accuracy-competitive methods and the smallest storage among compared methods.
75. 【2611.06089】STARE: Scene Text-Aware multimodal Retrieval for Everyday objects
链接：https://arxiv.org/abs/2611.06089
作者：Kento Tokura,Ryosuke Korekata,Daichi Yashima,Kei Katsumata,Kanon Amemiya,Miyu Goko,Komei Sugiura
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：everyday objects based, transport everyday objects, scene text, visual features, Crosslingual Visual Prompt
备注： ACCV 2026 MM4SciReal Workshop
点击查看摘要
Abstract:In this study, we focus on service robots that retrieve and transport everyday objects based on free-form instructions that may refer to visual features and scene text. This is challenging because it requires a multimodal understanding of the visual features and spatial relationships of objects, as well as scene text embedded in the environment. To address this, we propose Scene Text-Aware multimodal Retrieval for Everyday objects (STARE), which leverages visual and textual cues in response to free-form instructions. STARE introduces Crosslingual Visual Prompt to enhance scene text interpretation, and models the complex relationships between named entities in the instructions and their corresponding objects. We evaluate STARE using two novel benchmarks, GoGetIt and TextCaps-test, both of which consist of real-world indoor/outdoor images and instructions involving object manipulation and navigation. The results show that STARE outperforms all baseline methods on standard multimodal retrieval metrics. Furthermore, in physical experiments conducted under a zero-shot transfer setting, STARE achieves an overall success rate of 80%. Our project page and code are provided in the Supplementary Materials.
76. 【2611.06085】GeoBiaset: A Counterfactual Benchmark for Demographic Bias in World-Level Geolocalization
链接：https://arxiv.org/abs/2611.06085
作者：Niccolò Niccoli,Silvia Dani,Marco Mistretta,Andrew D. Bagdanov,Marco Bertini,Lorenzo Seidenari
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：increasingly important task, remain poorly understood, World-level image geolocalization, current models remain, models remain poorly
备注： Accepted at Neurips 2026, ED track. Project page: [this https URL](https://miccunifi.github.io/GeoBiaset/)
点击查看摘要
Abstract:World-level image geolocalization is an increasingly important task, yet the biases of current models remain poorly understood. Prior work has identified coarse dataset imbalances noting, for instance, that some cities are absent from training sets and that models tend to perform better in wealthier regions. However, no one has yet examined which visual cues drive these disparities. To do so, we introduce GeoBiaset, the first benchmark designed to measure how geolocalization models are influenced by the apparent race of a person inserted into the image foreground. The dataset consists of 9,541 images, pairing existing geotagged background images with counterfactual edits spanning seven races, holding the ground-truth coordinates fixed. Controlled masking experiments show that occlusion and background drift do not fully explain geolocalization degradation. Alongside the benchmark, we introduce the Person-Origin Perturbation Indicators (POPI), novel metrics that quantify model resilience to these demographic perturbations by measuring whether predictions are pulled toward the region associated with the inserted group. Our evaluation of state-of-the-art geolocalization and multimodal large language models reveals a 16-47% drop in continent-level performance when a subject from a demographically mismatched group is inserted. A landmark versus no-landmark analysis and gradient-weighted heatmaps show that models preferentially attend to geographic landmarks when present, but shift attention to facial features in their absence.
77. 【2611.06083】SleuthVLM: Do We Really Need Audio-in-Video for Omni Video Understanding?
链接：https://arxiv.org/abs/2611.06083
作者：Peiran Wu,Fangfei Gou,Zhaoxi Mu,Changhao Zhang,Jian Liu,Weiqiang Wang,Yuntao Wang,Yuanchun Shi,Junxiao Shen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：jointly processing sampled, processing sampled frames, progress driven largely, models answer questions, scaling model size
备注：
点击查看摘要
Abstract:Omni models answer questions about videos by jointly processing sampled frames and audio in one turn, with progress driven largely by scaling model size and omni training data. We ask whether a model needs to hear the audio directly at all, and present SleuthVLM, an agent harness built on a VLM that never hears the audio directly: speech will be transcribed into text, and the VLM will sleuth the video on its own without any predefined workflow. On four omni benchmarks with videos up to 90 minutes, SleuthVLM achieves the best average accuracy: \textbf{75.0%}, 2.6 points above Gemini 3.8 Flash, and it also tops the Video-MME-v2 leaderboard with \textbf{77.8%}; with an open-source 27B VLM, it beats all open-source omni models. We draw three findings: SleuthVLM beats a model that glances; hearing is not the bottleneck, agentic ability is; omni understanding needs better agentic ability, not just more omni data for modality alignment. So we provide a simple but effective starting point for doing omni video understanding. Omni understanding needs better agents, not just bigger models that hear.
78. 【2611.06070】RouTex: Multi-reference 3D Texture Generation by Reprogramming Rotary Position Encoding
链接：https://arxiv.org/abs/2611.06070
作者：Chengyang Li,Yang Liu,Jiale Zhang,Qiang Rao,Wei Zhang,Taicheng Huang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：remains largely under-explored, images remains largely, resolving surface ambiguity, conditioning texture synthesis, Rotary Position Encoding
备注：
点击查看摘要
Abstract:While single-image 3D texture generation has advanced significantly, conditioning texture synthesis on multi-view reference images remains largely under-explored, despite its necessity for resolving surface ambiguity in unobserved regions. In this paper, we propose RouTex, a novel multi-reference 3D texture generation framework based on in-context Diffusion Transformers (DiT). Our key insight is that native 3D Rotary Position Encoding (RoPE) inherently possesses spatial addressing capabilities. We introduce Positional Routing (PR) to reprogram 3D RoPE along spatial and semantic dimensions, establishing explicit reference-to-view correspondence without introducing additional parameters. To execute this routing efficiently, Dual-Granularity Attention (DGA) combines per-view local attention for fine texture fidelity with global joint attention over deduplicated references for cross-view consistency. Extensive experiments demonstrate that RouTex achieves new state-of-the-art performance in multi-reference 3D texture generation.
79. 【2611.06061】ouchéWorld tech report : Towards Online Unified Camera--Hand Exploration in Generative Worlds
链接：https://arxiv.org/abs/2611.06061
作者：Jiaao Yu,Yanjian Zhang,Haoyang Jiang,Guillaume Wisniewski,Nadi Tomeh,Shijie Jia
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Recent video world, explore generated environments, Recent video, Recent, camera navigation
备注：
点击查看摘要
Abstract:Recent video world models allow users to explore generated environments through camera navigation. Continuous hand motion provides a fine-grained action channel for interacting with the people and objects encountered during exploration. We present TouchéWorld, a framework that integrates gesture-driven interaction into a camera-controlled video world model. Given an initial image and a scene-description prompt, the model generates video conditioned on temporally aligned camera and hand controls. We construct joint camera--hand training data from heterogeneous egocentric videos through annotation completion, consistency-based filtering, and temporal alignment. Building on a pretrained camera-controlled world model, we combine spatial hand-skeleton conditioning with numerical hand-motion features through parameter-efficient adaptation. Causal adaptation and few-step distillation support chunk-level online generation, allowing users to update their controls based on generated visual feedback. We further introduce TouchéBench to evaluate hand-motion following, camera--hand coordination, online interaction, and object response. Together, these components establish a framework for studying continuous exploration and hand-driven interaction within generative worlds.
80. 【2611.06048】SVGFaith: A Two-Layer Meta-Evaluation of Faithfulness Metrics for Text-to-SVG Generation
链接：https://arxiv.org/abs/2611.06048
作者：Guotao Liang,Haitao Zhou,Biao Liu,Huanxuan Liao,Lingfeng Qiao,Qian-Wen Zhang,Qian Yu,Di Yin,Xing Sun
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：faithfulness remains unclear, capture fine-grained prompt, fine-grained prompt faithfulness, prompt faithfulness remains, applying raster-image metrics
备注： 27 pages
点击查看摘要
Abstract:Text-to-SVG systems are commonly evaluated by applying raster-image metrics to rasterised outputs, yet whether these scores capture fine-grained prompt faithfulness remains unclear. We introduce SVGFaith, a two-layer meta-evaluation framework in which the more faithful candidate of each pair is determined by construction or by human judgment. SVGFaith-Diagnostic contains 1,842 controlled contrastive pairs across eight capability axes, split evenly between two directions: two renderings compared against one prompt, and two descriptions compared against one rendering. SVGFaith-Arena contains 1,327 human-annotated comparisons of real generator outputs. On SVGFaith-Diagnostic, CLIP and three other image--text embedding metrics reach at least 0.789 pairwise accuracy on object identity but at most 0.672 on spatial relations and attribute binding, where chance is 0.5. We further introduce SVGFaith-Score, an interpretable pointwise metric. A domain-tuned decomposer turns each prompt into a dependency graph of atomic visual requirements, a visual question answering model scores whether each requirement is satisfied, and a requirement's score is discounted when its prerequisites score low. In addition to the overall score, the per-requirement scores show which requirements are judged unsatisfied and which inherit discounts from their prerequisites. SVGFaith-Score significantly outperforms all nine baselines, including a Qwen3.5-122B-A10B judge, on Arena and in both Diagnostic directions. Code and data: this https URL.
81. 【2611.06047】RI-Prune: Relation and Information Aware Visual Token Pruning for Multi-Image Vision-Language Models
链接：https://arxiv.org/abs/2611.06047
作者：Dongjin Lee,Eunju Lee,Jinhee Jang,Yoonji Lee,Youngbin Kim
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Large vision-language models, Large vision-language, extension dramatically increases, making visual-token pruning, vision-language models
备注： Accepted to CIKM 2026 Oral
点击查看摘要
Abstract:Large vision-language models (LVLMs) have recently been extended to handle multiple input images, but this extension dramatically increases the visual token budget, making visual-token pruning not merely an efficiency option but a practical necessity. Existing visual-token pruning methods, primarily designed for the single-image setting, rely on attention-derived saliency signals to estimate per-token importance. However, this attention-centric design transfers poorly to the multi-image regime: it causes substantial performance degradation on multi-image benchmarks, suffers from strong positional bias, and loses discriminative attention signals as the number of input images increases. To test whether attention-selected tokens are truly important for multi-image reasoning, we conduct two complementary causal probes Leave-One-In and Leave-One-Deletion, which measure token importance by restoring individual tokens to a zeroed visual sequence or removing them from the full sequence. Attention-based pruners provide only marginal gains over random selection, showing that attention is a weak proxy for visual-token importance in multi-image reasoning. Motivated by this gap, we propose Relation and Information Aware Pruning (RI-Prune), a training-free, attention-free pre-decoder selector for multi-image visual token pruning. RI-Prune scores each visual token using a z-normalized combination of three signals computed from projector outputs: query relevance, cross-image correspondence with compact per-image prototypes, and intra image representativeness. By integrating these signals, RI-Prune performs balanced per-image Top-K selection to preserve information across input images. Across multiple multi-image benchmarks and three LVLM backbones, RI-Prune achieves a stronger trade-off between token reduction and task performance than prior pruning methods, particularly under aggressive token budgets.
82. 【2611.06046】DeepfakeGenome: Toward Next-Generation Deepfake Attribution
链接：https://arxiv.org/abs/2611.06046
作者：Shunli Wang,Xinyu Zhou,Yandan Zhao,Wenbin Liang,Taiping Yao,Ke-Yue Zhang,Zhiyuan Yan,Shouhong Ding,Lizhuang Ma
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：posing severe threats, generating hyper-realistic forged, AIGC technologies, facial security safety, hyper-realistic forged facial
备注： 28 Pages
点击查看摘要
Abstract:In recent years, AIGC technologies are capable of generating hyper-realistic forged facial images, posing severe threats to facial security safety. To tackle these challenges, early Deepfake research primarily centered on real-fake classification. Recently, growing efforts have been devoted to the Deepfake Attribution (DFA) of generated content. Nevertheless, existing research on Deepfake detection and attribution faces saturated performance in binary classification, limited diversity in datasets and algorithms, and imperfect evaluation protocols, which severely impede practical application. To address these limitations, we propose a comprehensive deepfake detection and attribution benchmark named DeepfakeGenome (DFG). It contains 100 facial forgery algorithms and 2M images in total, achieving 4x to 100x larger than prior DFA benchmarks. We further design 4 protocols for practical evaluation, including a novel retrieval-based attribution paradigm. Unlike previous open-set evaluation metrics, the proposed retrieval metrics are more aligned with the real-world active defense situation of blacklist registration mechanisms. Based on these elaborate designs, we investigate the performance ceiling of deepfake attribution task. Over 2k experimental evaluations are conducted, and 10 insightful findings are derived. We believe this work can provide new insights into the DFA research field. The Code and Benchmark of DFG are avaliable on this https URL.
83. 【2611.06042】UniRestorer++: Scalable Universal Image Restoration with Multi-Granularity Degradation Modeling
链接：https://arxiv.org/abs/2611.06042
作者：Jingbo Lin,Zhilu Zhang,Fan Li,Renjing Pei,Wenbo Li,Hang Xu,Hongzhi Zhang,Wangmeng Zuo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：strategy remains underexplored, Universal image restoration, handle diverse degradations, reliable scaling strategy, scaling strategy remains
备注：
点击查看摘要
Abstract:Universal image restoration aims to handle diverse degradations within a single model, but a reliable scaling strategy remains underexplored. Increasing backbone depth and width can lead to performance saturation, while degradation-aware specialization depends on accurate degradation estimation and is vulnerable to errors on out-of-distribution and real-world inputs. We propose UniRestorer++, a scalable framework based on multi-granularity degradation modeling. It progressively refines degradation groups and introduces group-specific experts, coupling capacity growth with specialization. Degradation-estimation-based routing selects a root-to-leaf path, while granularity-estimation-based routing chooses a level along that path to balance specialization and robustness. Spatially dense degradation representation maps further enable region-aware routing for spatially non-uniform corruptions. We develop CDD-50, a benchmark covering 50 degradation categories from single to penta-degradation. Experiments show approximately log-linear PSNR trends over the evaluated model-size range and stronger scaling gains on out-of-distribution and real-world data than vanilla MoE scaling. UniRestorer++ achieves state-of-the-art performance across benchmarks and demonstrates zero-shot generalization and few-shot transfer on real-world images. Code: this https URL
84. 【2611.06040】USI-Brain: Enhancing Underwater Spatial Intelligence via Spatial Data-Driven Vision-Language Modeling
链接：https://arxiv.org/abs/2611.06040
作者：Zhiliang Zhu,Zhiqiang Zhao,Xie'an Jiang,Yingxin Lai,Kangye Zheng,Dawei Zhao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：spatial reasoning depends, Underwater spatial reasoning, color distortion, Underwater Prior-guided Rectifier, obscured by scattering
备注： 13 pages, 4 figures, 10 tables
点击查看摘要
Abstract:Underwater spatial reasoning depends on object boundaries and geometric cues that are obscured by scattering, color distortion, and low visibility. Existing underwater resources capture these cues through images, annotations, and depth maps, but provide fragmented supervision for vision-language models. We present a spatial data engine that connects visual appearance with object-level geometry through enhancement, 2D and geometry-assisted question generation, and expert filtering. It produces 4.27M QA pairs across five capability groups. We use this corpus to train USI-Brain and introduce an Underwater Prior-guided Rectifier (UPR) that applies gated corrections to visual features. USI-Bench evaluates the resulting capabilities with 6,525 held-out QA pairs. On its 15 task metrics, USI-Brain and USI-Brain + UPR improve over Qwen3-VL-8B-Instruct by 5.76 and 7.63 points on average, respectively, using signed differences on 100-point scales. Ablations show that geometry-assisted supervision improves depth and ordering by 4.8 and 6.1 points with UPR disabled, while UPR adds 18.0 points in scene description under matched training data. Both variants use raw images at evaluation. Across NautData, UWBench, and MarineEval, USI-Brain achieves the best or joint-best score on 28 of 32 metrics. Model weights and USI-Bench will be released at this https URL.
85. 【2611.06020】METRIC-GS: Selective Metric-Scale Estimation for 3D Gaussian Splatting
链接：https://arxiv.org/abs/2611.06020
作者：Sooyeun Yang,Jongseong Brad Choi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：inherits arbitrary units, reconstruction inherits arbitrary, Gaussian Splatting, inherits arbitrary, arbitrary units
备注：
点击查看摘要
Abstract:A 3D Gaussian Splatting (3DGS) reconstruction inherits arbitrary units from structure-from-motion, so it cannot be measured or used to place AR content until someone supplies a scale. Both standard recipes are fragile on real captures: on five indoor scenes with tape-measured ceilings, a quantile floor-to-ceiling heuristic errs by 27% and metric-depth alignment by 35-71% across three networks. We present METRIC-GS, a selective scale estimator for real indoor photographs: it reads the scale off the reconstruction's own semantic content and, just as importantly, refuses when the evidence is thin. A frozen 2D teacher labels Gaussians by visibility-aware voting; instance-level size priors for architectural and furniture classes (doors, tables, the floor-to-ceiling gap) are fused by a robust maximum-likelihood step; and an inlier-mass test turns thin evidence into an explicit abstention that doubles as a router to a heavyweight metric model. On 47 ScanNet++ scenes with laser ground truth, with a configuration frozen before public evaluation, the estimator alone cuts the heuristic's mean error from 21.1% to 16.6% (9.3% on the 28 scenes it acts on) at ~11 s per scene. MASt3R remains the more accurate standalone estimator (9.9%), but routing only our refusals to it matches running it everywhere with 60% fewer invocations; this selective hybrid is the configuration we advocate. Visibility-aware voting raises the scenes the estimator can act on from 16 to 28 at unchanged deployed accuracy. Applied unchanged to 13 phone and drone captures of our own, on which MASt3R fails its own registration gate 12 times, the system improves all five captures it acts on and degrades none. We also report that a current feed-forward metric model scores 2.3% on a benchmark inside its training mixture and 28-35% on captures it has never seen: a published metric-scale number is a best case, not a deployment estimate.
86. 【2611.06015】ChanSFormer: A Channel Agnostic Vision Transformer for Multi-Channel Cell Painting Images
链接：https://arxiv.org/abs/2611.06015
作者：Jingwei Zhang,Srinivasan Sivanandan,Dimitris Samaras
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Cell Painting assays, Cell Painting, High-content multi-channel imaging, modern scientific pipelines, Painting assays
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:High-content multi-channel imaging, from Cell Painting assays to remote sensing, is central to modern scientific pipelines. Because these channels are highly heterogeneous and experimental configurations frequently evolve, a practical vision backbone must be fundamentally channel-agnostic. Current channel-adaptive vision transformers rely on global self-attention with learnable channel embeddings, which can be computed only for previously known channels. Attempts to overcome this limitation of new channels either discard the embeddings, losing channel identity, or process each channel independently, thereby eliminating critical cross-channel interactions. To address this, we introduce ChanSFormer, an efficient Vision Transformer that replaces rigid embeddings with disentangled spatial-channel attention and individual channel CLS tokens. This architecture natively preserves both distinct channel identities and cross-channel information flow. Furthermore, the individual channel class token design unlocks more informative feature representations for self-supervised learning and enables representation-based channel sampling while remaining channel-agnostic. We evaluate ChanSFormer on two biology multi-channel datasets, CHAMMI, JUMP-CP and a satellite dataset, So2Sat. Experimental results show that ChanSFormer outperforms state-of-the-art methods by 3.93%-4.27% on JUMP-CP in classification accuracy. It also demonstrates exceptional cross-dataset transferability under a self-supervised setting, outperforming previous methods by up to 2.72% in accuracy in the same classification tasks. Furthermore, the disentangled attention reduces the quadratic complexity of channel-by-spatial sequence length of the global attention baseline, thus improving throughput by 55%-313%. Code is available at this https URL.
87. 【2611.06007】MotoVerse: A Benchmark for Predictive Perception of Motorized Two-Wheelers in Dense Unstructured Traffic
链接：https://arxiv.org/abs/2611.06007
作者：Varun A. Paturkar,Shankar Gangisetty,C.V. Jawahar
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Global South, dominate personal transport, driving and ADAS, predictive perception research, Motorized Two-Wheelers
备注：
点击查看摘要
Abstract:Motorized Two-Wheelers (MTWs) dominate personal transport across much of the Global South, yet remain largely overlooked in predictive perception research for autonomous driving and ADAS. We introduce MotoVerse, a benchmark for predictive perception from an MTW's ego-centric perspective. MotoVerse comprises 949 maneuver clips collected in dense, unstructured traffic and trajectory annotations for over 31,000 surrounding road agents, including over 16,000 MTWs, enabling two complementary tasks: Ego-Rider Maneuver Anticipation (ERMA) and Traffic Agent Trajectory Prediction (TATP). Each clip is further annotated with an MTW-specific challenge taxonomy comprising dynamic ego-motion, weak traffic structure and contextual occlusion, enabling challenge-aware evaluation. We benchmark established conventional prediction models, general-purpose Vision-Language Models (VLMs), driving-specific VLMs and vision-language-action models. Our experiments reveal three key insights: (i) video backbones reach most of their full-observation accuracy from the first fifth of a maneuver, whereas zero-shot VLMs need most of the maneuver to be observed; (ii) zero-shot VLMs, whether general-purpose or driving-specific, largely remain close to simple baselines on both tasks; a preliminary LoRA study shows that adaptation lifts anticipation sharply but leaves trajectory prediction behind conventional models; and (iii) the rider's own motion drives forecasting difficulty: for every model, including a static baseline, errors are highest during left turns and rise under dynamic ego-motion. We believe MotoVerse will serve as a challenging benchmark for safer and more robust predictive AI for intelligent two-wheelers. The dataset and evaluation code are publicly available at this https URL.
88. 【2611.06000】Intra-Architecture Source Attribution for Stable Diffusion: A New Task with Benchmark Dataset and Baseline
链接：https://arxiv.org/abs/2611.06000
作者：Ashutosh Dayal,Mallika Garg,Debashis Sen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Designing systems, stable diffusion, Intra-Architecture source Attribution, source attribution, image source attribution
备注： Accepted at IEEE/CVF Winter Conference on Applications of Computer Vision(WACV 2027)
点击查看摘要
Abstract:Designing systems that attribute a generated image to its source model has lately become a major area of AI research. Most existing datasets and systems related to image source attribution are targeted towards the detection of architectural signatures of the source models. Distinct from this, focusing on stable diffusion, we introduce a novel task, IntrAA-SD, Intra-Architecture source Attribution for Stable Diffusion, where the source models to be differentiated share the same architectural backbone and differ only due to fine-tuning. The proposed task aligns with the emergence of fine-tuned generators having the same architecture, like Juggernaut XL and RealVis XL, which are fine-tuned versions of Stable Diffusion XL (SDXL). We provide a first-of-its-kind $140$K-image benchmark dataset containing images generated from different fine-tunes of SDXL, along with in-domain and out-of-distribution prompts. We also provide a baseline framework for IntrAA-SD, which leverages a style-conditioned Mixture-of-Experts network. It uses a frozen CLIP backbone to capture the image style and gate the MoE, which processes fine-tuned trace features from a high-resolution LoRA-adapted DINOv2 network. The fine-tuned models used, the prompting strategies considered, and the formation details employed in the novel dataset are elaborated. Our baseline intra-architecture source attribution method is evaluated in terms of attribution accuracy on our dataset, and ablation studies are also performed. Code and dataset is available at this https URL.
89. 【2611.05994】FedIA: Instance-Aware Cross-Modal Representations for Federated Prompt Learning
链接：https://arxiv.org/abs/2611.05994
作者：Xuanjing Zhang,Qi Guo,Yanan Qiao,Yong Han,Junge Bo
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：pre-trained Vision-Language Models, Federated Prompt Learning, enables parameter-efficient adaptation, exchanging raw data, Vision-Language Models
备注：
点击查看摘要
Abstract:Federated Prompt Learning (FPL) enables parameter-efficient adaptation of pre-trained Vision-Language Models across decentralized clients without exchanging raw data. To cope with cross-client heterogeneity, existing FPL methods typically pair a globally shared prompt with a client-specific local prompt. However, this design personalizes only at the client level: the same local prompt is applied to all samples of a client, and the global and local prompts are combined in an input-agnostic, fixed manner. Consequently, it overlooks the substantial visual variations among samples within the same client and cannot adjust the balance between shared and personalized knowledge to each input. To address these limitations, we propose Federated Prompt Learning with Instance-Aware Cross-Modal Representations (FedIA), an FPL framework that learns instance-aware cross-modal representations. Specifically, FedIA first uses global text prompts as client-invariant semantic anchors to select image patches most relevant to each candidate class, suppressing distracting regions. The selected visual evidence then conditions the generation of instance-aware local text representations. Finally, an adaptive global-local fusion module calibrates the contributions of local and global text representations for each image-class pair. In this way, FedIA shifts personalization in FPL from the client level to the instance level while preserving the semantic knowledge shared across clients. Extensive experiments under domain shift, pathological label skew, and Dirichlet-based label skew show that FedIA outperforms FPL baselines, with maximum accuracy gains of 1.44\%-4.37\% over the latest baseline across the three settings. Ablation studies and analyses further verify the complementary contributions of instance-aware representation generation and adaptive global-local fusion.
90. 【2611.05992】Clips2Story: Training-Free Video Storyboarding and Editing Using Multimodal Retrieval-Embedded Generation
链接：https://arxiv.org/abs/2611.05992
作者：Junnuo Wang,Weihan Xu,Hao-Wen Dong
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM)
关键词：editors often work, work with large, large collections, collections of fragmented, fragmented footage
备注：
点击查看摘要
Abstract:Video editors often work with large collections of fragmented footage and must select and organize relevant clips into a coherent story. However, many existing video editing and summarization methods assume a temporally ordered source video and aim to preserve its original narrative and temporal structure. In this paper, we introduce Clips2Story, a training-free, LLM-based pipeline that enables users to create keyword-specified short videos from a pool of video clips. Given a pool of clips and a user-specified keyword, we first extract text-based multimodal descriptors for each clip and retrieve the clips most relevant to the keyword. We then provide the textual descriptors of these candidate clips to an LLM, which selects and arranges them into an editable storyboard with connective narrations. Finally, we assemble the selected clips and retrieve accompanying visuals for the narrations to compose the output video. To evaluate the proposed pipeline, we construct a synthetic evaluation dataset from 100 long-form videos across five genres by segmenting each video into short clips using a scene-change detection model and shuffling the resulting clips to remove their temporal order. Through objective evaluation and qualitative examples, we demonstrate that Clips2Story can effectively retrieve keyword-relevant clips and compose coherent storyboards based on user-specified keywords. Human evaluation further shows that Clips2Story outperforms a strong baseline in terms of narrative coherence, keyword alignment, and overall realism.
91. 【2611.05974】PathoS2VD: From 2D Histopathology to Pseudo Z-Stack Representations
链接：https://arxiv.org/abs/2611.05974
作者：Jiamu Wang,Keunho Byeon,Ji-Uk Kim,Jin Tae Kwak,Heounjeong Go
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：exhibiting inherently three-dimensional, biological tissues exhibiting, tissues exhibiting inherently, thin two-dimensional, inherently three-dimensional
备注： Pre-review version. Accepted at ACCV 2026
点击查看摘要
Abstract:For decades, diagnostic pathology has relied on thin two-dimensional (2D) tissue sections, despite biological tissues exhibiting inherently three-dimensional (3D) morphological organization. Because a single section captures only one focal plane, important morphological cues along the z-axis are inevitably discarded, limiting tissue representation for both human interpretation and computational analysis. In this work, we propose a generative framework that learns z-axis morphological priors from pathology z-stack data, offering a cost-effective alternative to dedicated volumetric imaging, and transfers this knowledge to conventional single-plane histopathology. Specifically, an image-to-video (I2V) latent diffusion model (LDM) is trained to synthesize a pseudo z-stack from a single 2D image, capturing plausible morphological variations across adjacent focal planes rather than reconstructing physical tissue volumes. To enable deployment on large-scale clinical datasets without native z-stack acquisition, we further introduce a prior-preserving mixture fine-tuning strategy that adapts the model to new domains while retaining the learned z-axis morphological prior. Extensive experiments demonstrate that the synthesized pseudo z-stacks exhibit realistic cross-plane morphological continuity and consistently improve downstream prostate cancer classification compared with conventional 2D representations. Our results suggest that learning transferable z-axis priors from limited z-stack data provides a practical way to enrich routine pathology images with complementary morphological information. Code: this https URL.
92. 【2611.05969】CLEAR: Color-Texture Latent Alignment for Single Image Reflection Removal
链接：https://arxiv.org/abs/2611.05969
作者：Tu Vo,Sheir A. Zaheer,Chan Y. Park
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：Image Reflection Removal, Single Image Reflection, captured through glass, Reflection Removal, Single Image
备注： Accepted to WACV 2027
点击查看摘要
Abstract:Single Image Reflection Removal (SIRR) seeks to recover the transmitted scene from a photograph captured through glass. Recent latent restoration methods use pretrained generative priors, but many recover detail by feeding high-frequency features from the degraded input back into the decoder. This works for degradations such as blur, noise, or haze, where input detail mostly belongs to the scene. It is less suitable for SIRR, where reflections add a second structured layer: directly reusing the input's skip connections can sharpen the image while also bringing reflection edges back. Latent compression also introduces color drift and fine-detail loss. We propose CLEAR (Color-Texture LatEnt Alignment for Single Image Reflection Removal), a deterministic, single-timestep, non-iterative latent framework that uses a pretrained latent diffusion backbone as a natural-image prior. A physics-guided separator organizes the prediction around the transmission, reflection, and residue formation model and outputs coarse layer latents in one forward pass. The Hybrid Feature Alignment Module (HFAM) then treats input-derived skips as contaminated layer-mixture features. It rectifies their high-frequency content with a clean-transmission-aligned color query, learned from the input features themselves under ground-truth feature supervision, keeping transmission-consistent texture while attenuating reflection-colored detail. CLEAR achieves the best average across fidelity and perceptual metrics on six real-world benchmarks and the lowest LPIPS on every dataset, with the largest gains on the hardest benchmarks.
Comments:
Accepted to WACV 2027
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
Cite as:
arXiv:2611.05969 [cs.CV]
(or
arXiv:2611.05969v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2611.05969
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
93. 【2611.05945】FLINT: Coupling Proximal Initialization and Bounded Stochasticity for Flow-Matching Inverse Problems
链接：https://arxiv.org/abs/2611.05945
作者：Junseo Bang,Daewon Choi,Dong Ju Mun,Se Young Chun
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Flow matching models, Flow matching, generative posterior sampling, matching models, models have emerged
备注： NeurIPS 2026, Project Page: [this https URL](https://junseo88.github.io/FLINT/)
点击查看摘要
Abstract:Flow matching models have emerged as a dominant paradigm for generative posterior sampling in imaging inverse problems. Existing solvers follow two distinct lines of work: trajectory-space methods, which refine sampling dynamics from random initial noise, and source-space methods, which optimize the initial noise itself. While most prior work treats these as independent design choices, we show that they are inherently coupled. We derive a unified stability bound that links initialization proximity and cumulative sampling stochasticity through a multiplicative envelope, complemented by two empirical observations. First, we identify a sufficiency regime in which a moderately optimized proximal source initialization is enough to attain the performance plateau, rendering exhaustive source-space optimization unnecessary. Second, this initial advantage is fragile: it is eroded by excessive stochasticity accumulation during guided sampling, necessitating a mechanism that bounds the cumulative noise injection. These findings motivate FLINT, a two-stage framework that operationalizes this coupling. FLINT establishes a high-fidelity starting point via a manifold-constrained proximal objective in only a few iterations, then performs guided sampling under a bounded stochasticity schedule that helps prevent erasure of the initialization advantage. Across diverse inverse problems, FLINT delivers state of the art perceptual quality and competitive distortion metrics while maintaining superior computational efficiency.
94. 【2611.05927】Modality-Aware Expert Pruning for MoE-Based Multimodal Large Language Models
链接：https://arxiv.org/abs/2611.05927
作者：Donggeun Kim
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：scale capacity efficiently, enables multimodal large, expert parameters dominate, parameters dominate memory, capacity efficiently
备注： NeurIPS 2026
点击查看摘要
Abstract:Mixture-of-Experts (MoE) enables multimodal large language models (MLLMs) to scale capacity efficiently, but expert parameters dominate memory even though only a few experts are activated per token: they account for over 90% of model size in modern MoE-MLLMs (e.g., 54 GB out of about 58 GB in BF16 for InternVL3.5-30B-A3B and Qwen3-VL-30B-A3B). Expert pruning has emerged as an effective compression strategy, but existing methods aggregate importance uniformly across tokens, ignoring that the same expert may serve different roles for vision versus language processing. To address this, we propose MAEP (Modality-Aware Expert Pruning), a training-free framework that decomposes expert importance by modality in a single forward pass. MAEP introduces (1) Delta-H Output ($\Delta H$), a redistribution-aware metric measuring the MoE output change when an expert is removed, and (2) low-attention vision tokens as a vision-side pruning signal that is dataset-stable: its expert-importance ranking remains stable across different datasets. Text-side importance serves as a preservation signal while vision-side importance serves as a pruning signal, and experts are ranked globally across layers. Experiments on three MoE-based MLLMs across multimodal and text benchmarks show that MAEP outperforms modality-agnostic baselines on the majority of multimodal benchmarks while remaining competitive on text-only tasks, reducing the BF16 expert weight footprint by about 27 GB (about 47% of total memory) so that the full weight footprint of an approximately 58 GB model fits within a single 40 GB GPU. Code is available at this https URL.
95. 【2611.05925】3D Banff Glomerulitis Scoring for Kidney Transplant Pathology: Feasibility Study for Volumetric Quantification
链接：https://arxiv.org/abs/2611.05925
作者：Yanfan Zhu,Junchao Zhu,Ruining Deng,Shilin Zhao,Yu Wang,Yaohong Wang,Yuechen Yang,Chongyu Qu,Zhengyi Lu,Juming Xiong,Mengmeng Yin,Yihan Wang,Andrew J. Rauch,Haichun Yang,Yuankai Huo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：inherently three-dimensional nature, Quantifying glomerular inflammation, single whole-slide sections, Quantifying glomerular, lesion distribution
备注：
点击查看摘要
Abstract:Quantifying glomerular inflammation in kidney-transplant biopsies is traditionally performed on single whole-slide sections using the Banff "most-severe section" rule, despite the inherently three-dimensional nature of lesion distribution. This 2D based assessment might lead to instability when inflammation varies across slices. This paper reports a feasibility study examining the technical feasibility and clinical relevance of extending Banff scoring into three dimensions. To this end, we propose a 3D Banff lesion-scoring framework that aligns serial sections, reconstructs glomerular identities across depth, and integrates inflammatory-cell counts in 3D under three scoring strategies: Compatible, Volumetric, and Deduplicated Volumetric. In the experiments, glomerulitis (g-scores) was used as an example Banff metric and applied to multi-section renal allograft biopsies. Our findings indicate that 3D Banff g-scores are more consistent across sections and, under the semi-automatic setting, the Volumetric strategy correlates more strongly with clinical biomarkers than traditional 2D scores. These results show that 3D volumetric quantification offers promising added value, underscoring the potential benefit of 3D-aware Banff scoring for kidney transplant pathology.
96. 【2611.05917】DecoupAttn: Decoupled Sparse Attention for Training-Free Acceleration of Video Diffusion
链接：https://arxiv.org/abs/2611.05917
作者：Yanjin Li,Bingbing Qiu,Qiang Huang,Rui Qian,Yanfeng Li,Jian Wang,Xiaoying Tang,Mingda Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：accelerates few-step video, few-step video diffusion, video diffusion transformers, attention accelerates few-step, Sparse attention accelerates
备注： 35 pages, 16 figures, 35 tables
点击查看摘要
Abstract:Sparse attention accelerates few-step video diffusion transformers by computing a few key blocks exactly and compensating for the rest. However, existing sparse attention still faces key challenges, including identification overhead from finding critical blocks at every denoising step, suboptimal budget allocation that sets sparsity budgets uniformly or by local metrics, and cross-step error accumulation as reused masks or clusters go stale. Observing that the errors left on skipped blocks cancel each other once every key is compensated, we propose DecoupAttn, a new paradigm of decoupled sparse attention: semantic clusters compensate every key, and exact attention corrects their error on a few blocks fixed once offline by position. To support this paradigm, we introduce Distortion Budget, a rate-distortion objective for budget allocation that places exact computation across timesteps, layers, and heads where it removes the most distortion that compensation leaves in the final latent. Built on this budget, we further propose Reassign Cache, in which each step reassigns the drifting keys to cached centroids and refreshes compensation while the budgeted blocks stay fixed. Moreover, DecoupAttn is training-free: a few calibration clips compile one plan offline, and inference runs standard block-sparse kernels with one fused compensation kernel. Our code will be released after submission.
97. 【2611.05909】Do Saliency Maps Fail Dense Breasts? A Chance-Normalized, Confounder-Aware Audit of Explanation Fairness in Mammography
链接：https://arxiv.org/abs/2611.05909
作者：Ahmed Jaheen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：offered as evidence, evidence that mammography, hide cancers, Integrated Gradients, dense breasts
备注：
点击查看摘要
Abstract:Saliency maps, offered as evidence that mammography classifiers use the cancer, are untested in dense breasts, which can hide cancers. We tested whether they locate cancers worse there, and why. On 1,345 malignant CBIS-DDSM views, we scored three CNNs' Grad-CAM, Integrated Gradients and occlusion maps by whether their peak hits the lesion and a chance-normalized lesion-to-background saliency ratio (bits; +1 doubles it). Unadjusted gaps were large: Grad-CAM peaks hit 44% of dense vs. 58% of non-dense lesions. Case mix, chiefly more calcifications in dense breasts, explained about half or more of each gap. Occlusion kept a significant average of -0.56 bit gap. Controls also implicate the classifiers: unadjusted gaps exceeded an image-only conspicuity map's, and models relied less on dense-breast lesions. We recommend reporting density gaps before and after case-mix adjustment, per classifier, with conspicuity and lesion-reliance controls.
98. 【2611.05893】Chronos: Sequential Identity-Preserving Video Generation by Temporal Anchoring
链接：https://arxiv.org/abs/2611.05893
作者：Mengqi Huang,Wenchuan Wang,Zhendong Mao,Yijing Tu,Zhike Liu,Luoni Wang,Ning Tong,Xiaoxiao Sheng,Tianyu Huang,Xuecheng Qi,Yongdong Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：Identity-preserving video generation, video generation aims, sequential action generation, aims to synthesize, synthesize high-quality
备注： Accepted by ACM MM 2026. 1st place in Tracks 1 and 2 of the ACM MM 2026 Identity-Preserving Video Generation Challenge
点击查看摘要
Abstract:Identity-preserving video generation aims to synthesize high-quality and visually realistic videos from textual and visual conditions while faithfully maintaining the subject's identity across diverse motions. Prior methods have extensively introduced reference-guided control signals and identity-aware conditioning to improve facial alignment from reference images. However, improving static identity alignment alone creates a fundamental tension between identity fidelity and temporal controllability, which frequently causes identity drift or motion suppression under large pose variations and multi-segment sequential actions. To address this, we propose Chronos, a framework that unifies single-segment facial identity preservation and multi-segment sequential action generation under a common temporal formulation. Specifically, Chronos integrates Semantic Prompt Anchoring to adaptively refine the user prompt, Visual Frame Anchoring to transform conditions into visually grounded keyframe anchors for visual guidance, and Metric-Guided Candidate Routing to select the highest-quality videos from heterogeneous generators via multi-dimensional evaluation. Extensive evaluations demonstrate the superiority of our approach, which achieved first place in both Track 1 and Track 2 of the ACM MM 2026 Identity-Preserving Video Generation Challenge, demonstrating its effectiveness across both facial identity preservation and sequential action generation settings.
99. 【2611.05874】Feature Puzzles: Single-Image Supervision for Multi-View 3D-Aware Segmentation
链接：https://arxiv.org/abs/2611.05874
作者：Jiahao Ma,Qiang Zhang,Miaomiao Liu,David Ahmedt-Aristizabal,Chuong Nguyen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：perception typically requires, large-scale monocular data., introduce Feature Puzzles, typically requires videos, Humans can easily
备注： Feed Forward 3D Reconstruction and Spatial Understanding, Multi-view Promptable Segmentation, Instance Tracking
点击查看摘要
Abstract:Humans can easily recognize the same objects across different viewpoints of a 3D scene, whereas teaching models such multi-view-consistent perception typically requires videos or calibrated multi-view captures, which are considerably more expensive and less diverse than large-scale monocular data.~In this paper, we introduce Feature Puzzles, a novel framework for learning multi-view-consistent segmentation using only single-image semantic segmentation supervision. Specifically, we propose a simple yet effective pipeline that constructs multi-view-consistent segmentation pseudo-labels through image cropping and geometric transformations. We further introduce a lightweight, plug-and-play network that leverages the multi-view-consistent image features learned by existing pretrained 3D foundation models and the generated pseudo-labels to perform multi-view-consistent segmentation. Importantly, our flexible framework supports various types of prompts provided from one or multiple views and can be readily extended to open-vocabulary 3D segmentation. Under this single-image supervision, our feed-forward model achieves the best mIoU on NVOS, remains competitive on SPIn-NeRF and ScanNet++ against baselines using per-scene optimization or in-domain multi-view training, and demonstrates zero-shot transfer to open-vocabulary 3D segmentation. Visual comparisons are available on our project page: this https URL
100. 【2611.05859】Generative AI for urban planning: synthesizing land-use maps with satellite imagery via DualControlNet
链接：https://arxiv.org/abs/2611.05859
作者：Qingqi Song,Yuzhou Chen,Lingqian Hu,Shenhao Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：facilitate scenario planning, characterize land-use patterns, models characterize land-use, land-use models characterize, scenario planning
备注：
点击查看摘要
Abstract:Various land-use models characterize land-use patterns and facilitate scenario planning. However, existing models are largely predictive, forecasting transitions based on numeric data without synthesizing new land-use maps from simple text prompts. Meanwhile, generative AI in urban systems remains unimodal, weakly controllable, and evaluated mostly by generic image quality rather than domain-specific metrics. To address these gaps, we introduce DualControlNet, a generative land-use model that jointly synthesizes high-resolution land-use maps and satellite imagery, addressing multimodality, controllability, and verification challenges. Trained on over 40,000 paired tiles from Orlando and Chicago, DualControlNet is evaluated using land-use, spatial consistency, and image quality metrics. Relative to unimodal baselines, DualControlNet improves land-use diversity consistency by 62.8% and building coverage ratio consistency by 16.3%, more than doubles cross-modal spatial consistency, and triples visual quality. Scenario-based experiments demonstrate that DualControlNet supports sustainable development through multidimensional controls, increasing density and diversity, and responding to text prompts like "high-density development." Overall, this work advances land-use modeling via a multimodal, controllable, and verifiable generative framework, lowering technical barriers and enabling intuitive exploration of urban futures.
101. 【2611.05851】Risk Control Certifies Rates, Not Magnitudes: An Audit of Selective Fetal Biometry
链接：https://arxiv.org/abs/2611.05851
作者：Zhengshuai Yang,Linna Jiang,Changyun Li,Guihu Zhao
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Prenatal ultrasound biometry, Prenatal ultrasound, head circumference, ultrasound biometry, return a head
备注： 10 pages, 2 figures, 3 tables
点击查看摘要
Abstract:Prenatal ultrasound biometry must return a head circumference (HC) and refuse when the image cannot support one. Selective prediction trades coverage against error, but its finite-sample guarantees bound the rate of gross errors, not their magnitude. We audit a tool-grounded biometry pipeline on two separately pre-registered four-way splits of the 999 labelled HC18 images, retraining the segmenter three times on each. Calibrating the contour-completeness threshold by exact Clopper-Pearson risk control returns a certificate indistinguishable from a hand-set floor, yet the pipeline still emits a 271.3 mm error: a small, geometrically complete ring fitted to an image whose true HC is 324.6 mm. The accepted candidate scores 0.94 completeness, so the score cannot see the failure, and one outlier among $\approx 150$ answers leaves the certified risk bound ($\alpha = 0.10$) intact. A second, untouched split reproduces the mechanism on a different image (233.3 mm). Constraining the admissibility region---the anatomical range in which the measurand is defined---removes the family instead: raising the lower bound from 50 to 55 mm costs 0.4 coverage points and cuts the worst-case error on both splits to 11.4 and 11.1 mm, whereas suppressing it through the completeness threshold costs 19.0 and 12.1 points. At an anatomically defined 70 mm the frozen tests give 1.91 and 1.81 mm MAE.
102. 【2611.05847】me-to-Goal: Learned Temporal Metrics for Long-Horizon Planning with JEPA World Models
链接：https://arxiv.org/abs/2611.05847
作者：Ruilong Yu,Fei Ye
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Joint-Embedding Predictive Architectures, Predictive Architectures, Joint-Embedding Predictive, comparing predicted latent, comparing predicted
备注： 10 pages, 6 figures
点击查看摘要
Abstract:Joint-Embedding Predictive Architectures (JEPAs) support planning by comparing predicted latent states with an encoded goal. For this comparison to guide temporal progress, states closer in time to the goal should receive lower costs. However, training representations for prediction and distribution regularization does not directly enforce this ordering. We examine this mismatch in flat LeWorldModel (LeWM) by analyzing how its Euclidean goal cost changes with temporal separation. Our analysis identifies conditions under which states at different long offsets receive similar average costs, weakening their temporal distinction. To learn the missing ordering explicitly, we introduce Time-to-Goal (T2G), a lightweight metric trained on latent triples from offline trajectories. A margin ranking loss encourages smaller distances for temporally nearer states, requiring no rewards or policy labels. The learned metric then replaces the Euclidean planning cost while the JEPA encoder and predictor remain frozen. Diagnostics on AntMaze and FourRoom show that T2G preserves stronger temporal contrast and improves near--far ranking at long offsets. Across four navigation and manipulation benchmarks, T2G improves the average planning success rate from 32.7\% (flat LeWM) to 63.0\% and approaches or even surpasses the performance of the hierarchical H-JEPA baselines. These results show that learning temporal ordering for the goal cost can substantially improve latent planning even with a flat world model.
103. 【2611.05825】DualCast: Dual-Image Conditioned Diffusion Transformers for Digital Human E-Commerce Video Generation
链接：https://arxiv.org/abs/2611.05825
作者：Lifan Jiang,Yibo Zhao,Senlin Cheng,Bolei Xu,Xiaobo Li,Can Ye,Dehai Zhao,Deng Cai,Boxi Wu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：preserving product appearance, Digital human e-commerce, requires preserving product, generation requires preserving, Digital human
备注：
点击查看摘要
Abstract:Digital human e-commerce video generation requires preserving product appearance, human identity, and overall video style during dynamic demonstrations. Although recent models support multiple reference images, their general conditioning schemes do not explicitly distinguish the asymmetric roles of "what is presented" and "who presents it." Consequently, generated videos may favor a single reference, resulting in product distortion, identity drift, or single-reference collapse. To address this issue, we propose DualCast, a role-addressed dual-image conditioning framework for video generation. By explicitly modeling the distinct roles of product and human conditions, DualCast reduces role ambiguity and feature competition between references. First, a dual-spatiotemporal slot injection mechanism VAE-encodes the product and human images separately and places their latent features at the front and rear boundaries of the DiT sequence, enabling sequence-level condition separation and directed injection. Second, a mask-guided region-weighted loss strengthens supervision over product, face, and product-face overlap regions, improving generation fidelity in critical areas. Third, image condition dropout enables a single model to support dual-image, product-only, and human-only generation. In addition, we construct a curated dataset of 10K e-commerce videos for model training. Experimental results demonstrate the strong performance of DualCast.
104. 【2611.05818】Navigational Safety of Marine Surface Vehicles in Restricted Visibility: From Intelligent Vision to Vision-Centered Multi-Sensor Fusion
链接：https://arxiv.org/abs/2611.05818
作者：Ryan Wen Liu,Fengchuan Song,Tianxiang Wang,Guobei Peng,Youngrong Kim,Xian Zhong,Hooi-Siang Kang,Maohan Liang,Junzhi Yu,Shanliang Yao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Marine surface vehicles, attracted considerable attention, Marine surface, surface vehicles, attracted considerable
备注： 42 pages, 16 figures
点击查看摘要
Abstract:Marine surface vehicles (MSVs) have attracted considerable attention for their commercial, scientific, and military applications. Owing to their favorable performance-to-cost ratio, shipboard cameras are widely used to detect and recognize potentially hazardous situations across diverse operational scenarios. However, visual perception is inevitably degraded by restricted conditions, including irregular motion of the imaging platform, adverse weather, and long imaging distances. To improve situational awareness and navigation capabilities, complementary sensors, such as the automatic identification system (AIS), radar, and light detection and ranging (LiDAR), etc., have become essential shipboard equipment. Multi-sensor fusion can provide richer perceptual information and help ensure navigational safety of MSVs in restricted visibility. This article reviews recent progress from intelligent vision to vision-centered multi-sensor fusion for newcomers and researchers in intelligent ship navigation and intelligent waterborne transportation system (IWTS). After introducing the generation of quality-degraded images in restricted visibility, we will review intelligent vision methods for four key issues, i.e., shipboard video stabilization, visual perception enhancement, object detection and tracking, and navigable area segmentation. We then examine vision-centered multi-sensor fusion methods, including infrared-visible image fusion, radar-vision fusion, LiDAR-vision fusion, AIS-vision fusion, and other multi-sensor fusion scenarios. Open-source datasets and safety-critical applications are also summarized and discussed. Finally, we highlight open challenges and future research directions. The collected maritime datasets are available at this https URL and will be regularly updated.
105. 【2611.05811】ReTailor: A Residual Feature Tailoring Framework for Real-Time Cross-Sensor Pansharpening Adaptation
链接：https://arxiv.org/abs/2611.05811
作者：Jing-Ze Liang,Wei-Jie Xiao,Zi-Han Cao,Yang-Dong Li,Tian-Yi Hu,Liang-Jian Deng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：achieve strong fusion, trained sensors, unseen sensors, Recent pansharpening models, models achieve strong
备注： 18 pages, 12 figures, including appendices. The first three authors contributed equally
点击查看摘要
Abstract:Recent pansharpening models achieve strong fusion performance on trained sensors, yet often generalize poorly to unseen sensors. Existing cross-sensor adaptation is limited by target-sensor retraining, which requires target-sensor training pairs and a dedicated training stage, and by per-image zero-shot adaptation, which is computationally expensive due to whole-network optimization for each test image. To address these problems, we propose ReTailor, a real-time sequential cross-sensor adaptation framework. Only a lightweight residual Feature Tailor is rapidly optimized under self-supervised, physics-aware constraints to correct cross-sensor shifts without modifying the well-learned fusion prior. For efficient and effective deployment, ReTailor combines content-aware patch selection, which identifies a few informative patches per image for optimization at negligible cost to improve both quality and efficiency, with rolling residual bootstrap, which inherits sensor-related knowledge across the image stream to further improve quality. Extensive experiments on cross-sensor adaptation settings show that ReTailor mitigates cross-sensor degradation both effectively and efficiently. Moreover, we compare ReTailor with Low-Rank Adaptation (LoRA), a widely used method for fine-tuning, to demonstrate the advantages of our approach. We further evaluate the core principle of ReTailor on two additional remote sensing tasks: super-resolution pansharpening and image segmentation, where it consistently improves performance. In general, ReTailor provides a highly effective and efficient strategy for deploying pansharpening models under real-world cross-sensor degradation, while also offering useful insights into managing cross-sensor degradation in other remote sensing tasks. Code will be released at this https URL .
106. 【2611.05802】GREP: Grounding Generated Room Evaluation in Principles
链接：https://arxiv.org/abs/2611.05802
作者：Mohan Cao,Yongsen Mao,Chucheng Xiang,Zhongyuan Liu,Zhihang Zhong,Haiping Wang,Yuan Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Graphics (cs.GR)
关键词：generate attractive furnished, attractive furnished rooms, Recent LLM-centric advances, arranging assets, LLM-centric advances
备注： 24 pages. Project page: [this https URL](https://han-808.github.io/GREP/)
点击查看摘要
Abstract:Recent LLM-centric advances can generate attractive furnished rooms by selecting and arranging assets. Yet evaluation remains limited to specific perspectives or predefined questions, failing to reflect overall scene quality. To address this pressing need, we introduce GREP. Its core is a focus shift from defining specific questions to establishing a three-tier evaluation philosophy: basic physical validity checks whether a scene obeys physical constraints; visual coherence concerns compatibility in object scale, style, and composition; and, at the highest level, human-use logic requires object arrangements to align with everyday human habits. Guided by these principles, an evaluation agent autonomously and adaptively identifies issues from scene context, gathers evidence, and produces scores and reports. This supports scene-specific issue discovery and reliable judgments. Experiments show that (1) GREP achieves 87% agreement with human majority preferences, substantially outperforming baseline evaluators. (2) GREP reports improve scene quality through refinement, whereas score-only and no-feedback baselines show slight declines. (3) GREP suggests that as planning ability improves, recent models such as GPT-5.6 Sol can move from relying on pipelines and harnesses to challenging their guidance and constraints, but still lack the ability to resolve the resulting conflicts. Stronger models are therefore expected not only to plan well, but also to adapt to external guidance and constraints more flexibly. Project page: this https URL
107. 【2611.05801】WayPOP: A Panoramic Open-Set Panoptic Tracking Benchmark
链接：https://arxiv.org/abs/2611.05801
作者：Rohit Mohan,Maximilian Luz,Swarnava Chowdhury,Yao Lu,Florian Drews,Thomas Nürnberg,Yakov Miron,Federico Tombari,Stefano Gasperini,Abhinav Valada
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Robotics (cs.RO)
关键词：autonomous agents requires, agents requires reliably, requires reliably segmenting, Holistic perception, fixed semantic taxonomy
备注：
点击查看摘要
Abstract:Holistic perception for autonomous agents requires reliably segmenting and associating scene elements across time and camera views, including objects outside a fixed semantic taxonomy. Existing open-set panoptic benchmarks focus on individual images or views, while panoramic tracking benchmarks assume closed-set taxonomies. Consequently, these benchmarks do not evaluate whether unknown objects can be consistently segmented and tracked across synchronized multi-camera sequences. We introduce WayPOP, a panoramic open-set panoptic tracking benchmark built on real Waymo PVPS sequences augmented with diverse out-of-taxonomy 3D assets from Objaverse. Inserted objects are placed at fixed locations in the 3D scene and rendered using calibrated vehicle-mounted cameras as the ego vehicle and surrounding traffic move, providing temporally and cross-view consistent panoptic annotations and auxiliary LiDAR range observations. WayPOP contains approximately 670 curated assets instantiated as 980 unique unknown-object tracks, yielding 53,452 unknown-object mask annotations across 21,300 camera images. Our evaluation protocol defines a hierarchy of tasks from view-independent open-set panoptic segmentation to full panoramic open-set panoptic tracking, using known/unknown PQ and (w)STQ metrics. We benchmark representative open-set and open-vocabulary segmentation methods with temporal and cross-camera association. Our results reveal substantial limitations of current methods in truly open-set scenarios, highlighting robust unknown-object localization and identity association across time and views as major open challenges.
108. 【2611.05766】ME^2FDiff: Multiscale Expert Enhancing Feature Diffusion in Residual Network for Brain Tumor Segmentation
链接：https://arxiv.org/abs/2611.05766
作者：Afrida Rahman,Bijoy Kundu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：MRI is essential, Automated segmentation, treatment planning, remains difficult, essential for accurate
备注：
点击查看摘要
Abstract:Automated segmentation of post-treatment glioma from MRI is essential for accurate diagnosis and treatment planning, yet remains difficult. Surgery and chemoradiotherapy cause structural changes in brain like resection cavities, edema, and fibrosis, that alter imaging appearance and mimic tumor recurrence. Contemporary segmentation architectures attain high accuracy with two limitations. First, the bottleneck originates from the deepest encoder stage, so one representation must serve sub-regions that differ widely in size and appearance. Second, they produce the segmentation in a single forward pass with no mechanism for refinement. We propose ME^2FDiff, a single-model architecture, addressing both. An attention-conditioned spectral diffusion block refines the bottleneck. It uses the image-conditioned latent diffusion process with two processes: a spatial pre-attention gate and a spectral fusion block whose timestep-adaptive bandpass filter selects the informative frequency band at each noise level. A multiscale expert-enhanced feature block fuses the intermediate encoder scales into the bottleneck through expert-selected shared tokens, guaranteeing balanced utilization without an auxiliary loss. On the BraTS 2024 post-treatment glioma dataset, ME^2FDiff achieves the best results on every tumor sub-region among all single-model baselines (91.23% Dice, 84.52% IOU, 2.13 mm HD95 on whole-tumor) and surpasses a three-expert ensemble on both overlap metrics at roughly one-third of its inference cost. Against recent state-of-the-art methods retrained under identical conditions, it maintains the strongest performance with the fewest parameters of any competing model. These findings demonstrate that a single, compact network can absorb the specialization, usually sought through ensembling or larger architectures.
109. 【2611.05755】Decompose the Distillation: Interpretable Single-Pass Guidance for Diffusion Models
链接：https://arxiv.org/abs/2611.05755
作者：Wuyang Zhang,Xiaolin Xu
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：adjusts conditioning strength, conditional image generation, Guidance, image generation, generation with diffusion
备注： The Fortieth Annual Conference on Neural Information Processing Systems
点击查看摘要
Abstract:Classifier-Free Guidance is a widely used inference-time guidance rule for conditional image generation with diffusion models, which exposes a guidance scale that adjusts conditioning strength after training. This flexibility requires conditional and unconditional model evaluations at every sampling step, so an N-step trajectory takes 2N forward passes. Single-pass alternatives reduce such cost, yet most collapse CFG's two components into one opaque guided prediction, losing the separable base flow and guidance direction that support per-step control and diagnostics, even when the scale remains adjustable. This work introduces CtrlFlow, a single-pass guidance method that preserves CFG's separable base-flow and guidance-direction interface. To preserve both components at one-pass cost, CtrlFlow attaches two lightweight LoRA adapters to a frozen backbone, each adding 2.5% parameters, and predicts the base flow and guidance direction from one pass of the shared frozen backbone. Because the guidance scale multiplies the guidance direction only after the forward pass, one evaluation yields the guided velocity at any scale, so a single trained checkpoint remains adjustable at inference without retraining. Preserving two outputs introduces a training mismatch: inference amplifies guidance-direction errors by the chosen scale, while naive component-wise losses weight both outputs equally. To align training with this composed inference-time error, CtrlFlow uses a unified multi-scale distillation loss. Residual guidance errors can still persist at extreme scales, where even small guidance-direction errors are amplified by the guidance scale. To reduce this inference-time error, CtrlFlow applies scale-adaptive modulation to damp velocity-field errors and time-grid warping to concentrate solver evaluations where the trajectory changes most rapidly.
110. 【2611.05742】Learning Hierarchical Patch Splitting Policies for Faster Vision Transformers
链接：https://arxiv.org/abs/2611.05742
作者：Aditya Gupta,Jean Sebastien Dandurand,Kai Qiu,Rohan Choudhury,Laszlo A. Jeni
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Vision Transformers, input token sequence, Vision, Transformers, Policy Learned Image
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:Vision Transformers (ViTs) are bottlenecked by the length of their input token sequence. Standard patchification fixes this length with a single patch size applied across the image, regardless of regional content. Prior work on adaptive patch sizing reduces token count by assigning coarser patches to visually simple regions, but relies on noisy pixel-level heuristics such as local entropy to make patchification decisions. We argue that this compute allocation should be grounded in the model's interpretation of task relevant information, not in raw pixel statistics. We introduce Split Policy Learned Image Tokenization which learns to allocate token resolution based on what the model finds meaningful, producing shorter token sequences that are better matched to task-relevant content. SPLIT matches the accuracy of full-resolution ViT classification baselines while using 30% fewer tokens. The same gains hold on dense prediction: SPLIT achieves competitive accuracy on COCO and ADE20K, demonstrating that semantically aligned patchification generalises well beyond classification.
111. 【2611.05738】OdorSpaces: Visual-Olfactory Embodied Navigation in 3D Environments
链接：https://arxiv.org/abs/2611.05738
作者：Changyeon Lee,Kelin Yu,Zheng Wei,Shuna Ni,Ruohan Gao
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：prior machine olfaction, machine olfaction work, olfaction work focusing, airborne chemical cues, remains largely underexplored
备注： Accepted at the 10th Conference on Robot Learning (CoRL 2026). 20 pages, 4 figures, 6 tables
点击查看摘要
Abstract:Olfaction provides critical information about airborne chemical cues, yet it remains largely underexplored in embodied AI, with limited prior machine olfaction work focusing primarily on semantic odor perception. We introduce OdorSpaces, a physics-based simulation platform and benchmark for visual-olfactory embodied navigation. OdorSpaces augments Habitat-Sim with 3D odor transport and dispersion simulated by Fire Dynamics Simulator (FDS), enabling agents to navigate photorealistic indoor environments using both visual and olfactory observations. The benchmark includes two representative source-seeking scenarios: invisible gas-leak localization and early-stage fire localization. We develop an initial multimodal reinforcement learning policy that integrates visual observations and olfactory measurements over time. Experiments show that the policy outperforms a diverse set of baselines, establishing a strong reference for future research on visual-olfactory embodied navigation.
112. 【2611.05737】C-WFDM: A ControlNet-Guided Wavelet-Fusion Diffusion Model for Multimodal Brain MRI Completion
链接：https://arxiv.org/abs/2611.05737
作者：Muhammad Nabi Yasinzai,Remika Mito,Mangor Pedersen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal brain MRI, downstream artificial intelligence, support downstream artificial, Multimodal brain, MRI
备注：
点击查看摘要
Abstract:Multimodal brain MRI provides complementary anatomical, tissue, and pathological information to support downstream artificial intelligence (AI) applications. However, modality availability is uneven across public and pooled neuroimaging datasets: T1-weighted (T1w) MRI is widely represented, T2-weighted (T2w) and fluid-attenuated inversion recovery (FLAIR) MRI are less consistently available, and gadolinium-enhanced T1-weighted (T1Gd) MRI is relatively scarce. Pooled datasets therefore contain participants with different combinations of acquired MRI contrasts, reflecting variation in the study designs, acquisition protocols, and clinical or research objectives of the contributing studies. Many missing-modality benchmarks simulate incomplete MRI by withholding contrasts from complete four-modality cases, which may not represent the observed availability patterns in pooled datasets. To address this gap, we introduce C-WFDM, a ControlNet extension of our Wavelet-Fusion Diffusion Model (WFDM), for subject-specific missing-modality completion. C-WFDM is built on an earlier BrainScape snapshot comprising 157 public MRI datasets and 45,880 preprocessed scans. The pretrained WFDM backbone retains target-modality and metadata conditioning, while target-specific ControlNet adapters use MRI contrasts from the same participant to guide synthesis. C-WFDM synthesizes T2w from T1w, FLAIR from T1w and T2w, and T1Gd from T1w, T2w, and FLAIR. Acquired conditioning contrasts are used when available, and generated intermediate contrasts are used only when required. We compare C-WFDM with ALDM, cWDM, and Pix2Pix using paired structural similarity index (SSIM), peak signal-to-noise ratio (PSNR), and mean absolute error (MAE). In the BrainScape completion experiment, C-WFDM achieves the best T2w and FLAIR results among the evaluated models, with SSIM values of 0.9232 and 0.8904, respectively.
113. 【2611.05734】Mitigating Spurious Invariance in Contrastive Learning: A Probabilistic Self-Supervised Learning Framework for Medical Image Analysis
链接：https://arxiv.org/abs/2611.05734
作者：Wei Wei,Yading Yuan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：gained substantial attention, prohibitive cost, cost of manual, manual annotation, annotation for enormous
备注： Published in IEEE Transactions on Medical Imaging (TMI), 2026. 17 pages
点击查看摘要
Abstract:Owing to the prohibitive cost of manual annotation for enormous medical images, self-supervised learning (SSL) has gained substantial attention and shown promise in various medical imaging tasks. Among SSL approaches, contrastive learning has emerged as a prominent one, encouraging models to encode semantic information that remains invariant between different augmented views. However, this invariance can be spurious for medical images, as subtle but critical medical features can be suppressed during augmentations. In this paper, we mitigate this issue by encoding the learned feature embeddings as probability distributions rather than fixed vectors, thus capturing a richer and more nuanced spectrum of information. Furthermore, we propose a unified probabilistic framework that seamlessly integrates multiple SSL approaches. Our method achieves superior performance over the state-of-the-art SSL methods on various downstream tasks across multiple datasets, including medical image segmentation and classification. We further validate the method through additional analyses of robustness to stronger augmentations, label efficiency under limited fine-tuning labels, and computational trade-offs. The code is released at this https URL.
114. 【2611.05697】GeoDIVE: Geospatial Descent Informed by Value Estimation
链接：https://arxiv.org/abs/2611.05697
作者：Hamza Iqbal,Dan Cher,Eric Xing,Pranavi Kolouju,Abby Stylianou,Robert Pless,Nathan Jacobs
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Finding specific objects, Finding specific, patterns supports critical, supports critical work, spatial patterns supports
备注： Accepted to WACV 2027. Includes supplementary material
点击查看摘要
Abstract:Finding specific objects, structures, and spatial patterns supports critical work in agriculture, infrastructure planning, environmental monitoring, and disaster response. These features, however, are often dispersed across very large regions and span dramatically different spatial scales, which defines a search space that is costly to embed, maintain, and search naively. We introduce GeoDIVE, a model that treats a multiresolution satellite image gallery as a forest and uses best-first traversal to determine which tiles to encode. At each visited node, a lightweight model then predicts an optimistic estimate of the best query similarity hidden among its descendants using the query and subtree representations. In evaluations with image and open-vocabulary text queries, GeoDIVE matches exhaustive search at 10% of the encoding cost for image queries and leads all tested baselines at every budget in both modalities. To support future evaluation of multiscale geospatial search, we also release object-level image and text queries for Git-10M, constructed from Microsoft building footprints and OpenStreetMap polygons with VLM-generated captions. Source code and models will be made publicly available.
115. 【2611.05693】Anchored Slice Propagation with Boundary Transport for 3D CT Segmentation from Three Orthogonal Annotated Slices
链接：https://arxiv.org/abs/2611.05693
作者：Tushar Kataria,Md Rakibul Haque,Shireen Y. Elhabian
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：adjacent slices, affinities between adjacent, annotated plane, propagates a binary, Dice
备注：
点击查看摘要
Abstract:Sli2Vol propagates a binary mask through affinities between adjacent slices, but an error can persist because each prediction becomes the input to the next step. Three orthogonal annotations reduce dependence on any one chain, yet they offer more than three starting masks: where a chain crosses another annotated plane, the correct label is already known. Those labels could correct drift during propagation and indicate how much to trust each chain at fusion. Between annotated planes, the information carried by the chain may matter as well. A binary mask records foreground membership but discards distance to the boundary, a cue that could help follow gradual shape changes between this http URL address these two sources of error with a fixed pretrained affinity backbone. We anchor each chain by correcting its prediction where it crosses another annotated plane, then use its agreement with those labels to weight fusion. We compare this anchored mask with two ways of transporting boundary geometry: a truncated signed-distance field (SDF) propagated by dense affinity averaging, and a contour whose vertices follow motion cues from the same affinity. The contour tracker starts from a hand-crafted rule and learns a motion correction from supervoxel pseudo-objects in 506 CT volumes, without manual organ labels. On 2,091 held-out structure instances from approximately 403 CT scans spanning 17 abdominal structures, anchoring raises mean Dice from 0.737 with orthogonal mask propagation to 0.769 and improves every structure. Beyond the anchored mask, learned contour tracking improves Dice by 5.7\% for the esophagus and 5.9\% for the postcava, while SDF transport improves right-adrenal Dice by 2.8\%. The anchored methods have similar mean Dice (0.769--0.772); contour tracking performs worse on the kidneys, stomach, and hepatic vessel tree.
116. 【2611.05689】RUST-Stereo: Teacher-Assisted Robust Uncertainty-Guided Search and Transfer for Fast Stereo Matching
链接：https://arxiv.org/abs/2611.05689
作者：Pouya Sohrabipour,Yihong Feng,Chaitanya Kumar Reddy Pallerla,Tuan Dang,Ngan Le,Dongyi Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：place ground-truth correspondences, Residual Search Module, local search ranges, Fast Stereo Matching, subsequent local search
备注：
点击查看摘要
Abstract:Coarse-to-fine stereo matching enables efficient disparity estimation but remains sensitive to errors in propagated disparity, which may place ground-truth correspondences outside subsequent local search ranges. We propose TRUST-Stereo (Teacher-Assisted Robust Uncertainty-Guided Search and Transfer for Fast Stereo Matching), which addresses this limitation through an Uncertainty-Guided Residual Search Module (UGRSM). UGRSM estimates the reliability of propagated disparity and predicts residual offsets to adaptively relocate local cost-volume centers. Additionally, we introduce a two-stage Senior-Junior Teacher Assistant knowledge distillation strategy to transfer rich monocular representations from a large foundation model to a lightweight backbone to achieve fast stereo matching performance. Experiments on KITTI 2012, KITTI 2015, ETH3D, and Middlebury demonstrate strong zero-shot generalization. Using only 1.4M synthetic stereo pairs, TRUST-Stereo achieves state-of-the-art results on several benchmark metrics, outperforming competing efficient methods trained with substantially larger datasets, including real-world pseudo-labeled samples. Specifically, it achieves a KITTI 2015 EPE of 0.93, ETH3D Bad 1.0 of 2.13% and Middlebury Bad 2.0 of 6.79% while maintaining inference at approximately 50 ms per stereo pair.
117. 【2611.05680】oward an Optimal Configuration for Tree Species Classification from Bark Images: A Leakage-Safe Ablation Study
链接：https://arxiv.org/abs/2611.05680
作者：Maeve Côté
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：wood-processing industry, studied systematically, test partitions, automatic identification, identification of tree
备注： 17 pages, 4 figures
点击查看摘要
Abstract:Background: The automatic identification of tree species from bark photographs is of practical interest for forestry inventory and the wood-processing industry, yet the design choices that govern the accuracy of deep-learning approaches have not been studied systematically, and some prior results may be inflated by leakage of images of the same trunk across training and test partitions. Methods: A systematic ablation study is conducted on the public BarkNet 1.0 dataset (20 species) under the established tree-level, leakage-safe partitioning scheme. Using ConvNeXt-V2 backbones, the following factors are varied in turn and evaluated by five-fold cross-validation: patch size, the strategy by which per-patch predictions are aggregated into an image-level decision, the training regime (single- versus two-stage), backbone capacity, the whole-image baseline, and the number of patches available at inference. Results: Per-patch accuracy rises monotonically with patch size (from 75.6% at 160 px to 89.6% at 512 px), and image-level accuracy rises in step, plateauing near 94.9% around 512 px. Learned aggregation exceeds majority voting by at most 0.7 pp, an advantage that shrinks as patches grow and attention becomes near-uniform. Backbone capacity (pico to tiny) alters accuracy by less than a point, and two-stage training offers no advantage over one-stage. Whole-image classification (91.9%) trails patch-based aggregation, since it admits no bag to average over; accuracy increases with the number of patches at inference, saturating around 64. Conclusions: The study yields a simple recommended configuration: patches as large as possible while leaving enough to average over (around 512 px here), with a nano backbone. It also quantifies the second-order role of learned aggregation and model capacity, providing a reproducible reference point for practitioners and future research
118. 【2611.05648】NitroFusion2: Bringing Adversarial Loss to the Text Stream of Multimodal Diffusion Transformers
链接：https://arxiv.org/abs/2611.05648
作者：Dar-Yen Chen,Yi-Zhe Song
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Adversarial diffusion distillation, conventionally relied, Adversarial diffusion, Adversarial, diffusion distillation
备注： Project page: [this https URL](https://chendaryen.github.io/NitroFusion2.github.io/)
点击查看摘要
Abstract:Adversarial diffusion distillation has conventionally relied on image features for discrimination. We revisit this choice for multimodal diffusion transformers (MMDiTs), whose text stream becomes image-dependent through joint attention. We introduce Text-Stream Adversarial Distillation (TSAD), which exploits intermediate text-token states as a new adversarial representation. Because the text stream has already read the image while remaining tied to the text condition, changing that condition changes what information it extracts from the image. Building on this property, we introduce Aspect-Cued Discrimination (ACD), which conditions the discriminator on different aspects of the sample, such as typography, objects, or style, to steer which properties are emphasized during adversarial training. Building on the expert-discriminator design of NitroFusion, we integrate TSAD and ACD in NitroFusion2. NitroFusion2 brings few-step distillation from the conventional 4-8-step regime down to just 1-2 steps at comparable quality. At one step, it produces sharp rendered text and rich fine-grained details, making one-step generation practical rather than merely a stress test for distillation. At two steps, it remains competitive across the evaluated benchmarks. These results establish the MMDiT text stream as a powerful and steerable representation for adversarial diffusion distillation.
119. 【2611.05646】ARIDA - Active railway infrastructure dataset annotation using neural network predictions
链接：https://arxiv.org/abs/2611.05646
作者：Maximilian Dornik,Christian Sieberichs,Simon Geerkens,Alexander Braun
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Modern railway perception, perception requires large, requires large comprehensive, railway perception requires, Railway Infrastructure Dataset
备注：
点击查看摘要
Abstract:Modern railway perception requires large comprehensive image datasets, but creating them is slowed by manual labeling, especially for track polylines and other complex infrastructure geometry. This paper presents the Active Railway Infrastructure Dataset Annotation framework, a railway-specific semi-automated pipeline that converts instance predictions from a mask scoring instance segmentation network into bounding-boxes, polygons, polylines, and paired polylines. To keep automatic track geometry annotation reliable without ground truth, it applies confidence thresholds and an unique contour-agreement quality score as an acceptance gate. An active learning loop ranks remaining images by uncertainty and adapts the number of manual queries per cycle. This is achieved through a novel quantity control mechanism, in which easy images are auto-accepted and human effort targets hard cases. Experiments on disjoint, diverse imagery and time-sequential, redundant imagery quantify effort reduction and accuracy trade-offs, achieving about two thirds reduction in the disjoint regime and up to 93% in the sequential regime. The study also provides guidance for initial label budgets and stopping to avoid over-annotation.
120. 【2611.05633】Spatio-Temporal Multi-Order Interaction for Video Recognition
链接：https://arxiv.org/abs/2611.05633
作者：Kevin D. Nguetche,Lilian Hollard,Eric Granger,Marco Pedersoli
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：cross-channel aggregation projections, introducing significant computational, significant computational overhead, explicit cross-channel aggregation, video recognition rely
备注：
点击查看摘要
Abstract:Many temporal approaches for video recognition rely on explicit cross-channel aggregation projections, which have quadratic complexity in the number of channels, introducing significant computational overhead. In addition, the spatio-temporal representation used for video recognition is biased either toward local order interactions (for CNNs) or toward global order interactions (for transformers). Starting from the multi-order spatial representation of MogaNet, our method introduces two complementary contributions to tackle these problems. First, for the temporal modelling, we introduce parallel multi-order processing with depthwise-only convolutions and implicit gating-based aggregation, which is linear in the number of channels, inducing a considerable computational reduction. Second, we propose a dual interaction between spatial and temporal dimensions, which allows a better spatio-temporal representation without increasing the computational cost. By combining these two contributions, our proposed VideoMogaNet achieves performance on par with or better than state-of-the-art action recognition approaches across multiple video benchmarks (UCF101, HMDB51, Kinetics-400, Diving48), while considerably reducing the cost of the temporal branch.
121. 【2611.05599】CAPTOR: text-encoder-free grounding by counting caption co-occurrence over the visual words of a frozen encoder
链接：https://arxiv.org/abs/2611.05599
作者：Elad Yoshai,Natan T. Shaked
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Grounding a text, text encoder, text, image, encoder
备注：
点击查看摘要
Abstract:Grounding a text query in an image needs a matrix scoring every term against every patch. Vision-language models compute it with an aligned text encoder, which many image encoders, such as histopathology-related models trained on slides alone, lack. The Caption-Anchored Patch-Term Occurrence Representation (CAPTOR) estimates the matrix without a text encoder. It clusters a frozen image encoder's patch tokens into visual words and describes each captioned image by its share of patches in each word. A term signature is the standardized difference of those shares between images whose captions mention the term and the rest. The matrix factorizes into a term-by-word table and a query-independent image factor, so an image is encoded once and a new term adds one table row. Against every training-free baseline, CAPTOR leads on Common Objects in Context (COCO), Pascal Visual Object Classes (VOC) and Cityscapes. On COCO, scored on the cells one object owns, it reaches 0.565 mean intersection over union (mIoU) against 0.502. On all three, it is also level with a text alignment trained on the same backbone, which needs gradients, a text encoder and several times the captions. On held-out breast-cancer slides, it exceeds the strongest baseline scoring patches with a pathology text encoder by 0.160 mIoU. Read through CAPTOR, UNI, an encoder trained on slides alone, exceeds such baselines by 0.132 on a common grid. Counting can therefore give a text interface to any image encoder trained without language, wherever captioned images exist.
122. 【2611.05594】Relevance Propagation as Entropic Optimal Transport on Filippov Neural Networks: Sinkhorn Propagation and Region Relevance in Image Classifiers
链接：https://arxiv.org/abs/2611.05594
作者：Olivier Gibaru,Eric Nyiri
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Optimization and Control (math.OC)
关键词：Layer-wise Relevance Propagation, Relevance propagation, Sinkhorn Relevance Propagation, network prediction backward, LRP
备注： 41 pages, 17 figures
点击查看摘要
Abstract:Relevance propagation, which redistributes a network's prediction backward through the layers, is usually treated as a heuristic. We show that it is the solution of a single variational problem: Layer-wise Relevance Propagation (LRP) is the divergence-free flow on the active computational graph of zero relative entropy to the backward transition law of the forward activation flow; for a non-negative reference, this is a relative entropy between Markov measures on backward paths. The rules LRP$_0$, LRP$_{z^+}$ and LRP$_{\alpha,\beta}$ follow from this principle by the choice of a reference, and are instances of one rule, LRPN$_{\alpha,\beta}$, whose weights may vary from node to node, for instance with the node's activity, in the spirit of Hebb's principle. The principle rests on a measure-theoretic formalization of feed-forward networks as directed acyclic graphs of Filippov operators, which covers piecewise-smooth and discontinuous architectures (e.g. hard-routed Mixture-of-Experts) with a Clarke-Filippov generalized-gradient calculus; it also characterizes backpropagation as the adjoint equation of a Lagrangian relaxation. On networks of ReLU and max-pooling nodes, LRP$_0$ is Gradient$\times$Input, with an explicit jump across a kink where LRP$_{z^+}$ stays continuous. Taking the entropy edge by edge yields a new rule, Sinkhorn Relevance Propagation. Aggregated over an input region, the flow of a non-negative reference tells, with exact accounting, which hidden units carry its evidence, the conditioned flow being a Schrödinger bridge. On VGG-16, the conservation identities hold to round-off, and the rules are told apart by the sign of their maps, the share of the output left to the bias nodes, faithfulness, localization and class dependence; on ConvNeXt-Tiny, LRPN$_{\alpha,\beta}$ conserves the output and its Hebbian weights give the highest ABPC of the rules tested.
123. 【2611.05593】GaussianRenderFormer: Transformer-based Rendering of 3D Gaussian Splats
链接：https://arxiv.org/abs/2611.05593
作者：Shahaf Valencia Levy,Sagie Benaim
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Machine Learning (cs.LG)
关键词：neural network learn, neural network, network learn, Gaussian, Gaussian splats
备注： Under review at TMLR. 32 pages. Project page: [this https URL](https://svlwoof.github.io/gaussianrenderformer)
点击查看摘要
Abstract:Can a neural network learn to render 3D Gaussian splats on its own, with no rasterizer in the renderer? We present GaussianRenderFormer, a transformer that takes a set of Gaussians and a camera and outputs the image directly. Each Gaussian becomes one token in a view-independent encoder, and a view-dependent decoder turns small patches of camera rays into pixels by attending to those tokens. Trained on 26,820 Objaverse objects pruned to 20,000 Gaussians each, GaussianRenderFormer renders 300 unseen objects at 38.08 dB PSNR against the full, unpruned splats, while rasterizing the same pruned input reaches 44.02 dB. The gap is not one of generalization, and our diagnostics are consistent with a bottleneck in the view decoder: telling it the projected footprint of each Gaussian, which it could in principle infer, adds 1.4 dB. Under-training is not ruled out. Code, trained models and videos: this https URL
124. 【2611.05581】BrainBind: Bridging Synchronized EEG and fMRI through Long-Form Naturalistic Video Representations
链接：https://arxiv.org/abs/2611.05581
作者：Shixiao Wang,Rining Wu,Jian K. Liu
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Real-world vision, dynamic and scene-rich, spatial scales, EEG and fMRI, vision is dynamic
备注： Accepted at BMVC 2026. 26 pages, 4 figures, including supplementary material. Code: [this https URL](https://github.com/Forainest789/Brainbind)
点击查看摘要
Abstract:Real-world vision is dynamic and scene-rich, while EEG and fMRI resolve it at complementary temporal and spatial scales. Most neural decoding systems, however, align one modality in isolation and mostly against static images or short clips. We study the synchronized case: EEG and fMRI are recorded during the same long-form naturalistic viewing, giving a shared stimulus but also recurring narrative context and many semantically similar candidates. We present BrainBind, a framework that maps synchronized EEG and fMRI into frozen long-form video embedding spaces and treats those spaces as common visual-semantic references, not literal neural codes. On CineBrain, a five-seed Recall@K 2 x 4 matrix across two video anchors and four system configurations shows distinct retrieval profiles. With Omni, fMRI organizes the full candidate list most strongly (MRR = 23.82, nDCG@10 = 25.31), while Joint-Dual gives the highest mean label-aware R@1 (13.52%) with a distinct rank-wide profile. The complementary episode-disjoint evaluation quantifies the contribution of repeated stimulus identity and narrative context to the random split. Across these experiments, proxy choice and system configuration produce distinct top-rank and rank-wide retrieval profiles within the present synchronized dataset. The code is available at this https URL.
125. 【2611.05579】Multimodal Fusion Methods for Whole-Slide Images and Clinical Data in Inflammatory Bowel Disease
链接：https://arxiv.org/abs/2611.05579
作者：Ankana Banerjee(1),Mark van der Giezen(1, 2, 3),Ole Gunnar Aasprong(2),Emiel A. M. Janssen(1, 2),Øyvind Steinsbø(2, 4),Tore Grimstad(2, 4),Kjersti Engan(1) ((1) University of Stavanger, Norway, (2) Stavanger University Hospital, Norway, (3) University of Greenwich, UK, (4) University of Bergen, Norway)
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：active research area, computational pathology, active research, research area, area in computational
备注： 5 pages, 4 figures, Submitted to the 2027 IEEE 24th International Symposium on Biomedical Imaging (ISBI)
点击查看摘要
Abstract:Multimodal AI fusion of histology and clinical data is an active research area in computational pathology, but fusion methods are rarely compared under identical conditions and across different clinical endpoints. We present a modular framework in which slide-level embeddings, obtained by training an attention-based aggregator over patch embeddings from a frozen foundation model, and per-visit clinical embeddings are fed into 15 interchangeable fusion methods with a shared output dimension and prediction head (except decision-level methods). Using a prospective cohort of newly diagnosed inflammatory bowel disease patients, we predicted STRIDE-II-aligned remission outcomes from baseline or follow-up visits. The best fusion method reached macro-F1 of 0.57-0.75, outperforming both single-modality models in four of six scenarios, and differed by outcome and input. Image reliance, the drop in balanced accuracy when the slide embedding is removed, tended to follow the remission type - highest for histological and lowest for endoscopic remission; methods with similar accuracy relied on the slide to very different degrees.
126. 【2611.05578】Whose Values Are Generated? Measuring Visual Value Leakage in Multilingual Text-to-Image Generation
链接：https://arxiv.org/abs/2611.05578
作者：Zucan Lyu,Binwei Yao,Rheeya Uppaal,Jing Yao,Xiaoyuan Yi,Junjie Hu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：systems serve users, serve users, cultural, systems serve, cultural contexts
备注： 38 pages
点击查看摘要
Abstract:Text-to-image (T2I) systems serve users across languages and cultural contexts. However, evaluations of cultural representation focus mainly on recognizable elements such as landmarks, clothing, and activities, overlooking the cultural values that generated images convey. To bridge this gap, we introduce VisionValueBench, a multilingual benchmark that operationalizes six of Hofstede's cultural value dimensions (e.g., individualism versus collectivism) to investigate how T2I systems frame neutral social situations through a particular cultural orientation. We find that value-neutral prompts, which admit diverse cultural interpretations, nonetheless yield images that favor particular value orientations, a phenomenon we call visual value leakage. We evaluate prompts varying in language and geographic cues across 960 social scenarios and six T2I configurations. Generated images consistently favor the same value orientations across all six dimensions, for example, equality over hierarchy (low power distance), individual autonomy over group obligation (individualism), and enjoyment over restraint (indulgence). Prompt language has limited influence on these orientations, whereas geographic cues shift some dimensions toward the associated cultural values while largely preserving the prevailing orientations. These findings reveal substantial homogeneity in the cultural values conveyed by T2I systems worldwide.
127. 【2611.05570】ChangeJEPA: Predict Before You Compare for Remote Sensing Change Detection
链接：https://arxiv.org/abs/2611.05570
作者：Buddhi Wijenayake,Dhananjaya Jayasundara,Vishal M. Patel
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Remote sensing change, Remote sensing, sensing change detection, typically formulated, encoded independently
备注： 15 pages
点击查看摘要
Abstract:Remote sensing change detection is typically formulated as Siamese feature comparison, where two images are encoded independently and a decoder determines which discrepancies correspond to meaningful change. This is challenging because the encoders preserve both true scene changes and nuisance variations such as illumination, seasonal, radiometric, and geometric differences. We introduce ChangeJEPA, a bitemporal joint-embedding predictive architecture that reformulates change detection as latent post-state prediction. Given a pre-change image and partial post-change evidence, ChangeJEPA predicts the full post-change representation under two complementary conditions: a prior hypothesis derived from the pre-change scene and an updated hypothesis conditioned on observed post-change context. A joint-embedding predictive loss aligns both hypotheses with the target latent representation, encouraging semantic consistency while suppressing transient appearance variations. Change is then inferred from the disagreement among the pre-change representation, the observed post-change target, and the predicted latent states, capturing complementary evidence of change, prior surprise, contextual update, and prediction reliability. Across SYSU-CD, LEVIR-CD+, and CDD, ChangeJEPA consistently outperforms its decoder matched Siamese baseline by up to 1.51 IoU points and achieves the best IoU and F1-score on all three benchmarks, demonstrating the advantage of latent post-state prediction over direct feature comparison. Page: this https URL
128. 【2611.05569】Role-based Effectiveness of an Epistemic Uncertainty Estimate in Training Models for Semantic Segmentation of 3D LiDAR Point Clouds
链接：https://arxiv.org/abs/2611.05569
作者：Krishnakumar N,Jaya Sreevalsan-Nair
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Point cloud segmentation, point clouds introduce, Point cloud, data analysis, applications across robotics
备注： 23 pages, 7 figures, 10 tables
点击查看摘要
Abstract:Point cloud segmentation is a fundamental task in 3D data analysis, with applications across robotics, augmented and virtual reality, and remote sensing. However, the inherent sparsity, noise, and unordered nature of point clouds introduce significant challenges, particularly in achieving reliable classification. While the state-of-the-art rely on training models for explicit modeling of uncertainty, there is a gap in exploring different roles that estimated uncertainty using generative approaches can play. This work investigates the impact of deterministic uncertainty in point cloud segmentation by explicitly modeling epistemic uncertainty and using it in different roles, namely, as a feature and in loss function. We evaluate a baseline artificial neural network (ANN) and two uncertainty-aware variants (uncertainty as an additional input feature and as a per-sample confidence weight in the training loss) on four large-scale LiDAR benchmarks spanning airborne and mobile acquisition, namely ISPRS Vaihingen, AHN3, Paris-Lille-3D, and Toronto-3D, together with PointNet++ and RandLA-Net references and their uncertainty-augmented counterparts under canonical spatially disjoint train and test splits. Under this protocol, uncertainty-aware modeling improves mean Intersection over Union, recovers minority classes that the baseline ANN never predicts at all, and in half of the configurations improves the alignment between prediction error and estimated uncertainty as measured by Patch Accuracy versus Patch Uncertainty. Our findings indicate that uncertainty can play multiple roles in the segmentation pipeline rather than as a device for improving accuracy alone.
129. 【2611.05565】Discarded or Unreachable? Diagnosing and Repairing Spatial Relation Failure in Vision--Language Similarity
链接：https://arxiv.org/abs/2611.05565
作者：Mahdi Mostajabdaveh,Zirui Zhou
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Contrastive vision-language models, vision-language models score, native image-text similarity, models score left, Contrastive vision-language
备注： Code, stimulus generators, and all result files: [this https URL](https://github.com/mahdims/vl-spatial-moment)
点击查看摘要
Abstract:Contrastive vision-language models score left/right relations near chance, but the symptom has two causes that call for opposite repairs: the relation may survive in the pooled embedding yet be unreachable by native image-text similarity, or pooling may discard it while the dense features retain it. On clean two object photographs, across ten encoders, the lateral polarity is linearly decodable from the flip odd component of the pooled vector at 0.77-0.99, yet a search over a million captions leaves nine of the ten at chance under native scoring: an access failure. On controlled C4 orbits, where the relation is the only thing that varies, pooling keeps the arrangement axis at 0.998-1.000 and loses its polarity, which the patch grid retains: a pooling failure. Both sit downstream of the dense features, so one readout covers both. Our zero parameter, query conditioned spatial moment recomputes the geometry from the patch grid and stores it as a vector beside the native embedding. On a 118,287 image index it raises left/right pairwise accuracy against reversed geometry negatives from 0.51-0.53 to 0.81-0.96 and conditional R@1 among 21 category matched candidates from 0.05 to 0.37-0.75, at under a millisecond per batched query, while reproducing the native ranking exactly for queries that name no relation.
130. 【2611.05564】Lesion Overlap Ranks PET Segmentation Models but Does Not Certify Patient-Level Tumor Burden
链接：https://arxiv.org/abs/2611.05564
作者：Tushar Kataria,Gerald Sabin,Ponnuswamy Sadayappan,Shireen Y. Elhabian
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Metabolic tumor volume, summarizes whole-body PET, whole-body PET disease, Metabolic tumor, PET disease burden
备注：
点击查看摘要
Abstract:Metabolic tumor volume (MTV) summarizes whole-body PET disease burden for prognostic stratification and treatment assessment. Automated MTV is useful only if its estimate is reliable for the individual patient, yet segmentation models are usually evaluated with overlap metrics such as Dice rather than burden error. We examined whether overlap metrics identify unreliable MTV estimates using 1,014 autoPET FDG PET/CT studies. We evaluated LesionTracer predictions held out from fine-tuning, compared five selected released models on 489 tumor-positive patients, and examined the findings in 597 PSMA studies. Across the five FDG models, ranking by higher mean Dice gave the same order as ranking by lower mean relative MTV error ($\rho=-1.00$, exact $p=0.017$). At the patient level, however, out-of-fold Dice tracked relative MTV error strongly ($\rho=-0.75$), yet 82 of 489 patients (16.8\%) fell on opposite sides of the Dice 0.80 and MTV-error 25\% thresholds. Within the training-exposed released models, correlations ranged from $-0.47$ to $-0.74$ over narrower, high-Dice ranges. Out of fold, opposing false-positive and false-negative volumes cancelled about one third of spatial error in net MTV. In 236 of 489 patients, each of the five models missed at least one lesion, though not necessarily the same lesion. Thus, agreement in average model rankings did not establish the reliability of individual MTV estimates or reveal shared lesion misses. PET segmentation benchmarks should report patient-level MTV error and missed-lesion counts alongside Dice and other overlap metrics.
131. 【2611.05559】How Finely Can Vision-Language Models See Biology? Bio-VQA: A Benchmark for Taxonomic, Morphological, Spatial and Individual Reasoning
链接：https://arxiv.org/abs/2611.05559
作者：S M Rayeed,Qian Ma,Charles V. Stewart,Yao Ma
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：single image raises, biodiversity monitoring, single image, image raises, biological
备注： Accepted to WACV 2027, 8 pages main paper; 4 figures, 4 tables
点击查看摘要
Abstract:In biodiversity monitoring, a single image raises several questions: which taxon, how many, which trait, and whether the individual has been seen before. Vision-language models (VLMs) could answer all of these from the image, but their ability is largely untested in biology, as existing benchmarks focus mostly on species identification within a few taxonomic groups. We present Bio-VQA, the largest biological visual question answering (VQA) benchmark and the only one to span four aspects of biological visual understanding: hierarchical taxonomic reasoning, fine-grained attribute grounding, quantitative spatial reasoning, and individual re-identification. Bio-VQA contains 1.86M questions over 217K images from 11 public datasets, and extends right-or-wrong scoring to graded scoring, so a near-miss counts for more than a distant one. Evaluating 18 open-weight models from 3.75B to 38.4B parameters, we find that general visual capabilities do not transfer to biological organisms: the best model counts animals exactly on 41.7% of images with 2 to 10 individuals, less than half its accuracy on everyday objects at the same counts. Taxonomic accuracy falls to one sixth, from 0.72 at phylum to 0.12 at scientific name, and scaling helps mostly at coarse ranks. The gap to a domain specialist widens accordingly, from 0.731 against BioCLIP-2's 0.874 at class (1.2x) to 0.269 against 0.544 at scientific name (2x). On trait size measurement, 15 of the 18 models do no better than an image-blind baseline that predicts one fixed number for every specimen, and on re-identification, 17 of the 18 models fall below chance under adversarial conditions. These failures persist across a tenfold range of model size. We hope Bio-VQA becomes a standard test of how well VLM capabilities transfer to the biological domain.
132. 【2611.05539】Rewrite, Then Veto: Rewriter-Agnostic Edit Gating for LLM-Based Post-OCR Correction
链接：https://arxiv.org/abs/2611.05539
作者：Jorge Ramón Fonseca Cacho
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：repair noisy OCR, noisy OCR transcripts, historical documents, noisy OCR, OCR transcripts
备注： 26 pages, 3 figures, 12 tables. Code: [this https URL](https://github.com/SniperJF/ocr-edit-gate-release;) models: [this https URL](https://huggingface.co/SJF7)
点击查看摘要
Abstract:LLMs can repair noisy OCR transcripts of historical documents, but they also change text that was already correct. We propose EditVeto, a veto gate placed after a full-context LLM rewrite. The rewrite is character-aligned to the OCR input, its differences are split into blocks, and a 0.6B-parameter gate keeps or reverts each block. An oracle analysis motivates the design: given the true error locations, per-span generation is worse than no correction, whereas vetoing a full rewrite's edits helps. Trained on rewrites by two Qwen3 models and evaluated, frozen, on the eight HIPE-OCRepair-2026 test sets, the gate improves all five rewriters tested, two of them unseen in training: weighted cMER falls by 0.0026-0.0044 and the preference score rises by 0.15-0.25 (paired bootstrap, p ~ 0.0002 each). On published competition outputs it lowers cMER for three of four teams but raises it for the winning run (0.0050 to 0.0065). In a second, disclosed test look, a retrained gate still improves LoRA-tuned rewriters (cMER -0.0011 to -0.0021), and an ensemble of their gated edits reaches a cMER of 0.0069 and a preference score of 0.928, mostly through fine-tuning and pooling rather than gating. Built only on public models and data, it is behind the winner (0.0050) and tied with the second-ranked run (0.0071), both from the only team using domain pre-training, and ahead of all other published runs. A third, secondary look shows the unchanged gate improving zero-shot Qwen3.8-27B (cMER 0.0114 to 0.0108) but only the preference score of its LoRA-tuned version.
133. 【2611.05522】From Activation to Intervention: Interpreting Sparse Visual Features through Reconstruction
链接：https://arxiv.org/abs/2611.05522
作者：Jianyang Gu,Jacob Beattie,Mridul Khurana,Julia Chae,Xi Xiao,Cheng Zhang,Anuj Karpatne,Wei-Lun Chao,Sara Beery,Tanya Berger-Wolf
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：explaining model behavior, offering a promising, model behavior, promising basis, SAE
备注： Demo and code available at [this https URL](https://imageomics.github.io/RecSAEI)
点击查看摘要
Abstract:Sparse autoencoders (SAEs) decompose visual representations into individual features, offering a promising basis for explaining model behavior. Interpreting these features typically relies on images or pixel regions that most strongly activate them. However, this evidence becomes ambiguous when multiple features with different semantics frequently activate in the same locations, such as texture and color in the same patterns. We propose Reconstructive SAE Intervention (RecSAEI), a framework that shifts feature explanation from passive observation to active visual reconstruction. By intervening on representations along SAE decoder directions and reconstructing the visual output, we provide direct evidence of a feature's semantic meaning. We demonstrate that our method successfully disambiguates feature meanings across multiple datasets and vision encoders. Furthermore, our framework grounds [CLS] SAE interventions in a sparse set of patch SAE decoder directions. Beyond stable target response, this attribution also exposes the compositional relationship between elementary visual patterns and high-level semantics. Our results advocate for intervention reconstruction as an essential complementary signal for explaining neural networks.
134. 【2611.05451】From Tokens to Trajectories: Parameter-Efficient Continuous Adaptation of Unified Multimodal Models
链接：https://arxiv.org/abs/2611.05451
作者：Gayatri Deshmukh,Onkar Susladkar,Adheesh Juvekar,Halil Kilicoglu,Ismini Lourentzou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Unified Multimodal Models, tokenization in Unified, strict quantization bottleneck, fine-grained visual details, establishes strong semantic
备注：
点击查看摘要
Abstract:While discrete tokenization in Unified Multimodal Models (UMMs) establishes strong semantic reasoning, it introduces a strict quantization bottleneck that degrades fine-grained visual details, often resulting in structurally accurate but artifact-heavy images. We introduce FlowShift, a parameter-efficient post-training framework that bypasses this bottleneck by converting pre-trained discrete UMMs into continuous rectified-flow generators. Instead of discarding the backbone's semantic priors, FlowShift replaces discrete visual interfaces with continuous latent projections and applies LoRA to the attention layers. To efficiently boost visual quality without semantic drift, we propose Dual-Objective Velocity Vector Distillation (DOVD), which aligns the model with a high-fidelity continuous teacher and ground-truth continuous trajectories. This approach drastically improves perceptual quality while preserving prompt adherence and reasoning. When applied to leading discrete UMMs, FlowShift significantly improves COCO-30K FID and aesthetic scores, while retaining over 99.5% of multimodal understanding capabilities. Ablations confirm DOVD drives generation quality. Ultimately, FlowShift achieves high-fidelity continuous generation without sacrificing pre-trained semantic grounding.
135. 【2611.05449】SO(3)-Equivariant Learning on CAD Boundary Representations
链接：https://arxiv.org/abs/2611.05449
作者：Matteo Ballegeer,Dries F. Benoit
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Learning on boundary, boundary representations, requires robustness, B-rep networks, Existing B-rep networks
备注： Accepted to NeurIPS 2026 main track
点击查看摘要
Abstract:Learning on boundary representations (B-reps) requires robustness to the pose of a part, since CAD models are not stored in a canonical orientation. Existing B-rep networks either operate on world-frame coordinates and normals, and thus degrade under rotation, or encode each face in a local reference frame. Local frames yield invariance, but reduce inter-face messages to scalars and discard the relative orientation of adjacent faces. We propose SO3brep, an SO(3)-equivariant graph neural network on the B-rep face-adjacency graph. Node features are computed in local frames and mapped into a shared frame by Wigner D-matrices. Clebsch-Gordan tensor products couple these features with the directions between adjacent faces, so that relative orientation is preserved throughout message passing and the output remains SE(3)-invariant. Across three face-segmentation and two classification benchmarks with randomly rotated test parts, SO3brep achieves the highest accuracy among the compared B-rep networks and equivariant point cloud networks, with the fewest parameters. Its advantage is largest with few labeled parts, a setting typical of industrial CAD. Code is available at this https URL.
136. 【2611.05443】SurgTransfer: Multi-Step Latent Action Modeling for Action Transfer in Surgical World Model
链接：https://arxiv.org/abs/2611.05443
作者：Saurabh Koju,Love Panta,Deepak Thapa,Rudra P. K. Poudel,Prajwal Ghimire,Angus Watson,Yash Raj Shrestha,Prashnna Kumar Gyawali,Binod Bhattarai
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：provide intra-operative guidance, accelerate risk-free training, intra-operative guidance, accelerate risk-free, world models
备注：
点击查看摘要
Abstract:Surgical world models have the potential to provide intra-operative guidance, accelerate risk-free training and facilitate transfer of expert surgical maneuvers. However, the use of world models for transferring surgical expertise has been largely unexplored. Moreover, recent approaches in this domain have mainly relied on ground truth kinematics actions or expert annotations for specific tasks, limiting their applicability beyond the narrow range of tasks with ground-truth annotations. In contrast, existing works in the natural domain have shown promising results in learning latent actions solely from unlabeled videos and transferring the learned actions across contexts. We observe that this paradigm is short-sighted for the surgical domain, failing to capture the hierarchical and goal-directed structure of surgical procedures. Thus, we propose a novel multi-step action learning framework to learn context-invariant latent actions that are easily transferable across various surgical contexts. We perform extensive experiments on the publicly available datasets, SurgToolLoc-2022 and PitVis-2023, verifying our approach with both quantitative metrics and qualitative evaluation by surgical experts. We have published our code and the implementation details at this https URL.
137. 【2611.05411】PointNDF: Cascaded Neural Displacement Fields for Point Cloud Denoising
链接：https://arxiv.org/abs/2611.05411
作者：Michael Y. Wang,Pingping Cai
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：recover clean geometry, fine surface details, cloud denoising aims, underlying spatial distribution, observations while preserving
备注： 14 pages, 3 figures, 7 tables. Accepted to MMM 2027 (33rd International Conference on Multimedia Modeling)
点击查看摘要
Abstract:Point cloud denoising aims to recover clean geometry from noisy 3D observations while preserving both fine surface details and the underlying spatial distribution of the points. Many learning-based methods adopt a two-stage pipeline that first extracts point-wise features from the noisy input and subsequently predicts point-wise displacements via simple regressions. However, these approaches often lack robust feature guidance and distribution-aware geometric refinement, causing them to fail at maintaining optimal point uniformity and geometric quality. To address these limitations, we propose PointNDF, a denoising framework that combines patch-level geometric context with local displacement prediction. Specifically, a Point Transformer V3 (PTv3) encoder aggregates multiscale geometric information into a global patch descriptor. Rather than directly regressing an unconstrained displacement vector, a Neural Displacement Field (NDF) fuses this global patch descriptor with per-point neighborhood features. It then predicts each displacement through bounded-vector and scale factor branches, thereby achieving a superior, more uniform point distribution. Three cascaded NDF stages propagate local features and progressively refine the point positions. Experiments on PU-Net and ModelNet10 demonstrate competitive denoising accuracy and favorable inference efficiency. The source code is publicly available at this https URL.
138. 【2611.05408】Augmentation with Reinforcement Transformation for Low-textured Scientific Sketch Image Retrieval
链接：https://arxiv.org/abs/2611.05408
作者：Zhiqiang Wang,Sheri L. Barton,Jennifer H. Johnson,Yi He,Xingquan Zhu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：including wildlife conservation, Low-textured sketch images, archaeological illustration, Low-textured sketch, scientific applications
备注： IEEE BigData 2026
点击查看摘要
Abstract:Low-textured sketch images are widely used in scientific applications, including wildlife conservation, archaeological illustration, and forensic composites. Learning from and retrieving such images is challenging because they lack detailed surface textures and visual variations commonly exploited by modern deep learning models. This paper proposes Augmentation with Reinforcement Transformation (ART) to fine-tune pretrained models to learn effective representations for accurate sketch image retrieval. Our key observation is that sketches are particularly sensitive to image transformations, such as rotation, flipping, zooming, and stretching. While some transformations preserve their structural integrity, others may introduce distortions that hinder representation learning. Instead of randomly choosing transformations to construct fine-tuning views, ART formulates augmentation selection as a multi-armed bandit (MAB) problem, where transformations are treated as arms and their effectiveness is continuously evaluated through rewards. This enables ART to adaptively construct reward-guided view banks before self-supervised fine-tuning; the subsequent representation loss does not feed back to ART. On Florida manatee sketches provided by Mote Marine Laboratory, ART achieves 71.40% average Top-1 accuracy for transformed-scar retrieval, compared with 68.83% for random augmentation selection, and 55.84% for location-aware sketch retrieval, compared with 18.18% for frozen CLIP.
139. 【2611.05407】PEEK: One-Step-Look-Ahead Exposure Bias Correction for Diffusion Sampling
链接：https://arxiv.org/abs/2611.05407
作者：Yunwei Bai,Ying Kiat Tan,Tsuhan Chen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：strong numerical samplers, accurate denoising networks, Diffusion image generators, generators are successful, successful due
备注： Accepted to Neurips 2026
点击查看摘要
Abstract:Diffusion image generators are successful due to accurate denoising networks and strong numerical samplers. Yet the two components are not fully matched. During sampling, the denoiser predicts for the next step based on flawed input that differ much from the real data. This train-test gap, or exposure bias, caps image generation quality (i.e., blurry, lacking in details or awkward in shape). To mitigate the problem, we propose PEEK, a novel training-free deterministic sampler plugin. At each eligible denoising step, PEEK first performs a provisional one-step update, evaluates the denoiser once at the look-ahead state, and interpolates it with the one-step-later prediction to form the next noisy state. By taking the additional step, we obtain a generally more-image-like prediction from the higher-signal noisy state, mitigating the exposure bias. To optimize the interpolation positions, PEEK searches for an interpolation schedule search made efficient by the prefix and baseline noise-schedule-rebasing caches. On 8 pixel-space and latent-space diffusion models with unconditional, label-guided, and text-guided settings across various output resolutions, PEEK consistently improves over NFE-matched baselines, with FID improvements up to 49.3\% at minimal extra computation cost (e.g., the one-time-per-model calibration takes at most 2.2 minutes across our experiments.). Project website is at this https URL.
140. 【2611.05406】When Does Sharing Work? Scaling a Shared SigLIP2 Across Image, Video, Audio, and Audio-Visual Representations
链接：https://arxiv.org/abs/2611.05406
作者：Xiaofei Sun,Peng Wang,Huayao Liu,Xiaoxiao Xu,Jun Song,Deqing Li,Lin Qu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：advanced image-text understanding, cross-modal alignment realized, Contrastive pretraining, frozen anchor space, image-text understanding
备注：
点击查看摘要
Abstract:Contrastive pretraining has advanced image-text understanding, yet image, video, and audio encoders are still trained independently, with cross-modal alignment realized mainly through post-hoc binding to a frozen anchor space. We present Omni-Encoder, a general multimodal encoder that processes image, video, audio, and audio-visual inputs within a single SigLIP-2 Vision Transformer with fully shared parameters. Unlike anchor-centric binding or per-modality adapters, all modalities are optimized jointly end-to-end, and the framework is organized from input to training. A modality-native input stage first maps each signal into the shared embedding space, including a 1D-convolutional audio tokenizer that converts mel-spectrograms into tokens aligned with visual patches. A multimodal rotary position embedding parameterized by absolute timestamps then places visual frames and audio segments in a unified spatiotemporal coordinate system. Finally, alternating-modality training interleaves image, video, audio, and temporally aligned audio-visual batches and accumulates their gradients into one update, which we find central to stable joint optimization. Omni-Encoder achieves competitive results on 16 benchmarks across all four modalities with one shared parameter set, and joint training improves each modality over its separately trained counterpart. Code and models will be publicly released.
141. 【2611.05404】mmHand: Toward Pixel-Level-Accuracy Hand Localization Using a Single Commodity mmWave Device
链接：https://arxiv.org/abs/2611.05404
作者：Xiaoyu Zhang,Zhengxiong Li,Chenhan Xu,Luchuan Song,Huining Li,Hongfei Xue,Yingxiao Wu,Wenyao Xu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：longstanding focus due, hand localization problem, hand localization, hand localization system, longstanding focus
备注：
点击查看摘要
Abstract:The hand localization problem has been a longstanding focus due to its many applications. The task involves modeling the hand as a singular point and determining its position within a defined coordinate system. However, due to data modality limitations, existing hand localization technologies face several challenges. For example, vision-based localization raises privacy concerns, while wearable-based methods compromise user comfort. In this paper, we introduce mmHand, a new device-free, privacy-preserving dynamic hand localization system with pixel-level accuracy, using a single commodity mmWave device. We first propose a mmImage generation tool to fully extract spatial information from raw mmWave data and introduce a novel 2D image-format representation of mmWave data. Next, we design a framework that provides a new quality evaluation method and pixel space labeling for the mmWave data. Finally, we present a cross-modality spatial feature-enhanced model with high spatial feature extraction capabilities, which can accurately localize hand positions at the pixel level in the mmWave radar U-V pixel coordinate system. We evaluate the system with experiments on 12 subjects in three scenarios, and the results across four metrics demonstrate the effectiveness of our hand localization system.
142. 【2611.05403】Visual Forensic Detection of Fabricated Bangla News Photocards using Deep Learning
链接：https://arxiv.org/abs/2611.05403
作者：Anindya Kundu,Kabya Mithun Saha,Md. Muhaiminul Islam,Fayek Ahmed,Aminul Kader Bulbul,Muhammad Ibrahim
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：localized misinformation spreads, single-image news summaries, well-known news organizations, localized misinformation, misinformation spreads
备注： 15 pages, 9 figures, 22 tables
点击查看摘要
Abstract:In Bangladesh, much localized misinformation spreads as photocards: single-image news summaries that imitate the branding of well-known news organizations. Because the misleading message lives in the pixels rather than in machine-readable text, text-based fact-checking tools cannot see it. We recast photocard fake-news detection as visual image forgery detection. We build a dataset of 969 authentic and 1,077 fabricated Bangla photocards scraped from public Facebook pages: authentic cards from the verified pages of seventeen national television broadcasters, fabricated ones from pseudo-broadcaster pages, anonymous profiles, and public groups. Sixteen photometric and morphological transformations per image grow the corpus to 32,736 samples. A fully connected ANN reaches only about 52% accuracy, its loss stuck at ln(2) ~ 0.693, showing that flattening the image destroys the spatial cues forgery detection needs. A compact, fully batch-normalized four-block CNN with 489,954 parameters, about 1,644x smaller than the ANN, is evaluated with leakage-free stratified group five-fold cross-validation, which keeps every augmented version of a card in one fold. Under this protocol the CNN reaches 87.45% +/- 0.53% pooled accuracy from scratch and 88.75% +/- 1.55% when its classifier head is warm-started from the ANN. An ImageNet-pretrained YOLOv8n-cls backbone (1.44M parameters) fine-tuned on the same folds reaches 97.36% +/- 0.42%, marking the headroom above the compact model. We report per-class precision, recall, F1, and pooled confusion matrices, diagnose and fix a one-class collapse caused by an unnormalized classifier head, and give a manual error analysis and bias-variance diagnosis showing that the compact CNNs under-fit.
143. 【2611.05380】VAR-Q: Tuning-free KV Cache Quantization for Visual Autoregressive Image and Video Generation
链接：https://arxiv.org/abs/2611.05380
作者：Boxun Xu,Jiaji Lu,Yuxuan Yin,Zihu Wang,Ziyue Liu,Yu Wang,Zirui Liu,Peng Li
类目：Computer Vision and Pattern Recognition (cs.CV); Performance (cs.PF)
关键词：next-scale prediction, autoregressive generation spans, prediction for images, next-frame prediction, Visual autoregressive generation
备注： A preliminary version of this work was presented at the ICCV 2025 BiVision Workshop
点击查看摘要
Abstract:Visual autoregressive generation spans two dominant paradigms: next-scale prediction for images and video, and next-frame prediction for video. Both decode block-by-block rather than token-by-token, yielding KV caches whose statistics diverge from those of language models. At scale, KV memory exceeds the weights and limits large-scale deployment caused by a large amount of visual tokens. Our analysis of these caches reveals three findings. First, a small set of massive-value channels carries the functional load: ablating these outlier channels collapses generation, whereas ablating a matched set of inlier channels leaves quality intact. Second, the outliers organize along two axes, feature and block, with magnitudes persistent within each cell and shifting across cells. Third, this structure arises from two independent mechanisms: projection bias and RoPE-induced scattering. Guided by these findings, we propose VAR-Q, a tuning-free KV-cache quantization framework that groups along the same two axes. The generation loop provides block boundaries for free, removing the need for outlier detection or calibration. Paired with bit-packing kernels for runtime memory reduction, VAR-Q delivers low-bit quantization across nine models spanning both paradigms, cutting KV memory by up to 78.5% with negligible quality degradation and enabling 6x larger inference batches.
144. 【2601.06035】Investigating Anthropometric Fidelity in SAM 3D Body
链接：https://arxiv.org/abs/2601.06035
作者：Aizierjiang Aiersilan,Ruting Cheng,James Hahn
类目：Graphics (cs.GR); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Emerging Technologies (cs.ET)
关键词：topologically coherent meshes, human mesh recovery, Momentum Human Rig, demonstrating improved performance, mesh recovery
备注：
点击查看摘要
Abstract:The release of SAM 3D Body is a recent development in human mesh recovery, demonstrating improved performance in producing clean, topologically coherent meshes from single images. By leveraging the Momentum Human Rig (MHR), it achieves robustness to occlusion and diverse poses. However, our evaluation reveals a specific and consistent limitation: the model struggles to reconstruct detailed anthropometric deviations, particularly in populations exhibiting distinctive morphological alterations such as geriatric muscle atrophy, scoliosis, or pregnancy, even when these features are prominent in the input image. In this paper, we investigate this phenomenon not as a failure of the model's capacity, but as a byproduct of the "perception-distortion trade-off". We posit that the architectural reliance on the low-dimensional parametric MHR representation, combined with semantic-invariant conditioning (DINOv3) and annotation-based alignment, creates a pervasive "regression to the mean" effect. We analyze these mechanisms to understand why individual biological details are smoothed out. Furthermore, we state our contributions by proposing specific, constructive pathways for future work, such as implicit-explicit hybrid representations and Medical-in-the-Loop alignment, to extend the baseline performance of SAM 3D Body into the high-precision medical domain.
145. 【2511.03212】MvBody: Multi-View-Based Hybrid Transformer Using Optical 3D Body Scan for Explainable Cesarean Section Prediction
链接：https://arxiv.org/abs/2511.03212
作者：Ruting Cheng,Boyuan Feng,Yijiang Zheng,Chuhui Qiu,Aizierjiang Aiersilan,Joaquin A. Calderon,Wentao Zhao,Qing Pan,James K. Hahn
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Graphics (cs.GR); Machine Learning (cs.LG); Multimedia (cs.MM)
关键词：Accurately assessing, limited medical resources, delivery is critical, cesarean section, access to healthcare
备注： 19 pages, 4 figures
点击查看摘要
Abstract:Accurately assessing the risk of cesarean section (CS) delivery is critical, especially in settings with limited medical resources, where access to healthcare is often restricted. Early and reliable risk prediction allows better-informed prenatal care decisions and can improve maternal and neonatal outcomes. However, most existing predictive models are tailored for in-hospital use during labor and rely on parameters that are often unavailable in resource-limited or home-based settings. In this study, we conduct a pilot investigation to examine the feasibility of using 3D body shape for CS risk assessment for future applications with more affordable general devices. We propose a novel multi-view-based Transformer network, MvBody, which predicts CS risk using only self-reported medical data and 3D optical body scans obtained between the 31st and 38th weeks of gestation. To enhance training efficiency and model generalizability in data-scarce environments, we incorporate a metric learning loss into the network. Compared to widely used machine learning models and the latest advanced 3D analysis methods, our method demonstrates superior performance, achieving an accuracy of 84.62% and an Area Under the Receiver Operating Characteristic Curve (AUC-ROC) of 0.724 on the independent test set. To improve transparency and trust in the model's predictions, we apply the Integrated Gradients algorithm to provide theoretically grounded explanations of the model's decision-making process. Our results indicate that pre-pregnancy weight, maternal age, obstetric history, previous CS history, and body shape, particularly around the head and shoulders, are key contributors to CS risk prediction.
146. 【2611.06484】Object-independent evaluation of small-data astronomical image classifiers: architecture, representation, and acquisition shortcuts
链接：https://arxiv.org/abs/2611.06484
作者：Eraldo Pereira Marinho
类目：Instrumentation and Methods for Astrophysics (astro-ph.IM); Computer Vision and Pattern Recognition (cs.CV)
关键词：reflect object reuse, Reported performance, small astronomical image, astronomical image datasets, small astronomical
备注： 17 pages and 3 figures
点击查看摘要
Abstract:Reported performance in small astronomical image datasets can reflect object reuse, field-of-view differences, acquisition settings, and catalogue-derived properties as well as astronomical morphology. We designed \dataset{} to measure these effects in a four-class task comprising galaxies, globular clusters, nebulae, and open clusters. The dataset contains 370 catalogue-supported physical objects, each represented by three Digitised Sky Survey FITS bands, and uses a group-constrained split of 222 training, 75 validation, and 73 test objects. We compared a custom CNN--Transformer trained from scratch with ImageNet-pretrained ResNet-50 and ViT-B/16 under an adaptive full-field representation, a common angular field, and two central-region-masked controls, using three fixed seeds. In the one-pass object-independent test, mean balanced accuracy on the adaptive view was $0.773\pm0.014$, $0.874\pm0.054$, and $0.866\pm0.023$ for the custom model, ResNet-50, and ViT-B/16, respectively. No primary architecture contrast rejected its null after Holm correction; ResNet-50 and ViT-B/16 differed by 0.007 balanced-accuracy points (95\% cluster-bootstrap interval $[-0.048,0.062]$). Controls based on acquisition and catalogue metadata reached 0.721--0.735, and central-region-masked adaptive views reached 0.731--0.800. These results demonstrate generalisation to unseen physical objects, but also show that image context, acquisition settings, and catalogue-derived object properties carry substantial class information. In this regime, high accuracy cannot be interpreted as evidence that a classifier learned target morphology, and the comparison does not isolate architecture from pretraining.
147. 【2611.06430】OP: Transmission-Oriented Remote Sensing Pansharpening
链接：https://arxiv.org/abs/2611.06430
作者：Zi-Han Cao,Jing-Ze Liang,Shao-Jie Wu,Jin-Cheng Di,Liang-Jian Deng,Gemine Vivone
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：fundamental image fusion, remote sensing, extensively studied, fundamental image, TOP
备注：
点击查看摘要
Abstract:Pansharpening has been extensively studied as a fundamental image fusion task in remote sensing. However, most existing methods focus on improving fusion quality under the implicit assumption that high-resolution observations have already been fully downlinked to the ground. As a result, existing models are highly vulnerable to perturbations introduced by lossy compression used for downlink transmission. To address this limitation, we present, to the best of our knowledge, the first transmission oriented pansharpening (TOP) framework, which unifies compact latent coding, onboard pansharpening, and efficient downlink transmission within a single satellite-toground pipeline. TOP encodes remote-sensing observations into a compact binary latent space, where a lightweight onboard fusion module can efficiently predict the fused binary latent code. Since only the compact fused code is downlinked, the transmission payload is substantially reduced. Overall, TOP enables low-payload downlink and lightweight onboard processing while maintaining high fusion quality under severe bandwidth constraints. Experiments across multispectral and hyperspectral settings show that TOP consistently achieves superior fusion quality at higher compression ratios than representative pansharpening methods paired with standard lossy codecs. For example, on GaoFen-2, TOP attains a fusion PSNR of 31.4 dB at a downlink compression ratio of 50x. This design also points toward transmissionoriented processing for other remote-sensing tasks. The code will be made available at this https URL.
148. 【2611.05843】Dual Flow: Joint Image-Measurement Flow for Inverse Problems
链接：https://arxiv.org/abs/2611.05843
作者：Sevket Ege Yesilyurt,Figen S. Oktem
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：Existing generative model-based, linear inverse problems, generative model-based approaches, Existing generative, inverse problems typically
备注： 17 pages, 8 figures. Our code is available at [this https URL](https://github.com/METU-SPACE-Lab/Dual-Flow)
点击查看摘要
Abstract:Existing generative model-based approaches to linear inverse problems typically use the acquired noisy measurement to condition or guide sampling in the image domain. In this work, we introduce Dual Flow, a novel joint flow model for solving linear inverse problems by jointly estimating the clean image and its corresponding noise-free measurement from the observation. Specifically, Dual Flow formulates image reconstruction and measurement denoising as a coupled estimation problem, using coupled flows in the image and measurement domains. The acquired noisy measurement $\mathbf{y}_0$ is used only to initialize the measurement state; thereafter, the image and measurement states are jointly updated based on their current values. By construction, the final image and measurement estimates are guaranteed to satisfy the underlying forward model. We derive the sampling updates for the joint flow and show that they are governed by the conditional mean of the clean image given the current joint state. We further derive a closed-form expression for a sufficient statistic of the joint state and show that the required conditional mean can be obtained by solving an image-domain Gaussian denoising problem involving operator-dependent, correlated noise. We train a velocity-prediction network using this formulation to estimate the conditional mean from the derived sufficient statistic. Dual Flow requires no hyperparameter tuning beyond selecting the number of inference steps and achieves substantially shorter reconstruction times than competing methods. Extensive experiments across various linear inverse problems and image datasets demonstrate state-of-the-art performance in both distortion metrics and perceptual quality. Additional analyses assess robustness to model mismatch, as well as the ability to generate diverse plausible reconstructions and characterize reconstruction uncertainty.
149. 【2611.05618】When can multi-fragment 2D/3D registration be trusted? Calibrated certification and uncertainty-driven view planning for pelvic fracture fluoroscopy
链接：https://arxiv.org/abs/2611.05618
作者：Bowen Xiang,Michael I. Miga
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：Registering a segmented, guide surgery, Registering, view, fluoroscopy
备注：
点击查看摘要
Abstract:Registering a segmented CT to fluoroscopy can locate every fracture fragment but can guide surgery only when trusted. After each shot, our closed loop registers all fragments, bounds their errors with a calibrated sandwich covariance, flags implausible or ambiguous ones, and stops or plans the next view. On simulated fluoroscopy of 60 held-out fracture CTs with realistic image uncertainty, 95% bounds covered 83% of unflagged fragments and 91% of those within 5mm, but from the second view on 14% failed by over 5mm, a third with bounds of at most 2mm. A fragment's shift when a view was added separated tightly bounded failures best (exploratory; AUC 0.94, bound 0.81). Requiring that the newest view moved no fragment beyond its bound, preferred post hoc, lowered false stops at 2mm from 23% to 6% overall, with 345 instead of 362 correct ones but more trajectories uncertified; delaying the stop did not, and other signals at equal acceptance left 10-15% false. With a segmentation error shared by all views (median Dice 0.89), 21% of this rule's stops were false against 10% without it (15 cases; exploratory). Minimax planning certified sooner than the clinical protocol without the check (4.20 versus 4.72 shots, Holm p 0.001), but no criterion reached the pre-specified endpoint, a true 2mm error, significantly sooner, even in the true basin. On real fluoroscopy of five intact pelves no 2mm certificate was false. Trust takes evidence across views, not only a calibrated local bound.
150. 【2611.05398】AgentCount: An Agentic Workflow for Traceable Colony Counting and Insight Generation from Agar Plate Images
链接：https://arxiv.org/abs/2611.05398
作者：Zhuosheng Liu,Austin E. Weber
类目：Quantitative Methods (q-bio.QM); Computer Vision and Pattern Recognition (cs.CV)
关键词：food safety testing, food safety, safety testing, testing and microbiological, Colony counting
备注：
点击查看摘要
Abstract:Colony counting is commonly used to evaluate microbial populations in food safety testing and microbiological studies. Despite its wide application, manual counting is time-consuming and operator-dependent, and the final count often lacks a record of the objects included in the measurement. To address these limitations, this study presents AgentCount, an open-source agentic workflow for colony counting and result interpretation from agar plate images. Plate photographs and plating metadata are processed through seven agents for image quality control, plate localisation, colony detection, counting, CFU calculation, validation, and reporting. Colony detection is performed using Segment Anything Model 3 (SAM 3) with multiple text prompts and morphology-based filtering. After that, replicate statistics are calculated and a large language model (LLM)-based agent is used to generate a results narrative. Intermediate outputs, including quality scores, segmentation masks, detections, and warnings, are retained to support review of the reported values. The workflow also extends to skill-guided analysis of archived microbial population data. In a retrospective comparison with two previously published studies, we benchmarked 241 published endpoints, including all 216 mean +- SD values of the meat-analogue pathogen tables; on the 168 endpoints with a complete n=6 replicate source, 164 (97.6%) agreed within 0.01 log10 units. Overall, AgentCount demonstrates the promising potential of agentic workflows for applications in applied microbiology.
