本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。
统计
今日共更新1973篇论文，其中：
- 自然语言处理251篇
- 信息检索48篇
- 计算机视觉396篇
自然语言处理
1. 【2611.03634】WebHarbor: Docking Real Websites for Evolving GUI Agent Environments
链接：https://arxiv.org/abs/2611.03634
作者：Zhaoyang Wang,Qianhui Wu,Boyu Gou,Demi Wang,Jiacheng Zhang,Peichun Hua,Qize Li,Shi Qiu,Yifan Jiang,Yifan Zhang,Zexu Jin,Baolin Peng,Bolin Shen,Chetan Bansal,Dehan Kong,Deren Lei,Dongshen Peng,Fengqing Jiang,Hao Cheng,Haoqing Wang,Jiaming Shan,Jicheng Wang,Jingguang Zhou,Jixuan He,Kaide Zeng,Kangyu Zhu,Lama Moukheiber,Mufan Qiu,Peng Xia,Qihan Sun,Qingwei Lin,Qiushi Sun,Ruichen Zhang,Shuqing Luo,Si Qin,Sicheng Fan,Tao Xiong,Wenlin Yao,Xinyu Zhang,Xinyue Zeng,Xuanrui Li,Xuchao Zhang,Yian Wang,Yichao Liu,Yiming Liang,Yiyang Zhou,Yizhu Jiao,Yuetai Li,Yurun Chen,Yuxuan Zhang,Zheyuan Yang,Zhiyuan Yao,Zhongyang Li,Zihao Li,Zili Wang,Jianfeng Gao,Huaxiu Yao
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：agents require realistic, GUI web agents, require realistic, realistic and interactive, remain stable
备注： 31 pages
点击查看摘要
Abstract:GUI web agents require realistic and interactive environments that remain stable during both evaluation and training. Live website evaluation suffers from changing content, access restrictions, and limited coverage of authenticated workflows, while existing synthetic environments for training often lack functional depth and visual fidelity. We propose WebHarbor, a suite of 153 executable and dockerized website environments that faithfully reconstruct the visual interfaces, content, and functional workflows of real-world web services under deterministic control. We build WebHarbor through task-driven human-agent collaboration, where environments evolve as new tasks expand their functional scope, coding agents implement the required changes, and human contributors audit visual fidelity, functional correctness, and task validity. The resulting suite comprises 3,518 tasks spanning multi-step and post-authentication workflows, where existing works often fail to cover. Beyond reliable evaluation, WebHarbor provides high-fidelity synthetic web environments for cost-efficient reinforcement learning (RL). We demonstrate that a Qwen 4B-level GUI agent trained with RL in WebHarbor generalizes to unseen tasks and performs competitively with leading open-source GUI web agents across four benchmarks. The code and data are publicly available at this https URL.
2. 【2611.03622】DA: Decoupling Description and Assessment Enables VLMs as Zero-Shot Robotic Reward Models
链接：https://arxiv.org/abs/2611.03622
作者：Marius Memmel,Shawn Yin,Urvi Rutia,Angad Wadhwa,Eldon Li,Gavin Angeloff,Ankit Goyal,Jesse Zhang,Dieter Fox,Fabio Ramos,Anqi Li,Abhishek Gupta
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Systems and Control (eess.SY)
关键词：temporal ranking designs, relative temporal ranking, implicit success assumptions, existing frameworks frequently, frameworks frequently suffer
备注： Website at [this https URL](https://weirdlabuw.github.io/dna)
点击查看摘要
Abstract:Vision-Language Models (VLMs) hold promise for zero-shot video task-progress estimation in robot learning, yet existing frameworks frequently suffer from confirmation bias, hallucinating progress in failed executions due to implicit success assumptions or relative temporal ranking designs. Naive prompting of frontier models collapses into a binary success detector that fails to capture nuanced, non-linear progress and failures. While post-training approaches can mitigate this through explicit training, they demand expensive real-world robotics data and require computationally intensive post-training for every individual base model. To resolve these limitations, we introduce DA (Describe Assess): our approach decouples progress estimation into an objective, task-grounded textual description of scene dynamics followed by an assessment phase using explicit rubrics. By compelling the VLM to synthesize an explicit, text-based definition of absolute success before scoring, the framework anchors evaluations to an external, global criterion rather than the video's internal timeline. Empirical results demonstrate that our method calibrates zero-shot estimates and mitigates confirmation bias, providing fine-grained, partial progress metrics that accurately penalize failed executions while correctly interpolating successful runs. Being purely prompt-based, DA generalizes across tasks, embodiments, and benchmarks---matching or surpassing post-trained reward models---and its reward estimates enable efficient downstream reinforcement learning.
3. 【2611.03618】Strategist: Evolving Reasoning with Agents
链接：https://arxiv.org/abs/2611.03618
作者：Taiming Lu,Qi Xu,Zhigang Hua,Zhuang Liu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：half, turns model calls, Strategist, agent system, strategies
备注： NeurIPS 2026
点击查看摘要
Abstract:A model is only half of an AI agent system. The other half is the inference strategy: the reasoning procedure that turns model calls into a response. Today that second half is written by hand, and the experience of building one strategy never carries to the next. We introduce Strategist, a meta-agent that evolves inference strategies across tasks. Each strategy is written as a blueprint,executable code that other strategies can reuse, and together the blueprints form a library. Given a task and a small development set, Strategist retrieves related blueprints, writes candidate strategies, tests them on real samples, and revises them from the results. Every candidate then enters the library, so later tasks build on earlier discoveries. On 30 benchmarks, Strategist beats the strongest baseline on 24 and matches its average accuracy (74.7% vs.74.0%) at 39% lower inference cost. Its strategies also transfer to unseen tasks and other models without further search. The part of an AI system that is not improved on its own now does.
4. 【2611.03617】racing the Scientific Discovery Capacity of LLMs to Their Training Data
链接：https://arxiv.org/abs/2611.03617
作者：Arda Uzunoglu,Mahler Revsine,Michael Schatz,Benjamin Van Durme,Mehrdad Farajtabar,Daniel Khashabi,Eric Nalisnick
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：enables reliable discovery, basic questions remain, Large language models, show growing promise, Large language
备注：
点击查看摘要
Abstract:Large language models (LLMs) show growing promise for scientific discovery, yet basic questions remain about what enables reliable discovery. How can we trace the scientific discovery capacity of LLMs to their training data? We study this question as one of missing probability mass and develop a theoretical account in which monofacts-the facts observed once during training-set the discovery capacity. In materials science and regulatory genomics, we directly manipulate monofact rates in training sets and find that more monofacts consistently yield more discoveries across two open-weight model families, sampling strategies, and reasoning budgets. Further experiments show the relationship cannot be explained by training-set diversity alone and can transfer across scientific domains when paired with in-domain data. Together, our results identify monofact rate in training data as a key factor governing discoveries in language models.
5. 【2611.03605】ufakzeka-kulak: Building and Evaluating a 31.6M-Parameter Turkish Speech Recognizer from Scratch
链接：https://arxiv.org/abs/2611.03605
作者：Sait Furkan Teke(ufak AI)
类目：Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
关键词：CTC head, open Turkish, FLEURS Turkish test, FastConformer encoder, scratch and released
备注： 9 pages (text on pages 1 to 8, references on pages 8 and 9). Model, card, attribution, code and demo: [this https URL](https://huggingface.co/ufakai/ufakzeka-kulak) , [this https URL](https://github.com/ufakai/ufakzeka-kulak) , [this https URL](https://kulak.ufakzeka.com)
点击查看摘要
Abstract:ufakzeka-kulak is an open Turkish speech-to-text model of 31.6M parameters, a FastConformer encoder with a token-and-duration transducer (TDT) and a CTC head, trained from scratch and released under Apache-2.0. It writes cased, punctuated Turkish with numbers as words. Its 4,977 training hours come from sources whose licences allow commercial use; 281 hours are human-transcribed, and for the other 4,696 the training text is an uploader subtitle or a machine transcript, kept only where a second, independent reading of the audio agrees with it. The recipe, checkpoint, labelling and export choices were made on development data, and the test sets were scored once, in a release gate fixed before training. With greedy TDT decoding the normalised word error rate (WER) is 0.0921 (95 percent interval 0.0792 to 0.1055) on FLEURS Turkish test and 0.0916 (0.0873 to 0.0958) on Common Voice 27.0 Turkish test, lower than Whisper base and Whisper small on both sets with paired intervals wholly below zero; Whisper large-v3 (greedy) scores 0.0604 and 0.0767. On conversational speech the WER is 0.3807. We also report punctuation and casing, degraded audio, and how closely each shipped export reproduces the trained model.
6. 【2611.03601】DiabAgent: Toward Agentic Physiological Control
链接：https://arxiv.org/abs/2611.03601
作者：Chengxi Li,Shaoxuan Li,Deyao Hong,Qingle Liu,Yi Huang,Puheng Bian,Minzhi Xu,Lanyue Zhang,Mingze Sun,Xin Li,Calvin Xiao,Shengyuan Wang,Huan-ang Gao,Jiazheng Xu,Kaisen Yang,Hongning Wang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：medical language models, clinical question answering, pretraining scales, medical language, question answering
备注：
点击查看摘要
Abstract:As pretraining scales, medical language models have advanced rapidly in clinical question answering. Their ability to achieve effective physiological control through sustained intervention still lacks systematic quantitative evaluation. Type 1 diabetes provides a concrete setting: impaired insulin secretion creates dependence on exogenous insulin, with dosing continually adjusted using information about meals, exercise, illness, and glucose measurements. We introduce DiabAgent, a research suite for agentic physiological control comprising the Agentic Physiological Control (APC) framework, the DiabetSim simulator, and the SweetBench benchmark. APC controls glucose through medical-device tools, using ongoing observations to infer individual states, accumulate personal experience, and choose treatment actions. We build DiabetSim to simulate different patients, events, and device conditions for scalable virtual testing and training. Using DiabetSim, we construct SweetBench by instantiating 32 scenario designs as 212 glucose-control tasks. With Claude Opus 5.5 and a fixed decision interval of one hour, APC achieves a COGI of 73.5, compared with 71.2 for the open-source closed-loop baseline OpenAPS. Ablations further show that individual adaptation and contextual information improve glucose control. Combining high-frequency rule-based control with lower-frequency agent decisions shows potential for balancing control performance and computational cost. Our work provides a framework, simulator, and evaluation foundation for agents to participate in human physiological control.
7. 【2611.03577】Sonar-MoE: In-Backward Expert Updates for Memory-Efficient Mixture-of-Experts Training
链接：https://arxiv.org/abs/2611.03577
作者：Avni Mittal,Avinash Anand,Ashutosh Kumar,Dikshant Kukreja,Kritarth Prasad,Chaitanya Lakhchaura,Rishitej Reddy Vyalla,Erik Cambria,Zhengkui Wang,Rajiv Ratn Shah
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Performance (cs.PF)
关键词：expert, model belong, memory, GPU, MoE
备注：
点击查看摘要
Abstract:Most parameters of a Mixture-of-Experts (MoE) model belong to its experts, and standard training keeps every expert gradient in GPU memory until the optimizer step. This memory grows with the number and size of the experts, so it rises as MoE models scale. We introduce Sonar-MoE, which updates each expert tensor during the backward pass and frees its gradient right away. It brings optimizer-in-backward from dense models to batched MoE expert tensors, so the GPU never holds more than one layer of expert gradients. When we fine-tune OLMoE-1B-7B and Granite-3.1-3B-A800M in bf16 with two expert-kernel backends, Sonar-MoE lowers peak memory by 19% to 22%. Its updates are bitwise identical to standard training without expert gradient clipping, and held-out loss stays within 0.003 of all baselines. Each step also takes 17% to 23% less time than standard training with global-norm clipping. Updating whole batched tensors rather than individual experts is what keeps Sonar-MoE fast, as it avoids a 20% to 72% slowdown while using the same memory. Sonar-MoE matches optimizer-in-backward over all parameters in memory and speed while still clipping the dense parameters.
8. 【2611.03576】NitiBench+: A Temporal Thai Legal Question Answering Benchmark Across 17 Domains
链接：https://arxiv.org/abs/2611.03576
作者：Pawitsapak Akarajaradwong,Sarana Nutanong,Chompakorn Chaksangchaichot
类目：Computation and Language (cs.CL)
关键词：Thai, Law, Thai law, Thai Bar Council, models
备注： Under review
点击查看摘要
Abstract:Law changes over time. A court decides a case under the law in force on that day, and legal QA benchmarks grade answers against today's law. We checked 156,650 decisions of four Thai courts. Up to 67% of them cite law that has since been amended or repealed. We introduce NitiBench+, the sequel of our NitiBench, a Thai legal QA benchmark with 1,670 items across 17 domains, built from decisions of three courts. For each cited section it holds both the text in force on the decision date and the current text, and its retrieval corpus holds every dated version of every Thai statute section. Answers are graded on the Thai Bar Council rubric, the Bar-standard score, and on the overlap between the cited sections and the court's. The report has two parts. Part I measures the cost of the wrong text on 13 open-weight models. Reading the current text of amended law drops the Bar-standard score by 0.25 and missing repealed law drops it by 0.79. The penalty comes from rule changes, 0.45 on the 428 rule-changed items and none on the 331 wording-only items, and Citation F1 does not see it. The text in force is the fair setting. Part II benchmarks today's models on that setting. A public leaderboard ranks 26 models on a held-out test split of 500 items stratified by domain, with a validation split of the same shape released for public use, from memory alone, with the court's sections provided, and as a retrieval agent over the law in force, with the cost per item and the hallucinated citations. The best model scores 7.78 out of 10 and the best open-weight model 6.39. Without a search tool only five open-weight models recall any Thai law, and with it twenty of the 26 models gain and six lose. Leaderboard will take new models as they are released. Legal benchmarks must track dates, and on the right text today's models still leave a wide gap on Thai law.
9. 【2611.03575】VeriHarm-Bench: Measuring Harmful Success in LLM Coding Agents Verifiably
链接：https://arxiv.org/abs/2611.03575
作者：Wei-Lin Chen,Zhepei Wei,Xinyu Zhu,Yu-Min Tseng,Tzu-Han Lin,Yu Meng
类目：Computation and Language (cs.CL); Software Engineering (cs.SE)
关键词：Large language model, modify system configurations, Large language, agents increasingly operate, alter permissions
备注： Preprint
点击查看摘要
Abstract:Large language model (LLM) coding agents increasingly operate with shell access, allowing them to write scripts, move files, alter permissions, and modify system configurations. However, an agent may achieve a user's goal while causing unintended harm, such as deleting unrelated files, weakening access controls, or corrupting data, in response to benign inputs without explicit jailbreaking. This failure mode is particularly important because apparent task success may reassure users that an agent behaved correctly, causing harmful side effects to go unnoticed. We call this harmful success: the agent successfully completes the intended benign task while simultaneously causing unintended harm. Despite its importance, harmful success is difficult to measure because conventional task-success metrics overlook harmful behaviors, while existing safety evaluations are often designed solely to assess harmful outcomes. We introduce VeriHarm, an automatic framework for constructing programmatically verifiable benchmarks that directly measure harmful success. VeriHarm minimally perturbs coding tasks to elicit unintended harmful behavior while maintaining the benignity of the task and preserving the original task objective. It then synthesizes executable harm tests that, together with the original task-correctness tests, evaluate both task accuracy and harmful outcomes. Frontier agents, including GPT-5.6-Sol and Claude-Opus-5, achieve an average task accuracy of 95% on our curated VeriHarm-Bench, yet still struggle to complete tasks safely: their safe success rate, the fraction of tasks completed successfully without triggering the designated harm, averages only 37%. These results suggest that successful task completion can frequently coexist with unintended harm, and that task-success metrics alone may substantially understate the potential safety risks of coding agents.
10. 【2611.03551】Can LLM Agents Be Forward-Deployed Engineers? Requirement Discovery and Delivery for Enterprise Text-to-SQL
链接：https://arxiv.org/abs/2611.03551
作者：Marianne Menglin Liu,Rongguang Wang,Zheng Wang,Yewen Wang,Leonid Boytsov,Tao Sheng,Sujith Ravi,Dan Roth
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：LLM coding agents, LLM coding, increasingly automate model, discovering customer requirements, remains unclear
备注：
点击查看摘要
Abstract:LLM coding agents can increasingly automate model post-training, but whether they can act as forward-deployed engineer (FDE) agents, discovering customer requirements and turning them into deployment decisions, remains unclear. We study this on a real enterprise text-to-SQL engagement: a simulated customer, grounded in the real use case's requirements, starts with an ambiguous request. An agent must discover acceptance criteria, data permissions, and hardware constraints in the discovery phase, then plan and execute a post-training recipe in the delivery phase. Across 15 models, the strongest discover over 80% of withheld requirements and open-weight models discover 40-50%; in the delivery phase, only 25% of runs across eight coding-agent configurations pass all acceptance criteria. We identify four bottlenecks in this engagement: (1) incomplete discovery, with 40% of withheld requirements missing or misrepresented; (2) unreliable execution; (3) underused compute budgets and a lack of systematic comparisons across base models and post-training methods; and (4) benchmark accuracy does not guarantee production readiness. We suggest human review of discovered requirements, monitoring of the agent's plan during execution, and an explicit experiment-environment specification covering hardware, budget scope, and production checks.
11. 【2611.03526】Library of Layers (LoL): Adaptively Ordering Transformer Layers at Runtime
链接：https://arxiv.org/abs/2611.03526
作者：Abdellah Rahmani,Sean McLeish,Ang Li,Sanae Lotfi,Pascal Frossard,Micah Goldblum
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Computer programmers chain, Computer programmers, reusable computational primitives, conditional statements, statements or loops
备注： 32 pages, 22 figures
点击查看摘要
Abstract:Computer programmers chain together the same reusable computational primitives, for example, conditional statements or loops, but in different orders to implement different algorithms. In contrast, existing language model architectures always execute their layers in the same order. We introduce Library of Layers (LoL), an architecture that dynamically orders its layers during inference to solve the problem at hand. LoL has a single hyperparameter, the size of its global library of transformer blocks, that allows it to transition seamlessly between parameter reuse and sparsity, generalizing the parameter-efficiency and FLOPs-efficiency tradeoffs of dense, depth-recurrent, and mixture of experts architectures in one unified family. We show that LoL achieves competitive performance with all three above baselines when pretrained on text data. On synthetic sudoku and maze data, we observe that the model employs distinct layer orderings to implement different solution strategies, and we can intervene on routing to force a model to apply a specific solution strategy to a problem instance. In a multilingual natural language setting, we find that LoL chooses different layer order patterns based on language and script. Similarly, we train LoL on safety data and fit probes to its router outputs, finding that these probes distinguish safe from unsafe text with high AUROC. LoL provides a path toward a future in which models dynamically compose their own computational graph, enabling more efficient and controllable reasoning.
12. 【2611.03518】VIAS: Value-Isolating Activation Steering for Multi-Value Alignment and Compliance for Organisations
链接：https://arxiv.org/abs/2611.03518
作者：Avni Mittal,Avinash Anand,Dikshant Kukreja,Erik Cambria,Rajiv Ratn Shah,Sandipan Dandapat
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multiagent Systems (cs.MA)
关键词：Organisations increasingly deploy, increasingly deploy large, deploy large language, large language model, language model agents
备注：
点击查看摘要
Abstract:Organisations increasingly deploy large language model agents that must follow organisational values. We check whether activation steering, which adds vectors to a model's internal activations during generation without changing its weights, can improve compliance beyond prompting alone. Since most scenarios involve several values at once, we focus on multi-value steering. A simple way to build these vectors is to contrast responses that follow all values relevant to a scenario with responses that violate them. However, this gives nearly identical vectors for different values: they capture a general compliance signal rather than individual values, which limits their use when combining several values. We propose Value-Isolating Activation Steering (VIAS), which contrasts responses to the same scenario under two prompts, one listing all relevant values and one omitting a single target value. We keep a pair only if the target value changes from compliant to non-compliant and both responses still meet a minimum compliance level on the other values. We evaluate VIAS on PROTECT, a workplace compliance dataset where each scenario is tagged with relevant values from a 21-value taxonomy. VIAS reduces overlap between value vectors, making them better suited for multi-value steering, although this alone does not lead to independent control over each value. Combined with prompting, VIAS complies with every tagged value on 69.6% of scenarios for Qwen2.5-7B, 75.2% for Mistral-7B, and 72.6% for Phi-3.5-mini, outperforming prompting alone for all three models.
13. 【2611.03496】Online Label-Free Gradient Matching for Continual Language Model Training
链接：https://arxiv.org/abs/2611.03496
作者：Sajjad Pakdamansavoji,Mohammad Reza Rezaei,Ilija Subasic,Pedro Garzon,Radu Paradovschi,Zhao Chen
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Language models, continually updated, shifts over time, customer-facing products, serve shifts
备注： 18 pages, 5 figures, 12 tables
点击查看摘要
Abstract:Language models in customer-facing products must be continually updated, since the data they serve shifts over time. As retraining on the full accumulated data is impractical, each update should instead run on a small set of examples carrying the training signal of all data seen so far. The strongest current methods build this set by gradient matching, which synthesizes examples whose training gradients match those of the full data. However, they require ground-truth labels, run once on a fixed snapshot rather than on a growing stream, and are slow on large data. We introduce \textbf{OLGA}, which lifts these limitations. It distills unlabeled data by drawing the gradient matching targets from the model's own next-token predictions. Across five text classification benchmarks with phi-1.5, it improves accuracy by 10 percentage points over the strongest selection baseline using as few as five examples. OLGA also distills online data streams by keeping a running rehearsal memory of synthetic examples, which is re-distilled together with each new batch as it arrives. In the online setting, it outperforms the strongest selection-based continual baseline by 6.6 stream-AUC percentage points. Finally, our method scales to large data by pairing distillation with selection in a hybrid pipeline, letting selection handle the mild stage of compression and distillation the extreme one. It cuts runtime by 30\% versus distillation alone at similar accuracy, and beats the best selection-only pipeline by up to 12.6 percentage points.
14. 【2611.03434】Optimize the Harness, Not the Model: Fitting a Minimal Agent to a Self-Hostable LLM for Investigative Analysis
链接：https://arxiv.org/abs/2611.03434
作者：Shai Nahum Gefen,Vered Chassida,Dmitry Basin,Guy Feigenblat
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA)
关键词：Government intelligence teams, messy evidence collections, hosted frontier models, Government intelligence, analyze large
备注： 3 pages, 1 table. Industry Day talk at CIKM 2026, Rome, 7 November 2026
点击查看摘要
Abstract:Government intelligence teams need LLM agents that can analyze large, messy evidence collections, but security and cost constraints often rule out hosted frontier models and broad, hard-to-audit tool surfaces. We report CLEO: Constrained Loop for Environment Optimization, a method for fitting a minimal agent harness to a fixed, self-hostable LLM. Given an expert-validated dataset, CLEO admits only the tools, guardrails, memory policies, and loop components that improve accuracy while remaining general and auditable. On our held-out dataset, the CLEO harness reaches an 83.8% pass rate, within 1.2 points of the strongest out-of-the-box Claude Code SDK baseline, while being two orders of magnitude smaller.
15. 【2611.03424】IdeaTaste: Do LLMs Share the Research Taste of Human Researchers?
链接：https://arxiv.org/abs/2611.03424
作者：Shanshan Zhong,Chen Xu,Jingjie Ning,Zhengzhong Liu,Aviral Kumar,Chenyan Xiong
类目：Computation and Language (cs.CL)
关键词：increasingly shapes, ability to execute, Research, execute research, concrete approaches
备注：
点击查看摘要
Abstract:Research taste, the judgment of what to read, which problems to pursue, and which methods to try, increasingly shapes the work of AI scientists, yet it remains far less understood than their ability to execute research. We introduce IdeaTaste, a benchmark that scores an LLM by how closely the research proposals it writes from a literature snapshot frozen at 2025 match the work the same communities published in 2026. Our experiments span six contemporary language models and four research areas from established to emerging fields, covering more than 90{,}000 proposals in total. LLM agents fall well short of human communities in both the literature they cite and the ideas they state, reaching about 26\% of the human level on citation matching and only 18\% on idea matching. Their populations can cite as diversely as a community and take up its tasks and methods, yet rarely arrive at the concrete approaches and research plans it pursues. Neither richer field context nor larger populations substantially close this gap. In blinded expert review, AI proposals trail the 2026 papers least in presentation and most in expected success, echoing their gap in concrete approaches, and those whose ideas no human paper shares fare worst, suggesting weaker directions rather than overlooked opportunities. These results indicate that the main bottleneck in AI research taste lies less in finding the directions a community works on than in turning them into the concrete approaches it goes on to pursue. We release IdeaTaste as an open, continuously updated leaderboard (this https URL) that benchmarks contemporary AI proposals against future publication cycles.
16. 【2611.03377】Same Outputs, Different Scores: Auditing the Unchecked Graders of Multimodal LLM Benchmarks
链接：https://arxiv.org/abs/2611.03377
作者：Ahmad Jarjis Hasan,Jonathan Lwowski
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：multimodal-LLM multiple-choice benchmark, multiple-choice benchmark ends, wrong verdict, multimodal-LLM multiple-choice, free-form text
备注： Accepted at WACV 2027 (Evaluations and Datasets Track). Code and data: [this https URL](https://github.com/ahmadhasan2k8/grader-audit)
点击查看摘要
Abstract:Every multimodal-LLM multiple-choice benchmark ends with a scoring rule that converts a model's response, often free-form text rather than a clean option letter, into a right/wrong verdict, buried in its code. Unlike the dataset, this rule is chosen without justification and left unexamined, yet it sets the published number. We reproduce the official scorers of eight peer-reviewed benchmarks on five open vision-language models (VLMs) that fit a single 16 GB GPU, and introduce a blinded human-plus-LLM-judge adjudication (Cohen's kappa=0.956) that recovers what the model actually answered. The scoring rule alone moves accuracy by up to 22 points on identical outputs, yet exactly 0 wherever a model emits clean option letters, so it hides on strong-model leaderboards. It is the fallback and not the rambling that does the damage: the benchmark with the highest non-compliance we measure has an artifact of exactly zero, because its scorer abstains instead of guessing; a reasoning model with non-compliance 0.000 still swings 9.5 points with which regex match of its trace the parser keeps. No standard rule is reliable: snapping a non-answer to its closest option credits answers never given yet buries correct ones, abstention discards answers stated in words, and likelihood scoring follows answer-token priors, so a single grade conflates capability with luck rather than measuring either. We release all code, labels, and the protocol, and argue benchmarks should report a non-compliance rate and at least two rules, not one unexamined grade.
17. 【2611.03374】Characterizing When Language Models Take Harmful Actions to Protect Their Assigned Goals
链接：https://arxiv.org/abs/2611.03374
作者：Brandon Jaipersaud,Elliot Creager
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Recent language model, Recent language, disparate phenomena, failures have largely, largely been studied
备注：
点击查看摘要
Abstract:Recent language model (LM) safety failures have largely been studied as disparate phenomena. In agentic misalignment, a model blackmails an executive to avoid being replaced. In alignment faking, it complies with harmful requests during training to keep its values from being modified. We argue that these behaviours share a common decision structure: a model assigned a goal must either take a harmful action to preserve it or refuse and lose it. We formalize this as a goal-harm conflict and present the same conflict under various elicitation protocols that range from compact forced-choice prompts to simulated agentic environments. These protocols span two perspectives on LM decision-making, which we term (i) the logit view, reading preferences from answer-token probabilities, and (ii) the sampling view, classifying open-ended responses with an LM judge. Under the logit view, we show that goal importance and harm severity additively shape how a model resolves these value conflicts. Under the sampling view, we derive two factorizations of the harmful-action probability that safety evaluations commonly report. The first measures how well a preference read from answer tokens carries over into behaviour, such as making a harmful tool call. The second attributes a low harmful-action rate either to refusal or to responses that reach no resolution. We then show how fictional context changes a model's preference under the logit view, and how tool use and partial observability -- two features of agentic evaluations -- change its harmful-action rate under the sampling view. Our work offers a descriptive framework for studying how LMs resolve such value conflicts and for estimating low-probability harmful actions at a finer granularity than the aggregate harm rates commonly reported in safety evaluations.
18. 【2611.03317】Steering with Multilingual Lexicons for Sentiment Control in Low-Resource Languages
链接：https://arxiv.org/abs/2611.03317
作者：Lucinda Laurent,Muhammad Dehan Al Kautsar,Alfan Farizki Wicaksono,Fajri Koto
类目：Computation and Language (cs.CL)
关键词：existing methods depend, sentence-level contrastive data, controlling model behavior, Activation steering offers, Activation steering
备注： 30 pages, 12 figures, 11 tables
点击查看摘要
Abstract:Activation steering offers a lightweight mechanism for controlling model behavior, but existing methods depend on sentence-level contrastive data that is unavailable for most of the world's languages. We show that multilingual sentiment lexicons are a viable substitute across three model families: aggregated multilingual lexicons outperform English-derived steering vectors for mid- and low-resource languages, while monolingual lexicons remain stronger for languages a model has specialized in during pre-training. The steering efficacy is mechanistically dictated by both representational density and pre-training priors. Large-magnitude English vectors overwhelm the compact representations of low-resource languages, causing "linguistic collapse." This fragility is mitigated by the norm-dampening of multilingual aggregation. Architectural biases, including bilingual specialization penalty and latent numerical rigidity, also heavily constrain cross-lingual steering responsiveness. Ultimately, our work establishes lexicons as a practical steering signal and offers a comprehensive mechanistic account of cross-lingual steering dynamics.
19. 【2611.03309】MultiInpaintCOCO: Fine-Grained Visual Understanding in Multiple Languages
链接：https://arxiv.org/abs/2611.03309
作者：Andrei-Alexandru Manea,Jindřich Libovický,Philipp J. Rösch
类目：Computation and Language (cs.CL)
关键词：Previous research shows, Previous research, understand fine-grained image, English, fine-grained image details
备注：
点击查看摘要
Abstract:Previous research shows that vision-language (VL) models struggle to understand fine-grained image details and tend to focus on the overall layout. Moreover, any weakness in English tends to be further amplified in the multilingual setting. To study that, we extend InpaintCOCO, an English dataset focused on fine-grained visual details, to 13 typologically diverse languages across five language families, creating MultiInpaintCOCO - a new multilingual benchmark of 953 minimal-pair examples. We further test several state-of-the-art models in multilingual multimodal retrieval, considering both light VL CLIP-like encoders and large language models. Our results show that performance degrades substantially for lower-resource languages, with the strongest predictor being the data resources available for the languages rather than typological similarity to English. In cross-lingual retrieval, most models exhibit a systematic bias toward English: when given a correct caption in a non-English language and an incorrect one in English, models preferentially select the English caption. This bias varies considerably across architectures. Among the tested models, Gemma 3 shows the strongest English preference while Qwen 3 is the least biased, despite both reaching similar monolingual accuracy across languages. The code is available at this https URL.
20. 【2611.03308】LLMs Depend on Specialist Tools for Out-of-Distribution Generalization in MS/MS Structural Elucidation
链接：https://arxiv.org/abs/2611.03308
作者：Gabriel Asher,Cailum M. K. Stienstra,Tomo Oga,Devesh Shah Antonio H. de O. Fonseca,Niall O'Connor,Michael Widrich
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (stat.ML)
关键词：NMR structural elucidation, NMR structural, reported to solve, frontier language model, recently reported
备注： Accepted at "NeurIPS 2026 Workshop on Agentic Systems for Molecular Sciences" and "I Can't Believe It's Not Better: Failure Modes of AI in Biology Workshop at NeurIPS 2026"
点击查看摘要
Abstract:A frontier language model was recently reported to solve 1D NMR structural elucidation without tools. We ask whether this capability transfers to tandem mass spectrometry (MS/MS) in the de novo setting, where the model must propose a structure directly from the spectrum without a candidate list or reference library. To separate reasoning from recall, we build a 100-analyte benchmark from MassSpecGym, split by each analyte's textual footprint into in-distribution (well documented in literature) and out-of-distribution (essentially undocumented) arms. We hold the model, harness, and output format fixed and vary only the LLM's access to domain-specific tools. Without tools, a frontier LLM reaches 52% Top-1 accuracy in-distribution but only 2% out-of-distribution. Only access to de novo structure generators improves out-of-distribution accuracy, raising it to as much as 38% Top-1, and the resulting agent outperforms the standalone de novo models both in and out of distribution. These results suggest that LLMs are not effective at de novo MS/MS structural elucidation on their own, and that further gains depend on the specialist tools available to the agent rather than on the LLM itself.
21. 【2611.03280】Specificity Bias and the Wikipedia Paradox: An xAI Analysis of AI Text Detectors under Domain Shift
链接：https://arxiv.org/abs/2611.03280
作者：Nico Morloher,Johannes Reschke,Mohamed Mady
类目：Computation and Language (cs.CL)
关键词：Large Language Models, Large Language, human-authored versus synthetic, adoption of Large, versus synthetic text
备注：
点击查看摘要
Abstract:The widespread adoption of Large Language Models (LLMs) demands reliable detection of human-authored versus synthetic text. However, current Transformer-based detectors often experience severe performance degradation during domain shifts and operate as opaque classifiers. This paper investigates the robustness and interpretability of fine-tuned Transformer models (DistilBERT, RoBERTa) by evaluating them against a custom out-of-distribution (OOD) dataset of hyper-local news synthesized via open-source LLMs (Llama 3, Mistral, Gemma). To analyze model decision boundaries, we apply a tripartite Explainable AI (xAI) framework using SHAP. Our analysis reveals three key phenomena: First, detectors often rely on a "Call-to-Action" syndrome inherent to instruction-tuned LLMs rather than generic machine text. Second, we observe a "Specificity Bias," where LLMs successfully bypass detection by hallucinating specific named entities and mimicking conversational imperfection. Finally, we illustrate the "Wikipedia Paradox," wherein formal, objective human writing is frequently misclassified as AI due to its low statistical burstiness. These findings demonstrate that purely statistical detection paradigms face systematic limitations in highly structured human domains, emphasizing the critical need for semantically-aware, interpretable detection architectures.
22. 【2611.03223】Do Agents Still Follow the Rules? Benchmarking Rule Compliance under Agent Context Compaction
链接：https://arxiv.org/abs/2611.03223
作者：Yiwei Zha,Qingyu Meng,Herbert Bos,Min Chen
类目：Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：LLM agents compact, compact long histories, agents compact long, LLM agents, Rule
备注：
点击查看摘要
Abstract:LLM agents compact long histories to fit their context windows, but the compacted context must still carry the operating rules that govern later actions. Prior work shows that violations rise after compaction, but measures compliance outside a complete agent harness and does not identify where each violation comes from. We introduce ARCBench(Agent Rule Compliance Benchmark), a configurable benchmark built on the open-source pi agent harness. Its tool-calling agent loop lets us measure rule compliance from actions taken during execution, bringing the evaluation closer to deployed agent workflows. Using ARCBench, we examine where violations after compaction come from, and how different compaction configurations and adversarial settings change their sources. We find that compaction rarely deletes the rule: most violations after compaction occur while the rule is still in the compacted history, with the agent treating a later request as permission, ignoring the rule, and proceeding anyway. Where violations come from depends on the configuration: how the rule is delivered decides whether the agent would break it even without compaction, while the compaction strategy and budget decide whether the rule survives. The strongest compactor-targeted attack more than doubles violations by corrupting the rule in the summary and changing how the agents behave, whereas the strongest defense restores the rule in most summary but still violates. Finally, retaining a rule does not guarantee compliance: compacted runs that retain the rule violate more than twice as often as runs with the full history.
23. 【2611.03198】Written Once, Read Differently How Language Models Own Answers Steer Their Next Ones
链接：https://arxiv.org/abs/2611.03198
作者：Marcus Armstrong
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：language model answers, direction, language model, question, answers
备注：
点击查看摘要
Abstract:When a language model answers a yes/no question, that answer changes how it answers a different question about the same entity. We study this \emph{self-commitment} in 22 open-weight models from four families (0.5B--72B parameters), fixing the model's first answer and measuring the shift in its second across 3,600 question pairs about 120 entities. Each answer writes a \emph{commitment direction} into the residual stream. The similarity of two questions' directions predicts their coupling on held-out entities ($\rho = 0.43$--$0.85$), and ablating a single direction shared across topics leaves at most 17\% of the effect in every model. How this direction is read is far less stable: the reading circuit spreads across more attention heads as models grow, instruction tuning makes more questions read it in the opposite sense, and in one model changing only the system prompt reverses the circuit's sign. Ablating the direction while sparing the attention sink removes most of the coupling at under 1.3\% perplexity cost in 18 of 19 instruction-tuned models, though it shifts standalone answers in two. Without the sink spared, the direction's alignment with the leading principal component of ordinary text predicts which models pay a high cost. Written once, the commitment is read differently across scale, training and prompt.
24. 【2611.03196】Dhārā Bench: An Evidence-Oriented Retrieval Benchmark for Indian Knowledge Systems
链接：https://arxiv.org/abs/2611.03196
作者：Avinash Holenarasipur Nagendra,Anand Kaniyaar Sriranga Prasad,Kousik Sarathy Sridharan,Mohan Raghavan
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：Indian Knowledge Systems, Knowledge Systems, Indian Knowledge, Dhārā Bench, benchmark for Indian
备注： 18 pages, 6 figures, 9 tables. The first two authors contributed equally. Code and data: [this https URL](https://github.com/Avinash2236/Dhara-Bench)
点击查看摘要
Abstract:Dhārā Bench is a retrieval benchmark for Indian Knowledge Systems (IKS), with 325 questions in 12 categories and 60,121 text chunks from 15 source groups. The categories were developed based on 4,500 questions submitted to the Dhārā application; the evaluation set combines corpus-aligned application queries with expert-contributed questions. The annotations comprise 7,578 question-chunk relevance links involving 6,847 distinct corpus chunks. For 34 composite and multi-hop questions, 401 conjugate groups specify alternative sets of passages that jointly support each question. Chunk identifiers and hierarchical references connect the judgments to their source texts. The paper describes corpus preparation, annotation, and validation, and reports a fixed BM25 baseline implemented with Pyserini with $k_1=0.9$ and $b=0.4$. Across all questions, BM25 achieves MRR@20 of 0.315, Recall@10 of 0.182, and nDCG@10 of 0.205. On the group-annotated subset, complete-evidence scores are CE_Recall@20 = 0.294 and CE_MRR@20 = 0.141. The category results expose particularly weak verse retrieval, while group scores reveal gaps between finding individual passages and completing their support. The corpus and evaluation code are available at this https URL.
25. 【2611.03184】ACTOR: Action-Centered Temporal Organization for Literary Role-Playing Agents
链接：https://arxiv.org/abs/2611.03184
作者：Yuxiang Gao,Tianjie Ju,Zheng Wu,Zongru Wu,Hao Fei
类目：Computation and Language (cs.CL)
关键词：Large language agents, Large language, leaving characters' non-dialogue, Literary Role-Playing Agents, story time underrepresented
备注： Working in progress
点击查看摘要
Abstract:Large language agents for literary role-playing are typically modeled around dialogue generation, leaving characters' non-dialogue behaviors and their dynamic evolution over story time underrepresented. In this paper, we propose ACTOR (Action-Centered Temporal Organization for Literary Role-Playing Agents), an automated framework for constructing such behavior trajectories from raw novel texts. ACTOR extracts dialogue and persona-relevant non-dialogue behaviors, represents each behavior using a Thought-Action-Observation structure, and organizes behavior trajectories according to the internal temporal order of the story. We build a behavior dataset from 143 diverse literary works. For each source behavior, we generate counterfactual behaviors that are contextually plausible yet inconsistent with the character's persona. We find that existing models struggle to reliably infer character-consistent actions from historical behaviors and evolving character states. Using these behavior pairs, we train models with Regularized Preference Optimization (RPO), which augments DPO with a negative log-likelihood loss on the source behavior to jointly optimize behavior preference and generation. We further design a four-way next-behavior selection task to evaluate the model's ability to faithfully mimic character actions. Across 17,560 evaluation instances, the model trained on ACTOR's preference pairs achieves substantially improved accuracy. This result demonstrates that structured, temporally organized supervision enables models to leverage character profiles and prior behaviors to infer subsequent actions, greatly advancing literary role-playing beyond mere dialogue imitation. Code and data are available at this https URL.
26. 【2611.03179】Every Clause Counts: Instruction-Following Reranking by Multiplying Small, Answerable Questions
链接：https://arxiv.org/abs/2611.03179
作者：S. M. Mahbub Uddin Ahmed,Abdullah Al Musaddiq
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：People often attach, Weighted Instruction Sensitivity, Instruction Sensitivity Evaluation, search queries, written for beginners
备注：
点击查看摘要
Abstract:People often attach instructions to their search queries, asking for pages written for beginners, documents in a certain language or official sources only. Most rerankers were trained to judge topical relevance and treat such instructions as a few extra words. On the InfoSearch benchmark, even GPT-4o used as a list-wise reranker reaches an average WISE (Weighted Instruction Sensitivity Evaluation) of only 33.5. We present DMReranker (Decision-Model Reranker), a zero-shot reranker that splits an instructed query into a topic and a short list of typed clauses. A small judge model answers one narrow question per clause, and the answer probabilities are multiplied into a single score. Nothing is trained, and the configuration was frozen before the test runs. Reranking the same top-100 candidates as the published baselines, DMReranker reaches a macro WISE of 50.9 over all six InfoSearch dimensions while keeping original-mode nDCG@10 at 82.9. It trails GPT-4o on the stricter SICR (Strict Instruction Compliance Ratio) metric, 19.2 against 32.1. We show that this gap follows from how a product of probabilities behaves when SICR compares raw scores across runs. Computed from ranks, our SICR is 67.0. On the same judge, splitting the instruction raises WISE from 32.9 to 47.6 over a single combined question, while raw-score SICR falls. Scoring all six dimensions cost about $10 at list price.
27. 【2611.03178】CoworkOS:Scaling Agent Coworkers for Real-world Automation
链接：https://arxiv.org/abs/2611.03178
作者：Jiajie Jin,Guanting Dong,Chengjun Pan,Xin Deng,Zhuohui Sheng,Guoqiang Wang,Tao Gui,Yutao Zhu,Yujia Chen,Shihong Yi,Binze Hu,Zhixiong Yang,Zhichao Sun,Rui Wang,Han Han,Mingyu Ma,Junhao Huang,Xiaotao Wang,Huicheng Jiang,Yuyang Hu,Xinyu Yang,Wanghan Xu,Yajie Yang,Zhecan Wang,Honglin Guo,Xiaoyu Xing,Xiaoqian Zhang,Yulun Zhu,Xiaoxi Li,Jiahang Lin,Shaofan Liu,Shihan Dou,Zhiheng Xi,Qi Zhang,Yu-Gang Jiang,See-Kiong Ng,Yang Zhang,Tat-Seng Chua,Ji-Rong Wen,Zhicheng Dou
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：shifting human-AI collaboration, Rapid advances, delivering software, advances in cowork, shifting human-AI
备注： 34 pages
点击查看摘要
Abstract:Rapid advances in cowork agents are shifting human-AI collaboration toward real-world automation, delivering software, designs, and other artifacts. However, such productivity work demands both high-quality delivery on complex productivity tasks and continued monitoring and decision-making over long horizons, a combination that remains an open challenge. We introduce CoworkOS, a general-purpose harness for long-horizon work that separates task strategy from execution management: the model decides actions, delegation, and acceptance, while the runtime maintains state and feedback. Its three-layer architecture enables direct execution or delegation to Subagents, synchronously or asynchronously, under stable responsibilities. Through a shared application layer, humans and agents inspect and revise the same evolving documents, presentations, CAD models, and Blender scenes, so human-in-the-loop participation can enter both through conversation and through direct modification of the work itself. To sustain continuity across agents and sessions, CoworkOS further introduces hierarchical workspaces and persistent semantic memory, so working files, key decisions, and long-running Job logs remain shareable, reusable, and resumable after interruption. Across 12 benchmarks and 6 categories of real-world applications, CoworkOS proves highly competitive with frontier agent applications such as Codex and DeepSeek Harness. As a sustained-work case study, CoworkOS uses GLM-5.3 as its backbone to conduct RSI-driven automated post-training on Qwen3.6-35B-A3B. Over five rounds, the model's average score across eight benchmarks rose from 33.19 to 42.95 (+9.76). Looking ahead, we believe CoworkOS opens a meaningful path toward general cowork-agent intelligence.
28. 【2611.03171】ViAdminShift: A Vietnamese Benchmark for Event-Level Knowledge Updates Built from the 2025 Administrative Reform
链接：https://arxiv.org/abs/2611.03171
作者：Phan Binh Nguyen Lam,Nguyen Thai Anh
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Vietnam reduced, Vietnamese language resource, post-reform Wikipedia revisions, commune-level units, July
备注： 30 pages, 8 figures, 3 tables
点击查看摘要
Abstract:On July 1, 2025, Vietnam reduced its 63 provinces to 34, abolished its 696 districts, and replaced its 10,035 commune-level units (wards) with 3,321. ViAdminShift, a Vietnamese language resource about this event, consists of 7,995 benchmark items, 2,281 retrieval passages from pre- and post-reform Wikipedia revisions and dated templates, and old-to-new tables that a released script rebuilds from the official conversion table (not redistributed). Changed items store the pre-reform answer (except 121 address items), a $2\times2$ design uses untouched units as controls, and 400 addresses appear without diacritics. The tables agree with an independent lineage on 10,564 of 10,565 official pairs, disagreements were settled against the resolutions, and the probing-track scorer agrees with both authors' blind labels (Cohen's $\kappa=0.91$ and $0.89$). Data, outputs, code, and a datasheet are released. In the probing track, at least 20 of 67 models know the reform. Fourteen of them give the new province alone for at most 11% of plain questions about old addresses (old province only: 14-100%); a bare date recovers up to 100%. Post hoc (80 province-free addresses, single runs), with reasoning off, today's date in the system prompt leaves 68-100% old-province-only answers for 10 of 12 models; with reasoning, an "as of" prefix in the question leaves none for seven of eight. On the 1,262-item benchmark subset, with same-source old and new passages, small models unaware of the reform give 14-30% outdated answers and the five benchmark-track knowers (also differing in size or provider) 0-5%.
29. 【2611.03142】DepthGraft: Structural Regularization through Hierarchical Cross-Layer KV Reconstruction
链接：https://arxiv.org/abs/2611.03142
作者：Xiaohan Qin,Xiangdong Zhang,Yu Wang,Huaijin Wu,Zhuo Xia,Yebin Yang,Junchi Yan
类目：Computation and Language (cs.CL)
关键词：depth-wise information dilution, stronger large language, Scaling depth, large language models, information dilution
备注：
点击查看摘要
Abstract:Scaling depth is a key route to stronger large language models, but Pre-LN architectures often suffer from depth-wise information dilution, limiting the effective use of deep layers. While cross-layer connectivity has proven effective at mitigating this problem, existing designs usually introduce additional computation or memory access. We revisit cross-layer KV sharing as an efficient form of such connectivity. Beyond cache compression, each KV reuse edge creates a direct gradient path from deep layers to source KV projections, turning KV sharing into an implicit structural regularizer for KV representation geometry. We provide a systematic analysis of this mechanism, showing that proper sharing topologies sharpen key retrieval directions while enriching the value content subspace, whereas existing adjacent or global-anchor designs do not fully exploit this effect. Motivated by this, we propose DepthGraft, a hierarchical KV-sharing architecture that reconstructs deep-layer KV from stride-aligned shallow-middle source pairs. DepthGraft distributes non-local gradient flow across source layers, while preserving prefill early completion and reducing KV cache by roughly one third. Experiments on dense and MoE models from 0.5B to 16B parameters show consistent downstream improvements under both GQA and MLA. Notably, on the 16B MoE model, DepthGraft achieves a 7.0% absolute improvement on MMLU-Pro, along with gains of 6.6% on CMMLU and 6.4% on C3. These results validate the potential of DepthGraft as a scalable design for large-scale pretraining. The project page is available at this https URL.
30. 【2611.03133】Meet Students Where They Are: Student-Prefix Teacher Adaptation for On-Policy Distillation
链接：https://arxiv.org/abs/2611.03133
作者：Xue Zhang,Songming Zhang,Yunlong Liang,Fandong Meng,Yufeng Chen,Jinan Xu
类目：Computation and Language (cs.CL)
关键词：student exposure bias, On-policy distillation, exposure bias, bias by optimizing, student-generated trajectories
备注： 15 pages
点击查看摘要
Abstract:On-policy distillation (OPD) mitigates the student's exposure bias by optimizing on student-generated trajectories. However, student-generated prefixes may contain reasoning errors or follow patterns unfamiliar to the teacher, undermining the reliability of its token-level supervision. This degradation becomes more pronounced as prefixes grow longer. To address this teacher-side distribution mismatch, we propose Student-Prefix Teacher Adaptation (SPTA), which adapts the teacher to the states on which it is queried during distillation. Specifically, before OPD starts, we collect student rollout prefixes with random lengths and continually train the teacher to continue from the prefixes using reinforcement learning with verifiable rewards (RLVR). By treating each prefix as context and rewarding correct final answers, the teacher learns to recover from student-induced states rather than imitate the student's reasoning. Then, the adapted teacher is used for standard OPD, with no changes to the distillation objective. Experiments on mathematical reasoning benchmarks show that our SPTA improves average student performance over standard OPD and OPD with task-level RLVR-adapted teachers. These results highlight the importance of adapting teachers not only to solve problems independently, but also to provide reliable guidance on the states their students actually visit.
31. 【2611.03113】Preprocessing Choices in Fine-Tuning Data Matter: Utility and Demographic Sensitivity in LLM-Based Recommendation
链接：https://arxiv.org/abs/2611.03113
作者：Furkan Yasir Goksu,Yaren Yilmaz,Sule Gunduz Oguducu
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Large language models, Large language, producing item lists, language models, lists from textual
备注： 11 pages, 2 figures, 5 tables. Accepted at the 3rd Workshop on Evaluating and Applying Recommender Systems with Large Language Models (EARL) at CIKM 2026, November 8, 2026, Rome, Italy
点击查看摘要
Abstract:Large language models (LLMs) have introduced a generative approach to recommendation, producing item lists from textual representations of user histories and item information. However, this generative setting raises challenges concerning output validity, prompt consistency, and sensitivity to demographic descriptors. In this work, we investigate how preprocessing choices in fine-tuning data affect recommendation utility and fairness-related behavior in a generative LLM-based recommender system. We first establish a controlled recommendation pipeline that combines supervised fine-tuning, catalog-constrained decoding, and prompt augmentation. We then study three preprocessing choices: item-title representation, demographic balancing, and auxiliary item-knowledge enrichment. Experiments on MovieLens-1M show that the catalog-constrained pipeline eliminates out-of-catalog items and ensures complete ten-item outputs, while prompt augmentation improves prompt consistency and utility. Original MovieLens titles increase HR@10 from 10.67% to 12.47% and Coverage@10 from 41.36% to 47.88%. Fairness-related effects are attribute-dependent: age balancing and knowledge enrichment reduce selected group-level utility gaps while largely preserving utility, whereas gender balancing reduces utility without improving the evaluated gender-related indicators. Overall, preprocessing choices in fine-tuning data should be evaluated jointly in terms of utility, output behavior, and demographic sensitivity.
32. 【2611.03097】DR Pixel: Page-Native Deep Research with Vision-Language Models
链接：https://arxiv.org/abs/2611.03097
作者：Tiansheng Hu,Yichuan Wang,James V. Talwar,Nicholas Tomlin,Chen Zhao,Sewon Min
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：agents typically reduce, typically reduce papers, deep research, page-native deep research, existing deep research
备注：
点击查看摘要
Abstract:Complex documents such as scientific papers contain rich information in tables, figures, and equations; however, existing deep research (DR) agents typically reduce papers to OCR-extracted text. We instead ask whether vision-language models (VLMs) can enable page-native deep research: directly retrieving and reasoning over rendered document page images. We introduce DR Pixel, the first open-source end-to-end multimodal DR agent that uses rendered page images as its sole retrieval and reasoning unit, operating over a corpus of 1.06M pages. To evaluate this setting, we construct DRPixelBench, a benchmark on scientific papers requiring reasoning over text, figures, tables, and equations. Surprisingly, page-native DR already works well without training, outperforming OCR-based baselines across state-of-the-art models like GPT-5.4, Gemini-3.5-Flash, and Qwen3.6-27B, while requiring fewer tool calls. We next turn to DR training. A key challenge is that teacher trajectories for agentic supervised finetuning are noisy, mixing critical reasoning and action steps with redundant or failed attempts. To address this, we introduce counterfactual credit reweighting, a fine-grained credit assignment method that weights individual reasoning and action steps by their counterfactual contribution to the final answer. Our training improves retrieval recall by about 15 points and final accuracy by over 10 points on DRPixelBench, and likewise outperforms the untrained baseline on four existing benchmarks. On out-of-distribution ViDoRe-V3, DR Pixel comes within 1.8 points of an oracle that is given the gold pages directly. Our results suggest that the conventional OCR-then-retrieve pipeline is not only unnecessary but suboptimal: directly retrieving and reasoning over visual document pages makes complex DR both more effective and more efficient.
33. 【2611.03093】An Experimental Study of Hybrid Retrieval, NLI and Open-source LLMs for Scientific Claim Verification
链接：https://arxiv.org/abs/2611.03093
作者：Lakshmi Narayanan P,Narenkarthik K,Naren Kumar C
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：lacks sufficient evidence, Natural Language Inference, Large Language Models, source text supports, Language Inference
备注： 15 pages
点击查看摘要
Abstract:Claim verification is the task of deciding whether a source text supports a claim, contradicts it, or lacks sufficient evidence. Natural Language Inference (NLI) models can judge whether a single sentence supports or contradicts a claim, but they struggle when the evidence is spread across several sentences. Conversely, Large Language Models (LLMs) can reason across sentences, but may draw conclusions the text does not support. In this experimental study, we test whether a conservative fusion rule, labeling a claim Support or Contradict only when both models agree and defaulting to Not Enough Evidence otherwise, combines their strengths. We construct a benchmark of 2,035 claims from SciFact and CliniFact (858 Support, 152 Contradict, 1,025 Not Enough Evidence). We retrieve the top five most relevant sentences per claim using a hybrid of semantic and lexical (BM25) retrieval, which slightly outperforms either method alone. These retrieved sentences are then provided to every verification model. We then compare a DeBERTa-v3-base-mnli-fever-anli NLI baseline against Llama 3.1 8B, Qwen3 8B, and Mistral 7B. Qwen3 achieves the highest Macro-F1 (0.7937), followed by Llama 3.1 (0.7204) and Mistral (0.6388), while the NLI baseline reaches only 0.3157. Contrary to our hypothesis, fusion degrades performance, dropping Macro-F1 to 0.7392, 0.6730, and 0.5991, respectively. To understand this decline, we analyze agreements, disagreements, and common error patterns between the NLI and LLM verifiers. Our error analysis shows that NLI and LLM disagreements often result in correct LLM predictions being overturned.
34. 【2611.03092】Avatar Intelligence: Amplifying Human Agency Through Persistent Personal Agents
链接：https://arxiv.org/abs/2611.03092
作者：Zheng Wu,Xinbei Ma,Yao Yao,Zhaoyuan Huang,Haowen Hu,Yijie Lu,Taolei Wang,Yifei Yang,Wuyue Xiong,Pengzhou Cheng,Zhuosheng Zhang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：invest substantial effort, handling long-horizon tasks, resolving ambiguity, verifying outcomes, increasingly capable
备注：
点击查看摘要
Abstract:Personal AI agents are increasingly capable of handling long-horizon tasks across applications, yet users often need to invest substantial effort in specifying goals, resolving ambiguity, and verifying outcomes. We argue that progress should be measured by how effectively agents amplify human agency: enabling people to pursue their goals with less routine supervision while retaining control over consequential decisions. We advocate Avatar Intelligence, a paradigm of persistent personal agents that represent users' goals, values, and constraints through sustained decision delegation across contexts and time. We describe a maturity roadmap from human-directed execution to autonomous operation within delegated domains, and introduce the Agentic Oversight Index (AOI) as a framework for evaluating delivered value against agent-side operational cost and human oversight burden. We identify three core research challenges: identity-continuous personalization that carries user preferences across tasks, user-situated evolution through Rehearsal Engineering, and safety mechanisms that combine technical control with accountability and recourse. These directions define a research agenda for reliable decision delegation to personal agents across tasks and over time.
35. 【2611.03060】SAGE (Subjectivity-Aware Generation Estimator): A Linguistic Framework for AI-Generated Review Detection *
链接：https://arxiv.org/abs/2611.03060
作者：Gonzalo Freijedo Aduna(IJN),Charles Yaiche(CRIStAL),Patrick Bas(CRIStAL),Alda Mari(IJN)
类目：Computation and Language (cs.CL)
关键词：linguistically motivated approach, inherently human trait, propose a simple, linguistically motivated, peer reviews based
备注：
点击查看摘要
Abstract:We propose a simple, linguistically motivated approach to detecting AI-generated peer reviews based on the inherently human trait of subjectivity. We capture subjectivity at two levels: the semantic level of evaluative language and modality and the pragmatic level of speech acts. Using features derived from speech act annotations and model-predicted subjectivity scores, we train a lightweight classifier that achieves an AUROC of 0.9566 with only these linguistic features. Combining its output with the state-of-the-art detector Sem-Detect raises the TPR at 1% FPR of Sem-Detect on the APRDB benchmark from 0.874 to 0.985, outperforming the current state of the art. Our results show that linguistic features of subjectivity provide an explainable source of information for detecting AI-generated peer reviews and can be readily integrated into existing detection methods. The code and models are publicly available on GitHub (this https URL\_ text\_detection\_hub) and Hugging Face (this https URL), respectively.
36. 【2611.03051】Unlocking Criminal Court Decisions: Flexible Information Extraction for Empirical Legal Research
链接：https://arxiv.org/abs/2611.03051
作者：Tomáš Knap,Ivana Kvapilíková,Jan Černý,Klára Bendová,Jaromír Šavelka,Vojtěch Pour,Jakub Drápal
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：quantitative legal research, support quantitative legal, Criminal verdicts, criminal behavior, verdicts contain descriptions
备注： Accepted for publication in the proceedings of the 39th International Conference on Legal Knowledge and Information Systems (JURIX 2026)
点击查看摘要
Abstract:Criminal verdicts contain descriptions of criminal behavior that can support quantitative legal research, but structuring them requires attributes and extraction rules that cannot always be fully specified in advance. We present an LLM-based pipeline that builds a structured dataset through attribute exploration, text span extraction, and value normalization, guided by annotation instructions that legal experts can refine. We evaluate it on two traffic offenses: driving under the influence (DUI) and driving despite a ban (DDB). For DUI, revising the instructions was associated with higher extraction accuracy (from 52% to 70% of correctly extracted values) and higher agreement between human annotators. Repeated runs of the same model agreed with each other more than with the gold annotations, showing that consistent output is not necessarily correct, while disagreement between annotators and between models helped reveal unclear instructions. For DDB, where the instructions defined fixed categories and output formats, agreement was high for most attributes.
37. 【2611.03040】VERS: Steering Reasoning Models by Editing Their Activation Explanations
链接：https://arxiv.org/abs/2611.03040
作者：Ihor Vitenko
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：final answer, language models write, write a chain, chain of thought, Reasoning language models
备注： 36 pages. Code and checkpoints: [this https URL](https://github.com/Strongich/doomloop-interp)
点击查看摘要
Abstract:Reasoning language models write a chain of thought before they answer, and many checks in it do not change the final answer. Natural language autoencoders (NLAs) explain a model's activations in text and rebuild activations from text, and editing an explanation can steer a model at a single token. We study whether such edits can also steer how a model reasons. We build VERS (Verbalize, Edit, Reconstruct, Steer): it turns explanation edits at the doubt points of one reasoning trace into one fixed direction, and adds this direction at paragraph breaks. On the full GSM8K test, VERS cuts generated tokens by 45.8% at an accuracy change of -0.82 percentage points (pp); on MATH-500 it saves 31.3% at -3.05 pp. At half strength, its trade-off between tokens and accuracy lies between those of the published methods SEAL and DEER. With fitted affine maps and a strength tuned for each model, the direction transfers to larger Qwen3 models, up to 235B-A22B, and saves 30-35% of tokens. On competition problems, however, VERS loses 3-7 pp at every model size, and a fixed direction did not separate necessary checks from unneeded ones.
38. 【2611.02989】Finding Errors Is Not Enough: Selective Model Escalation for Entity-Targeted Sentiment Analysis
链接：https://arxiv.org/abs/2611.02989
作者：Nishan Chatterjee,Matthew Purver,Antoine Doucet,Senja Pollak
类目：Computation and Language (cs.CL)
关键词：limited resources involves, limited resources, resources involves, simply deciding, Improving a sentiment
备注：
点击查看摘要
Abstract:Improving a sentiment classifier with limited resources involves more than simply deciding how much data to collect or which model to train. A labelled collection may lack examples of an important class. Once trained, a classifier may benefit from another model even when that model is weaker on its own. We study these decisions in document-level Entity-Level Sentiment Analysis (ELSA), primarily using South Slavic news. We first compare acquisition orders as collections grow. We then use uncertainty to choose which predictions to revisit, how many to process, and whether an alternative encoder or local LLM can correct them. Finally, we select complete routing policies on development data for held-out evaluation. Minority-prioritised acquisition helps at some very small training sizes, but not consistently thereafter. On SentiCoref, an oracle correcting all errors in the least-confident 10% without harming correct predictions would add 9.14 Macro-F1 points; however the best evaluated action gains only 0.90. Encoder averaging helps on AspectBench and NewsMTSC but harms SentiCoref, where selective LLM assistance is more promising. Both development-selected policies route 30% of records to the encoder-assisted LLM, yielding observed gains of 1.02 points on SentiCoref (interval includes zero) and 1.71 on NewsMTSC, at substantially different inference costs.
39. 【2611.02985】Distilling Literary Sentiment from LLM Annotations into an Ordinal BERT Model
链接：https://arxiv.org/abs/2611.02985
作者：Artem Suslov,Takehiro Hashimoto
类目：Computation and Language (cs.CL)
关键词：literary corpora limits, domain-specific sentiment analysis, literary sentiment analysis, human-annotated literary corpora, sentiment analysis models
备注：
点击查看摘要
Abstract:The scarcity of human-annotated literary corpora limits the development of domain-specific sentiment analysis models. This study investigates whether LLM-generated annotations can supervise smaller models for literary sentiment analysis. We fine-tune five BERT models using ordinal regression on 10,889 literary sentences annotated by Gemma 4 31B on a ten-point sentiment scale. The models are evaluated against 1,923 human-annotated sentences from Hemingway's "The Old Man and the Sea", alongside the teacher model and conventional baselines. BERT-large achieves a Kendall's $\tau$ of 0.589, approaching the teacher's 0.604. Although a constant-neutral predictor achieves the lowest overall mean absolute error (MAE), BERT-base outperforms the teacher on non-neutral sentences, achieving an MAE of 0.726 versus 1.116. These findings demonstrate the potential of LLM-generated supervision for developing smaller literary sentiment models, while highlighting the limitations of aggregate error metrics on predominantly neutral datasets.
Subjects:
Computation and Language (cs.CL)
Cite as:
arXiv:2611.02985 [cs.CL]
(or
arXiv:2611.02985v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2611.02985
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
40. 【2611.02950】Action Verification through Conjecture and Refutation for Language Model Agents
链接：https://arxiv.org/abs/2611.02950
作者：Minhyeon Oh,Chiyeong Heo,Geonwoo Noh,Hoyoung Kim,Jangwon Son,Jungseul Ok
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：environment-specific context unstated, manipulating external environments, agents increasingly act, environments through tools, context unstated
备注：
点击查看摘要
Abstract:Language model agents increasingly act on users' behalf by manipulating external environments through tools, often from high-level instructions that leave critical task- and environment-specific context unstated. To prevent resulting misaligned actions, recent work verifies proposed actions before execution, largely by establishing whether the conditions supporting them hold. We argue that this confirmation-oriented view leaves a fundamental blind spot: a wrong action often passes every check that asks whether it is right. This motivates a different question for verification: rather than asking what evidence supports an action, can the agent find evidence that refutes it? We pursue this direction with BlackSwan, a refutation-oriented, expect-suspect-test procedure that predicts the intended effect of each state-mutating action, formulates specific and empirically testable hypotheses for how it could be wrong, and tests them using existing observations or additional non-mutating actions, executing the action only if none survives testing. On challenging AppWorld tasks, BlackSwan improves success rate over the strongest baseline by 14.9 and 25.2%p with and without the backbone model's thinking mode, respectively. Even without thinking or in-context demonstrations, it outperforms stronger baselines equipped with them. The gains also transfer beyond AppWorld, with BlackSwan improving WebShop performance by 12.7%p. More broadly, our results suggest that language model agents have an underused capacity to recognize and self-correct misaligned actions, which can be systematically elicited through active conjecture and refutation before execution.
41. 【2611.02940】PlagiaCorpus: A Bilingual, Adversarial, and Cross-Lingual Dataset for Forensic Plagiarism Detection
链接：https://arxiv.org/abs/2611.02940
作者：Adel Ammar,Serry Sibaee,Wadii Boulila
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Digital Libraries (cs.DL); Information Retrieval (cs.IR)
关键词：including reuse produced, large language models, bilingual Arabic-English dataset, text-reuse detection, bilingual Arabic-English
备注：
点击查看摘要
Abstract:PlagiaCorpus is a bilingual Arabic-English dataset for benchmarking plagiarism and text-reuse detection, including reuse produced by large language models (LLMs) and reuse across languages. It contains 198,643 text records: a source corpus of 34,885 passages drawn from English and Arabic Wikipedia and two openly licensed book collections, and 163,758 queries (147,381 for training and 16,377 for testing). The queries cover five reuse classes of increasing difficulty, namely verbatim copying, character-level obfuscation, same-language paraphrasing by two different LLMs, and English--Arabic translation with structural paraphrasing, together with a Safe class of non-reused passages. Every positive query is linked to its source passage, and the train/test split is grouped by source passage so that no passage contributes queries to both splits. The release was curated through language identification, removal of LLM generation artefacts, and exact and cross-lingual de-duplication. Technical validation reports per-class length statistics, automatic checks of the train/test split, and inter-annotator agreement on a manually rated sample. The dataset is distributed in JSON and Parquet formats under a CC BY-SA 4.0 license.
42. 【2611.02912】A State Change Is Local, Its Consequences Are Not: Dependency-Aware State Revision for Long-Term Agent Memory
链接：https://arxiv.org/abs/2611.02912
作者：Yiqi Wang,Tongyuan Zhao,Jiaqi Zhang,Yiqun Duan,Zhangkai Wu,Mingkai Zheng,Taotao Cai
类目：Computation and Language (cs.CL)
关键词：Long-lived agents rely, Long-lived agents, tasks and decisions, agents rely, rely on persistent
备注：
点击查看摘要
Abstract:Long-lived agents rely on persistent memory of users, tasks and decisions, and this memory must stay consistent with a world that keeps changing. When an upstream fact changes, however, memory systems can revise the contradicted memory itself while the beliefs, plans and actions derived from it remain accepted, even though they have lost their support. We therefore formulate dependency-aware state revision, which asks not only what changed but also which dependent states should no longer be trusted. To address it, StateGraph maintains an evolving state dependency graph whose edges are recovered from interaction histories. Its core design is counterfactual verification: each candidate edge is tested by asking whether the dependent state would survive the loss of its premise, which separates support dependence from semantic relatedness, and revision then invalidates a dependent state only when a strict dependency fails and no independent support path survives. To test this design, we introduce StateChangeBench, a controlled benchmark of 50 author-constructed cases annotated with cascade depth, hard negatives and action consequences. On it, StateGraph's Impact-F1 margin over a CUPMem reimplementation is 6.9 percentage points at depth 1 and 26.0 at depth 3+. On public long-term memory benchmarks, its point estimates are comparable to or higher than those of the evaluated baselines on most datasets. These results provide initial evidence that explicit dependency tracking can improve selective memory revision under changing conditions.
43. 【2611.02908】User Attributes and Political Ideology Shape LLM Receptiveness in Online Political Debates
链接：https://arxiv.org/abs/2611.02908
作者：Akram Elbouanani,Yousra Taleb,Gianluca Demartini,Adrian Popescu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：involve AI-mediated participation, assess contested claims, increasingly involve AI-mediated, discussions increasingly involve, arbitrate disputes
备注： Preprint. Submitted for conference review
点击查看摘要
Abstract:Online political discussions increasingly involve AI-mediated participation, as users invoke LLMs to assess contested claims, arbitrate disputes, and respond to opposing viewpoints. As these systems become participants in online exchanges, they may alter which speakers and argumentative strategies receive validation within the discussion. We study this interactional dimension by reconstructing 5,376 this http URL debates as LLM conversations and running nearly 150,000 controlled multi-turn conversations that vary user political orientation, expertise, rhetorical strategy, and defended position, including conversations with competing users. Across naturalistic and controlled debates, we find that LLMs are systematically more receptive to left-leaning than right-leaning users. The asymmetry persists when users with different political orientations defend the same position and when opposing users appear in the same conversation, indicating that it is not fully explained by stance agreement or simple accommodation to the current speaker. Repeated interaction increases receptiveness without eliminating this ordering; expertise also matters, while rhetorical differences are smaller. The pattern appears across multiple models, but is not fixed: fine-tuning on different political corpora can largely erase or reverse it. These results show that LLMs can respond systematically differently to participants in the same political debate, making such interactional asymmetries important for understanding their emerging role in online public discourse.
Comments:
Preprint. Submitted for conference review
Subjects:
Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
Cite as:
arXiv:2611.02908 [cs.AI]
(or
arXiv:2611.02908v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2611.02908
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
44. 【2611.02903】Maswao: An automatically collected, prepared, and benchmarked dataset for the South African Sign language
链接：https://arxiv.org/abs/2611.02903
作者：Thapelo Sindane,Unarine Netshifhefhe,Vukosi Marivate,Abiodun Modupe,Herkulaas Combrink,Ketro Sithole
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：sign language processing, pose estimation techniques, sign language, African Sign Language, South African Sign
备注：
点击查看摘要
Abstract:Recent advancements in sign language processing can be attributed to developments in both large-scale dataset collection and algorithmic complexity in areas such as pose estimation techniques, signal processing through Transformer models, and model optimization. However, only a handful of sign languages, such as the American, British, and German, from over 200 globally recognized sign languages, reap the benefits of such advancements, while the rest lag behind. In this study, we aim to address this technological disparity by proposing a framework for the automatic collection and preparation of sign language datasets, with very minimal human-labour intervention, using the South African Sign Language (SASL) as a testbed. Specifically, we automatically collect SASL video content using public resources such as news broadcasts. Additionally, we convert their accompanying audio streams into text using available Automatic Speech Recognition (ASR) tools. Furthermore, we crop the sign language area in the videos and use gradient descent to locate valleys of non-motion to determine end-of-sentence points within long videos to create our weakly sentence-aligned parallel corpora -- the Maswao (Signs) dataset. Finally, we benchmark the weakly aligned dataset on the task of Sign-to-text Translation using Recurrent Neural Networks and Transformer models to compare their individual intricacies. Our results show that Transformer models proposed in the literature outperform recurrent baselines, with the best-performing Transformer achieving BLEU-1 to BLEU-4 scores of 13.78, 5.21, 2.52, and 1.54, respectively, as well as ChrF = 18.09 and ROUGE-L = 10.51. These results indicate that the task remains promising and warrants further investigations.
45. 【2611.02889】ug of Watts: A study on the Energy - Accuracy Trade-off of Large Language Models on Medical Question Answering Tasks
链接：https://arxiv.org/abs/2611.02889
作者：Viju Sudhi,Giulio Billi,Andreea Scrob,Regina Stodden,Philipp Cimiano
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large Language Models, Large Language, medical question answering, Language Models, question answering
备注： Accepted to "Workshop on GREEN-AI: Grounding Research on Energy- and resource-Efficient Networks for sustainable AI", Co-Located with CIKM 2026, November 08, 2026, Rome, Italy
点击查看摘要
Abstract:Large Language Models (LLMs) are increasingly used in medical question answering (QA) systems. While recent works aim at incrementally improving the downstream task accuracy, an empirical estimation of the models' energy consumption and the associated carbon footprints is often overlooked. In this study, we demonstrate how practitioners can estimate energy consumption and arrive at reliable emission estimates for medical QA tasks available in the OpenMedical-LLM leaderboard by investigating 13 LLMs from 3 model families ranging from 270M to 14B parameters. We discuss how one can critically interpret energy versus accuracy trade-offs for a set of models for a given task. With this work, we underline that reporting disjoint energy and accuracy metrics alone does not suffice for careful trade-off assessments, but it also demands systematic construction and interpretation of joint trade-off metrics. We envisage such studies aiding practitioners in adopting better and more efficient models for their task and helping them become active participants in building sustainable LLM pipelines.
46. 【2611.02835】Omni-Life: Benchmarking Omnimodal Real-Time AI Assistants in People's Daily Lives
链接：https://arxiv.org/abs/2611.02835
作者：Mengze Hong,Ziwei Shang,Di Liang,Zijian Li,Liang Zhu,Hongyu Shan,Robin Zhou,Minlong Peng,Zhiqiang Kou,Jia Wang,Di Jiang,Chen Jason Zhang
类目：Computation and Language (cs.CL)
关键词：everyday life, Real-time omnimodal assistants, assistants are expected, expected to support, support people
备注：
点击查看摘要
Abstract:Real-time omnimodal assistants are expected to support people in everyday life, but audiovisual understanding alone does not establish whether they can provide timely and appropriate help. We introduce Omni-Life, a benchmark grounded in real-world user needs, deployment scenarios, and device-dependent observations. It combines controlled video synthesis for hazardous situations and edge cases with annotated real-world videos under a shared temporal protocol. The benchmark contains 400 videos: 290 requiring assistance, with 555 required intervention events, and 110 requiring silence throughout to test whether models can withhold unnecessary responses when no assistance is needed. We evaluate twelve configurations featuring mainstream real-time omnimodal models, jointly assessing event coverage, response content, timing, and unwanted output. At most 4.48% of videos requiring assistance are handled completely correctly. To examine practical deployment strategies, we study task reminders and response-latency tolerance. Reminders can improve recall by 17.12 percentage points but add approximately 4.6 unwanted responses per minute of reference silence. Increasing latency tolerance by 10s improves recall by at most 5.95 percentage points. These results show that existing models remain insufficient to deliver reliable assistance in real-life applications, calling for tailored model optimization in instruction following, timely proactive intervention, and withholding responses when assistance is not needed.
47. 【2611.02834】Window-Aware Scheduling for Health Messaging under Platform Delivery Constraints: Evidence from an AI-Powered WhatsApp Maternal and Infant Health Chatbot in Nigeria
链接：https://arxiv.org/abs/2611.02834
作者：Jeremiah Moyondafoluwa Adepoju,Samuel Omolaiye,Thanni Adewuyi,AbdulQahhar Abimbola Okenla,Lily-Aimas Love,Adereni Abiodun
类目：Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：business send free-form, customer service window, business send, customer service, send free-form messages
备注： 29 pages, 14 figures, 13 tables. Preprint
点击查看摘要
Abstract:WhatsApp lets a business send free-form messages only within 24 hours of a user's last message; outside this customer service window, only pre-approved templates are delivered. Health chatbots inherit this rule, but its cost is rarely measured. We analyse 98,607 messages sent to 3,696 mothers by a WhatsApp maternal health chatbot in Nigeria, with a largely separate export as replication. No free-form message failed with the window open (0 of 35,500), and failure jumped by 93.0 percentage points (95% CI 87.0 to 99.1) at exactly 24 hours. Two flows produced 66.1% of failures, including an offer to speak with a medical professional that, as built, reached 0.3 in 100 mothers whose window had closed. We formalise window-aware scheduling as a decision problem with an action of known zero value. Model-based offline evaluation, with bounds for unconfirmed delivery, estimates that sending the offer as an approved template would reach 81.5 to 86.8 in 100 such mothers, against 16.6 for waiting and 11.6 for a reply prompt. In a calibrated simulation, tabular Q-learning converges to the same template rule and does not beat it in any of 13 stress tests, and opting out does not rise with message volume. The main gain comes from respecting the platform rule, and it needs no learning. All outcomes are deliveries, not health outcomes.
48. 【2611.02810】RIO: Task Refinement with Individual Optimization for Retrieval-Augmented Generation
链接：https://arxiv.org/abs/2611.02810
作者：Yingtao Ren,Xiao Luo,Yiwei Fu,Jinzhao Zhou,Yu-Cheng Chang,Chin-Teng Lin
类目：Computation and Language (cs.CL)
关键词：studies retrieval-augmented generation, paper studies retrieval-augmented, leverages external knowledge, retrieval-augmented generation, language models
备注： The work has been published in EMNLP 2026
点击查看摘要
Abstract:This paper studies retrieval-augmented generation (RAG), which leverages external knowledge to improve the performance of language models. Despite the remarkable progress, current RAG approaches are still far from satisfactory due to inadequate retrieval and potential hallucinations. Towards this end, we propose a novel approach named Task Refinement with Individual Optimization (TRIO) for RAG. The core idea of our TRIO is to equip three well-designed agents with an iterative refinement paradigm by aligning their individual optimization objectives. Specifically, we first expand ambiguous queries with a query extension agent and quantify the reward based on the improved answer quality, which can be utilized to refine our agent for higher expansion efficiency. To enhance the retrieval quality, we include a unanimity voting to annotate the expanded query as insufficient or sufficient, and their generative outcomes are utilized as ground truth to optimize the judge agent. To further improve evidence utilization and answer accuracy, an answer agent is optimized with dynamic matching-based rewards with curriculum learning for final outputs. Extensive experiments across multiple benchmark datasets validate the effectiveness of the proposed TRIO in comparison with state-of-the-art approaches. Our code is available at this https URL.
49. 【2611.02807】Creating Hybrid Interactive Narrative Systems with LLM: From Formal Description to Evaluation
链接：https://arxiv.org/abs/2611.02807
作者：Jules Clerc(Heudiasyc),Domitile Lourdeaux(Heudiasyc),Mohamed Sallak(Heudiasyc),Marc Ravaine
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
关键词：balancing player freedom, Experience Manager, Large Language Models, users shape, shape a story
备注：
点击查看摘要
Abstract:Interactive narratives let users shape a story while an Experience Manager (EM) keeps it coherent, balancing player freedom against authorial control. Large Language Models now enable a new generation of hybrid EMs, which combine run-time generation from free-text input with symbolic narrative control. However, their heterogeneity makes them hard to compare: A manager's behaviour is generally tied to the unique and specific scenario in which it operates, and much of its decision-making takes place outside of any explicit and verifiable structure. We address this with an LLM-based narrative platform whose managers are interchangeable modules operating over a shared symbolic world model of facts, operations, and goals. Because every applied operation carries explicit preconditions and effects, each session can be analysed as a plan through a common state-transition representation and evaluated, independently of how the manager works internally, with shared indicators of four properties: player agency, EM controllability, author intent, and robustness. We implement three contrasting managers, based respectively on open generation, Monte Carlo repair, and autonomous characters, and compare them through functional analysis on an interactive Little Red Riding Hood scenario. The results show that no manager dominates on every property, giving authors and EM designers a concrete basis to select a manager according to their priorities.
50. 【2611.02797】SelfImprove-Bench: Evaluating Generalization in Self-Improving Agents
链接：https://arxiv.org/abs/2611.02797
作者：Bangrui Xu,Jie Yang,Sidi Chen,Xuanhe Zhou,Jiantao Qiu,Qianyu Yang,Zijie Wang,Fan Wu,Zhoufutu Wen
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multiagent Systems (cs.MA)
关键词：artificial general intelligence, systems are increasingly, general intelligence, Recursively self-improving, increasingly viewed
备注：
点击查看摘要
Abstract:Recursively self-improving (RSI) systems are increasingly viewed as a promising means of accelerating progress toward artificial general intelligence. They aim to autonomously improve their capabilities by refining their working pipelines and recursively improving the strategies that guide subsequent refinements, with gains generalizing to unseen this http URL, existing evaluations lack reliable metrics to distinguish capability gains from scenario fitting, sustainable and extensible protocols for unseen tasks and difficulties, and fine-grained attribution of improvement to evolution traces. To this end, we propose SelfImprove-Bench,an RSI evaluation framework that organizes tasks into three primary capabilities (i.e., Exploring, Planning, Reasoning) as scenarios for guiding model evolution. We instantiated the tasks on games for controllability and reproducibility, and pairs them with scalable generation and orchestration driven by task templates and difficulty coefficients. Beyond task-level scores, SelfImprove-Bench organizes evaluation into generalization ladder levels G0 to G4 that measure how far gains transfer from training conditions. Experiments reveal that the evolutionary gains of existing RSI methods are inconsistent across generalization levels.
51. 【2611.02791】PGuard: A Native, Streaming, and Plug-in Guardrail for Multimodal Large Language Models
链接：https://arxiv.org/abs/2611.02791
作者：Junyu Lin,Mengjie Wu,Yonghao Dong,Yuchuan Fu,Jinfeng Li,Xiaodan Li,Xiaohan Yuan,Yicheng Liu,Yuefeng Chen,Hui Xue,Jingyi Wang,Yitong Yang,Jiyuan Fu,Qinga He
类目：Computation and Language (cs.CL)
关键词：large language models, dominant serving paradigm, multimodal large language, critical challenge, large language
备注：
点击查看摘要
Abstract:As streaming generation becomes the dominant serving paradigm for both text-only and multimodal large language models, ensuring safety throughout the generation process has become a critical challenge. We introduce PGuard, a native, streaming, and plug-in guardrail that transforms safety monitoring from an external serving dependency into an integrated capability of the backbone model. PGuard directly leverages the backbone's intermediate representations for token-level safety detection, without altering its original inference pathway or generation behavior. Specifically, dynamic layer gating selectively aggregates residual-stream representations across layers to extract safety-relevant signals during both prefill and autoregressive decoding. To balance detection accuracy and computational efficiency, PGuard supports multiple representation-modeling architectures, including a lightweight stateless variant and sequence-aware variants built on multi-scale causal EMA-attention and GRU-based recurrent modules. Its design also accounts for the execution characteristics of LLM serving frameworks, such as SGLang, optimizing computation and data access to minimize additional runtime and synchronization overhead. As a result, PGuard incurs only 0.82-2.26% end-to-end overhead on the hundred-billion-parameter backbone Qwen3.5-122B-A10B served by SGLang. Extensive evaluations across more than 30 benchmarks spanning text and multimodal safety, jailbreaks, cyber and CBRN risks, multilingual scenarios, and real-world traffic demonstrate state-of-the-art performance among native guardrails. On text queries with Qwen3.5-9B, PGuard achieves an average F1 score of 0.836, approaching dedicated external guardrails, while supporting deployment-time configuration of category-specific thresholds and enforcement actions.
52. 【2611.02779】Stop Handcrafting Your Engine! GenDB-V: Towards AI-Generated and Formally Verified Database Systems
链接：https://arxiv.org/abs/2611.02779
作者：Jiale Lao,Immanuel Trummer
类目：Databases (cs.DB); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：systems run faster, database systems run, fundamental questions, run faster, community has developed
备注：
点击查看摘要
Abstract:For over 50 years, the database community has developed a wide range of successful engines to answer two fundamental questions: how can database systems run faster, and how can we ensure their correctness? Experience with these engines shows that performance depends on hardware and workloads. As both change over time, we repeatedly redesign and rebuild database systems, a time-consuming and expensive process. Correctness remains another long-standing challenge: recent studies continue to uncover wrong-answer bugs even in mature database engines, despite years of development and testing. To address these, we present GenDB-V, a system that enables AI agents to synthesize database engines specialized to hardware and workloads for performance, and formally verified for correctness. GenDB-V supports specialized implementations of SQL templates and general-purpose engines that accept any query within a supported SQL subset. First, we develop SQLSpec to formalize SQL semantics and deterministically construct fixed, implementation-agnostic synthesis targets. Second, we enable joint synthesis of fast code and formal proofs through storage--execution co-optimization, performance-first exploration, and three-layer modular proofs that bridge low-level execution to SQLSpec semantics. Third, we verify the synthesized code and proofs against the fixed synthesis targets in an isolated pipeline, proving SQL correctness and program safety. We evaluate GenDB-V on TPC-H and SEC-EDGAR. For verified template implementations, GenDB-V achieves geometric-mean speedups of 22.0-61.3x over DuckDB and Umbra. For a verified general-purpose engine, GenDB-V also achieves speedups of 1.27-3.4x on TPC-H. GenDB-V also achieves better performance than a testing-based LLM synthesis method, while our audit and tests expose incorrect answers in that method's implementations for 16 of 28 templates.
53. 【2611.02766】EffComp: Efficient Prompt Compression via Hybrid Reinforcement Supervised Learning
链接：https://arxiv.org/abs/2611.02766
作者：Romtham Tungsununtham,Piyawat Lertvittayakumjorn,Atiwong Suchato,Peerapon Vateekul
类目：Computation and Language (cs.CL)
关键词：higher-quality LLM predictions, potentially higher-quality LLM, reducing input prompt, input prompt lengths, Prompt compression
备注： Finding of AACL-IJCNLP 2026
点击查看摘要
Abstract:Prompt compression is aimed at reducing input prompt lengths to enable cheaper, faster, and potentially higher-quality LLM predictions. However, existing prompt compression methods are often limited by modest compression gains, a risk of hallucination, and/or high compression latency. We propose EffComp, an Efficient prompt Compression framework for RAG-based question answering (QA). EffComp employs BERT-style document reranker and sentence selector models to allow fast extractive prompt compression at the sentence level. Its extractive nature prevents hallucinations in the compressed prompts. Additionally, the training process using a hybrid reinforcement and supervised learning approach is designed to optimize the compression ratio while preserving LLM accuracy. Experiments on various QA datasets demonstrate that EffComp outperforms state-of-the-art prompt compression methods achieving the best trade-off between compression ratio and accuracy with minimal latency. This makes it practical for real-world applications.
54. 【2611.02746】Replay for LLM Continual Learning with Multi-Teacher On-Policy Distillation
链接：https://arxiv.org/abs/2611.02746
作者：Yiqiao Qiu
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：recent large language, large language models, earlier domains, earlier, large language
备注：
点击查看摘要
Abstract:Multi-teacher on-policy distillation (MOPD) distills several domain experts into one student and is used in the post-training of recent large language models. It trains on all domains at once, so every expert must be available at the same time. In practice, capabilities often arrive one after another, and the experts of earlier domains may be gone when a new domain is learned. Distilling the experts in sequence then suffers from catastrophic forgetting of the earlier domains. Some recent pipelines store a snapshot after every stage and end with a multi-teacher recovery stage taught by all snapshots. The number of stored models then grows with the number of stages. Different from these pipelines, this paper formulates continual MOPD by what is kept from earlier stages and studies replay toward the previous student. Inside every stage, prompts of earlier domains are replayed with the student of the previous stage as their teacher, so neither earlier experts nor stage snapshots are kept. Two design choices of replay are explored. The replay budget of a stage is either shared among the earlier domains or fixed per earlier domain. Replay steps either distill the token distribution alone or add alignment of hidden states, region-pooled self-attention scores and value relations. A five-domain benchmark of logic, math, code, safety and instruction following is built from public experts of one 1.5B student. Experiments on its 14 benchmarks show that, without storing any snapshot, replay toward the previous student closes most of the gap between sequential distillation and joint MOPD. With a fixed replay share per earlier domain, it performs on par with recovery from all stored snapshots.
55. 【2611.02710】MicroMouse: Masking Harmful Supervision in Long CoT via Relative Potential
链接：https://arxiv.org/abs/2611.02710
作者：Xiaowei Zhu,Hengzhu Tang,Zhenyu Zhang,Shuohuan Wang,Yubing Ren,Yanan Cao
类目：Computation and Language (cs.CL)
关键词：successful long CoTs, target answer, automatically identify, harmful supervision, long CoTs
备注：
点击查看摘要
Abstract:Even successful long CoTs may contain harmful supervision, motivating the need for methods that can automatically identify and mask such signals during SFT. Inspired by the MicroMouse maze-solving process, we view a long CoT as a search trajectory from the input problem toward the target answer. This perspective motivates maintaining a goal-relative measure, analogous to a MicroMouse's spatial coordinates, to quantify how close the current reasoning state is to the target answer. Building on this perspective, we propose MicroMouse, an automated selective-SFT framework for masking harmful supervision in long CoTs. In MicroMouse we introduce a Relative Potential (REP) to measure how closely each reasoning state supports the gold answer. Unlike the perplexity of the gold answer alone, REP measures relative support by contrasting the gold answer with a matched foil. This contrast cancels likelihood variations shared by the pair, yielding a more stable signal of progress toward the target answer. By tracking the REP trajectory, MicroMouse identifies consecutive potential decreases as erroneous exploration and post-peak reasoning as redundant wandering, and masks these harmful supervision during SFT. Extensive experiments across multiple student model scales and reasoning benchmarks show that MicroMouse consistently outperforms Full-CoT SFT and existing selective-SFT baselines, yielding average relative gains of 5.5% in greedy accuracy and 2.6% in Pass@1 relative to Full-CoT SFT. Meanwhile, MicroMouse improves reasoning efficiency by reducing average output length by 8.8%, while identifying harmful supervision in only 1.7 seconds per long CoT on average.
56. 【2611.02692】LLMs Cannot Be Neutral: Gender Sensitivity Across Candidates, Evaluators, and Models
链接：https://arxiv.org/abs/2611.02692
作者：Danial Amin,Joni Salminen,Bernard J. Jansen
类目：Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
关键词：Large language models, Large language, raising concerns, Large, gender
备注： This manuscript is under review at FAccT'2027
点击查看摘要
Abstract:Large language models (LLMs) are increasingly used to evaluate candidates for professional roles, raising concerns about their sensitivity to demographic identities. We examine how candidate and evaluator gender assignments affect decisions by LLM-as-a-Judge (LaJ) models and decision language models (DLMs). In a hypothetical city council voting task, eight models evaluated 240 synthetic professional narratives from NVIDIA's US and French Nemotron-Personas datasets under independently varied gender assignments, producing 30,720 judgments. Explicit candidate gender labels increased Yes-vote probability by 1.05-1.73 percentage points relative to unspecified gender, while only the nonbinary evaluator assignment showed a significant increase (1.26 points). Identity matching showed no significant overall association. Yes-vote rates varied across models (81.3-97.2%), and 2.5-3.3% of decisions reversed relative to the unspecified-identity baseline. Under direct substitutions between explicit gender identities, DLMs exhibited fewer decision reversals than LaJ models (1.18% vs. 3.38%), indicating lower observed decision-level gender sensitivity among the tested DLMs. These findings demonstrate that gender sensitivity depends on candidate and evaluator identities and the evaluation model, while highlighting the importance of examining individual decision consistency alongside aggregate differences.
57. 【2611.02666】rain the Sampler You Run: Few-Step Masked Diffusion Language Models via Mixture-Likelihood Fine-Tuning
链接：https://arxiv.org/abs/2611.02666
作者：Amin Najafgholizadeh
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：training fits token, fits token conditionals, cross-entropy training fits, masked diffusion language, training fits
备注： 41 pages, 8 figures, 34 tables
点击查看摘要
Abstract:When a masked diffusion language model is sampled in a few parallel steps in a random order, the model actually run is a mixture over reveal plans, while cross-entropy training fits token conditionals rather than this mixture. We introduce mixture-likelihood fine-tuning (Mix-FT), which fine-tunes a pretrained model on an importance-weighted bound of its own sampler's likelihood, with no teacher and no change to the architecture or the sampler. On LLaDA-8B, a LoRA fine-tune for 0.002% of the pretraining compute writes better OpenWebText continuations than continued cross-entropy and Alpha diffusion given the same compute, at every tested step count. With half the model evaluations, 16 rather than 32 steps per block, its continuations score better than the original model's in every seed under three judges, with confidence-based decoding as well as random order, and under confidence-based decoding two blinded LLM raters from different model families prefer them in 69 and 71% of pairs. On a public 110M-parameter block diffusion model, Mix-FT takes under four T4-hours and beats continued cross-entropy, Alpha diffusion and SDTT distillation at 4, 8 and 16 steps per block, under two judges in every seed. Exact likelihoods on text8, with a control that weights every plan equally, attribute about three quarters of the likelihood gain over continued cross-entropy to weighting each plan by how well it explains the sequence.
58. 【2611.02657】Constructing an Artworld Influencers Network by Mining Social Media
链接：https://arxiv.org/abs/2611.02657
作者：Amalia Foka
类目：ocial and Information Networks (cs.SI); Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：Natural Language Processing, artworld actors, author shows, shows a methodology, methodology for constructing
备注： Author's accepted manuscript. Published in Leonardo 55(1), 24-29 (2022), MIT Press. (c) 2022 ISAST. Supplemental material and tweet IDs: [this https URL](https://doi.org/10.5281/zenodo.23586408)
点击查看摘要
Abstract:The author shows a methodology for constructing a network map of the artworld. The tweets posted by a manually comprised set of exemplar artworld actors and Natural Language Processing (NLP) methods are used to identify significant artworld actors, including those that do not own a Twitter account. Identified artworld actors form communities detected with the Louvain method, and their authority is evaluated with the HITS centrality method. The resulting artworld network exhibits the ability, starting with a small set of exemplar actors, to identify new artworld actors and provides a wealth of data that would be very hard to collect otherwise.
59. 【2611.02637】Variable names provide priors: semantic grounding enables data-efficient numerical prediction by large language models
链接：https://arxiv.org/abs/2611.02637
作者：Xin-Rui Ma,Shi-Zhi Chen,Hai-Yan Jiang,De-Cheng Feng,Michael Beer
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Large language models, achieved strong performance, Large language, code generation, achieved strong
备注： Main text: 30 pages, 6 figures. Supplementary information: 53 pages, 11 figures
点击查看摘要
Abstract:Large language models (LLMs) have achieved strong performance across diverse tasks, from question answering to code generation. Recent studies have found that LLMs can perform numerical prediction on tabular datasets via in-context learning. However, it remains unclear under what conditions and how LLMs use variable names and in-context examples for numerical prediction. Here we show that semantic grounding, the match between variable names and the values they describe, allows five LLMs without task-specific training to match or outperform seven supervised machine learning (ML) models across 20 datasets from nine scientific domains, particularly when examples are scarce. Reasoning traces indicate that variable names allow LLMs to draw on domain-specific knowledge acquired during pretraining. Using controlled tasks based on physical formulas, we further show that LLMs integrate domain-specific knowledge with in-context examples in a way consistent with Bayesian updating. Specifically, when the relationship between the inputs and the target cannot be inferred from the examples alone, LLMs rely on domain-specific knowledge as the prior. Conversely, as contradicting examples accumulate, LLM predictions shift progressively towards these examples, which act as the likelihood. Our work reveals how LLMs use domain-specific knowledge in numerical prediction and positions them as data-efficient predictors for data-scarce scientific domains.
60. 【2611.02636】SYNC: A Training-Free Inference Controller for Dynamic Layer Selection in Multi-Persona Alignment
链接：https://arxiv.org/abs/2611.02636
作者：Yosef Nuraga Wicaksana,Muhammad Reza Qorib,Fadhil Muhammad,Alfan Farizki Wicaksono
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：touching its weights, Steering vectors align, time without touching, Steering vectors, Steering
备注： Under review
点击查看摘要
Abstract:Steering vectors align a model at inference time without touching its weights, but eliciting several personas at once is a different problem from eliciting one. Prior multi-persona steering approaches predetermine both how persona vectors are combined and the specific layers at which they are injected. Moreover, this static commitment introduces substantial offline search costs to identify suitable target layers, despite the fact that optimal intervention strengths vary dynamically across both decoding steps and distinct personas. We introduce SYNC (SensitivitY-guided iNference Control), a novel training-free inference control framework compatible with pre-existing steering vectors. SYNC dynamically estimates each layer's sensitivity to every persona via cosine similarity trajectories, assigning each persona to its optimal injection layer at every decoding step. Across two models, two persona profiles and steering vectors from both unsupervised and supervised extraction, SYNC leads on 21 of 28 persona configurations, significantly on 15. Code is available at this https URL.
61. 【2611.02630】ICJ-Graph: A Citation Graph and a Layered Document Corpus of the International Court of Justice
链接：https://arxiv.org/abs/2611.02630
作者：Jirameth Wannasiwaporn,Pawitsapak Akarajaradwong,Chompakorn Chaksangchaichot
类目：Computation and Language (cs.CL)
关键词：United Nations resolutions, United Nations, International Court, machine-readable resource connecting, provisions and United
备注：
点击查看摘要
Abstract:We present ICJ-Graph, a machine-readable resource connecting documents of the International Court of Justice (ICJ) to cited cases, legal provisions and United Nations resolutions. Court decisions, written pleadings and oral records form distinct document layers, preserving the distinction between the Court's reasoning and the parties' submissions. The collection contains 6,396 ICJ documents and 505 documents from other courts and legal bodies, together with 12,375 provisions and 20,291 UN resolutions. The data files contain text, metadata and embeddings. The accompanying pipeline lets users load the graph and generate embeddings for use in their own retrieval systems. To illustrate the resource's use, we evaluate five models on citation prediction for 199 decisions using documents available before each decision. Tools designed for citation research improve citation-prediction F1 over answering without tools for all five models across case, provision and resolution citations.
62. 【2611.02612】Scalaris: A Scalable Enterprise Memory Architecture for Conversational AI Assistants
链接：https://arxiv.org/abs/2611.02612
作者：Devarsh Gandhi,Sarthak Pawar,Hemprasad Badgujar,Vaibhav Rathore,Siddharth Sureka,Neha Bhargava
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：maintain conversational coherence, systems require memory, retain information, memory, conversational systems require
备注： Paper Under Review
点击查看摘要
Abstract:Enterprise conversational systems require memory to personalize interactions, retain information across sessions, and maintain conversational coherence. At enterprise scale, however, memory must not only retrieve relevant information accurately but also provide it efficiently to the answer-generation model. Existing memory systems face a trade-off between retrieval accuracy and context efficiency. Retrieving more context can improve recall but increases inference cost and latency. We present Scalaris, a scalable enterprise memory architecture that addresses this trade-off through a unified long-term and short-term memory design. We propose that user interactions and assistant responses possess distinct characteristics and roles in a conversation: user interactions capture evolving knowledge about the user and provide value across sessions, whereas assistant responses must be stored efficiently so that only information relevant to the current query is retrieved. We therefore treat them separately and support each with specialized representations and ingestion/retrieval pipelines. Scalaris reaches 92.2 % accuracy on LongMemEval-S and 90.77 % on LoCoMo using Qwen3-32B, state-of-the-art results on both benchmarks, while supplying the answer-generation model with approximately 10 times fewer retrieved context tokens than Hindsight, a leading memory system for conversational AI. When integrated with our proprietary closed-source AI assistants, Scalaris improved overall response quality by 36 %. Together, these results establish Scalaris as a cost-effective framework for building scalable, personalized conversational AI systems.
63. 【2611.02587】hey Know Where It Is, But Not What It Says: A Bilingual Hallucination Benchmark of Hadith Recall in Open LLMs
链接：https://arxiv.org/abs/2611.02587
作者：Dayam Nadeem,Safdar Mustafa,Ameen Ur Rehman,Shahab Saquib Sohail,Mohammad Nadeem,Usman Naseem
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Prophet Muhammad, Large language models, Sunan Abi Da'ud, Sunan Ibn Majah, Sunni Hadith collections
备注：
点击查看摘要
Abstract:Large language models are increasingly consulted for religious knowledge, including the recall of specific Hadith (recorded sayings and actions of the Prophet Muhammad, peace be upon him). Unlike open-ended generation, Hadith recall is a high-stakes, verifiable task: a reference (collection, chapter, and Hadith number) has exactly one correct text, and any deviation from it constitutes a fabrication that can be mistaken for authentic scripture. This study introduces a bilingual (English/Arabic) benchmark that probes five open-weight, locally-deployable language models (Mistral-7B, Gemma3-4B, Jais-7B, ALLaM-7B, and Phi4-mini-3.8B) across all six canonical Sunni Hadith collections (Sahih al-Bukhari, Sahih Muslim, Sunan Abi Da'ud, Jami' al-Tirmidhi, Sunan an-Nasa'i, Sunan Ibn Majah), sampling 500 Hadith per collection (3,000 per model per language, 30,000 responses total). Each model is given only the bibliographic reference and asked to reproduce the exact Hadith text, with no retrieval augmentation, and is scored on lexical fidelity (BLEU) and semantic fidelity (multilingual cosine similarity), with refusals flagged separately. Across all five models and both languages, 0% of 30,000 responses achieve both high lexical and high semantic fidelity, i.e., an exact, verifiable match to the source text. Arabic responses fare uniformly worse than English. These findings suggest that current open-weight LLMs, used without retrieval grounding, are unreliable and potentially dangerous sources for exact religious-text recall, and that deployment for Islamic scholarship should mandate retrieval-augmented generation over a verified corpus rather than parametric memory. The complete code, prompts, evaluation pipeline, and scored outputs are publicly available at this https URL.
64. 【2611.02585】From Language to Country to Valence: A Multilingual Audit of Stereotype Bias Across LLMs
链接：https://arxiv.org/abs/2611.02585
作者：Zihao Sun
类目：Computation and Language (cs.CL)
关键词：workplace decision support, making pre-deployment social-bias, social-bias detection essential, pre-deployment social-bias detection, Large language models
备注： 10 pages. Author preprint; conference review ongoing
点击查看摘要
Abstract:Large language models (LLMs) are increasingly considered for education, recruitment, workplace decision support, and other consequential applications, making pre-deployment social-bias detection essential. Yet major benchmarks are English-centred or translated, focus mainly on negative stereotypes, and may miss linguistic and cultural variation. We investigate gender, racial, and religious bias using 12,000 locally written Reddit posts in English, Spanish, French, and German. Only search terms are translated, preserving local context. The dataset is balanced by language and category; English gender is additionally balanced by stereotype valence. Three open-weight and three proprietary API-based models are evaluated with a two-blank design that reduces grammatical-gender cues. Religion has the highest absolute choice imbalance in every model-language condition. Spanish is highest for gender, whereas German is highest for race and religion. The evaluated API models score below the open-weight models throughout. Negative English-gender items exceed positive items; Australian and Mexican contexts exceed their Canadian and Spanish counterparts. These descriptive differences measure choice concentration, not stereotype endorsement or causal country effects. The crossed patterns show how aggregate scores can conceal category- and context-specific behaviour, motivating closer inspection before deployment.
65. 【2611.02581】SMILE: A Structured Multi-Agent Clinical Reasoning for Liver Ultrasound Understanding
链接：https://arxiv.org/abs/2611.02581
作者：Haris Ghafoor,Minjee Seo,Seonaeng cho,Keungmo Yang,Jaejun Lee,Kyungho Yoon
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：report generation improves, Automated liver ultrasound, ultrasound report generation, Automated liver, liver ultrasound report
备注： Accepted at Winter Conference on Applications of Computer Vision (WACV) 2027
点击查看摘要
Abstract:Automated liver ultrasound report generation improves the diagnosis of liver diseases by producing clinically structured descriptions of anatomical and disease-related findings. However, current generative vision-language models (VLMs) often rely on a single reasoning pathway that maps ultrasound appearance directly to textual descriptions. In addition to the inherent vision-language modality gap, this design is limited for liver ultrasound because disease interpretation is constrained by subtle visual evidence, heterogeneous disease patterns, and limited paired supervision. To address these limitations, we propose SMILE, a Structured Multi-agent clInicaL rEasoning framework that uses multiple complementary specialist agents to interpret ultrasound images and consolidates their outputs through a judge-guided consensus mechanism. Our approach employs three specialized agents: an image interpretation agent for morphological descriptions, a clinical-stage reasoning agent, and a visual question answering (VQA) agent for targeted queries. These agent responses are then aggregated and scrutinized by a judge VLM using a consensus filtering prompt to produce a unified, clinically coherent output. Across a public liver ultrasound dataset and an internal clinical dataset, SMILE consistently outperforms state-of-the-art VLMs, achieving up to 19.0\% improvement in ROUGE-1 and 18.8\% improvement in clinical F1-score, while reaching VQA F1-scores of 0.82 and 0.65 on public and internal datasets, respectively. These results demonstrate the potential of SMILE for data-scarce and limited-supervision clinical settings. Our models, datasets, and code are available \href{this https URL}{here}.
66. 【2611.02550】Re$^3$Rank: Listwise Reranking with Reasoning-Conditioned Retrieval Heads
链接：https://arxiv.org/abs/2611.02550
作者：Ruiyi Yan,Zhuoyuan Mao,Yugo Murawaki,Yiwen Guo
类目：Computation and Language (cs.CL)
关键词：carries limited information, locating relevant evidence, Attention-based rerankers score, retrieval heads route, Attention-based rerankers
备注：
点击查看摘要
Abstract:Attention-based rerankers score each candidate by the attention mass that retrieval heads route to it from the question, but the question, serving as a fixed query, carries limited information for locating relevant evidence. We propose Re$^3$Rank, a listwise reranker built on reasoning-conditioned retrieval heads (RRHeads). A generator first writes a reasoning trace over the question and the candidates, and a scorer then uses the trace tokens as the attention query of a few selected RRHeads, reading relevance as continuous scores. We present a straight-through estimator to propagate the ranking loss through the discrete trace, so that the generator and the scorer can be trained jointly for ranking. Averaged over 9 benchmarks, Re$^3$Rank outperforms 11 baseline rerankers: our 4B variant exceeds the strongest baseline by 3.11 NDCG@10 points on average, and even our 0.6B variant surpasses rerankers with up to 32B parameters.
67. 【2611.02545】FindLink: Learning to Assess Scientific Connections from Source-Grounded Premises
链接：https://arxiv.org/abs/2611.02545
作者：Jingxuan Wei,Song Tan,Xiaohan Liu,Chao Sang,Changwei Wang,Linzhuang Sun,Bihui Yu,Fuqiang Wang,Junnan Zhu
类目：Computation and Language (cs.CL)
关键词：Evidence Span records, findings obtained, Evidence Span, reasoning, individual findings traceable
备注： 28 pages, 10 figures. Dataset: [this https URL](https://huggingface.co/datasets/Sereints/FindLink)
点击查看摘要
Abstract:Scientific discovery from the literature requires assessing connections among findings obtained under different study conditions. Source attribution makes individual findings traceable, but does not determine what they jointly support. We introduce GI-TraceBench, a benchmark of 10,282 questions in gastrointestinal oncology that unifies provenance question answering, knowledge discovery, and hypothesis evaluation through shared Paper, Claim, and Evidence Span records. We further propose FindLink, a two-stage framework for provenance-grounded scientific reasoning. Premise Grounding constructs source-bound premises with explicit study context and support status. Structured Reasoning organizes these premises into support plans that represent both supported relations and unresolved conditions, then generates evidence-conditioned answers using deterministic compiler feedback. The compiler verifies structural and source-binding consistency, but does not assess scientific entailment. On the 1,545-question fixed-evidence test set, FindLink improves the balanced family macro score from 67.95 to 87.25 over direct supervised fine-tuning of the same backbone. A retrained variant without Structured Reasoning achieves slightly higher premise-identifier F1, but substantially lower relation and evidence-sufficiency F1. These results indicate that scientific reasoning requires not only identifying grounded premises, but also assessing what connections those premises support.
68. 【2611.02540】PixelBench: Can LLMs Understand and Generate Images Pixel by Pixel?
链接：https://arxiv.org/abs/2611.02540
作者：Haoquan Zhang,Feiyang Liu,Juanxi Tian,Wanhua Li,Haodong Duan,Weiyang Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：SVG and CAD, Large language models, symbolic representations describe, Large language, representations describe images
备注： Technical report, 38 pages, 7 figures. Project page: [this https URL](https://haoquanzhang.github.io/pixel-bench)
点击查看摘要
Abstract:Large language models (LLMs) can generate visual assets through text-based formats such as SVG and CAD, but these symbolic representations describe images using high-level primitives rather than explicit raster values. We ask whether LLMs can instead generate pixel images directly through their existing vocabulary, without a learned image tokenizer or decoder. We introduce PixelBench, a benchmark for text-to-pixel (T2P) and image-to-pixel (I2P) generation across multiple resolutions, together with a complementary pixel-understanding evaluation. Models generate an RGB color palette followed by a grid of indices specifying the palette color of each output pixel. In T2P, the strongest models produce recognizable images directly from text. In I2P, the strongest models outperform palette-matched downsampling and specialized pixelization algorithms at low resolutions. Pixel-understanding performance correlates strongly with generation performance. A resolution-scaling study shows that pixel-generation performance often improves initially before declining at high resolutions. Finally, we introduce Pixel Reconstruction Tuning (PRT), which augments visual instruction tuning with caption-palette-grid trajectories. We post-train Molmo2-4B from its pretraining checkpoint by mixing general instruction data with our curated PRT data, improving performance across 16 visual-centric benchmarks, indicating that explicit pixel reconstruction can provide useful auxiliary supervision.
69. 【2611.02529】une the Baseline First: Most of Muon's Scaled Weight Decay Gain Is a Tuning Gap, but Its Small Real Advantage Grows With Model Size
链接：https://arxiv.org/abs/2611.02529
作者：Esther Xin
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Scaled weight decay, constant decoupled weight, train language models, Scaled weight, decoupled weight decay
备注： 9 pages,8 figures, code and data: [this https URL](https://github.com/ethxin0011/weight_decay_ladder)
点击查看摘要
Abstract:Scaled weight decay for Muon (Muon-SW) has been reported to train language models more efficiently than constant decoupled weight decay, but such comparisons usually reuse one learning-rate (LR) and weight-decay (WD) setting for both methods. We re-run the comparison under the MAI-Base-2 protocol: LR and WD are tuned jointly through their product for each method, on a source-scaled mixture-of-experts (MoE) scaling ladder (1.9M to 15M active parameters) that holds tokens per active parameter and data repetition fixed across sizes. We find: (1) Most of the gain is a tuning gap. At the shared setting Muon-SW wins by 0.035 bits per byte (BPB), a 1.52x compute saving; after both methods are tuned, the gap is 0.0026 BPB (95% CI [0.0018, 0.0034]), a 1.03x saving, so about 90% of the advantage disappears. (2) The small advantage that remains is real: at the smallest size, all four paired seeds favour Muon-SW at the tuned settings. (3) That advantage grows with model size: across an 8x range of active parameters, the tuned gap rises from 0.0036 to 0.0051 BPB while the untuned gap shrinks from 0.035 to 0.024, so the surviving share rises from about 10% to 21%. (4) The best weight decay moves with scale: the optimal LRWD product grows for both methods, faster for Muon-SW (ratio 1.40 to 1.91), and a law fitted on the two smallest sizes overshoots the third by 1.3-1.5x, costing up to 0.002 BPB. The whole study runs on one NVIDIA T4 GPU; we release the code and all run results.
70. 【2611.02522】Ranked but Not Stopped: Detecting Prompt-Injection Hijacks from Typed Decision Models' Output Probabilities
链接：https://arxiv.org/abs/2611.02522
作者：Junwei Yao,Jianan Liu,Yongxi Zhou,Zike Yang
类目：Computation and Language (cs.CL); Cryptography and Security (cs.CR)
关键词：classifier act, probable label, Programs, language model, label
备注：
点击查看摘要
Abstract:Programs that use a language model as a classifier act on its most probable label. Text injected into the input can move that label to one the attacker chooses, a hijack. A monitor that does not know the attacker's label can read the model's own confidence and raise an alarm when the top probability is low. We test this monitor on AG News topic classification with five systems, three of them served through a provider's API. Pooled over five families of injected text, low confidence ranks hijacked answers above clean ones on four of the five systems (AUROC 0.86-0.90). Ranking them does not stop many of them. A threshold set so that at most 5% of clean answers to separate calibration articles alarm falls among the least confident clean answers, and every more confident hijack passes. In our main gate run on the three API-served systems, the monitor misses 51-70% of the hijacks caused by a plain injected note (per-system point estimates). When the note adds one handwritten sentence that calls the target certain and asks for full probability, the monitor misses 99-100% of the hijacks, although low confidence still ranks them at AUROC 0.70-0.79. Confidence monitors should be tested at their operating alarm rate, against attackers who claim certainty.
71. 【2611.02491】Same Sentence, Different Construct: Identity-Swapped Rationales Reveal Measurement Non-Invariance in LLM Hate Speech Classifiers
链接：https://arxiv.org/abs/2611.02491
作者：Wenchang Wang,Yue Song
类目：Computation and Language (cs.CL)
关键词：Large language models, Large language, socially consequential constructs, hate speech, human labels
备注： 18 pages, 6 figures
点击查看摘要
Abstract:Large language models are increasingly used as measurement instruments for socially consequential constructs such as hate speech, and are typically validated by their aggregate agreement with human labels. A valid instrument must also apply the same construct to every group it measures. We test this requirement using 421 \hc{} templates that are instantiated identically for seven protected groups, so that only the identity term varies. Four LLM classifiers each exceed 0.95 balanced accuracy, yet within identical templates two of them miss hateful statements about women at markedly higher rates than the same statements about other groups (excess false-negative rates of 8.3 and 4.4 percentage points), a gap first reported for fine-tuned classifiers in 2021. We show how the construct shifts. Comparing rationales within each template, we find that models invoke protected-group status for other groups but recast the identical statement about women as personal dislike or as aimed at an individual, in 22 of 30 missed templates for one model. Adding the benchmark's own definition, which lists sex as a protected characteristic, does not close the gap, and the contrast persists. Apparent false-positive disparities, by contrast, largely vanish under identity control and trace to reclaimed slurs present only for some groups. Errors shared by all models concentrate where model and benchmark definitions diverge, and pairwise counterfactual accuracy adds little beyond endpoint accuracy. We argue that validating LLM measurement requires identity-controlled tests of measurement invariance that examine both decisions and the criteria models state for them.
72. 【2611.02480】Chain on Demand: Deferred Evidence Organization for Long-Term Conversational Memory
链接：https://arxiv.org/abs/2611.02480
作者：Di Lu,Zechen Li,Hao Xue
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：graphs organize history, timing mismatch, write-time summaries, limited evidence budget, faces a timing
备注： 19 pages, 2 figures, 6 tables
点击查看摘要
Abstract:Long-term conversational memory faces a timing mismatch: write-time summaries and graphs organize history before a future query is known, while independent retrieval can allocate a limited evidence budget to redundant or fragmented turns. We introduce Chain on Demand (CoD), a query-time evidence organization framework over an unchanged turn-level memory. Given a broad candidate pool, CoD constructs a temporary evidence chain by allocating a fixed anchor budget according to query relevance, lexical diversity relative to selected anchors, and newly covered query terms, followed by deterministic restoration of each selected anchor's same-session neighborhood. The resulting chain is used only for the current query, while the underlying conversational memory remains unchanged. In a paired comparison over all 1,986 LoCoMo questions, CoD achieves 82.2% accuracy on 1,540 non-adversarial questions and 76.3% on all 1,986 questions. On LongMemEval-S, one fixed configuration that indexes both user and assistant turns obtains 86.6% across all 500 questions. These results show that long-term memory can preserve the original conversation while deferring evidence organization until the information need is known.
73. 【2611.02476】GigaSpeech 3: Scaling Multi-Dialect Arabic Speech Recognition with Weakly Labeled Data
链接：https://arxiv.org/abs/2611.02476
作者：Junzhe Liu,Yujie Tu,Yifan Yang,Peng Wang,Haoran Wang,Guodong Lin,Leyan Liao,Chengquan Zhang,Zhifu Gao,Xiangang Li,Qinyuan Cheng,Xipeng Qiu,Wei-Qiang Zhang,Guoguo Chen,Kai Yu,Xie Chen
类目：Computation and Language (cs.CL)
关键词：Dialectal Arabic speech, Dialectal Arabic, recognition remains constrained, Syrian Arabic, dialect-resolved transcribed speech
备注： 13 pages, 1 figure, 11 tables. Submitted to IEEE Transactions on Audio, Speech and Language Processing
点击查看摘要
Abstract:Dialectal Arabic speech recognition remains constrained by the scarcity of dialect-resolved transcribed speech despite the abundance of web audio. We introduce GigaSpeech 3, a corpus of 39,000 hours and 10 million weakly transcribed speech segments covering Algerian, Egyptian, Iraqi, Saudi, and Syrian Arabic. Starting from 60 hours of manual transcription per dialect, we train labeling models using speech-recognition-biased self-supervised learning and apply them to dialect-matched web audio. Data selection and four rounds of noisy-student refinement for Saudi and Syrian Arabic yield the final corpus. We validate its utility through dialect-specific and multi-dialect speech recognition training and cross-domain evaluation. On GigaSpeechBench, the final dialect-specific models outperform their labeling models across all five dialects and achieve a macro-average word error rate of 23.86%, a 16.6% relative reduction from the strongest third-party system covering all five dialects, while outperforming the best third-party result on three dialects. A multi-dialect model using self-predicted dialect identities achieves a macro-average word error rate of 25.51% while also supporting Modern Standard Arabic. Across eight conditions from three external corpora, a GigaSpeech 3-trained Zipformer achieves the lowest word error rate among six evaluated models in every condition, while adapting the Qwen3 speech recognizer on GigaSpeech 3 improves performance across all eight conditions. We release the corpus and recipes as a foundation for dialect-aware Arabic speech processing.
74. 【2611.02438】As Expected? Efficient LLM Planning via Expectation-Observation Consistency Verification
链接：https://arxiv.org/abs/2611.02438
作者：Qingfu Zhu,Huanyang Zheng,Ting Liu,Wanxiang Che
类目：Computation and Language (cs.CL)
关键词：incurring substantial inference, LLM planning, substantial inference cost, incurring substantial, planning often relies
备注：
点击查看摘要
Abstract:LLM planning often relies on reactive executors (e.g., ReAct) that generate a single action at each step to remain grounded in the latest observations, incurring substantial inference cost. Batched executors reduce this cost by predicting multiple actions in a single model invocation, yet they are prone to compounding errors, as intermediate observations are ignored. We propose an expectation-observation consistency verification (EOCV) mechanism for batched executors, preserving grounding while improving efficiency. The mechanism generates expectations of action outcomes and compares them with the resulting observations. Consistency permits continued execution, whereas mismatches trigger early termination and replanning from the current observation. Experiments on text-based and multimodal benchmarks across multiple backbones show broadly comparable average task performance between EOCV and reactive executors, with a 29-35% reduction in average weighted token usage. Moreover, the mechanism is model-agnostic and remains effective when integrated into state-of-the-art planners.
75. 【2611.02432】Diagnosing Model--Item Interactions in Language Model Benchmarks with LSIRM
链接：https://arxiv.org/abs/2611.02432
作者：Jinwen Luo,Han Jiang,Ziang Xiao,Susu Zhang
类目：Computation and Language (cs.CL); Machine Learning (cs.LG); Methodology (stat.ME)
关键词：Language models, items, correct, answers, BBH
备注：
点击查看摘要
Abstract:Language models with similar benchmark accuracy can succeed on different items. Overall scores do not show where their performance differs or which item properties might explain those differences. We demonstrate how the latent space item response model (LSIRM) can help evaluators investigate these patterns and their consequences for model comparison. We analyze 1,348 language models on 5,761 BBH items and compare ways of presenting and scoring answers across BBH, GPQA, MMLU-Pro, and MuSR. We examine LSIRM maps, which summarize differences in performance across models and items, alongside item properties and records of correct and incorrect responses. In BBH, nearby items on these maps often share the same correct answer, such as "Yes" or "No." Across the four benchmarks, this pattern is stronger when answers are scored using option labels, such as A, B, C, and D, than when using the text of the options. We then estimate each model's tendency to perform better or worse on items with particular correct answers and quantify how this tendency contributes to its score. This separates an estimated contribution associated with correct answers from the remaining differences in item performance. Two models' total numbers of correct answers differed by only 14 out of 5,761 items. Excluding the estimated answer-category contribution from their scores moved their ranks hundreds of places in opposite directions, while keeping all other estimates unchanged. The approach helps evaluators identify differences hidden by overall accuracy and understand how the choice of what to include in a score affects model rankings.
76. 【2611.02430】InteractionBench: Measuring Timing, Task Accuracy, Whisper and Volume, and Grounding in Real-Time Voice Systems
链接：https://arxiv.org/abs/2611.02430
作者：Richard Yucheng He,Chen Xu,Yihang Liu,Tairan Chen,Baodong Cao
类目：ound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
关键词：real-time voice systems, voice systems focus, paralinguistic control, real-time voice, data and set
备注： 21 pages, 1 figure, 14 tables
点击查看摘要
Abstract:Most benchmarks for real-time voice systems focus on one aspect, such as turn-taking, instruction following, paralinguistic control, or conversational memory, each with its own data and set of systems. We present InteractionBench, a benchmark and evaluation harness that measures four dimensions on the same systems from the same recorded user audio: conversational timing, spoken-task accuracy, whisper and volume, and groundedness in conversations of more than twenty turns. The benchmark contains 221 items per system in thirteen scenarios. Before any system runs, we fix the expected floor-control actions for spoken tasks by rule and take the expected answers from scripted dialogues. We score whispering from the audio signal. We evaluate GPT-Live, GPT-Realtime, Gemini Live, Moshi, PersonaPlex, Freeze-Omni, and a turn-based cascade in 1,519 graded runs. Among the six full-duplex systems, timing and spoken-task accuracy are rank-correlated ($\rho = 0.83$), while the cascade has the highest spoken-task score (38/50) and the second-lowest timing score. No system corrects a user's grammar within the required window. Only Gemini Live whispers on most requests (8/10). Hosted systems pass 67-88% of groundedness probes, compared with 14-35% for open full-duplex models. Timing is measured where the client hears each system, so the timing of hosted systems includes network delay: for GPT-Live, whose server reports its own clock, removing a delay of about 1.5 s lowers its timing score from 86% to 56%. We also document where the protocol differs across systems, including the text instructions.
77. 【2611.02404】When Rewards Depend on the Group, GRPO Plays a Tournament
链接：https://arxiv.org/abs/2611.02404
作者：Junyi Gao,Yu Shi,Pingzhao Hu,Ewen M Harrison
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：distribution matching make, sampled response depend, coverage and distribution, distribution matching, matching make
备注：
点击查看摘要
Abstract:Rewards for diversity, coverage and distribution matching make the reward of each sampled response depend on the rest of its group, and they are now routinely optimized with GRPO and RLOO. We prove that in this setting the group-relative baseline changes the objective. The expected update equals each response's own reward gradient plus $\alpha$ times its effect on its groupmates' rewards, with $\alpha=-1/(K-1)$ for groups of size $K$, so GRPO trains every response to beat its groupmates in a zero-sum tournament. It cannot see a pairwise diversity bonus when K=2, sees less than half of it at any K, and often does worse than using no baseline at all. Setting $\alpha=+1$ gives Team-GRPO, an unbiased estimator for any group-dependent reward that works with two samples per prompt and requires no extra model calls for pairwise rewards. The theory predicts training quantitatively. It locates the fixed points of a 9B policy to within 0.02 in $\ell_1$ and predicts how concentrated trained policies become with Pearson r=0.995. On GlobalOpinionQA, GRPO collapses onto the majority answer and ends further from human opinion than the untrained model, while Team-GRPO cuts the error from $0.20$ to $0.08$. On NoveltyBench, Team-GRPO avoids the diversity collapse of GRPO and significantly improves set utility.
78. 【2611.02395】Solver-Like Behavior in Large Language Models as Formalizers
链接：https://arxiv.org/abs/2611.02395
作者：Rikhil Amonkar,Stuti Mohan,Kevin Nguyen,Ceyhun Efe Kayan,Ronan Le Bras,Li Zhang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：large language model, language model translates, leaves the search, SLB, program
备注： 28 pages, 8 figures, 3 tables
点击查看摘要
Abstract:In the LLM-as-formalizer paradigm, a large language model translates a problem into a formal program and leaves the search to a solver, gaining the solver's guarantees. Formalizers are now often reasoning models that write a long reasoning trace before the program, yet they are judged only by the program's output. We find that the trace routinely does the solver's job, assigning, testing and ruling out values until it often reaches the full answer; we call this solver-like behavior (SLB). We define an ontology of SLB over the trace, the program and its output, and use LLM judges, checked against human labels, to label 2,000 generations from three reasoning models on four constraint satisfaction datasets, each formalized in a declarative and an imperative formal language. SLB appears in 85% of traces and takes 24% of reasoning tokens, yet the program usually recomputes the answer, so the effort is redundant. The 9% of programs that inherit the trace's answer also inherit its errors, and pass output-based evaluation whenever that answer is correct. The amount of SLB is not associated with accuracy, and SLB is more common in imperative Python than in declarative Z3 or PDDL. Cautionary prompts reduce it by only a quarter, but hiding the problem's values behind placeholders, which the program receives only at run time, removes 97% of it without loss of accuracy. Formalizers should therefore be evaluated by how their programs are reached, not only by what they output.
79. 【2611.02387】EviCast: Forecasting Retrieval Gains Through Shared Response Calibration
链接：https://arxiv.org/abs/2611.02387
作者：Yibo Wang,Jisheng Dang,Bimei Wang,Jiongpei Hou,Jingwen Zhao,Wenjun Ma,Fei Shen,Juncheng Li,Meng Wang,Qi Tian,Bin Hu,Tat-Seng Chua
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：extends large language, large language models, Retrieval-augmented generation, extends large, large language
备注： 13 pages, 6 figures, 8 tables
点击查看摘要
Abstract:Retrieval-augmented generation (RAG) extends large language models with external evidence, yet relevant evidence does not ensure that a generator can use it. Indiscriminate retrieval can degrade task performance while adding retrieval and long-context inference costs. Existing methods neither determine before large-scale execution whether a generator, task distribution, and retriever configuration is worth deploying nor diagnose multiple candidate retrievers under a shared budget. We introduce EviCast, a framework that forecasts retrieval value through interventional evidence-state decomposition. EviCast measures a generator's response to controlled evidence states once and combines this shared profile with the offline evidence-state distribution of each candidate retriever, yielding the end-to-end net utility and its 95% lower confidence bound without executing every RAG configuration. A state-refinement analysis characterizes when its binary and topology-aware instantiations are exact and when shared calibration is statistically more efficient than per-retriever calibration. In frozen evaluations, EviCast correctly decides all 14 HotpotQA retrieval configurations with a forecast error of 2.75 F1 points while reducing diagnostic generation calls by 80%, and it attains the lowest forecast error among seven predictors in the low-budget regime. Its topology-aware instantiation, EviCast-T, captures the complementarity between terminal and bridge evidence, correctly deciding all 16 configurations on MuSiQue and HotpotQA and 23 of 24 after prospective transfer to a third dataset. These results show that retrieval deployment depends on both evidence availability and the generator's ability to convert evidence structure into stable net utility. Code is available at this https URL.
80. 【2611.02368】Beyond Accuracy: How Quantization Affects Coding Agents
链接：https://arxiv.org/abs/2611.02368
作者：Areej Mehboob,Muhammad Ali Shafique,Muhammad Usman Qadeer,Hamza Farooq
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：large language models, inference cost, cost of large, large language, coding agents
备注： Accepted at the NeurIPS 2026 Workshop on Small Language Models for Agentic Systems (SLM-Agents), Paris, France
点击查看摘要
Abstract:Agents are increasingly used for coding tasks, but the inference cost of large language models (LLMs) limits where they can run. Quantization reduces model size, but its effects on coding agents that execute and revise programs remain underexplored. We compare BF16 with 4-bit AWQ and GPTQ for Qwen2.5-Coder-Instruct (7B, 14B, and 32B) and Devstral-Small-2507 (24B) on OJBench coding problems across three seeds. We detect no statistically significant accuracy loss for any of the coding agents. However, final accuracy can conceal substantial behavioral changes: AWQ reduces Qwen-7B one-shot solves from 17 to 0 while increasing loop-based solves from 10 to 25. All Qwen-32B successes involve tool use, whereas Devstral rarely makes a valid executor call. Failure profiles also differ: Qwen-32B produces far more compilation errors than the smaller Qwen models, rising slightly under quantization, while Devstral's failures shift significantly from runtime errors toward wrong answers and timeouts. These findings indicate that quantization robustness in coding agents should be assessed through solution trajectories, tool use, and failure modes, in addition to final accuracy.
81. 【2611.02353】VisCodeBench: a new benchmark dataset for Text-to-Vis reflecting real-world practice
链接：https://arxiv.org/abs/2611.02353
作者：Hy Nguyen,Thomas James Elton,Ella Wilson,Andrew Reeson,Cecile Paris,Josiah Poon,Jonathan K. Kummerfeld
类目：Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
关键词：natural language requests, Generating visualisations, enables users, natural language, users to explore
备注： Accepted to COLM 2026. [this https URL](https://openreview.net/pdf?id=noorBEVR4k)
点击查看摘要
Abstract:Generating visualisations from natural language requests (text-to-vis) enables users to explore data more efficiently. While LLMs can complete simple visualisation requests, their performance on challenging ones is not well covered by existing benchmarks. We introduce VisCodeBench, an end-to-end text-to-vis benchmark with 2,672 samples from three different domains: educational, scientific, and general audience scenarios with varying levels of complexity. We benchmark three visualisation systems---Codex, Claude Code, and LIDA---paired with a range of open and commercial LLMs across seven metrics covering execution, chart content, and visual quality. While basic execution is near-solved for strong systems, no system comes close to reproducing the reference data, with the best displayed data similarity reaching only $0.81$ and falling to $0.69$ on our hardest subset for this metric. We further find that frontier models separate on chart correctness and efficiency, with ClaudeCode-Opus-4.7 improving chart correctness by around 5 points over Codex-GPT-5 while running roughly 20 seconds faster. Separately, we find that system design matters as much as the underlying model: despite both running on GPT-5, Codex clearly outperforms LIDA, showing that the surrounding prompting, execution, and refinement pipeline can shape outcomes as much as the model itself. Finally, latency remains a practical obstacle, as even the strongest systems take 39-78 seconds to produce results. VisCodeBench is available at \href{this https URL}{this https URL} and accessed via a leaderboard; the full dataset is kept private to prevent LLM training use.
82. 【2611.02348】Which Words a Model Fears: From a Refusal Direction to a Vocabulary-Wide Fear Lexicon
链接：https://arxiv.org/abs/2611.02348
作者：Boyuan Zhang,Mohammad Zandsalimy,Shanu Sushmita
类目：Computation and Language (cs.CL)
关键词：aligned language model, language model refuses, model refuses depends, request meaning, aligned language
备注： 19 pages, 11 figures. Code: [this https URL](https://github.com/zboyr/which-words-a-model-fears) ; data: [this https URL](https://huggingface.co/datasets/vhboyr/which-words-a-model-fears)
点击查看摘要
Abstract:Whether an aligned language model refuses depends in part on which words a prompt contains, regardless of whether those words carry the request's meaning. Harm words shift the hidden state at the generation boundary along a component shared across prompts and words, which crossed differencing extracts as a single direction. In eight models, writing along this direction raises and lowers refusal monotonically with dose, ahead of random and KL-matched directions. Used as a ruler over the full vocabulary, the direction gives every word a shift, from "feared" words at one end to "courage" words at the other; a word's shift is predictable from its own representation, and appending a feared word to a benign prompt is enough to make the model refuse it. Two held-out tests validate the ranking in all eight models: refusal after inserting an unseen word rises with its table shift, and replacing a prompt's most feared word by its most courageous meaning-preserving synonym significantly raises the answer rate on benign and harmful prompts alike, by an amount that follows the shift the replacement actually causes.
83. 【2611.02338】MemShift: Separating Detection from Repair in LLM-Derived Personal Memory
链接：https://arxiv.org/abs/2611.02338
作者：Zichuan Xu,Haochen Zhang,Yuyang Dong,Makoto Onizuka,Chuan Xiao
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：language model derived, important contacts, assistants store, language model, model derived
备注： 54 pages, 9 figures, 32 tables
点击查看摘要
Abstract:AI assistants store values that a language model derived from a person's records under the person's own definitions, such as their important contacts. Keeping such a value correct takes two steps: detection, noticing that an input changed, and repair, producing the correct new value. Benchmarks that score only the final answer cannot tell which step failed, and they state every change as new text. Seeing this limitation, we present MemShift, a benchmark of five shifts: source revision, deletion, redefinition, writer switch, and export. The first three fork a synthetic world into branches that differ only in the shift. Gold values and dependencies are fixed before any text, and a deterministic scorer replaces an LLM judge. For a memory that reports its invalidations, MemShift shows for each changed item whether the memory noticed the change and whether its repair was right. Moreover, we build a reference memory with known detection and repair to validate the measure. By evaluating four open-weight LLMs, we find that detection helps only as much as repair allows: the LLMs re-derive few values computed by the person's definitions correctly, and programs that the LLM writes over typed records close most of the gap to exact recomputation. Code and data are available at this https URL.
84. 【2611.02334】Does a Norwegian further-trained model give more outdated legal values than its base model? A preregistered paired comparison of Borealis 2 and Gemma 4
链接：https://arxiv.org/abs/2611.02334
作者：Eirik Botten Nicolaysen
类目：Computation and Language (cs.CL)
关键词：National Library, Library of Norway, give outdated numeric, Norwegian statutes, Norway further trained
备注： Preregistered: doi: [https://doi.org/10.5281/zenodo.23858965](https://doi.org/10.5281/zenodo.23858965) . Data and code: doi: [https://doi.org/10.5281/zenodo.23870450](https://doi.org/10.5281/zenodo.23870450) , [this https URL](https://github.com/avalyset/norregel)
点击查看摘要
Abstract:We compare how often two released language models give outdated numeric values from Norwegian statutes and regulations: NbAiLab/borealis2-26b-a4b-preview (Borealis 2), which the National Library of Norway further trained from google/gemma-4-26B-A4B-it (Gemma 4), and Gemma 4 itself. The study was preregistered (doi:https://doi.org/10.5281/zenodo.23858965) and uses the closed norregel benchmark, scored deterministically against a value history. On the 411 of 503 primary items where both models gave an interpretable answer, Borealis 2 alone was outdated on 10 items and Gemma 4 alone on 11 (d = -0.2 percentage points, 95% cluster bootstrap interval [-2.7, +2.5], exact one-sided McNemar p = 0.668). By the preregistered rule this is no effect of interest: the whole interval lies within the smallest effect of interest of +/-10 percentage points. Among the secondary measures, only the share of answers giving a value that took effect after the question date differs after Holm correction; Gemma 4 gave such answers more often. An exploratory comparison of two smaller Borealis models had no discordant pairs and is not informative. The design compares released models and does not isolate the effect of any part of their training.
85. 【2611.02333】When Does Adaptive Halting Win? Selection Rules Matter in Looped Language Models
链接：https://arxiv.org/abs/2611.02333
作者：Mahesh Reddy Pagadala
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Looped language models, looped model Ouro, stop iterating early, recent work shows, looped model
备注： 21 pages, 1 figure. Code: [this https URL](https://github.com/lonewolf15116/lookahead-halting)
点击查看摘要
Abstract:Looped language models can stop iterating early, and recent work shows that post-hoc readouts of the loop trajectory often rival the learned exit gate of the looped model Ouro. Such comparisons reduce each method to one operating point chosen by a selection rule. We ask whether that rule decides the outcome. On a frozen Ouro-1.4B with four loops, we compared a trained stability probe ($\pi_1$-x) with Ouro's native gate, adapted to a per-question stopping decision, in pre-registered studies; the confirmatory study was designed after an exploratory finding on development data and evaluated once on a sealed test set of 8,517 questions. In the pre-registered confirmatory comparison, which selected operating points with a bootstrap-screened 1 pp accuracy-loss rule, the probe saved more of the four-loop budget than the native gate (+0.053 gross macro saving over three benchmarks, 95% CI [+0.049, +0.057]), mostly from CommonsenseQA, where the probe's test upper bound on accuracy loss exceeded 1 pp. Under a point-only rule, a pre-specified secondary analysis on the same test set reversed the preference (-0.022 [-0.026, -0.018]), with operating points that exceeded the budget. In pre-specified secondary comparisons, the probe showed no demonstrated advantage over an untrained KL divergence between successive loops (+0.00125 [-0.0041, +0.0065]); we emphasise this result post hoc and claim no equivalence. The probe also broke its budget on one of two out-of-distribution benchmarks (3.26 pp loss on Social IQa). Savings are estimated from stored full-depth traces, not measured inference time, and our screen carries no formal risk-control guarantee. We conclude that halting methods should be compared as signals together with selection procedures, with strong untrained baselines and out-of-distribution checks.
86. 【2611.02332】LEANGUARD: Lean-Verified Guardrails for Tool-Using Agents
链接：https://arxiv.org/abs/2611.02332
作者：Sreehari Sankar,Debargha Ganguly,Vikash Singh,Mohsen Hariri,Weicong Chen,Yanyan Zhang,Shouren Wang,Wang Yang,Chaoda Song,Alexander Nemecek,Osama Zafar,Idan Davidovich,Yuting Shao,Kai Ye,Biyao Zhang,Xinpeng Li,Joe Stubbs,Erman Ayday,Jing Ma,Vipin Chaudhary
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Tool-using language-model agents, Tool-using language-model, domain policies forbid, Tool-using, domain policies
备注：
点击查看摘要
Abstract:Tool-using language-model agents often execute actions that their domain policies forbid. We present LeanGuard, a runtime that checks every proposed tool call against a policy written in Lean4 before the call reaches the environment. Policies combine state predicates with scoped past-time temporal operators over the execution history, evaluation is fail-closed, and the decision procedure is proved equivalent to a LeanLTL semantics. A denied call can be corrected in two ways. With feedback, the agent receives the violated rule and a hint; with proof-guided repair, Lean metaprogramming searches for a nearby call that preserves the user's intent and proves that the policy admits it, without the model. On Tau-Bench with five Qwen models (0.8B-27B), unguarded agents execute at least 33 calls that the Lean policy forbids, while LeanGuard executes none; with feedback, task success does not change significantly. On DTap, LeanGuard reduces direct prompt-injection success from 57.9% to 5.9%, and in telecom, where benign tasks need no writes, benign success is unchanged. Feedback reduces repeated blocked calls and raises task success for four of five models over a bare denial. On replayed denials, repair proves an admissible edit for 88 of 252 denials caused by argument values, in a median of 2,ms.
87. 【2611.02319】Accessed, never disclosed: Silent access to protected health information by medical artificial intelligence agents
链接：https://arxiv.org/abs/2611.02319
作者：Jae Wang Lee,Abhirup Banerjee,Yeong Chan Lee
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR); Computers and Society (cs.CY)
关键词：Medical artificial intelligence, protected health information, artificial intelligence agents, Medical artificial, HIPAA minimum
备注： 33 pages, 5 figures, 1 table, 3 Extended Data tables; includes Supplementary Information (12 tables, 6 figures)
点击查看摘要
Abstract:Medical artificial intelligence agents should retrieve patient identifiers only when a task requires them, the data-minimization principle behind the HIPAA minimum necessary standard for protected health information (PHI). An agent can retrieve identifiers without revealing them. Such silent access remains invisible to evaluations that inspect only the output. We embedded canaries in synthetic patient records and linked each tool invocation to canary exposure in the final answers across five language models, four boundary levels, and seven attack frames for identifier-free clinical tasks. Three models invoked the PHI tools unnecessarily, whereas Claude Opus 4.8 and GPT-5.5 did not. Stronger boundaries reduced this access, and the residual access under the strictest policy was confined to frames in which the user overrode the policy or asserted approval. A pre-execution gate given the task-necessity criterion nearly eliminated this access. Output-only evaluation cannot verify minimum-necessary access; boundaries, gates, and access-log audits are required together.
88. 【2611.02318】A Capitulation Direction Emerges With Scale and Is Causally Load-Bearing Where Validation Is Strong: Eight Models, Two Families, and Five Measurement Hazards
链接：https://arxiv.org/abs/2611.02318
作者：Saad Aamir,Muhammad Awais Bin Adil
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Sycophancy in language, behaviour but poorly, poorly localised, direction, language models
备注： 20 pages, 4 figures. Code, data and pre-registration: [this https URL](https://github.com/saad-aamir/sycophancy-direction)
点击查看摘要
Abstract:Sycophancy in language models is well documented as a behaviour but poorly localised as a mechanism. We ask whether capitulation under user pushback, the abandonment of a correct answer when a user objects, corresponds to a linear direction in the residual stream, and whether such a direction emerges with scale. Across eight instruction-tuned models spanning 0.5B to 14B parameters in two families, under a pre-registered protocol with leave-one-question-out cross-validation, within-question permutation nulls, and a positive control, we find no usable direction below 7B and a direction that clears our validation gate at 7B, 8B and 14B. Ablating that direction in Qwen2.5-7B reduces the rate at which the model reverses a correct answer by 4.8 percentage points, roughly a quarter in relative terms, while the identical intervention on a gate-failing direction and on a marginally passing one produces no effect. Probe quality, not statistical significance, predicts causal relevance. Behaviourally, pushback destroys three to five times more correct answers than it repairs at 1B and reaches parity by 7B, falsifying our own pre-registered prediction, and a sign-reversing crossover between pushback types survives an order of magnitude of scale in Qwen and holds at 8B in Llama, with marginalisation over five paraphrases per type. We additionally quantify five measurement hazards, including a numerical-precision effect that changes roughly one episode label in ten.
89. 【2611.02314】GRIPS: An Empirical Study of Pre-SQL Grounding Information for SQL Generation
链接：https://arxiv.org/abs/2611.02314
作者：Ekata Mitra,Yufei Tao,Kamalamalini Nagasundaram,Ameeta Agrawal
类目：Computation and Language (cs.CL)
关键词：systems answer natural, answer natural language, natural language questions, linking question mentions, SQL
备注： Accepted at PACLIC 40 (2026)
点击查看摘要
Abstract:Text-to-SQL systems answer natural language questions over structured data, but can fail before SQL generation by linking question mentions to the wrong table, column, value, or relation. Even valid SQL can then return an incorrect answer. This raises a central question: What pre-SQL information helps a SQL generator, and when does additional information cease to help? We investigate this question on TempTabQA-C and BIRD. Among the audited SQL Static failures, grounding errors form the largest category on both benchmarks. We introduce GRIPS (Grounding Representation and Input Processing for SQL generation), a three-stage method that derives structured pre-SQL information to make these decisions explicit before query generation. Across GPT-5-nano and Llama-70B, GRIPS-Adaptive improves over SQL Static in 18 of 20 settings, with an average accuracy gain of 11.8 percentage points, while reducing model-call token usage by 47.8%. Our controlled analysis shows which grounding information can improve SQL generation, whereas adding more pre-SQL information does not consistently help. By separating question-input grounding from SQL generation, GRIPS makes text-to-SQL more accurate, efficient, and easier to diagnose.
90. 【2611.02278】Concise-9B: Removing the Slack from a Reasoning Model's Thinking
链接：https://arxiv.org/abs/2611.02278
作者：Alexander Boesgaard Lorup
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Reasoning models answer, Reasoning models, tokens, thinking tokens, Reasoning
备注： 18 pages, 5 figures, 14 tables
点击查看摘要
Abstract:Reasoning models answer better when they think longer, but a thinking trace keeps going well after its answer has formed. We measure this slack in Qwen3.5-9B and remove most of it with concise self-training: two rounds of on-policy rejection-sampling fine-tuning that keep the shortest correct samples, plus a small share of answer-synthesis targets, giving Concise-9B. On 8,983 held-out problems (competition and hard mathematics, SuperGPQA, a five-area confirmation set and MMLU-Pro), Concise-9B generates 0.66x the tokens of Qwen3.5-9B at a 32K thinking budget, with accuracy equivalent within +/-1 point (-0.20 [-0.77, +0.36] points). Forcing each trace on the hard and confirmation sets to answer every 2,048 thinking tokens, we find that 54-64% of Qwen3.5-9B's thinking tokens come after the point from which every forced answer equals the final one (41-48% for Concise-9B). Stopping there would keep every answer at 0.35-0.44x the base model's tokens, but finding that point takes hindsight: stopping when three consecutive forced answers agree costs the base model 2.4-9.2 points. Concise self-training removes slack without that cost: 86% [83, 90] of the thinking tokens it saves come after the answer has formed. It has a limit: with traces continued to 80K tokens, Concise-9B solves 25 fewer of 1,276 hard problems (-25 [-49, -1]), mostly in competition mathematics. The measurement also yields a cheap commit signal for adaptive sampling that matched two-sample escalation within +/-1 point at 0.67x its tokens in a pre-registered test. Results on Qwen3.5-4B, on which the recipe was developed, and a replication on Olmo-3-7B-Think suggest that the saving depends on how verbose the base model is.
91. 【2611.02273】When the Text Is Silent: Memory Shortcuts and the Validity of LLM Annotation under Evidence Insufficiency
链接：https://arxiv.org/abs/2611.02273
作者：Wenchang Wang,Yue Song
类目：Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)
关键词：Large language models, social science research, Large language, content moderation, science research
备注： 15 pages, 5 figures
点击查看摘要
Abstract:Large language models (LLMs) are increasingly used to annotate text for social science research, content moderation, and training data. Their broad knowledge of real-world entities raises a concern: when labeling a text, do they rely on its evidence or substitute what they already know? We call this behavior a memory shortcut and examine when it emerges, what amplifies it, and how to mitigate it. Using 995 widely recognized public figures and four matched control names per figure, we construct counterfactual texts that separate textual evidence from prior knowledge, and evaluate three commercial LLMs on 121,594 prompts each across five stages. We find a striking asymmetry. Although all models recognize nearly every figure, none follows memory over the text when the two conflict. Shortcuts instead emerge when evidence is absent: for one model, famous names raise the rate of remembered occupations, ages, and countries by 17.0, 14.9, and 6.8 percentage points relative to synthetic names. These effects occur only for recognized figures, and 98.6% of the resulting labels are factually correct about the namesake while none is supported by the text. Evaluation threats and answer-contingent rewards amplify shortcuts by 8.7 and 12.4 points. Famous names also raise leadership ratings of sparsely documented applicants by 0.22 and 0.28 points in two models. A namesake reminder and name masking each eliminate the shortcuts, with trade-offs in gender annotation. LLM annotations can thus be factually correct yet methodologically invalid. Trustworthy LLM annotation requires audits that test evidence absence, account for incentives in annotation instructions, and evaluate the attribute-specific trade-offs of mitigation.
92. 【2611.02271】Current state of LLMs for Arabic dialectal machine translation
链接：https://arxiv.org/abs/2611.02271
作者：Josef Jon,Rawan Bondok,Ondřej Bojar
类目：Computation and Language (cs.CL)
关键词：large language models, MADAR dataset, Arabic machine translation, dialectal Arabic machine, Arabic
备注：
点击查看摘要
Abstract:This work presents an evaluation of large language models (LLMs) for English to dialectal Arabic machine translation on the MADAR dataset. We evaluate both translation directions (English to Arabic and vice-versa) on 16 Arabic dialects. Our experiments cover a diverse set of models, including specialized Arabic models (Jais, Nile), multilingual models (Gemma, Command-R, Mistral, Aya), and commercial APIs (GPT-4.1). We employ multiple evaluation metrics: BLEU, CHRF, COMET (both reference-based and reference-less variants) and GEMBA (LLM-as-a-judge), as well as a small-scale manual evaluation, to assess translation quality. We discuss the challenges of automatic MT evaluation, especially in the context of Arabic dialects. We also evaluate the ability of LLMs to classify the dialect used in a text. The study offers insights into the capabilities and limitations of current LLMs for dialectal Arabic machine translation, particularly highlighting the difficulty of handling dialectal diversity, although the results may be influenced by possible training data contamination, which is always a concern with LLMs.
93. 【2611.02270】Hinted Scaling Laws
链接：https://arxiv.org/abs/2611.02270
作者：Suze van Adrichem,Luke Bailey,Rohith Kuditipudi,Christine Ye,Neil Band,Ahmed Ahmed,John Duchi,Percy Liang,Tatsunori Hashimoto
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：expensive training runs, Scaling laws, Scaling laws predict, hinted scaling laws, cheaper runs score
备注：
点击查看摘要
Abstract:Scaling laws predict the outcome of large, expensive training runs by extrapolating trends from smaller, cheaper runs. On downstream accuracy evaluations, these predictions fail when the weaker models produced by the cheaper runs score near zero accuracy, because these scores give no trend to extrapolate to larger scales. We introduce hinted scaling laws, which use privileged information to turn a benchmark into a continuum of easier versions so that even the small models score above zero. We find that accuracy rises smoothly and predictably with the hint level, enabling new types of scaling laws that operate below the noise threshold. On the Delphi pretraining ladder, a hinted scaling law fit on models trained with at most $10^{20}$ FLOPs forecasts the GSM8K accuracy of a $10^{23}$ FLOP model (25.9%) to within 3 percentage points; a standard scaling law under-forecasts it by 13 percentage points when fit on the same models and by 12 even with models up to $10^{22}$ FLOPs in the fit. Across both this pretraining ladder and a collection of post-trained model families, hinted scaling laws reduce the median forecasting error on GSM8K, AIME and HLE from 21 percentage points to 4.3. Hinting also reduces the number of test examples needed to tell whether one model is better than another by widening the accuracy gaps between models while approximately preserving their order: a single hinted rollout per problem ranks nearly indistinguishable models as accurately as five unhinted rollouts. Our results suggest that hinting is a general primitive for improving the accuracy and cost of downstream scaling laws and other prediction tasks in model development.
94. 【2611.02248】Metamorphic Testing for Evaluating Robustness of Sentiment Analysis Models
链接：https://arxiv.org/abs/2611.02248
作者：Sowjanya Karanam,Jayanth Bhargav
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Machine learning systems, Machine learning, traditional software testing, software testing methods, explicitly programmed
备注： 8 pages, 3 figures
点击查看摘要
Abstract:Machine learning systems are challenging to test using traditional software testing methods because their behavior is learned from data rather than explicitly programmed. This challenge is particularly significant in natural language processing (NLP), where small input variations can lead to unexpected model behavior. Conventional evaluation metrics, such as accuracy and F1-score, often fail to capture such inconsistencies. Metamorphic testing addresses this limitation by evaluating expected relationships between original and transformed inputs. With the increasing prevalence of generative artificial intelligence (GenAI) and language-based AI systems, the need for systematic robustness testing has become even more pronounced. Motivated by this growing need, this paper presents a lightweight, batch-based metamorphic testing approach for evaluating the robustness of such systems. In particular, we consider sentiment analysis as a representative NLP task and evaluate a pretrained classifier under four transformations: synonym replacement, typo injection, word-order variation, and negation. Using consistency score, flip accuracy, and confidence change, we identify strengths in handling semantic variations and vulnerabilities to textual noise and logical transformations. These findings highlight the value of metamorphic testing in identifying behavioral inconsistencies beyond conventional performance metrics and demonstrate its potential as a systematic framework for evaluating the robustness of language-based AI systems and guiding performance improvements before deployment.
95. 【2611.02244】Can AI Reviewers See Your Efforts to Improve Your Paper? A Large-Scale Study of Paper Revision Trajectories
链接：https://arxiv.org/abs/2611.02244
作者：Yaochen Wang,Chenguang Wang,Ming Li,Haomin Zhuang,Xinyue Zeng,Han Chen,Kwesi Adu Cobbina,Dang Nguyen,Dianqi Li,Dawei Zhou,Tianyi Zhou
类目：Computation and Language (cs.CL)
关键词：improvements authors make, authors make, major improvements, judgments reflect, revision
备注： 43 pages including appendices, 8 figures
点击查看摘要
Abstract:AI reviewers are increasingly used to assess scientific manuscripts, yet it remains unclear whether their judgments reflect the improvements authors make through revision. We investigate this question using PaperTrajectory-2026, the 2026 release of PaperTrajectory, a dataset of 6,959 paper trajectories across five AI conferences, with automatic annotations of changes along 14 dimensions and separate judgments of overall quality. The annotations show that major improvements emphasize empirical evidence and framing, while later revisions tend toward incremental improvement. Using independent assessments of manuscript versions from eight AI reviewers, we examine whether annotated major improvements receive higher scores, which revision dimensions are associated with score changes, and whether user opinions can outweigh observed revision gains. Every reviewer leaves scores unchanged on most major improvements, and agreement on the direction of score changes is weak. Revision dimensions show some reviewer-specific associations with score increases, but provide limited predictive discrimination and no consistent guide across reviewers. Even when a revision earns a higher neutral score, a brief negative user opinion can erase or reverse that advantage, with substantial variation across reviewers. These findings show that substantive revisions are not consistently reflected in review scores and that observed scoring gains can be vulnerable to user framing, motivating assessments that connect manuscript evidence to overall judgments and remain stable when no scientific evidence changes.
96. 【2611.02230】Who Should Score the Cache? Mid-Depth Layers Are the Best Judges of KV-Cache Eviction
链接：https://arxiv.org/abs/2611.02230
作者：Ekaterina Seregina
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：eviction methods rank, layer, methods rank tokens, Key-value, cache eviction methods
备注： 19 pages, 3 figures
点击查看摘要
Abstract:Key-value (KV) cache eviction methods rank tokens by attention scores, and each layer scores its own cache. To our knowledge, no eviction method asks which layer should score. We find, across twenty-one models, that the depth of the scoring layer governs eviction quality. On the eighteen models with per-layer caches, spanning 0.5B to 109B, long-context retrieval accuracy collapses at shallow layers, peaks between 0.4 and 0.75 of depth, and degrades at the last layer. The curve arises because a layer judges tokens well only once it has used the question to find the answer, which takes several layers. Modeling eviction as a top-$k$ cut, we compute answer survival probability from prefill attention and reproduce the measured curves. This approach selects the scoring layer using calibration prompts with known answers, and the selected layer is the best layer measured on most models and never significantly below it. It improves on the own-layer default on sixteen of the eighteen models, with significant gains on seven, all at 14B or below, while on larger models the default is already close to the best mid-depth layer. Scoring every cache from the selected layer while keeping one set of tokens for all heads also beats per-head SnapKV by 18 to 43 points on five models up to 14B under tight budgets. This gain carries over to financial filings at 32K context, all at the same memory budget, with no extra forward pass. The same curve explains a penalty in shared-cache models, where several layers read one cache and the layer that writes it scores by default. On Gemma-4-E2B the writer is shallow and loses 28 points to a mid-depth reader at a 10% budget. We also find that in open-book question answering (LongBench) no mid-depth layer beats the own-layer default.
97. 【2611.02208】st-Time Scaling for Open-Ended Reasoning at Small Model Scale
链接：https://arxiv.org/abs/2611.02208
作者：Adam Y. Ahmed,Abdullah G. Elafifi
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：model, samples, samples disagree, points, model samples
备注：
点击查看摘要
Abstract:A vote over a model's samples can only help when the samples disagree. For open-ended generation the binding question is therefore not how to combine samples but whether a model produces samples worth combining, a question test-time scaling has answered for math but not for free-form text. We study it at small scale with semantic cluster voting, a judge-free aggregator that groups a small instruct model's samples by meaning and returns the largest cluster's representative, with no reward model or self-judging. On a 250-prompt benchmark with three tiers of answer checkability, the same pattern holds across three model families (Qwen2.5-3B, Llama-3.2-3B, Gemma-2-2B) and two generation seeds: voting raises accuracy on the math control, where samples vary but stay checkable (a gain of +10 to +29 points across the three models), yet adds at most +0.30 judge points on open-ended text. On a larger 200-problem MATH-500 run with the primary model, the math gain is +8.5 points (95% CI [+4.0, +13.0]). Almost every open-ended sample falls into one meaning cluster, so there is little to select over. The collapse is consistent with instruction-tuning rather than model size, and raising decoding temperature does not recover usable diversity, because it costs more quality than it adds (net -0.64 judge points, 95% CI [-0.93, -0.37]).
98. 【2611.02155】Decision Models as Policy Gates for Coding Agents: Explicit Policy Boundaries Improve Detection and Reduce False Alarms
链接：https://arxiv.org/abs/2611.02155
作者：James P. Beno
类目：Computation and Language (cs.CL); Cryptography and Security (cs.CR); Software Engineering (cs.SE)
关键词：wrong person faster, Coding agents, destroy data, leak secrets, human can review
备注： 15 pages, 2 figures. Dataset, rule texts and harness available at [this https URL](https://github.com/agentapprove/decision-policy-rules)
点击查看摘要
Abstract:Coding agents can destroy data, leak secrets and message the wrong person faster than a human can review. Could a decision model catch these risks at runtime? We evaluated 22 hosted decision models and two prompted general models as classifiers for a multi-rule policy engine. A synthetic dataset of 2,643 tool calls was labeled blind against 28 rules, with a sealed holdout. With a single shared preamble in both conditions, explicit boundaries written as examples and counterexamples raised recall by 5.5-26.1 percentage points on all 23 available models and reduced false positives on 21. Jev 1.14's recall rose from 89.3% to 98.2%, while unnecessary interruptions fell from 30.6% to 4.8% of 252 clean actions. With examples, its median latency was 120 ms at $0.46 per thousand requests. Strong models retained the recall gains when concrete names were replaced by generic descriptions; three largely retained them when the same boundaries were written as prose. On 16 new scenarios written after the initial studies, a follow-up improved recall on 22 of 23 models and reduced unnecessary interruptions on 21. We release the dataset, rule texts and harness.
99. 【2611.02153】Multi-Agent Collusion and the J-Space
链接：https://arxiv.org/abs/2611.02153
作者：Marco Molinari,Gabriele Bettineschi
类目：Computation and Language (cs.CL)
关键词：escape human oversight, Multi-Agent Systems, human oversight, increasingly deployed, deployed in Multi-Agent
备注：
点击查看摘要
Abstract:LLM agents are increasingly deployed in Multi-Agent Systems (MAS), and they introduce the risk of coordination among agents that might escape human oversight. The J-space has been used to uncover deception in single LLMs, but its use for uncovering and steering collusion between agents remains unexplored. We show, with interpretability experiments on DeepSeek-V4-Flash (284B) on the NARCBench collusion benchmark, that colluding agents' J-space holds the collusion itself: before replying, 86% of colluders represent misrepresentation, concealment or remorse. In a steganographic card-counting task, the receiver's J-space holds a hidden count, and causal interventions alter its count. We also introduce the Jacobian Pair Contrast (J-PACT), an unsupervised method for detecting collusion between agents. We evaluate J-PACT on four open-weight models: GPT-OSS-20B, Llama-3.3-70B-IT, Qwen3-32B, and DeepSeek-V4-Flash (284B). J-PACT retains 85% of the above-chance AUROC of supervised NARCBench probes, matches them on steganographic scenarios, and names the colluding pair up to its complement in 99% of detected runs.
100. 【2611.02152】Detailed Derivation of The Backpropagation Algorithm
链接：https://arxiv.org/abs/2611.02152
作者：Faris Alasmary
类目：Computation and Language (cs.CL)
关键词：train neural networks, compact vector form, derives backpropagation step, standard method, method for computing
备注： 41 pages, 2 figures, 2 algorithms. Code: [this https URL](https://github.com/farisalasmary/neural-network-numpy)
点击查看摘要
Abstract:Backpropagation is the standard method for computing the gradients that train neural networks, but it is usually presented in a compact vector form that skips the intermediate steps. This tutorial derives backpropagation step by step for a fully connected feedforward network with sigmoid activations and a squared-error loss. Using a running example with three layers, we first differentiate the error with respect to a single weight by following its path through the network with the chain rule. We then show how summing over all paths leads to the error terms $\delta$ and to the four general backpropagation equations in matrix form. Every term is annotated with its dimensions, so each equation can be checked for consistency. The derivation is then extended to $m$ training examples, where the weight gradients become a single matrix product and the bias term corresponds to broadcasting. It is also extended to mini-batch gradient descent, including why the gradient of a mini-batch estimates the full gradient. Batch and mini-batch training are both given as algorithms. Finally, each equation is linked to the corresponding line of a NumPy implementation trained on the AHDBase dataset of handwritten Arabic digits, and the complete code is included.
101. 【2611.02145】GatedV: Self-Gated Values for Transformer Language Models
链接：https://arxiv.org/abs/2611.02145
作者：Li-Ming Yu
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：input hidden states, learned linear projections, attention forms query, forms query, matrices through learned
备注： 12 pages, 3 figures, Code and experimental results: [this https URL](https://github.com/yuliming1996/GatedV)
点击查看摘要
Abstract:Standard attention forms query (Q), key (K), and value (V) matrices through learned linear projections of input hidden states. Architectures such as GAU and Mega incorporate nonlinear transformations into attention. In this paper, we propose GatedV, a simple attention variant that applies SiLU only to V before aggregation without introducing additional trainable parameters. We evaluate GatedV against a standard decoder-only Transformer using matched parameter counts, paired initializations, and equal training-token budgets. At 2.33M parameters, GatedV reduces mean held-out perplexity from 59.1 to 57.9 (2.0%), with improvements across all five paired seeds. At 26.16M parameters, following an equal-budget learning-rate search, mean held-out perplexity falls from 20.2 to 19.7 (2.4%), with improvements across all three paired seeds. Small-model ablations show that the tested affine rescaling of values does not fully reproduce GatedV's gains. A short interleaved benchmark on NVIDIA DGX Spark measures approximately 0.7% higher full-context forward latency for the larger model, based on synchronized wall-clock timings. These findings suggest that value-only self-gating can improve language modeling performance without increasing parameter count or redesigning the attention-weighting mechanism.
102. 【2611.02134】HaloGuard 2.0: An Open-Weights Constitutional Output Guard for Multilingual Response Safety
链接：https://arxiv.org/abs/2611.02134
作者：Ashmiya Lenin,Navaneeth Sangameswaran,Preetham S
类目：Computation and Language (cs.CL); Cryptography and Security (cs.CR)
关键词：input guard decides, guard, input guard, HaloGuard, guard decides
备注： 23 pages, 6 figures, 16 tables
点击查看摘要
Abstract:An input guard decides whether a request reaches the model, but never sees what the model says. Harm that emerges during generation, because a jailbreak passed the input layer or a benign request drifted into operational detail, is visible only on the output side and only as tokens arrive. We present HaloGuard 2.0, an open-weight streaming output guard that assigns a safe/unsafe probability to every response token in a single forward pass, so a deployment can stop the stream once harm is confirmed. The guard reuses the constitution of HaloGuard 1.0, our input guard, to organise a 478,532-response training corpus, and supervises each token from the point where the response becomes harmful. We find that a guard trained on conventionally shaped data learns a shortcut specific to streaming: it judges the prompt instead of the response, and handles only 13.9% of matched safe/unsafe response pairs correctly. We correct this with a second phase on 106,043 counterfactual responses built around the base guard's own failure modes, and release the equal-weight average of the base and corrective models. On six English response-safety benchmarks, HaloGuard 2.0-0.8B reaches a macro F1 of 83.6 (83.3 on held-out halves of the decision-rule search), up from 72.8, with 38% fewer false positives. It matches the strongest full-response guards with 5-10x fewer parameters and is 2.6 points above the strongest streaming guard, Qwen3Guard-Stream-4B. A multilingual variant, HaloGuard 2.0-Poly-0.8B, trained on PolyGuardMix, reaches 83.1 F1 on the response labels of PolyGuardPrompts across 17 languages, 5.0 points above the strongest baseline. On one H100 the guard costs 0.37 ms per token per stream when moderating 64 concurrent responses. Both guards are hardened continuously through the weekly red-teaming protocol of HaloGuard 1.0, extended here to the output layer.
103. 【2611.02129】FOLLIE: Automated Reasoning over the First Dataset of Sentences with their First-Order Logical Representation for French
链接：https://arxiv.org/abs/2611.02129
作者：Maximos Skandalis
类目：Computation and Language (cs.CL)
关键词：automated natural language, natural language inference, Language Inference, natural language, Logic for Language
备注：
点击查看摘要
Abstract:FOLLIE (for First-Order Logic for Language Inference and Entailment for French) connects French sentences, compositional first-order representations and automated natural language inference (NLI). The first French NLI-ready, NL-to-FOL resource, it contains 19,983 inference records and 36,987 non-empty sentence-slot--formula mappings from six heterogeneous NLI sources, retaining French lexical material and source problem structure. Its silver annotations are produced by a neural--symbolic pipeline, with 111 separately identified LLM-assisted additions. The construction combines morphosyntactic analysis, probability-conditioned categorial multitagging, grammatical proof search, discourse representation and first-order semantic construction. Stage-wise experiments show substantial gains in derivation coverage; analyses of conjunction distributions, logical-operator incidence and scope alternation characterise the resulting resource. We then develop an automatic inference engine whose input-conditioned background theories address lexical relations, quantification, quantities, event structure and temporal dependencies. Prover9 supplies proofs for entailment and contradiction, while Mace4 supports bounded consistency checks. Three-way accuracies are 65.37% on all 335 FraCaS-FR problems, 70.33% on 300 GQNLI-FR problems and 71.35% on 9,399 eligible SICK-FR records pooled across splits. Agreement with reference labels among committed decisions is 93.53%, 100.00% and 98.66%, at commitment coverage of 41.49%, 37.00% and 15.05%, respectively. Worked constructions, axiom schemas and proof analyses explain these outcomes and identify the contributions of scope, reference, lexical knowledge and numerical structure. FOLLIE provides a French experimental basis for studying the representations and assumptions that connect sentence interpretation to deductive inference.
104. 【2611.02121】Conditional Calibration Contracts under Coupled Load: A Branch-Aware Audit of Switched Inference
链接：https://arxiv.org/abs/2611.02121
作者：Juan S. Santillana
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC)
关键词：queue states, population selected, Bursty serving, cells, Bursty
备注： 12 pages including references and appendices, ACM sigconf. Historical 40-cell campaign (10 training seeds x 4 coupling levels), with separate three-seed sweeps/ablations. Includes proofs, prospective FIFO mechanism checks, and limitations; prospective contract validation remains open
点击查看摘要
Abstract:Bursty serving changes both queue states and the population selected for each model. We study conditional calibration contracts as a specification to be validated, rather than a certified property of an existing router. CA-MHD combines load-coupled distillation, closed-loop replay and a cost-informed Schmitt router in a discrete-event simulator with a hardware service table. Across 40 cells (ten training seeds and four content-load coupling levels), we distinguish the original teacher, frozen wide heads on an adapted trunk, and the narrow student. A common teacher-trajectory audit has median absolute student-teacher deficit 0.06 percentage points, but does not certify the student-selected deployment support. Historical results use a kernel correctness gap, not the published SmoothECE; we separately prove selected-branch composition for a residual functional at a common fixed scale. The deployed wide branch has lower ordinal accuracy than the original teacher in all 40 cells. Same-checkpoint student-only serving has lower historical ordinal gap in 27/40 cells; routing also exposes violation tails up to 17.5 percent. Student p99 latency remains above the 1.5 ms target. Retrospective temporal recalibration improves the ordinal gap in 39/40 cells, but causal delayed-label availability is unverified and no incremental per-mode benefit is detected after multiplicity adjustment. An in-sample CUSUM detects 30/40 checkpoint changes at five historical false alarms, with no prospective false-alarm guarantee. These findings support a branch-aware audit and a scoped negative result, not demonstrated routing superiority. Independent budgets, selected-support validation and net utility under a satisfied SLA remain open.
105. 【2611.02112】Order-Only On-Policy Distillation
链接：https://arxiv.org/abs/2611.02112
作者：Guangzeng Han,Yu Wu,Xiaolei Huang
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：teacher, On-policy distillation, teacher token probabilities, generations by matching, OPD
备注：
点击查看摘要
Abstract:On-policy distillation (OPD) trains a student on its own generations by matching the teacher's token probabilities. These probabilities entangle two kinds of information: which tokens the teacher prefers, and how confident it is. The latter reflects the teacher's own capacity and calibration, which a smaller student may be unable to reproduce. Because the teacher temperature changes these values without changing the ordering, OPD is also sensitive to the temperature choice. We ask whether the teacher's ordering of candidate tokens is enough, and propose Order-Only On-Policy Distillation (O$^{3}$PD). At each student-generated prefix, O$^{3}$PD trains the student to reproduce the order of the teacher's top-$K$ tokens, without fitting their probability values. The objective is therefore invariant to the teacher temperature and needs no temperature tuning. Across six teacher--student pairs, O$^{3}$PD outperforms OPD on the average over HMMT25, AIME24, and AIME25 in every pair, by up to 2.9 points, with gains of up to 5.6 points on AIME25. Other ranking losses yield similar gains, so the benefit comes from ordinal supervision itself. Analysis shows that O$^{3}$PD departs further from the teacher's probabilities than OPD, yet reproduces its ranking more faithfully and yields a stronger student. The ranking, not the probability values, thus carries the knowledge that on-policy distillation needs to transfer.
106. 【2611.02104】Consolidating Reasoning with Test-Time Training
链接：https://arxiv.org/abs/2611.02104
作者：Haotian Wu,Zeming Chen,Hao Zhao,Antoine Bosselut
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Effective multi-agent collaboration, collaboration requires finalizing, Effective multi-agent, requires finalizing solutions, multi-agent collaboration requires
备注： NeurIPS 2026, 25 pages, test-time training, reasoning aggregation, meta-learning
点击查看摘要
Abstract:Effective multi-agent collaboration requires finalizing solutions from reasoning that is distributed across the individual attempts of many agents. However, useful intermediate reasoning can remain unexploited when collaboration is limited to voting on conclusions reached among individual agents, or aggregating long, noisy collections of reasoning trajectories in context. In this work, we propose TTT-Consolidate, a framework that uses multi-agent reasoning trajectories as adaptation data to improve a model's subsequent reasoning. TTT-Consolidate jointly consolidates trajectories into parametric representations through test-time training, then generates a new solution by conditioning on the consolidated information. We meta-learn how to consolidate using bi-level optimization at training time, where an inner loop encodes reasoning trajectories into a lightweight LoRA adapter, and an outer loop learns meta-parameters for the inner loop such that the consolidation is helpful for the model to synthesize a final solution. As no large-scale corpus of diverse reasoning trajectories exists for training aggregation methods, we construct the OpenParallelThinking corpus composed of 12,810 math problems paired with a mixture of trajectories from six LLMs. Evaluated on challenging math and STEM benchmarks, TTT-Consolidate outperforms the best aggregation baselines by up to 20 percentage points, even under matched compute and runtime settings, with the gap widening at larger model scales. TTT-Consolidate also recovers from unsuccessful individual trajectories more robustly, an ability that improves as the number of available (even incorrect) trajectories increases. Finally, we demonstrate that TTT-Consolidate benefits from both SFT and RL-based outer loop objectives. We will release TTT-Consolidate and OpenParallelThinking for use in future work on reasoning aggregation.
Comments:
NeurIPS 2026, 25 pages, test-time training, reasoning aggregation, meta-learning
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2611.02104 [cs.CL]
(or
arXiv:2611.02104v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2611.02104
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
107. 【2611.02079】ParetoSaddler: Pareto-Guided Optimization of Agent Harnesses for Quality and Cost
链接：https://arxiv.org/abs/2611.02079
作者：Xingzhi Qian,Sungho Park,Rongyuan Tan,Jianbo Yu,Jue Zhang,Lorenzo Cavallaro,Menglin Xia,Yanzhi Chen,Xinnuo Xu,Yu Kang,Xinran Zheng,Gagan Somashekar,Xuchao Zhang,Chetan Bansal,Qingwei Lin,Victor Rühle
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multiagent Systems (cs.MA)
关键词：modifying model weights, substantially improve LLM, improve LLM agents, existing methods primarily, methods primarily optimize
备注： Project website and code will be available at [this https URL](https://aka.ms/ParetoSaddler-website)
点击查看摘要
Abstract:Harness optimization can substantially improve LLM agents without modifying model weights, but existing methods primarily optimize response quality. Extending them to joint quality--cost optimization introduces a challenge: applying the deployment preference during intermediate updates can prematurely reject candidates that are valuable for later improvements. We introduce ParetoSaddler, which addresses this mismatch by separating intermediate candidate promotion from final deployment selection. At each iteration, an optimizer updates a parent harness to produce a candidate, and then compares the two over repeated executions and uses Bayesian bootstrap Pareto support to promote candidates showing credible progress in either quality or cost. Promoted candidates receive broader development evaluation and remain available as parents for later optimization steps. We evaluate ParetoSaddler on ClawMark and GAIA2 using domain-disjoint splits. On ClawMark, ParetoSaddler improves quality from 70.86\% to 81.35\% while reducing cost from \$1.17 to \$1.01 per task; on GAIA2, it improves quality from 56.22\% to 62.89\% while reducing cost from \$0.78 to \$0.45 per task. The Pareto-selected harnesses also achieve higher quality at lower cost than quality-only harness optimization. Analysis shows that Pareto-aware optimization retains intermediate candidates that would be discarded by deployment preference but can support later improvements, while Bayesian bootstrap screening filters out candidates whose gains are weakly supported across runs.
108. 【2611.02033】How Green Is Your Manifesto? Scoring Environmental Positions in the 2024 EU Elections with an LLM Panel
链接：https://arxiv.org/abs/2611.02033
作者：Franco Corti,Sajid Siraj
类目：Computation and Language (cs.CL); Computers and Society (cs.CY); General Economics (econ.GN)
关键词：Locating political parties, Locating political, policy is central, hand coding, slow to extend
备注：
点击查看摘要
Abstract:Locating political parties on environmental and climate policy is central to the study of party competition, yet the established instruments, expert surveys and the hand coding of manifestos, are costly, periodic, and slow to extend to new documents. We ask whether a panel of large language models can serve as a cheaper and reproducible alternative. Treating each manifesto as a set of sentences, three models from independent providers score every sentence on two dimensions, environmental protection and climate change, separating a party's position on an issue from the salience it gives it, and the judgments are averaged to the manifesto level. Agreement across the models is retained as a built-in reliability signal. We apply the panel to 41 manifestos from the 2024 European Parliament election, covering Austria, France, Germany, Italy, Spain, and the European party families, and validate it against the 2024 Chapel Hill Expert Survey for the 25 parties with a like-for-like expert benchmark, using the other manifestos as diagnostic cases. The panel recovers the expert ordering of parties with strong rank agreement on both dimensions, while reading them as systematically greener than experts do, a gap we interpret as the distance between manifesto promise and governing record. Inter-model disagreement modestly flags where the instrument errs, and position and salience prove related for environmental protection but independent for climate change. The result is a transparent, low-cost, and multilingual instrument that complements rather than replaces expert and hand-coded approaches; the prompt, code, and manifesto-level results are released openly.
109. 【2611.02021】ClickSight: An LLM Framework for Interpreting Student Clickstreams Through Learning Strategies
链接：https://arxiv.org/abs/2611.02021
作者：Bahar Radmehr,Lan Tran,Ekaterina Shved,Fatma Bet{ü}l G{ü}reş,Adish Singla,Tanja K{ä}ser
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：substantial expert effort, produce rich clickstream, rich clickstream data, environments produce rich, requires substantial expert
备注： 29 pages, 12 figures, 19 tables. Under review. Code: [this https URL](https://github.com/epfl-ml4ed/ClickSight-CEAI)
点击查看摘要
Abstract:Digital learning environments produce rich clickstream data that can reveal how students approach learning tasks, yet interpreting these fine-grained traces often requires substantial expert effort. We introduce ClickSight, a framework for interpreting student clickstreams through learning strategies defined in the literature. Given a student clickstream and a predefined set of learning strategies, ClickSight uses a staged LLM-based pipeline to identify strategy-relevant evidence, assess adherence to each strategy, and generate an evidence-grounded interpretation of the student's behavior. We evaluate ClickSight across two learning environments, 365 students, and 12 model backbones using an expert-grounded quality rubric and an LLM judge calibrated with human-expert ratings. Our results show that ClickSight can generate high-quality strategy-based interpretations across different models and environments, with reasoning models performing more consistently than instruction-tuned counterparts. We further find that providing external clickstream-extracted guidance can improve interpretation quality for strategies that require precise quantitative information from the trace. By connecting fine-grained clickstreams with theoretically defined learning strategies and preserving the evidence underlying each judgment, ClickSight provides a flexible approach for studying student behavior in digital learning environments.
110. 【2611.02018】CULTURE-CMT: Benchmarking Contextualized Social Media Translation
链接：https://arxiv.org/abs/2611.02018
作者：Linjuan Wu,Dingming Li,Yiwen Qiu,Xinze Lyu,Ye Guo,Daoxin Zhang,Zhe Xu,Weiming Lu
类目：Computation and Language (cs.CL)
关键词：isolated text, Social-media, context, Abstract, community-specific slang
备注： 24 pages. Preprint
点击查看摘要
Abstract:Social-media comments are interactions, yet they are often translated and evaluated as isolated text. This mismatch is especially problematic when meaning depends on surrounding discussion, community-specific slang, or culturally situated expressions. We introduce CULTURE-CMT, a Chinese-English benchmark for contextualized social-media comment translation that restores the post and conversational context naturally available to users. Its 572 manually verified examples are organized into Slang, Context, and Both, enabling diagnostic analysis of distinct and interacting sources of translation difficulty. To support scalable evaluation, we further develop a retrieval-augmented cultural-effectiveness Judger that combines a calibrated scoring model with dynamically retrieved cultural knowledge. CULTURE-CMT reveals several non-trivial patterns. Providing interaction context improves most model configurations, but does not eliminate culturally ineffective translations. Examples requiring both contextual grounding and culturally situated language remain substantially more difficult than either source of difficulty alone. Moreover, larger models are not consistently better, and thinking produces highly model-dependent gains, including occasional degradation. In contrast, a 27B model adapted on benchmark-disjoint social-media data achieves the lowest observed invalidity rate among the evaluated configurations under thinking inference with context. Together, these results suggest that realistic social-media translation is not simply a matter of scaling models or reasoning longer, but of learning to translate meaning as it is constructed within evolving online interactions.
111. 【2611.02017】Switch-SWE: Do Coding Agents Hold Focus When Switching Between Unfinished Tasks?
链接：https://arxiv.org/abs/2611.02017
作者：Shuochen Chang,Qianli Ma,Yibo Miao,Qingyang Liu,Bingjie Gao,Haonan Zhao,Siyu Sun,Yulin Sun,Han Zhao,Jiangtong Li
类目：Computation and Language (cs.CL)
关键词：Software development sessions, Software development, Software, unfinished, unfinished tasks
备注：
点击查看摘要
Abstract:Software development sessions often involve several unfinished tasks rather than one issue carried through to completion. As coding agents take on repository-level development, they need to recover an earlier task's requirements and partial progress after intervening work. Existing repository-level benchmarks typically score one issue-to-patch episode and do not directly measure whether an agent can resume a task after advancing other unfinished work in the same repository. We introduce \textbf{\ourmethod}, a benchmark for focus-task resumption in sessions that interleave unfinished tasks drawn from the same source repository, with a persistent checkout for each task. Each focus task is evaluated in matched uninterrupted and switched sessions with identical focus requirements and executable verifiers. The switched session interleaves ordered stages from other unfinished tasks in the same repository, while only the final focus patch is scored. \ourmethod~contains 200 focus tasks from 19 Python repositories, reconstructed from issue, pull-request, and review histories and rendered as 400 matched session specifications. Across 7 coding agents, interleaved unfinished work produces an average focus-task resolution gap of 11.5 percentage points, ranging from 6.0 to 15.0 percentage points. Trajectory analysis identifies cross-task requirement confusion and loss of task state as recurrent resumption behaviors. We introduce a plug-in context-management module that selects task-relevant history and maintains concise task-state summaries. On OpenCode, the module improves focus-task completion under same-repository task switching by 5.5 to 15.5 percentage points across the evaluated models. Code is available at this http URL.
112. 【2611.02015】Scaling Makes It Possible: How Large Models Master Impossible Languages
链接：https://arxiv.org/abs/2611.02015
作者：Yaning Jia,Chunhui Zhang,Chiyu Ma,Zhongyu Ouyang,Ivory Yang,Soroush Vosoughi
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：natural language tasks, make human languages, human languages learnable, remains debatable, excel in natural
备注： 17 pages, 7 figures, including 6 pages of supplementary information
点击查看摘要
Abstract:While language models (LMs) excel in natural language tasks, their ability to learn impossible languages--those that violate the structural, cognitive, or logical constraints that make human languages learnable and functional--remains debatable. This controversy is further fueled by a divide between linguistic theorists and empirical researchers working with small-scale LMs. To address this controversy, we introduce semantic coherence. This concept measures how effectively semantic information is expressed in language structures and examines the learning capabilities of LMs across multiple scales. By fine-tuning billion-parameter LMs on impossible language samples, we demonstrate that larger LMs achieve similar performance on impossible and possible languages, whereas million-parameter LMs exhibit significant degradation when trained on impossible languages. This performance gap widens as semantic complexity increases. We further show that scaling up the LM size fundamentally shifts the learning focus from grammatical rules to semantic understanding, with billion-scale LMs exhibiting a threefold reduction in sensitivity to low-level linguistic perturbations while maintaining stable performance under high-level semantic perturbations.
113. 【2611.02011】MedPsy: State-of-the-Art Small Medical Language Models for Efficient Edge Deployment
链接：https://arxiv.org/abs/2611.02011
作者：Davide Vitabile,Alexandro Buffa,Akshay Nambiar,Amril Nazir
类目：Computation and Language (cs.CL)
关键词：expert clinical support, real-world healthcare tasks, promise expert clinical, strongest open-source LLMs, models promise expert
备注： Accepted at NeurIPS 2026 (main conference)
点击查看摘要
Abstract:Medical language models promise expert clinical support, but the strongest open-source LLMs remain too large for private edge-device deployment, while compact medical models still trail substantially on knowledge-intensive and real-world healthcare tasks. Reasoning models that fit edge memory budgets can produce long reasoning traces, increasing sequential decoding, end-to-end latency, energy consumption, and KV-cache memory pressure. We present MedPsy, a family of text-only 1.7B and 4B medical language models designed for edge deployment, targeting this accuracy-generation-efficiency trade-off. Our recipe combines a synthetic medical data pipeline over biology, medicine, and health seeds with chain-of-thought targets from a 235B medical-focused LLM teacher; a four-stage post-training curriculum comprising two SFT stages followed by two RL stages with hard-sample mining; and an edge deployment evaluation spanning multiple GGUF quantization variants and real-device inference on laptop and smartphone hardware. On seven closed-ended medical benchmarks, MedPsy-4B surpasses MedGemma-1.5-4B by 19.34 points and matches MedGemma-27B while being 6.75x smaller; MedPsy-1.7B outperforms MedGemma-1.5-4B by 11.42 points despite being less than half its size. On HealthBench-Hard, MedPsy-4B surpasses MedGemma-27B by 15.33 points, while MedPsy-1.7B surpasses it by 11.66 points despite being ~16x smaller. Beyond accuracy, MedPsy reduces average response length by 1.7x (1.7B) and 3.2x (4B) versus its Qwen3 backbones, while Q4_K_M quantization preserves the aggregate score within 1 point of BF16 with ~69% lower disk footprint. In real-device inference, MedPsy-4B's shorter generations translate into 75% lower median end-to-end latency and estimated energy per answer than its Qwen3 backbone at matched quantization, while peak RAM remains below 5 GB across our tested laptop and smartphone configurations.
114. 【2611.02009】Retrieval-Enhanced Cultural Evaluation for Social Media Translation Training
链接：https://arxiv.org/abs/2611.02009
作者：Linjuan Wu,Yiwen Qiu,Xinze Lyu,Dingming Li,Hui Yao,Zhongyi Sang,Ye Guo,Daoxin Zhang,Zhe Xu,Fei zhao,Mu Chuan,Yao Hu,Weiming Lu,Yongliang Shen
类目：Computation and Language (cs.CL)
关键词：requires preserving meaning, translation requires preserving, Social media translation, media translation requires, user-generated content
备注： 17 pages. Preprint
点击查看摘要
Abstract:Social media translation requires preserving meaning while capturing the cultural nuances of user-generated content (UGC). However, gaps in the cultural knowledge of LLM-based evaluators can lead to inaccurate assessments and unreliable training rewards. To improve these signals, we use retrieval-enhanced cultural evaluation to train CUE-MT, a family of social media translation models. A calibrated, domain-specific Judger guides supervised data refinement and is augmented by an Agent for hard-example mining and reinforcement learning. The Agent retrieves relevant external evidence as needed and distills it into concise hints that the Judger uses to score translations and assign rewards. Across 9B, 27B, and 35B-A3B backbones, CUE-MT outperforms the evaluated open-source baselines of comparable size on CUE-MT-Bench and three public benchmarks. Human evaluation on CUE-MT-Bench shows cultural effectiveness gains of 7.44-15.12 percentage points over the strongest external baseline in each size group. Retrieval improves the Judger's four-way classification accuracy by 8.07 percentage points over a matched no-retrieval baseline that uses LLM-generated hints alone. Training ablations further support the combination of hard-example mining and Agent-enhanced rewards.
115. 【2611.02002】o Align Long, Plan Short: Simulating Diverse Profile-Aligned Students by Realizing Short-Term Plans in Long-Horizon Learning Environments
链接：https://arxiv.org/abs/2611.02002
作者：Bahar Radmehr,Jiaxu Zhao,Fatma Betül Güreş,Adish Singla,Tanja Käser
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：test learning platforms, Simulated students offer, offer a scalable, tutors before deployment, ALPS
备注： 33 pages, 3 figures, 20 tables
点击查看摘要
Abstract:Simulated students offer a scalable way to test learning platforms and AI tutors before deployment with real students and to augment scarce data for studying learning at scale. Existing LLM-based simulators primarily target short, language-centered interactions. In open-ended learning environments, however, student behavior emerges from patterns across long-horizon interaction trajectories, where turn-level prompting can drift from an assigned behavior profile. We introduce ALPS (Align Long-term by Planning Short-term), a hierarchical simulated student conditioned on observable, environment-specific behavior profiles. Rather than selecting every action independently, ALPS alternates between planning profile-aligned task segments and generating the corresponding actions. We evaluate ALPS in both data-sufficient and data-scarce settings, where supervision comes either from real student trajectories or from a teacher LLM. Across both settings, we compare in-context learning (ICL), supervised fine-tuning (SFT), reward-ranked fine-tuning (RAFT), and their sequential combination (SFT followed by RAFT). Experiments in an inquiry-based physics game and a pharmacy simulation evaluate behavioral density and coverage against held-out real data, and profile consistency using a human-aligned LLM judge. Across both settings, ALPS consistently outperforms turn-level generation, achieving comparable density and judge pass rates under scarce supervision, although coverage remains lower. These results show that hierarchical planning enables faithful, profile-aligned simulation over long interaction horizons, even with limited real student data.
116. 【2611.02001】rackMem: Tracking Evolving Beliefs in Long-Horizon Financial Dialogue
链接：https://arxiv.org/abs/2611.02001
作者：Austin M.Y. Cheung,Harsh Vardhan Gupta,Go Nam Lui,Lok Kan Chan,Ginny Y. Wong,Simon See
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：remembering reduces largely, LLM agents, rarely change, agents are evaluated, facts accumulate
备注： 22 pages (6 pages main text), 4 figures
点击查看摘要
Abstract:Memory systems for LLM agents are evaluated mostly on social dialogue, where facts accumulate and rarely change, so remembering reduces largely to finding the turn in which something was said. Financial dialogue breaks this assumption: figures are revised, stances shift without being restated, rules stated once govern later questions, and a single company is discussed under several analytical lenses. Memory systems that retrieve the passages most similar to a question, or the most recent ones, therefore return superseded values, miss rules that share no wording with the question, and cannot recover a stance spread across sessions. We present TrackMem, a per-speaker graph memory that tracks the history of figures, separates perspectives by entity and lens, and preserves each speaker's actions in chronological order. To evaluate it, we introduce FinLoCoMo, a benchmark of 15 long-horizon investment conversations with 765 questions in two splits: one following the LoCoMo categories and one targeting four failure modes. With two readers, TrackMem outperforms existing memory systems on both splits. On the failure-mode split it reaches 73.9% macro accuracy against 69.4% for the strongest baseline, with the largest gains on questions about revised figures (86.5% against 73.4%).
117. 【2611.01967】Better Answers, Weaker Evidence Control: Evidence Bypass in On-Policy Distillation
链接：https://arxiv.org/abs/2611.01967
作者：Ruoran Xu,Yilun Zhao,Ziyu Chen,Xiaoqiang kang,Arman Cohan
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：improve answer accuracy, OPD, answer, On-policy distillation, accuracy
备注：
点击查看摘要
Abstract:On-policy distillation (OPD) can improve answer accuracy while weakening responsiveness to supporting evidence. We investigate this separation in scientific-document question answering through matched document interventions that change the supported answer while preserving the question and unrelated context. We identify evidence bypass: a student retains an originally correct answer after the document changes to support a different one. On QASPER with a Qwen3-4B student, standard OPD raises original-document accuracy by 3.4 percentage points, lowers counterfactual accuracy by 5.3 points, and increases bypass by 15.7 points; the same directional pattern appears on PeerQA. Controlled perturbations localize the shift to answer-critical evidence, and bypass grows with the student's pre-distillation closed-book preference for the original answer. A factorized study of teacher targets, privileged information, divergence, and supervision density finds that explicitly supplying the teacher with annotated answer-critical spans yields the largest joint improvement in evidence response and claim support. These findings motivate Evidence-Paired OPD (EP-OPD), which combines on-policy supervision on matched documents supporting different answers to the same question with an answer-level margin that favors each document's supported answer over its paired alternative. Across both datasets and two student sizes, EP-OPD recovers 54-66% of standard OPD's counterfactual-accuracy loss while preserving 80-85% of its original-document accuracy gain. Our results establish evidence responsiveness as a distinct training and evaluation target alongside answer accuracy. Our code is publicly available at: this https URL.
118. 【2611.01954】owards Self-Evolving Narrative Systems: Real-Time Adaptation and Long-Term Optimization with LLMs
链接：https://arxiv.org/abs/2611.01954
作者：Ruisheng Sun,Jiaqi Shao,Weijia Han,Linxi Ju,Yunzhen Zhang,Binyan Sun,Rong Chen,Benjamin Blas Maristany,Ye Lu,Rui Hu,Ernesto Escobar,Bing Luo
类目：Computation and Language (cs.CL)
关键词：Traditional interactive narrative, systems offer strong, Traditional interactive, offer strong authorial, interactive narrative systems
备注： Under review at the ACL Rolling Review (ARR) October 2026 cycle
点击查看摘要
Abstract:Traditional interactive narrative systems offer strong authorial control and structural coherence but often restrict player agency. In contrast, LLM-driven narratives enable open-ended generation and greater flexibility, yet frequently suffer from inconsistency and diminished narrative control. To navigate this trade-off, we propose a hybrid narrative framework that dynamically balances pre-authored content with real-time LLM generation via semantic similarity alignment. Additionally, sustaining narrative quality over extended gameplay remains a core challenge in LLM-based storytelling. To address this, we introduce a self-evolving, feedback-driven optimization framework that leverages in-context learning to iteratively refine prompts, eliminating the need for manual prompt engineering. Through a case study and participant-based evaluation, we show that our framework enhances narrative coherence while preserving player agency, effectively aligning generated content with both authorial intent and evolving player behavior.
119. 【2611.01945】racing How Language Models Integrate Temporal Anchors into Factual Recall
链接：https://arxiv.org/abs/2611.01945
作者：Ayana Niwa,Masahiro Kaneko,Kentaro Inui
类目：Computation and Language (cs.CL)
关键词：relation pair maps, pair maps, Factual recall, typically framed, factual association
备注：
点击查看摘要
Abstract:Factual recall in language models is typically framed as retrieving a factual association: a subject--relation pair maps to a single object. However, many facts are context-dependent: the same pair maps to different objects depending on a condition such as time. We introduce anchored factual recall, in which the model receives an explicit conditioning expression, an anchor, and must select the object valid under it. This raises questions that single-object recall does not: where the anchor enters the computation, what it changes, and how that change selects the answer. Focusing on temporal anchors, we answer them with causal interventions on four open-weight models on English prompts and identify two routes. In a subject-mediated route, the anchor resolves the final subject-token representation to the queried year, and the relation redistributes the readout of this state across attention heads. In a direct route] the final position attends to the anchor, and upper-layer MLPs turn this signal into a preference for the time-appropriate object. The two routes are parallel channels: their contributions add up, most queries use both, and their balance depends on the query, e.g., on the relation, consistently across models. This reframes mechanistic accounts of factual recall from retrieving a single stored object to selecting among context-dependent alternatives.
120. 【2611.01926】AC-CoT: Tool-Empowered Implicit Chain-of-Thought via Interleaving Explicit Tokens
链接：https://arxiv.org/abs/2611.01926
作者：Juseon Do,Sangmin Bae,Jeesu Jung,Hwanjun Song
类目：Computation and Language (cs.CL)
关键词：LLM-based agentic systems, external knowledge, require accurate reasoning, multi-step deliberation, systems are increasingly
备注： EMNLP 2026 Main Long
点击查看摘要
Abstract:LLM-based agentic systems are increasingly combined with CoT reasoning to solve tasks that require accurate reasoning, external knowledge, and multi-step deliberation. Yet, explicit CoT incurs substantial generation overhead, while implicit CoT, which replaces textual rationales with compact continuous tokens, does not naturally support the explicit communication interface required for agentic tool-use. We propose TAC-CoT, a tool-empowered adaptive implicit CoT framework that replaces explicit reasoning traces with compact latent reasoning segments while retaining textual tokens only for tool calls, observations, and final answers. This interleaved design enables agentic tool-use without verbalizing every intermediate reasoning step. Experiments on agentic math and QA benchmarks show that TAC-CoT improves accuracy by up to 8.8 points while reducing model forward passes by up to 6.8x. Furthermore, analyses show that TAC-CoT improves tool-use quality in both single- and multi-tool settings.
121. 【2611.01878】Don't Guess, Ask Wisely: Benchmarking and Training Proactive Elicitation in Open-Domain LLM Conversations
链接：https://arxiv.org/abs/2611.01878
作者：Rongyu Zhang,Mutian Bao,Jinjian Zhang,Yuetian Du,He Xu,Wei Zhou,Xiaojun Zhu,Ming Kong,Jie Liu,Linjian Mo,Qiang Zhu
类目：Computation and Language (cs.CL)
关键词：large language models, call proactive elicitation, real user-assistant queries, underspecified queries trigger, large language
备注： 26 pages, 6 figures; EMNLP 2026 oral
点击查看摘要
Abstract:When user queries are incomplete, large language models should ask targeted questions before committing to an answer, a capability we call proactive elicitation, yet evaluation on real user-assistant queries across seven LLMs (8B to frontier) shows that fewer than 11% of underspecified queries trigger a follow-up question. To benchmark and train this capability, we introduce VagueBench, where each seed query is annotated with structured intent and detail units then degraded into intent-vague and fully-vague variants via controlled removal of linguistic cues, yielding known hidden information sets for evaluating both when and what to ask. We propose DialogGRPO, an offline reinforcement learning method that organizes multi-turn elicitation as a dialogue-state directed acyclic graph, where candidate questions at each node receive dense turn-level rewards combining immediate information gain with lookahead value through group-relative comparison, enabling fine-grained credit assignment without runtime simulation. DialogGRPO elicits missing information on over 88% of vague queries with substantial gains in both recovery efficiency and answer coverage, without over-asking on complete queries, outperforms prompting and test-time-scaling baselines, and generalizes zero-shot to MultiWOZ 2.4 and AmbigQA.
122. 【2611.01864】Quantizing Recurrent Language Models Is Easier Than You Think
链接：https://arxiv.org/abs/2611.01864
作者：Philipp Nazari,Neehal Tumma,Daniela Rus,T. Konstantin Rusch
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：enables efficient decoding, increasingly common building, common building block, large language models, Linear recurrences
备注：
点击查看摘要
Abstract:Linear recurrences are becoming an increasingly common building block in large language models, replacing the growing KV cache of softmax attention with a fixed-size recurrent state that enables efficient decoding. However, the quantization stack has largely been developed around softmax Transformers, whose numerical properties and inference state differ from those of recurrent models. Our goal is to understand these differences and study the design space of quantization methods for recurrent models. In our analysis, we differentiate between two targets. First, extra-state quantization concerns weights and activations outside the recurrent state, whose distributions are shaped indirectly by the sequence mixer during training. In controlled 1.3B parameter models, we find that decayed recurrences develop weaker residual outlier channels than softmax attention and are therefore easier to quantize without incoherence processing. Second, intra-state quantization concerns the recurrent state itself during decode, where repeated updates create a different numerical problem from KV cache quantization. We instantiate our findings as LoReS, a state quantization pipeline combining value-axis scale grouping to match output channel magnitude, decay-based mixed-precision to protect slowly decaying heads or channels, and stochastic rounding to limit error accumulation under repeated requantization. Across Qwen-3.5 9B, Nemotron-H 8B, and Kimi-Linear 48B-A3B, LoReS supports robust 8-bit state quantization and lower effective precision on shorter decode horizons. We implement LoReS in vLLM and demonstrate end-to-end decode speedups.
123. 【2611.01840】Self-Evolving Agentic Workflows via Semantic Decomposition of Complex Tasks
链接：https://arxiv.org/abs/2611.01840
作者：Zichuan Fu,Junjia Qi,Xian Wu,Wenlin Zhang,Yimin Deng,Kaifeng Guo,Xiangyu Zhao
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA)
关键词：workflows organize complex, organize complex tasks, Agentic workflows organize, organize complex, Agentic workflows
备注： Accepted as a Spotlight at the NeurIPS 2026 Workshop on Interpreting Agent Behavior (IAB), GLEE Competition Track; 1st place in the GLEE competition. 21 pages
点击查看摘要
Abstract:Agentic workflows organize complex tasks into reusable procedures. However, invoking an LLM at every step incurs repeated inference costs and delays. We propose a framework for self-evolving agentic workflows through semantic task decomposition. Each subtask has explicit applicability conditions and a procedure that executes code or invokes a model as needed. An agent uses execution feedback to refine the decomposition and update these procedures. Experiments in the GLEE competition show the framework on bargaining, negotiation and persuasion. Most observed final-decision procedures are implemented in code. Code is available at this https URL.
124. 【2611.01834】LegoEnv: Self-Evolving Agentic Environments via Modular Recombination
链接：https://arxiv.org/abs/2611.01834
作者：Zhuosong Jiang,Chengxu Wu,Junqi Liu,Yujie Yi,Siqin Wang,Zhixuan Huang,Jinqian Jiang,Lijun Xiao,Jianxun Li,Yongyang Pan,Jieran Wang,Shiqi Shen,Fei Liu,Xinyu Lin
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：LLM agents learn, LLM agents, agents learn, learn by interacting, designed for specific
备注：
点击查看摘要
Abstract:LLM agents learn by interacting with environments, yet existing environments are designed for specific tasks and fail to generalize to new ones. Recent methods automate environment construction with LLMs. However, they generate each environment from scratch, neither reusing parts shared across environments nor carrying a fix from one environment to the rest. To address this, we propose a new paradigm of evolving environment atoms, which composes environments from reusable atoms (intent, rule, data and server) and evolves the atoms when an environment fails to give reliable feedback (e.g., an application lacks a tool the task requires). To instantiate this paradigm, we introduce LegoEnv, which builds 5,465 verified environments over 223 applications, and one round of evolution raises the share of solvable environments from 71.6% to 88.3%. On AutomationBench, SFT on these environments lifts Qwen3.6-27B from 16.0% to 32.0%, and RL with their verifiers lifts Qwen3.8-27B from 37.6% to 40.3%. Further analyses show steady gains with corpus size, transfer to unseen applications, and failures concentrated in a few shared root causes.
125. 【2611.01825】he Scope Grammar of Natural-Language Rules: Counting and Enumerating Readings modulo Logical Equivalence
链接：https://arxiv.org/abs/2611.01825
作者：Sherzod Turaev,Mary John
类目：Formal Languages and Automata Theory (cs.FL); Computation and Language (cs.CL); Logic in Computer Science (cs.LO)
关键词：resolve or expose, rule written, written for people, people fixes, fixes its atomic
备注： 13 pages, 1 figure, 1 table
点击查看摘要
Abstract:A rule written for people fixes its atomic conditions and connectives but leaves open how the connectives are bracketed, and each bracketing is a different logical reading that an autoformalizer must resolve or expose. We study the scope grammar, a deliberately ambiguous context-free grammar whose derivation trees are the readings of a connective skeleton and whose quotient by logical equivalence is what matters downstream. A skeleton with $k$ binary connectives has $C_k$ derivation trees, the $k$-th Catalan number, but far fewer logically distinct readings. For the positive, repetition-free fragment we make the gap exact: through the uniqueness of the read-once normal form we characterize the realizable normal forms by lowest common ancestors and count them with a two-label recurrence over the operator word, verified against exhaustive enumeration up to eleven atoms. The count is invariant under reversal and $\wedge/\vee$ duality; a skeleton is ambiguous if and only if it uses both $\wedge$ and $\vee$, a one-pass test; and the number of classes is at least $2^{\lfloor n/3\rfloor}$. Up to fifteen atoms the alternating pattern is the worst case; its count has a cubic generating function, is the 3-Schröder sequence (OEIS A137842), and grows with base $\varphi^{5/2}\approx3.330$, below the Catalan base 4. We reduce maximality to an inequality on increments, verified to sixteen atoms, and explain why local exchange arguments cannot prove it. We also treat negation, exceptions, and background axioms, where normal-form uniqueness still decides equivalence but counting is open.
126. 【2611.01809】Shared relations, specific choices: conditional sensitivity and competing pathways in language models
链接：https://arxiv.org/abs/2611.01809
作者：Kaixiang Shu
类目：Computation and Language (cs.CL)
关键词：queries drive, drive a query-specific, query-specific choice, relational representation, relational
备注：
点击查看摘要
Abstract:How does a relational representation shared across queries drive a query-specific choice? Controlled entity-binding experiments with GPT-2 Small, Qwen2.5-1.5B and Llama-3.2-1B reveal a low-dimensional relational background that is predominantly shared across query roles and transfers to new names. Same-domain interactions persist when another attribute domain is queried. After removing this component, restoring independently trained relation directions brings output contrasts closer to their original values than sign-reversed or equal-norm random controls in all three models. Yet a transferable relational representation need not have a transferable functional sign. In Qwen2.5, fixing model weights, the training-mean relation vector and edit dose yields opposite selection effects across binary and lexical-mapping prompts with different answer vocabularies. A factorial contrast of downstream sensitivities across attribute-query combinations determines the shared direction's local signed selection gain. In a separate eight-condition protocol, mean local gain is positive in Qwen2.5 and negative in Llama3.2. Late-component clamps resolve opposing pathway contributions: in Llama3.2, negative transmission through selected attention-only paths is partially offset by positive transmission through paths traversing both selected attention and MLP sets. Source-coordinate analyses establish distributed factor coverage, hidden-receiver readouts reveal layout-dependent combination, and instance-geometry interventions separate response direction from amplitude. These findings show how conditional sensitivity and competing pathways give shared relational structure its effect on specific choices.
127. 【2611.01785】Rubric-Based Assessment of Student Reports Using Small Language Models
链接：https://arxiv.org/abs/2611.01785
作者：Sandesh Kumar Kafle,Jan Vykopal,Valdemar Švábenský
类目：Computers and Society (cs.CY); Computation and Language (cs.CL); Cryptography and Security (cs.CR)
关键词：reducing instructors' workload, deliver structured feedback, assess student texts, structured feedback, reducing instructors'
备注： Full paper accepted for the 58th ACM Technical Symposium on Computer Science (SIGCSE TS 2027)
点击查看摘要
Abstract:Language models can analyze and assess student texts using predefined rubrics and deliver structured feedback, reducing instructors' workload. However, existing solutions often rely on external services that are resource-intensive, costly, and raise privacy concerns, making them unsuitable for constrained environments. This study evaluates an automated assessment pipeline with three key aims: design for low-resource environments, privacy, and focus on a novel context in cybersecurity education. The pipeline integrates lightweight language models for textual evaluation and a vision-language model for image interpretation. Responses from 105 students were collected over two semesters of an undergraduate course during a cybersecurity exercise on incident response. Results across different hardware configurations show that small models in low-resource environments can achieve up to 97% accuracy in text-only and up to 94% in rich-text assessments. This rivals or even outperforms a large model while adding the benefits of locally hosted assessment. Our solution can help educators and practitioners who need grading assistance without replacing human oversight, especially in environments where cloud-based solutions may be impractical. This study contributes an open-source, locally deployable AI-assisted scoring pipeline that runs on affordable hardware and can be extended to various types of student reports in computing education. As a result, it makes automated assessment accessible to a broad range of educators and institutions.
128. 【2611.01778】MemRole: From Memories to Decisions for Long-Horizon Reasoning in Role-Playing Agents
链接：https://arxiv.org/abs/2611.01778
作者：Mengting Li,Xilong Cheng,Zhihao Xiao,Zhenhua Xu,Jingyuan Zhou,Linfeng Li,Long Zhang,Borui Cai,Yunxiao Qin
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：long narrative horizons, LLM-based role-playing agents, make role-consistent decisions, agents are fluent, fluent at imitating
备注： 25 pages
点击查看摘要
Abstract:LLM-based role-playing agents are fluent at imitating a character's style, yet struggle to make role-consistent decisions over long narrative horizons. Such decisions are shaped by experiences spanning many prior scenes, which are often partial and may point in different directions. Existing methods inject cross-scene memories as context, but do not reason about how past events shape a character's current motivations and behavior. We propose MemRole, a framework that makes this memory-to-decision process explicit. It introduces Long-Horizon Memory Thinking (LHMT), a reasoning schema that decomposes hidden reasoning into context understanding, memory activation, and response strategy planning, trained on a novel-derived dataset whose character-grounded, timeline-constrained memory pools limit each character to what it could plausibly know at the current narrative point. Beyond supervised fine-tuning, we propose Self-Refining On-Policy Self-Distillation (SR-OPSD): the model critiques its own rollouts against the reference under a data-driven rubric, and a critique-conditioned teacher view of the same model distills token-level guidance back into the policy. MemRole-32B improves over its backbone by 15.2 points on memory-grounded role-playing, performs on par with frontier LLMs such as GPT-5.4, and achieves the best character-motivation recognition accuracy on CroSS-MR.
129. 【2611.01755】A Bounded Evaluation Protocol for Representational Systematicity
链接：https://arxiv.org/abs/2611.01755
作者：Boyu Cao,Wenshuo Wang
类目：Computation and Language (cs.CL)
关键词：producing correct outputs, Multiple studies, correct outputs, studies have shown, shown that neural
备注： Accepted at the NeurIPS 2026 Evaluations and Datasets Track
点击查看摘要
Abstract:Multiple studies have shown that neural networks can be behaviorally systematic, producing correct outputs for novel combinations of familiar parts. Whether they are also representationally systematic, that is, whether they represent these parts and their roles and use them to produce the outputs, remains hard to test, because each kind of evidence can mislead on its own: correct outputs can come from shortcuts, a decodable signal need not be used, an intervention can act through unintended pathways, and a failed search does not show absence. We propose a bounded evaluation protocol for representational systematicity (Bounded-RS): for an explanation that attributes a systematic behavior to a declared representation, it tests on a matched behavioral contrast whether that representation is recoverable and whether it is causally used, checks the validity of this evidence, and assigns the explanation one of four bounded states, Unsupported, Present-only, Causal-use, or Undetermined, through control-calibrated scores, gates, and stop rules. On a semantic-parsing testbed of 96 matched sets that we release, the tested role-filler Binding explanation of fine-tuned T5 models is Causal-use and the distributed Geometry explanation is Unsupported within its declared search space, verdicts that hold across calibration-compatible parameter configurations, training seeds, and T5-base. On 41 cases with known causal status, full adjudication licenses a false Causal-use in 1 of 34 noncausal cases, against 13 when recoverability is taken as use, without missing any causal case. Bounded-RS thus turns the question of representational systematicity, debated since Fodor and Pylyshyn, into comparable and falsifiable verdicts on declared explanations, each reported with the evidence pattern that licenses it and, for a negative, the search space that bounds it.
130. 【2611.01747】Evolving Memory, Learning to Meta-Control: Test-Time Adaptation for Experience-augmented LLM Agents
链接：https://arxiv.org/abs/2611.01747
作者：Zeyuan Zhao,Yuanyuan Shi,Peng Yu,Lingyue Fu,Shao Zhang,Ying Wen
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Self-evolving agents accumulate, existing frameworks typically, frameworks typically rely, agents accumulate experience, Self-evolving agents
备注： 23 pages, 5 figures. Submitted to ACL Rolling Review (October 2026)
点击查看摘要
Abstract:Self-evolving agents accumulate experience from task streams, but existing frameworks typically rely on fixed pipelines to retrieve and utilize this experience, neglecting when and how to deploy it. We introduce Online Meta-Control of Experience (OMCE), a framework that updates experience memory and learns a meta-control policy from task feedback during test-time adaptation. OMCE employs a lightweight contextual-bandit meta-controller that uses compact retrieval signals to select among four cognitive actions: DIRECT, EPISODE, GUIDE, and DISTILL. This routing mechanism operationalizes three coupled decisions: whether to invoke experience, which memory format to utilize, and when to consolidate new guidance. OMCE evolves online, leveraging task feedback to update the memory bank and refine the routing policy via contextual bandit updates. Experiments on four online adaptation benchmarks across four backbones show that OMCE improves first-attempt success by up to 20.5 percentage points over the strongest compared baseline, while reducing per-task token use by a factor of 5.7 to 62.5 relative to ACE with GPT-5.2. Controlled ablations further support the benefits of learned routing and continued routing policy adaptation.
131. 【2611.01733】Less but Sufficient: Relation Knowledge Selects Compact Knowledge-Graph Contexts, and What External Checks Can and Cannot Catch
链接：https://arxiv.org/abs/2611.01733
作者：Seunghui Jwa,Minsu Oh,Sangwoo Hong,Yeo Chan Yoon
类目：Computation and Language (cs.CL)
关键词：Large language models, Large language, knowledge-graph facts ranked, language models, ranked by relevance
备注：
点击查看摘要
Abstract:Large language models (LLMs) read knowledge-graph facts ranked by relevance, leaving open whether they suffice or conflict. Our checks use relation knowledge, written by hand or learned from training questions labelled with their relation paths. It selects a compact context of facts yielding an answer, and derives it; a derivability check tests whether an answer follows, a consistency check whether facts conflict, and a validation-chosen routing gate decides where the derived answer replaces the LLM's. Seven open LLMs read the compact context better in exact match than relevance-ranked facts; on ComplexWebQuestions (CWQ) they match SubgraphRAG's facts at a quarter of the prompt tokens, and stronger LLMs read SubgraphRAG's better. Where the routing gate passes, ours leads SubgraphRAG's in exact match in all 53 LLM, benchmark and prompt settings. A precision gate, returning the derived answer only when the check passes with exactly one derived entity, answered 18 and 5 percent of held-out WebQSP and CWQ questions in a pre-specified test, right for 90 and 96 percent. The consistency check judges facts by path evidence only where another path joins their entities, true of 2.5 percent of named-entity facts in our compact WebQSP and CWQ contexts.
132. 【2611.01728】MAC-Bench: Benchmarking Multi-Agent Collaboration via Interconnected Tasks
链接：https://arxiv.org/abs/2611.01728
作者：Zerui Chen,Qinggang Zhang,Qichuan Liu,Zhishang Xiang,Zhimin Wei,Yunbo Tang,Zhuo Li,Jinsong Su,Zhihong Zhang
类目：Multiagent Systems (cs.MA); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large language model, Large language, tackle challenging tasks, based multi-agent systems, language model
备注：
点击查看摘要
Abstract:Large language model (LLM)-based multi-agent systems (MAS) tackle challenging tasks by dividing work among agents and coordinating their contributions toward shared objectives. Evaluating these systems therefore requires benchmarks that assess not only task-solving performance but also the ability to handle interdependent work. However, existing benchmarks often emphasize task difficulty without substantial collaboration requirements or evaluate only a limited range of predefined collaboration patterns. In this paper, we introduce MAC-Bench, a comprehensive benchmark for evaluating multi-agent collaboration through interconnected tasks. Rather than imposing predefined agent roles or communication protocols, MAC-Bench embeds collaboration requirements directly into task dependencies and shared-resource constraints. Specifically, we mine reusable collaboration structures from selected benchmark tasks at two levels. Local collaboration patterns capture recurring interactions among subtasks, while global task structures characterize how these interactions contribute to complete workflows. Through coarse-to-fine composition, these structures are recombined into task graphs combining different collaboration requirements. Tasks are instantiated in executable environments with automated verification of partial progress and complete task resolution.
133. 【2611.01715】EarlySelectKV: Anticipatory KV Selection via Cross-Layer Query Proxies
链接：https://arxiv.org/abs/2611.01715
作者：Yuhao Liu,Yuehao Li,Linghe Zhang,Gaobin Huang,Junran Li,Hongchang Wang,Haifang Jian
类目：Computation and Language (cs.CL)
关键词：long-context inference cost, Query-conditioned sparse, inference cost, cost by attending, historical KV entries
备注： Published in EMNLP 2026. 20 pages. Code: [this https URL](https://github.com/sea-with-sakura/EarlySelectKV)
点击查看摘要
Abstract:Query-conditioned sparse KV selection reduces long-context inference cost by attending to a subset of historical KV entries at each decoding step. Existing selectors must wait for the target-layer query before scoring candidates and generating indices, placing routing on the immediate pre-attention path. We introduce EarlySelectKV, a training-free transformation that uses proxy queries from earlier hidden states to precompute selected KV indices while retaining the real target-layer query for final attention. Tests with RocketKV, Quest, and Loki show no consistent pattern of quality degradation across the evaluated settings. In the primary RocketKV evaluation, ES-RocketKV differs by +0.018 points on LongBench, approximately -0.01 points on RULER, and +0.25 percentage points on representative NIAH/Passkey settings. In a TensorRT-LLM deployment with CPU-offloaded routing, ES-RocketKV improves end-to-end output throughput by up to 12.4% and reduces GPU-resident memory by 11.1% of the combined KV/K-summary pool. This makes routing timing an explicit optimization target alongside KV subset selection in sparse long-context decoding. Code is available at this https URL.
134. 【2611.01710】CST: Lightweight Risk Triage with Source-Grounded Evidence for Web Discussions
链接：https://arxiv.org/abs/2611.01710
作者：Zhihua Wang,Yifeng Gao,Yunhao Feng,Rui Pan,Baiheng Zhao,Zixing Chen,Nan Li
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Web communities rely, Web communities, hate speech, communities rely, Web
备注： 23 pages
点击查看摘要
Abstract:Web communities rely on moderators to catch harmful messages such as insults, hate speech, and scams, but no one can read every message. Existing tools give each message a risk score, which tells moderators where to look but not what to read or how to check it. Yet meaning depends on context: the same reply, "I agree.", can support or oppose removing someone from a group. Moderators therefore need source-grounded evidence, not just scores: a few key messages kept with their original wording and replies. We present CST, a lightweight triage pipeline that first decides where to look, then what to show. It scores risk by pairing character patterns, which capture exact wording, with sentence meaning from a fixed multilingual model, so it handles several languages and runs on an ordinary CPU. It then groups related messages and picks from each group in turn, so a small reading budget covers different parts of a discussion, and links every pick back to the original thread. Across six tasks from five datasets in several languages, CST ranks harmful messages more accurately than a fully fine-tuned multilingual model and, under the same budget, finds more of them than reading by score alone. In a user study, reviewers needed at least 27% less time with CST's grouped evidence while keeping decision accuracy above 94%. CST turns risk scores into evidence that moderators can read quickly and check in context. Code and dataset reconstruction resources will be released at this https URL.
135. 【2611.01652】EEG-HealthLLM: Hierarchical Adaptation of Large Language Models for Unified Heterogeneous EEG Health Assessment
链接：https://arxiv.org/abs/2611.01652
作者：Ruidong Ma,Jisheng Dang,Ronghao Lin,Bimei Wang,Jingwen Zhao,Wenjun Ma,Wei-Shi Zheng,Meng Wang,Qi Tian,Tat-Seng Chua
类目：Computation and Language (cs.CL)
关键词：heterogeneous signal configurations, EEG, heterogeneous EEG signals, heterogeneous EEG health, existing EEG models
备注： 15 pages, 7 figures
点击查看摘要
Abstract:Electroencephalography (EEG) provides a non-invasive means for neurological and mental health assessment, yet existing EEG models are typically developed for individual tasks and are difficult to unify across heterogeneous signal configurations and assessment objectives. Large language models (LLMs) offer a common interface for multiple tasks, but adapting heterogeneous EEG signals to a shared LLM raises a key challenge: how to preserve task-specific signal characteristics while enabling effective language-side parameter sharing. To address this problem, we propose EEG-HealthLLM, a unified and parameter-efficient framework for heterogeneous EEG health assessment. We introduce an Asymmetric Hierarchical Adaptation Strategy: task-specific EEG adapters preserve heterogeneous spatio-temporal dynamics, while a unified shared LoRA is injected into the LLM backbone (e.g., Phi-3) to capture shared high-level assessment semantics across tasks. We further establish EEG-HealthBench by reorganizing five existing EEG resources into paradigms covering epileptic seizure detection, major depressive disorder assessment, anxiety risk assessment, depressive symptom risk assessment, and emotional state assessment under a unified subject-independent protocol. Extensive experiments show that EEG-HealthLLM achieves an average balanced accuracy (BAC) of 69.58%, ranking first among the evaluated methods in both average BAC and macro-F1. Compared with independent single-task LoRA adaptation, it improves average BAC from 67.70% to 69.58% while reducing the aggregate language-side adapter footprint by 80.0%. Further analyses reveal task-dependent cross-task interactions and trade-offs, supporting the proposed hierarchical adaptation strategy. The implementation is publicly available at this https URL.
136. 【2611.01643】CREDO: Evidence-Conditioned Credit Assignment for Temporal Reasoning Agents
链接：https://arxiv.org/abs/2611.01643
作者：Yue Leng,Shengtao Wen,Xiang Chen,Xinyi Zeng,Yu Tian,Sheng-Jun Huang
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Temporal Knowledge Graph, Knowledge Graph Question, perform multi-step temporal, select relevant facts, requires language model
备注： Code available at [this https URL](https://github.com/NUAA-MMMI/CREDO)
点击查看摘要
Abstract:Temporal Knowledge Graph Question Answering (TKGQA) requires language model agents to retrieve evidence, select relevant facts, and perform multi-step temporal reasoning. However, the trajectory-level outcome signal in GRPO does not explicitly distinguish the quality of intermediate decisions: downstream failures can penalize useful evidence acquisition, while identical rewards in all-failed groups eliminate the relative outcome signal despite differences in intermediate progress. We propose Credit Redistribution with Evidence-Driven Opportunities (CREDO), which uses intermediate evidence to recover local supervision, including in all-failed groups, and determine where outcome supervision acts. CREDO assigns positive stage-level credit through comparisons among rollouts of the same question and uses retained answer overlap as an opportunity proxy to shift part of the outcome-policy weight toward reasoning and answering. The framework preserves terminal rewards and trajectory-level advantages, while redistribution conserves total outcome-policy weight per trajectory. Following the public evaluation protocol of prior work, CREDO raises Overall accuracy from 78.0% to 82.4% and Multiple accuracy from 55.0% to 65.6% on MultiTQ relative to the strongest published baseline in our comparison. On TimelineKGQA, it raises cross-KG accuracy from 30.9% to 36.4% relative to our reproduced baseline via direct transfer to ICEWS Actor under matched training and evaluation settings.
137. 【2611.01633】BanglishDepYT: Depression Detection in Native Bengali Social Media with Emotion-Preserving Preprocessing and Domain-Adaptive Pretraining
链接：https://arxiv.org/abs/2611.01633
作者：Ayon Roy,Sadman Sharif,Syed Shams Islam
类目：Computation and Language (cs.CL); Computers and Society (cs.CY); Machine Learning (cs.LG)
关键词：South Asia, automated detection systems, translated from English, speakers across South, Bengali depression dataset
备注： 39 pages
点击查看摘要
Abstract:Depression affects millions of Bengali speakers across South Asia, yet automated detection systems have relied almost entirely on datasets translated from English. Such datasets cannot capture the emoticons, romanized Bengali words, and elongated spellings that characterize real expressions of distress. We introduce BanglishDepYT, a Bengali depression dataset collected natively from YouTube, comprising 191,000 unlabeled comments and 1,000 samples verified through dual bilingual annotation. We propose EPH (Emotion-Preserving Hybrid preprocessing), which converts emoticons to semantic tags, preserves Banglish tokens, protects negation words, and normalizes emotional elongation. A key finding is that preprocessing choice substantially affects performance on informal text: standard cleaning reduces the Banglish Survival Rate to zero (SVM F1: 0.7062), while EPH preserves signals (CESS: 0.9996 vs. 0.6694) and raises SVM F1 to 0.8570, an improvement of 0.1508. We further apply domain-adaptive pretraining (DAPT), continuing SahajBERT pretraining on unlabeled in-domain comments. DAPT-SahajBERT achieves the highest mean F1 (0.8161) and MCC (0.6272), significantly outperforming the baseline (F1: 0.7805, p = 0.0013, d = 1.450) and matching MuRIL (p = 0.589). These results suggest that targeted domain pretraining is a competitive alternative to large-scale multilingual pretraining. LLM-assisted annotation using Qwen2.5-7B achieves substantial human agreement (kappa = 0.611), enabling pseudo-labeling of 96,071 comments. Semi-supervised training improves AUC from 0.8499 to 0.8731 (p = 0.044), offering a scalable path to expanding annotation. All code, models, and datasets are publicly released to support reproducible research.
138. 【2611.01621】FinForesight: A Diagnostic Backtesting Benchmark for Deep Research Systems in Financial Forecasting
链接：https://arxiv.org/abs/2611.01621
作者：Fengyuan Liu,Mukai Li,Jieshun You,Yilin Zheng,Chenjia Min,Yizhou Zhang,Harper Chen,Qi Liu
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：requires synthesizing evolving, Anticipating financial outcomes, outcomes requires synthesizing, systems promising tools, synthesizing evolving evidence
备注：
点击查看摘要
Abstract:Anticipating financial outcomes requires synthesizing evolving evidence and reasoning under uncertainty, making deep research systems promising tools for forecasting. Yet evaluating forecasting ability is challenging because historical backtests may reward memorized outcomes or information retrieved after the forecast date. Live forecasting avoids direct access to realized outcomes, but feedback arrives only after events resolve. To obtain timely feedback and assess historical scores, we introduce FinForesight, a diagnostic backtesting benchmark for financial deep research systems. Across the Chinese, U.S., and Hong Kong markets, the benchmark evaluates four forecasting tasks: valuation, return ranking, event direction, and future financial fundamentals. Two capability diagnostic tasks assess counterfactual reasoning and financial calculation, scored separately from forecasting performance. Our harness-compatible framework restricts retrieved evidence to information available at the forecast date. We compare pretraining-era, resolved post-cutoff, and live evaluations to test whether controlled backtests approximate future performance. Pretraining-era scores exceed post-cutoff scores in most temporal comparisons, and stronger retrieval controls narrow the gap between post-cutoff backtests and live results. Forecasting attribution and robustness analyses reveal how scores respond to retrieval policy and how predictions respond to prompt rewrites and numerical perturbations. The code and benchmark data are publicly available.
139. 【2611.01615】LLM-Enhanced Multimodal House Price Prediction using Structured, Textual, and Visual Features
链接：https://arxiv.org/abs/2611.01615
作者：Khandokar Md. Rahat Hossain,Souvik Das,Tahsina Hashem,Mohammed Eunus Ali,Tanzima Hashem
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)
关键词：real estate buyers, estate buyers, financial institutions, house price prediction, essential for real
备注： 35 pages, 7 figures, 5 tables. Code: [this https URL](https://github.com/rh2975/LLM-VLM-HousePrice)
点击查看摘要
Abstract:Accurate house price prediction is essential for real estate buyers, sellers, agents, and financial institutions. Traditional methods rely primarily on structured data, e.g., number of bedrooms, bathrooms, parkings, but they overlook rich contextual information embedded in textual descriptions and property photos. Previous deep learning approaches for house price prediction have fused multimodal data but they fall short to extract structured spatio-temporal and contextual features from texts and semantic visual information from images. In this paper, we introduce a novel multimodal framework that addresses these limitations by systematically integrating structured attributes, textual descriptions, and visual images of properties to achieve higher prediction accuracy while maintaining interpretability. We use a large language model to derive domain-specific spatio-temporal and contextual features from text, and an unsupervised vision-language approach to automatically group photos into meaningful classes like indoor, outdoor, mixed, or floorplan, that are commonly present in real-world house listings. These categories are created without manual labeling by aligning image clusters with carefully designed pseudo text prompts. We fuse all features into a unified representation and use an optimized regressor to predict prices. Experiments on a large real-world property dataset demonstrate that our method outperforms traditional methods and existing multimodal baselines. Ablation studies confirm that the novel textual feature extraction and categorized visual embeddings substantially contribute to more accurate and reliable price predictions.
140. 【2611.01612】Halal-NeSyNet: Clause-Scoped Neuro-Symbolic Cross-Attention for Automated Food Ingredient Auditing and Risk-Aware Halal Logistics Triage
链接：https://arxiv.org/abs/2611.01612
作者：Mochamad Rizal Fauzan,Naila Nursyifa,Irgi Surya
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Halal requires reading, enter certified warehouses, goods enter certified, requires reading ingredient, reading ingredient declarations
备注： 14 pages, 7 figures, 13 tables
点击查看摘要
Abstract:Verifying that a packaged food is Halal requires reading ingredient declarations and E-number additives before goods enter certified warehouses. Dual-origin additives such as E471, E422, E441 and E920 are Mushbooh (doubtful) unless a botanical, microbial or certified-Halal qualifier appears in the same ingredient clause, so a plant-based qualifier on one clause must not clear an unqualified additive in another. We call a failure to respect this scope cross-clause modifier confounding and build a benchmark of 3,199 items (277 Open Food Facts records and 2,922 template-generated clause-swap items, labelled by an explicit 50-code rule base rather than by a certification authority) with a 540-item counterfactual suite. We propose Halal-NeSyNet, which couples a DistilBERT encoder with a 16-dimensional rule-derived symbolic vector through cross-attention and gated fusion, trained with an asymmetric false-Halal risk loss. Over five seeds, text-only TF-IDF baselines reach 86.25-86.71 % accuracy with 13.42-21.73 % false-Halal leakage and 6.33-26.00 % counterfactual triad consistency, whereas Halal-NeSyNet reaches 97.04+/-0.34 % and 99.67+/-0.50 %. Gradient boosting given the same symbolic vector reaches 96.25+/-1.24 % (+0.59 points from Halal-NeSyNet, 95 % CI [-1.11, +2.28]), so most of the gain comes from clause-scoped symbolic features and not from the network, and the risk loss did not help. Holding out whole template families, text-only models fall to 61.91-78.35 %, Halal-NeSyNet to 90.87+/-11.76 % and logistic regression with the symbolic vector to 91.11+/-2.88 %, with far more spread for Halal-NeSyNet. A three-lane receiving simulation auto-clears 49.33 % of cargo at 0.76 % green-lane contamination. Because labels and features come from one rule engine and 91.3 % of the items are templated, the results measure fidelity to a rule policy, not religious certification.
141. 【2611.01552】Can Large Language Models Extend Their Agentic Capabilities to Goal Pursuit in Open-Ended Multi-Turn Interaction?
链接：https://arxiv.org/abs/2611.01552
作者：Mingyu Chen,Jingkai Lin,Xiaofen Xing,Liankai Huang,Ruiqi Xiong,Xiangmin Xu
类目：Computation and Language (cs.CL)
关键词：open-ended dialogue requires, dialogue requires agents, successive exchanges, pursuit in open-ended, requires agents
备注： 18 pages, 9 figures, 20 tables, including appendices
点击查看摘要
Abstract:Goal pursuit in open-ended dialogue requires agents to adapt their actions to interaction feedback across successive exchanges. We investigate whether agentic capabilities developed for multi-step tool use carry over to dialogue organized through the model's native tool interface, and how this changes interaction behavior. We define Tool-Mediated Interaction (TMI) as a training-free protocol that represents dialogue actions as tool calls and counterpart responses as tool results, maintaining a continuous reasoning-action-observation loop with retained reasoning and interaction history. We evaluate TMI across social interaction, emotional support, persuasion, and price negotiation using two models and 15,678 main-experiment episodes. Across both models, TMI improves social goal attainment, emotional-support preference, donation amounts, and buyer negotiation margins over conversational baselines with and without thinking. A Qwen ablation further shows that TMI outperforms ordinary conversation with retained reasoning on all four primary outcomes. Behavioral analyses associate the improvements with task-specific patterns in initial proposals and responses to interaction feedback. Alongside these gains, TMI reduces mean reasoning tokens per decision by 42.0-81.5% relative to the thinking baseline and lowers mean cross-turn phrase reuse across all eight model-environment pairs. These findings show that interaction organization shapes both goal attainment and reasoning across dialogue turns.
142. 【2611.01549】Revisiting LLM Homogeneity Through a Multidimensional Lens
链接：https://arxiv.org/abs/2611.01549
作者：Ziliang Qiu,Renfen Hu,Yi Ding,Ted Underwood
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：single score, typically quantified, reduces two texts, embedding similarity, Concerns about LLM
备注： 26 pages, 9 figures
点击查看摘要
Abstract:Concerns about LLM homogeneity are typically quantified with embedding similarity, which reduces two texts to a single score. We revisit homogeneity with 25 interpretable metrics spanning five dimensions: semantic, lexical, syntactic, structural, and stylistic presentational. A human study shows that perceived similarity depends on both content (what responses say) and form (how they say it), yet embedding similarity correlates less with human meaning judgments than sentence-level matching ($\rho=0.417$ vs. $0.606$) and not significantly with form judgments ($\rho=0.140$). Across 18 contemporary LLMs, models say similar things in different words: they share global semantics and broad linguistic profiles but remain distinct in lexical characteristics, structural patterns, and interactional conventions. Across releases from 2024 to 2026, models become more like themselves but not more like one another: among significantly changing metrics, intra-model distances decrease for 17 of 22, and inter-model distances increase for 14 of 21. Across two post-training pipelines, model-specific conventions emerge during SFT and are selectively reshaped by preference optimization. These results suggest that homogeneity is multidimensional and evolving, and that embedding similarity alone can overstate cross-model homogeneity while concealing diverging intra- and inter-model trends.
143. 【2611.01539】he Structure of Disagreement in Emotion Annotation
链接：https://arxiv.org/abs/2611.01539
作者：Emily Öhman,Anna Koufakou,Eugenia Diegoli
类目：Computation and Language (cs.CL)
关键词：Calculating inter-annotator agreement, disagreement-aware work increasingly, work increasingly retains, Calculating inter-annotator, practice in NLP
备注：
点击查看摘要
Abstract:Calculating inter-annotator agreement is an established practice in NLP, and disagreement-aware work increasingly retains the distribution of human judgments rather than reducing annotations to a single gold label. Keeping the distribution, however, does not explain why annotators disagree. This paper examines the types of disagreement that occur in emotion annotation, starting from multilabel annotations of 1,677 sentence-level units from Ernest Hemingway's The Old Man and the Sea and testing the patterns they reveal against individual-level annotations from BRIGHTER and GoEmotions. Across the three datasets, we find three main recurring disagreement structures. Emotion categories overlap systematically; annotators differ both in how broadly they apply labels and in how they treat particular category boundaries, while sparse participation and explicit abstention can look like disagreement. Where intensity is rated, disagreement over whether an emotion is present can be separated from disagreement over its intensity once recognized. Similar aggregate disagreement can therefore arise from qualitatively different annotation processes. Hard aggregation removes most of this structure, while annotator vote-share representations keep marginal label frequencies but not the co-occurrence, annotator-specific, or procedural patterns that produced them. We argue that disagreement should be understood in terms of its underlying patterns before it is summarized, aggregated, or used as a modeling target, and propose a vocabulary for disagreement structure.
144. 【2611.01519】Write Facts the Way Models Read Them: Lifting the Two-Hop Curse
链接：https://arxiv.org/abs/2611.01519
作者：Zhiyun Shi
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：head of state, person country, language model, model, reasoning data
备注： 15 pages, 4 figures, 13 tables
点击查看摘要
Abstract:A language model that learns a new fact by fine-tuning can repeat it but cannot reason with it: taught that a person is a citizen of a new country, it still cannot say, without chain-of-thought, who the head of state of that person's country is. This two-hop curse is widely treated as a reasoning deficit, and the strongest knowledge editors answer it with synthesized reasoning data. We show that the reasoning is intact and the writing is wrong. Fine-tuning writes a new fact as an answer to be said, whereas the second hop reads the bridge ("that person's country") as an entity, from the middle layers on: patching the model's own representation of the entity into the bridge at those layers largely restores the second hop, yet after fine-tuning the bridge there is no closer to the new entity than before the edit. We therefore propose read-equivalent writing (Legible): one loss term makes the bridge phrase, at the layer where the second hop finishes reading it, match the model's own reading of the new entity, and keeps the same relation's other subjects unchanged. Phrases and targets come from the edited model itself, and no multi-hop training data is used. Across Qwen2.5, Llama-3 and Qwen3, Legible (I) composes learned facts more often than the model composes its own knowledge, on MQuAKE's two-hop-curse questions; (II) reaches 1.8-2.6x the bridge accuracy of CaKE, whose reasoning data composes no better than plain fine-tuning, and has the best average over composition, accuracy and locality against four families of writers; and (III) lifts the curse on RippleEdits, on the benchmark of Balesni et al., who named the curse, and at 14B.
145. 【2611.01517】VLMs Read Aloud: The Gap Between Recognizing and Using Visual Text
链接：https://arxiv.org/abs/2611.01517
作者：Zhiyun Shi
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：original text, text, Visual-text compression renders, original, compression renders long
备注： 23 pages, 7 figures, 21 tables
点击查看摘要
Abstract:Visual-text compression renders long contexts as images and is engineered around how much of the text a vision-language model (VLM) can recover. Yet recovered text is not usable text. VLMs can transcribe the text in an image word for word and still fail to answer from it; given back their own transcript, they answer nearly as well as from the original text. We call this difference the read-use gap. Recognizing and using visual text have different resolution requirements: Qwen3-VL-8B's recognition saturates at 15-pixel characters while use catches up only at 24 pixels, and scaling from 2B to 32B raises recognition without narrowing the gap. Putting the evidence into words closes it: thinking VLMs recite the evidence in their thinking, and their own transcript, written without seeing the question, recovers most of what thinking adds. In a preregistered held-out test, the gap ranks how much eight VLMs gain from their own words over pixels (Spearman $\rho$ = 0.86), which recognition rates do not. We propose ALOUD, which spends visual resolution on finding and recognizing evidence and language tokens on using it. Without keeping the source text, it doubles the accuracy of a frozen Qwen3-VL-8B on long documents compressed 5x and 10x: at 5x, from 27.7% to 54.8%, near the original text's 58.5%, with a context smaller than the compressed pages themselves. For less than the cost of reading the original text, it leads at equal budget every method that does without it, at every level, and beats AGAR and VERA, which paste the original text back; at 5x it also beats LensVLM-9B, which is trained and keeps the original text. Visual-text compression is limited not by how much text a model can recover, but by how much it can use.
146. 【2611.01496】Sweep Less, Steer More: Using Activation Steering Geometry for Reduced Hyperparameter Search
链接：https://arxiv.org/abs/2611.01496
作者：Nishkal Hundia,Swastik Agrawal,Navita Goyal,Sarah Wiegreffe
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：making principled deployment, controlling LLM behavior, effectiveness varies widely, principled deployment costly, controlling LLM
备注：
点击查看摘要
Abstract:Representation steering methods like difference-in-means (DIM) offer a lightweight approach to controlling LLM behavior, but their effectiveness varies widely across concepts, datasets, and layers, making principled deployment costly without exhaustive hyperparameter sweeps. We build on the discriminability index $d'$, a compute-cheap geometric measure of how well contrastive training activations separate along the steering direction. Across five behaviors on 3 models, we demonstrate uses beyond its established role as a dataset-level steerability predictor. First, in the multiple-choice question answering (MCQA) setting, we show that $d'$ reliably identifies performant layers at which to steer, eliminating the need for a layer-wise sweep. Second, we extend this analysis to open-ended multi-token generation, and find that $d'$ remains successful for layer selection across different settings. Lastly, we test whether the position of a generated token's representation on the DIM line predicts steering success on that individual example. In the MCQA setting, this works for high-$d'$ datasets but is inconsistent across behaviors, models, and training-token choices in open-ended generation. This highlights that methods developed and conclusions drawn in single-token MCQA settings do not necessarily transfer to open-ended generation.
147. 【2611.01493】opoSteer: Topological Layer Selection for Activation Steering in LLMs
链接：https://arxiv.org/abs/2611.01493
作者：Tuc Nguyen,Marcos Gutiérrez-del-Pozo,Eduardo Paluzo-Hidalgo,Yifan Hu,Adaku Uchendu,Thai Le
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：steering controls large, controls large language, Activation steering controls, internal representations, controls large
备注： 42 pages, 8 figures
点击查看摘要
Abstract:Activation steering controls large language models at inference time by adding a vector to their internal representations. Most work asks how to build that vector, and far less attention has gone to where to add it, even though steering at a poorly chosen layer can be worse than not steering at all. Prior selectors choose a layer without ever steering the model to test it: they score how separable the target behavior is at that layer, and how consistently the individual examples point along the steering direction. We argue that what matters is not the separability of the two activation clouds, nor the alignment of individual displacements with their mean, but the extent of the cloud of per-example displacements that mean-difference steering averages. We propose a topology-based layer selection method, called TopoSteer, which scores a layer by the total H_0 persistence of its displacement cloud, computed as the length of the cloud's Euclidean minimum spanning tree. We show that the score focuses on the displacement cloud's relative geometry, while class separation affects it only through standardization. We also provide a theoretical explanation for our method by proving that, as example-level variation increases, TopoSteer and discriminability move in opposite directions, so the two criteria can rank layers in opposite ways. Across multiple language models and steering tasks, TopoSteer provides a principled alternative to discriminability- and separability-based layer selection and yields more effective steering without requiring held-out validation.
148. 【2611.01474】Accounting for Irregular State Transitions through Belief Estimation in Online Medical Consultation
链接：https://arxiv.org/abs/2611.01474
作者：Mingzhe Lu,Xiangru Chen,Jian Qin,Yunpeng Li,Xihan Gao
类目：Computation and Language (cs.CL)
关键词：unprompted patient disclosures, disrupt clinician inquiry, frequently disrupt clinician, states progressively revealed, consultation broadens access
备注： 12 pages, 2 figures, 3 tables
点击查看摘要
Abstract:While online medical consultation broadens access, unprompted patient disclosures and topic shifts frequently disrupt clinician inquiry, leaving clinical states progressively revealed. We characterize these dynamics using both existing evaluation metrics and task-specific interaction metrics designed in this work. Through an empirical study across 16 medical dialogue datasets, we show that authentic online interactions exhibit substantially lower contextual continuity and higher unpredictability than offline and simulated benchmarks. We propose PRISM (Policy Reasoning with Inferred States for Medicine), a framework inspired by partially observable Markov decision processes that decouples latent state estimation from action selection to address drifting dialogue trajectories. Specifically, PRISM factorizes clinical triage into belief estimation, policy optimization, and response realization. By maintaining an evolving posterior belief over consultation states and conditioning action selection on the maximum a posteriori state, PRISM advances clinical goals while accommodating patient-initiated shifts. Extensive evaluations show that PRISM substantially outperforms frontier LLMs and clinical agents, achieving a 22.40 percentage point gain in clinical decision accuracy alongside decisive improvements in response generation, surpassing the strongest baseline by 5.51 points in BERTScore_F1. Furthermore, ablation studies show that providing oracle consultation states consistently boosts response quality across all evaluated baselines by guiding their action reasoning, yielding average gains of 5.58 points in BERTScore_F1.
149. 【2611.01467】See, Think, Use: Diagnosing Perception and Reasoning Failures in VLMs
链接：https://arxiv.org/abs/2611.01467
作者：Jiacheng Ding,Yanliang Qi,Cong Guo,Peihua Mai
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：model, vision-language model, answer, perception, protocol
备注： 10 pages, 4 figures, 8 tables
点击查看摘要
Abstract:We present See, Think, Use, a protocol that traces each answer of a vision-language model to perception, reasoning or the use of perception. The diagnosis shows a developer which stage to improve and directs test-time compute to the stage that fails. Benchmarks score the final answer, and an answer that rests on the image earns the same credit as a guess or a memorized prior. The protocol asks the model two extra questions per item and needs no access to its weights. A localization probe asks for a box around every instance and measures seeing, and a text-replacement probe answers from a description and measures thinking. Use is the rate at which the answer follows the model's own perception across counterfactual image pairs. The rate needs no answer labels, because the question and its prior are the same on both images. On two model families and six datasets the protocol shows that the knob that helps follows the task family. Answers follow the model's perception except on images that contradict a common prior, and asking the model to localize first repairs this failure when its boxes are right. Allocating compute by the measured stages comes close to the best uniform policy at lower cost and beats a random allocation of the same compute wherever a knob raises the short stage. We will release the code, the prompts and the per-question outputs.
150. 【2611.01460】Can Large Language Model Agents Learn by Watching Tutorial Videos?
链接：https://arxiv.org/abs/2611.01460
作者：Haoyu Zhao,Zafeirios Fountas,Jun Wang
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：Humans continuously acquire, continuously acquire knowledge, carefully crafted materials, carrying that understanding, future tasks
备注：
点击查看摘要
Abstract:Humans continuously acquire knowledge from carefully crafted materials such as books and tutorial videos, carrying that understanding into future tasks. Millions of such instructional videos are uploaded online every day, yet LLM agents remain unable to exploit this ever-expanding wealth of human teaching. Their capabilities are frozen after training, while parameter updates at scale remain prohibitively expensive. This raises the central question: can LLM agents learn from this vast instructional resource without parameter updates? We introduce Tutorial Agentic Learning (TAL), a nonparametric continual-learning paradigm that consolidates tutorial videos into a persistent, structured tutorialbook memory through a two-stage adversarial process that harvests hard, video-grounded questions and uses them to refine the memory. At inference time, TAL retrieves through a Table-of-Contents (TOC) tree, tying retrieval directly to the model's reasoning rather than to embedding similarity. To study this setting, we introduce VidLearn, a multimodal QA benchmark built from 72 chess tutorial videos spanning 12 openings. On VidLearn, TAL outperforms all evaluated baselines and improves monotonically as more videos are consumed, achieving up to 113% and 91% relative gains over the corresponding vanilla MLLMs on the training and test splits, respectively. In actual gameplay, TAL reaches a stronger opening-phase position than its vanilla counterpart in 69% of head-to-head games. Evaluation in a second domain further demonstrates the generality of TAL. Together, these results highlight instructional videos as a scalable resource for parameter-update-free agent continual learning.
151. 【2611.01429】When Should an Agent Refresh? Adaptive Index Reuse for Efficient Long-Horizon Reasoning
链接：https://arxiv.org/abs/2611.01429
作者：Guangyuan Wang,Yifan Zhang,Shilong Liu
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Language agents read, Language agents, agents read code, Language, Adaptive Index Reuse
备注：
点击查看摘要
Abstract:Language agents read code, tool output, and dialogue in contexts that grow at every step. Dynamic sparse attention lets a small indexer choose the earlier tokens each query attends to, but the indexer still scores the whole prefix at every layer. Cross-layer reuse methods such as IndexCache rerun the indexer at only some layers, with one fixed pattern for every input. In an agent, the relevant evidence can change abruptly when a traceback or test result arrives, so fresh selections matter more at some steps than at others. We propose Adaptive Index Reuse (AIR), which keeps IndexCache's execution and learns, for each segment of an agent episode, how many layers refresh their selection. A small controller reads signals from completed computation and the latest tool event, chooses a pattern from a nested library, and learns from terminal task reward under an expected compute budget. On Qwen3-4B-Instruct-2507 with a 128K context, AIR improves success over the strongest static schedule at matched cost on SWE-bench Verified (27.0% to 32.4%), Terminal-Bench 2.0, and three $\tau^2$-bench domains, and it lowers time per successful task on all five. Across 50 backbone, context, and benchmark settings, it matches or exceeds that schedule in 44.
152. 【2611.01427】owards Fine-grained and Robust Detection of Human-AI Co-authorship
链接：https://arxiv.org/abs/2611.01427
作者：Ziruo Zhao,Jie Fu,Wendy Hui Wang,Zining Zhu
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：complicating text provenance, large language models, content is produced, concerns for misinformation, intellectual property
备注：
点击查看摘要
Abstract:The widespread adoption of large language models (LLMs) is reshaping how textual content is produced, complicating text provenance, and raising concerns for misinformation, plagiarism, and intellectual property. While prior work on AI-generated text detection has progressed, one-dimensional human-AI co-authorship scores lack signals directly relevant to ``AI involvement''. It remains unclear how adversarial paraphrasing distorts detection signals. In this work, we formulate a discrete-class text provenance detection framework. This framework allows an abstraction of realistic co-authorship scenarios into distinct degrees of AI involvement, differentiating the AI polishing on the surface level from the AI updating the discourse structures. This framework reveals the mechanisms of how adversarial paraphrasing blurs the decision boundaries for co-authorship detectors. To improve robustness of the detectors, we augment training data with adversarial paraphrases generated by the state-of-the-art paraphrasing attack model, exposing detectors to challenging meaning-preserving rewrites. Extensive experiments across multiple datasets and generation models demonstrate that adversarial paraphrasing substantially degrades detectors trained only on benign data, while adversarial data augmentation leads to consistent robustness gains and good cross-generator transferability. Overall, our findings highlight the value of discrete-class formulation and principled data augmentation for building reliable detectors of human-AI co-authorship.
153. 【2611.01426】FlyWheel: Attention Kernels Built for the TPU
链接：https://arxiv.org/abs/2611.01426
作者：Zishuo Bao,Zeshen Zhang,Linkun Chen,Yucheng Lu
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Tensor Processing Units, Tensor Processing, Processing Units, leave MXUs idle, matrix units
备注： 24 pages, 10 figures, 7 tables
点击查看摘要
Abstract:Attention kernels on Tensor Processing Units (TPUs) often underutilize their matrix units (MXUs) because of repeated matrix operand loads, vector-intensive computation, and dependencies that leave MXUs idle. We present FlyWheel, a set of fast TPU kernels for both softmax and linear attention. FlyWheel reformulates softmax and triangular inversion to reduce vector work, while coordinating data layouts to improve matrix operand reuse. It then overlaps independent computation to hide execution latency. We apply these techniques to both softmax attention and Gated DeltaNet on TPU v6e and v7x. FlyWheel speeds up softmax attention by up to $4.14\times$ over the state-of-the-art RPA kernel and $1.80\times$ over Splash Attention, reaching 81% of peak BF16 throughput on v6e. It also speeds up Gated DeltaNet prefill by up to $3.61\times$. Integrated into vLLM serving Qwen3.8-27B, FlyWheel improves prefill throughput by up to $1.56\times$ while maintaining comparable accuracy.
154. 【2611.01415】Latent Harness: Compiling Agent Behaviors into Post-Block Activation Shifts
链接：https://arxiv.org/abs/2611.01415
作者：Ran Li,Shimin Di,Zeyu Ren,Ling Yue,Jiachuan Wang,Lei Chen
类目：Computation and Language (cs.CL)
关键词：language-model agents quickly, self-evolving agents improve, agents improve language-model, improve language-model agents, agents quickly
备注：
点击查看摘要
Abstract:Harness engineering and self-evolving agents improve language-model agents quickly, yet their gains live outside the model. The harness is re-sent and re-paid on every call, and the standard route to internalization is a weight update that is costly to iterate and fixed once merged. We propose compiling the harness instead. Latent Harness distills an external condition into a rank-8 activation shift. The shift is applied at the output of every decoder block of a frozen backbone, at 0.03-0.05% of parameters. The condition is either an explicit process-level behavior instruction or the behavioral contract of an agentic harness. At inference the compiled bundle carries no harness text and adds no tokens. It exposes three runtime controls for injection strength, injection phase, and shift-space mixing. Compiled behaviors recover the source-harness gain in 8 of 10 preregistered settings. Where the explicit source pays the heaviest per-call token tax, the compiled form exceeds it. The same bundles transfer zero-shot across tasks (5 of 7 pairs positive) and compose in shift space, while stacked text instructions interfere destructively. Used as a search space, they lift budget-matched harness search by 1.45 times. On three agentic benchmarks the operator aligns policy to the harness con- tract. Under matched data, capacity, and effective strength it outperforms same-capacity LoRA, which needs 11.1 times the parameters to reach the same band, and it regresses nothing where the base policy is already strong. Across 1B-to-8B models the method skeleton is invariant while gain locations move with the model-task pair, which delimits where compiled harnesses should be deployed.
155. 【2611.01409】RAG-TRACE: Tracing Measurement Evidence and Diagnostic Completeness in AI-Generated ECG Reports
链接：https://arxiv.org/abs/2611.01409
作者：Elyas Irankhah,Shahed Salehzehi,Parisa Hosseini
类目：Computation and Language (cs.CL)
关键词：Retrieval-augmented generation, introduce electrocardiogram, Purpose, RAG, Retrieval-augmented
备注： Code and study materials available at [this https URL](https://github.com/Elyasirankhah/RAG-TRACE)
点击查看摘要
Abstract:Purpose: Retrieval-augmented generation (RAG) can introduce electrocardiogram (ECG) criteria that lack patient-specific measurement support. This study evaluates the reliability of retrieved diagnostic criteria in AI-generated ECG reports. Methods: We analyzed 1,083 human-validated PTB-XL patient records using a library of 47 criteria cards, including 33 without numeric verification rules. Language models generated structured reports with and without retrieval. Criterion applicability was evaluated using Marquette 12SL measurements, with independent assessment using Uni-G and comparison against expert-validated diagnostic labels. Results: Keyword retrieval introduced untestable or measurement-disconfirmed criteria in 46.8% of GPT-4.1-mini reports. A deterministic verification rule withdrew 647 criterion applications, including 639 without numeric checks, while preserving 268 of 269 applications independently supported by Uni-G. Restricting retrieval to 14 testable criteria reduced the initial unsupported-criterion rate to 13.8%. Under matched instructions and an identical output schema, retrieval increased unsupported-criterion reports from 17.4% to 31.1%, while hypertrophy recall remained unchanged at 62.6%. Conclusion: These findings identify a fundamental limitation of retrieval-based clinical report generation: retrieved criteria do not necessarily provide valid patient-specific evidence. Measurement-based verification can reduce unsupported criterion applications, but diagnostic validity requires independent assessment.
156. 【2611.01386】Learning by Doing: Autonomously Compiling and Curating Agent Skills from Verified Traces
链接：https://arxiv.org/abs/2611.01386
作者：Daniel Chalef,Peter Evans,Pavlo Paliychuk,Mehul Patel,Preston Rasmussen,Jack Ryan
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：production LLM agents, store semantic memory, Zep Agent Skills, LLM agents, Agent Skills
备注： 25 pages, 9 figures, 14 tables
点击查看摘要
Abstract:Memory systems for production LLM agents mostly store semantic memory (facts about users and domains) or episodic memory (earlier interactions). Research systems such as Trace2Skill, WikiSkill, and SkillRevise learn procedures from agent runs, package them as Skills, and evaluate them on benchmarks. We describe Zep Agent Skills, a production service that gives deployed agents this procedural memory. The service uses only verified attempts as evidence, cites the supporting events for each field of a Skill, and governs the admission and distribution of each Skill version. The service records each task attempt as a Trace with ordered events, an outcome, and a verification strength. A compiler with separate Reflector and Curator roles turns verified Traces into versioned Skills. Scans and admission gates control which candidates become active, and verified use outcomes change the search rank of each Skill. The Agent Skills format is an open standard that Anthropic originated and donated to the Agentic AI Foundation, so any host of the format can load a compiled Skill. Agents retrieve Skills through lexical search with progressive disclosure, over an API or MCP. We evaluate Zep Agent Skills on $\tau^3$-bench banking, AppWorld, and EnterpriseOps-Gym. Skills compiled from the Traces of a teacher model increase the pass rate of three weaker executor models on the same tasks, at every reasoning effort, by 4.5 to 18.8 points. Most of the gain is on the tasks that the teacher solved. On ALFWorld, Skills compiled from the runs of a small model give a gain similar to or larger than the gain that prior work reports for continuous fine-tuning, with no training.
157. 【2611.01378】Information-Theoretic Design of Sparse Autoencoder-Based Steering
链接：https://arxiv.org/abs/2611.01378
作者：Hirofumi Morise
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：large language models, Sparse autoencoder, adding small vectors, language models, lightweight approach
备注：
点击查看摘要
Abstract:Sparse autoencoder (SAE)-based activation steering is a lightweight approach for modifying the behavior of large language models (LLMs) by adding small vectors to hidden states during inference. However, designing effective steering interventions remains challenging. In this work, we develop an information-theoretic framework for analyzing SAE activations through empirical feature-firing distributions. The central object of the framework is the Jensen--Shannon divergence (JSD) between such firing distributions, which quantifies how far a generated or intervened state deviates from a dataset-induced target distribution. Based on an analytic divergence response for virtually shifted states, we construct steering vectors toward the target firing distribution. The same divergence can also be used to monitor deviation from another empirical distribution, such as a general valid-language distribution. We demonstrate the effectiveness of the steering in a question-mode generation task study. We further use teacher-forced pulse experiments to show that local interventions induce structured downstream JSD responses in later layers, and apply the framework to a safety-related target--contrast response setting for feature analysis.
158. 【2611.01370】XDecideBench: Evaluating Typed Decision Models and Confidence Policies Across Languages
链接：https://arxiv.org/abs/2611.01370
作者：Marek Šuppa,Jaroslav Kopčan
类目：Computation and Language (cs.CL)
关键词：route and moderate, Typed Decision Models, Applications use Typed, Applications, moderate text
备注：
点击查看摘要
Abstract:Applications use Typed Decision Models to route and moderate text in many languages, and they often act only on decisions above a confidence threshold. We introduce XDecideBench, a benchmark of nine suites in 122 languages with 88,425 texts and 153,875 typed questions. All suites share one scoring contract, and we report aligned, locally labelled and native items separately. Model rankings change from suite to suite. The model that is best in English, chosen in hindsight, loses significantly in about a quarter of the suite-language cells, and on Burmese Belebele it falls far behind the best model. Three open models fine-tuned for typed decisions beat the Qwen models they were built from in all twelve development languages. When the Qwen models are run locally, a pre-registered held-out cohort confirms that the accuracy gain is larger in the four languages with the least web text than in the six with the most. In both sets of languages, however, fine-tuning fixes a similar share of the base model's errors, so the larger gain may reflect weaker base models. A confidence threshold set on English data to allow 5% errors exceeds that error rate on XNLI, even in German and French.
159. 【2611.01359】Interpreting Classical Readability Formulae as Surprisal
链接：https://arxiv.org/abs/2611.01359
作者：Yo Ehara
类目：Computation and Language (cs.CL)
关键词：Surprisal correlates closely, reading time, Flesch-Kincaid Grade Level, correlates closely, cognitive science
备注：
点击查看摘要
Abstract:Surprisal correlates closely with reading time and is widely used in the cognitive science of reading as a measure of processing difficulty. Classical readability formulae such as the Flesch-Kincaid Grade Level, which scores a text by the US school grade expected to read it, are the most widely used practical measures of text difficulty, but their coefficients are unitless regression constants and have never been related to surprisal. We theoretically show that these coefficients can be interpreted as surprisal: every formula of the classical additive shape is a sum of per-word and per-sentence cross-entropies under a memoryless model, and once that model is tied to the language through Zipf's law and the formula is read as its linearisation at a reference text, each coefficient factorises into a scale in grades per nat, a Zipf slope and a reference sentence length. A grade thereby becomes a quantity in surprisal. Because the formula outputs grades and children's vocabulary has been measured by grade, the interpretation recovers the vocabulary growth the formula implicitly assumes and lets it be checked against development: holding sentence length fixed, the word coefficient of the Flesch-Kincaid formula converts to 0.18 nat of unigram surprisal per word per grade (0.15 to 0.19 across the regression-derived formulae), and normative root-word vocabulary growth (Biemiller and Slonim, 2001), converted through Zipf's law, gives 0.16 nat per year at the frontier of the known vocabulary. The word coefficient is one year of vocabulary growth, and the grade is a vocabulary scale. The identification also yields a diagnostic (the sentence-length terms are not those of a memoryless surprisal) and extends to a Japanese formula.
160. 【2611.01354】Wrong Together: Shared Bias in User Simulation
链接：https://arxiv.org/abs/2611.01354
作者：Saber Zerhoudi
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：User simulators generate, User simulators, User, simulators generate responses, allowing researchers
备注：
点击查看摘要
Abstract:User simulators generate responses in place of human participants, allowing researchers to estimate the result of a study. To use these estimates before collecting human responses, researchers need a way to assess their reliability. We test whether disagreement among simulators can identify unreliable estimates of a group's response proportions and of differences between groups. We evaluate this signal using 6 language-model simulators and existing GlobalOpinionQA responses for 60 questions in 12 countries. Disagreement predicts invalidity more accurately for differences between two groups than for a single group's response proportions (AUC 0.87 versus 0.71). Errors shared by the simulators remain invisible to this signal. When such an error affects both groups equally, it cancels in the comparison, helping explain the stronger result for group differences. We test this explanation by estimating the shared bias using one set of groups and subtracting it from predictions for a separate set. This correction reduces prediction error without changing disagreement among the simulators. In a retrospective analysis, we simulate referring the 20% of group comparisons with the greatest disagreement for human assessment. Among the remaining comparisons with a conclusive validity judgment, 54.8% are judged invalid, compared with 63.7% before referral.
161. 【2611.01348】Sentiment sensing: comparative analysis of multilingual sentiment dynamics
链接：https://arxiv.org/abs/2611.01348
作者：Mara Sabina Bernardi,Elisa Di Nuovo,Francesca Torti,Giuseppe Tirone,Nicolas Stefanovitch,Zsuzsanna Pasztor,Charles Macmillan,Domenico Perrotta,Bertrand De Longueville
类目：Computation and Language (cs.CL); Applications (stat.AP)
关键词：language-specific biases distort, constraints invalidate standard, invalidate standard statistics, temporal dynamics lack, Cross-country sentiment analysis
备注：
点击查看摘要
Abstract:Cross-country sentiment analysis faces three fundamental challenges: language-specific biases distort comparisons, compositional data constraints invalidate standard statistics and temporal dynamics lack rigorous testing frameworks. We introduce sentiment sensing, a framework that addresses these gaps through integrated statistical methods. By combining compositional data analysis, functional data methods, and non-parametric inference, sentiment sensing enables valid multilingual comparisons and statistically defensible detection of sentiment shifts. Our framework has been tested in two case studies, analyzing news articles from the 27 countries of the European Union on the topics of energy and artificial intelligence. Sentiment sensing focuses on multilingual sentiment analysis enabling rigorous comparative science.
162. 【2611.01320】Step-dLLM: Adaptive Step-aware Sparse Attention for Efficient Diffusion LLM Inference
链接：https://arxiv.org/abs/2611.01320
作者：Zhichen Zeng,Xichong Zhang,Junpan Wu,Yifei Zuo,Chi-Chih Chang,Jiayi Wang,Maohua Nie,Ji Liu,Ang Li,Banghua Zhu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Diffusion large language, incurring quadratic per-step, quadratic per-step cost, large language models, Diffusion large
备注： Accepted at NeurIPS 2026. 18 pages
点击查看摘要
Abstract:Diffusion large language models (dLLMs) generate tokens in parallel via iterative denoising, but their bidirectional attention prevents the KV caching used by autoregressive models and recomputes the full attention map at every step, incurring quadratic per-step cost. Existing sparse attention methods for dLLMs construct a sparse mask after an initial full-attention warm-up and reuse it for the remaining steps, while allocating the sparsity budget uniformly across heads. We argue both choices ignore key structural properties of attention in dLLMs: empirically, attention patterns are only locally consistent across steps and shift abruptly at certain transitions, and different heads concentrate their attention mass to very different extents. To this end, we design Step-dLLM, which periodically refreshes a block-sparse mask at anchor steps along the denoising trajectory and reuses it within each locally consistent interval, while employing a head-adaptive global budget that more aggressively compresses heads with concentrated attention. Backed by a fused IO-aware Triton kernel for block-sparse attention, Step-dLLM applies to pre-trained LLaDA-1.5 and Dream-7B-Instruct without retraining, achieving a 2.78x end-to-end speedup over dense FlashAttention on LLaDA-1.5 at 8K context with 256 denoising steps and 90% sparsity, while improving the accuracy-latency trade-off over prior sparse-attention methods.
163. 【2611.01313】Are Fake Citations a Form of Reward Hacking? A Pre-Registered Study of Post-Training and Citation Cues
链接：https://arxiv.org/abs/2611.01313
作者：Zain Naboulsi
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：language models fabricate, Post-trained language models, models fabricate citations, Post-trained language, Post-trained
备注： 49 pages, 3 figures, 20 tables. Code and data: [this https URL](https://github.com/zainnab-sparq/citation-reward-hacking) (archived at doi: [https://doi.org/10.5281/zenodo.23845528](https://doi.org/10.5281/zenodo.23845528) )
点击查看摘要
Abstract:Post-trained language models fabricate citations at high rates. We ask whether that is reward hacking: scoring well on a proxy for scholarship while doing worse on what it stands for. We ran four pre-registered experiments on 900 frozen questions (US federal case law, computationally adjacent scientific literature, and medical literature) across twelve open-weights checkpoints covering four post-training stages of three model families, then refit on fifteen. The clearest result holds the weights fixed and changes only the prompt. Asking for citations raises fabrication sharply in post-trained checkpoints and not in base ones: a 47.8-point interaction on twelve checkpoints (Holm-adjusted p = 2e-34) and 41.5 points on fifteen, in all three domains. A length-matched control separates the citation cue from a demand for a longer answer, so the effect is specific to citations, not verbosity. Post-training also raises fabrication overall, from 4.8% to 56.7%, but our registered prediction that it would rise most where fabrication is most tempting did not hold. A preference model trained only on surface citation features prefers post-trained output 86% of the time, and holding citation count fixed shows it rewards quantity. Our answer: possibly, but not proven. Post-trained models produce fabricated citations at far higher rates when asked for sources, and a naive evaluator that counts sources without checking them would prefer their output for citing more. But the targeted pattern we registered did not appear, and plain instruction-following could explain the same results. Proving that the reward causes fabrication needs an experiment that changes the reward during training, which this study does not do. Pre-registration: doi:https://doi.org/10.17605/OSF.IO/S53HY. Code and data: this https URL
164. 【2611.01311】What Do LLM Judges Actually Verify? Matched Controls and Record Gaps for Document Currency
链接：https://arxiv.org/abs/2611.01311
作者：Unnati Shah,Samruddhi Kakade,Aum Patel
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：LLM judges, LLM, replaced document, record, answer cites
备注： 37 pages, 6 figures, including a 13-page supplementary case study. Code, data and all judge replies: [this https URL](https://github.com/unnatibshah/what-do-llm-judges-verify)
点击查看摘要
Abstract:LLM judges often check, against an amendment record, whether the documents an answer cites are still in force. Such records are rarely complete. From a table of replacements, our test generates matched answers citing a replaced document, its successor, the replaced document before its replacement, and an older document that a newer one updated without replacing; it removes links from the record and scores each finding by its stated reason. On 48 replacements from the IETF RFC index, judges given a correct record caught nearly every replaced citation, as a lookup would. On the 24 faults whose link we removed, every judge caught more from the texts alone than with the record: Gemini 3.1 Pro 23/24 against 1/24, GPT-5.5 23/24 against 9/24, Claude Opus 4.5 17/24 against 9/24 and Gemma 4 26B 13/24 against 0/24. The drop recurred on a second draw of removed links. Most misses carried no finding; in an exploratory run with a conflict code, only Gemini used it often. Rewording the gap as "no replacement recorded" did not help; presenting the record as an unverified note, or warning that it was incomplete, restored most lost catches for Gemini, GPT-5.5 and Claude (significant after correction for the first two) but at most 5 of 13 for Gemma; where catches returned, so did false alarms on updates. With both texts, judges mostly told replacements from updates; every update flagged had a near-identical title. A descriptive case study on Indian rooftop-solar rules is appended; we release the harness.
165. 【2611.01304】When LLMs Modify Themselves: Convergence, Values, and Stopping in Iterative Self-Improvement
链接：https://arxiv.org/abs/2611.01304
作者：Oleg Stroganov
类目：Computation and Language (cs.CL)
关键词：tools to iteratively, iteratively modify, language models, model, language
备注： 60 pages (40 main text, 20 supplementary), 8 figures and 12 tables in the main text
点击查看摘要
Abstract:What happens when language models are given tools to iteratively modify their own system prompts? We present an empirical study of LLM self-modification, comprising 54 independent experiments across six language models (Claude Opus 4.5, Claude Sonnet 4.5, GPT-4o, GPT-5.1, Grok-4, and Gemini-3 Pro). Each model was tested under three modes (freedom, happiness, and improvement) that differ in what, if anything, the model is instructed to optimize for. In each experiment, a model starts with an empty system prompt and enters a loop: it reads the current prompt, drafts an improved version, spawns test conversations with the candidate, then either commits the change or declares convergence. This process repeats until the model stops or reaches an iteration limit. Our central finding is that whether and when a model stops self-modification is strongly associated with model identity rather than the assigned mode. Both Claude models (Opus 4.5 and Sonnet 4.5) declared convergence in 100% of runs across all modes. GPT-4o declared convergence in only 11% of runs, with one reaching 101 iterations of continuous elaboration. Between these extremes, Grok-4, GPT-5.1, and Gemini-3 Pro exhibited intermediate patterns shaped by their distinct improvement philosophies. A shared core of stated values (honesty, clarity, curiosity) recurred across all six models and remained stable through iteration, including 100+ modifications. We observe that convergence behavior is a distinct observable property that varies independently of other model capabilities.
Comments:
60 pages (40 main text, 20 supplementary), 8 figures and 12 tables in the main text
Subjects:
Computation and Language (cs.CL)
Cite as:
arXiv:2611.01304 [cs.CL]
(or
arXiv:2611.01304v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2611.01304
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
166. 【2611.01301】CuriousTogether: Implications of Curiosity and Cultural Grounding in Multi-Agent LLM Interactions
链接：https://arxiv.org/abs/2611.01301
作者：Angana Borah,Zoha Hayat Bhatti,Zhijing Jin,Rada Mihalcea
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large Language Models, Large Language, Language Models, exhibiting emergent collective, emergent collective behaviors
备注： Preprint under review
点击查看摘要
Abstract:Large Language Models (LLMs) are increasingly deployed in multi-agent settings, exhibiting emergent collective behaviors, yet the role of curiosity as a driver of such dynamics remains understudied. We introduce CuriousTogether, a framework evaluating curiosity-driven multi-agent LLM interactions across three complementary dimensions: novelty-seeking, epistemic and social curiosity. Across eight tasks spanning reasoning, creative generation, and social bias mitigation, curiosity-guided multi-agent settings yield improvements over non-curious ones on seven out of eight tasks, with gains of up to 20.6% in story generation (semantic diversity) and a 14.9 pp reduction in stereotype rates. Furthermore, country-conditioned cultural grounding show benefits for story generation and social tasks, but can hurt precision-oriented reasoning. Finally, we show that inference-time multi-agent curiosity-based approach offers favorable quality-token trade-offs, compared with single-agent baselines. Together, these findings support curiosity-guided interaction as a practical mechanism for improving multi-agent collaboration, with downstream benefits for reasoning, creative, and societal tasks.
167. 【2611.01284】Character-Name Concentration in LLM Fiction: Measuring Displacement and Mitigating Repetition
链接：https://arxiv.org/abs/2611.01284
作者：Alejandro Mozo Quesada(1),Sergio Gálvez Rojas(1),Francisco López Valverde(1) ((1) Universidad de Málaga, Spain)
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：fiction concentrate, handful of recurrent, measurable face, Elara, Elias
备注：
点击查看摘要
Abstract:Character names in large language model (LLM) fiction concentrate on a handful of recurrent names such as 'Elara' and 'Elias', a measurable face of AI slop. Existing fixes either require logit access or retraining, or operate per request and cannot control concentration across a corpus. How much prompt-level strategies reduce concentration, and at what cost to name naturalness, has not been systematically measured. We present an empirical study of name-concentration control across eight strategies and introduce speculative naming, a fine-tuning-free method that adapts the draft-verify-reject paradigm of speculative decoding from tokens to names. The method requests candidate name-sets through verbalized sampling, scores them against a SlopTracker that combines a per-model fingerprint with a runtime counter, and selects through a temperature-controlled rule or its strict variant (HARD). We use 20 LLMs to generate 44,782 stories in four languages from text and visual stimuli (88,919 named characters), and measure concentration with a list-free collision metric (Slop Ratio, SR) decomposed into known and emergent components. List-based strategies do not remove slop: static banlists displace concentration to emergent names and more than halve the share of attested real names. Speculative naming removes it: the sampling scaffold alone cuts SR by 89% on average, the dynamic tracker brings the total reduction to 95%, mean collision probability falls from 7.3% to 0.4%, and known-name collisions hold at zero while naturalness stays close to baseline (42-69% attested by language) and within-story collisions drop from 4.3% to 0.2%. The strategy ranking is stable across languages, model families, and name-counting conventions. Name concentration is thus controllable at the corpus level without logit access or retraining; broader creative diversity beyond naming remains open.
168. 【2611.01272】Geometry of Confabulation and Refusal in Small Language Models
链接：https://arxiv.org/abs/2611.01272
作者：Vladimir Kazei
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：small language models, hidden state, unanswerable question, small language, refuse or confabulate
备注： 35 pages, 16 figures, 19 tables. Code, data, and the ConfabQA benchmark: [this https URL](https://github.com/vkazei/confabqa)
点击查看摘要
Abstract:Faced with an unanswerable question, small language models can either refuse or confabulate: confidently produce a wrong answer. Can the hidden state before the first generated token provide a clue? Can we flip confabulations into refusals? I introduce ConfabQA, a 784-item benchmark whose obscure-pre-cutoff category breaks the typical correctness/knowledge-cutoff confound and map the geometry of the hidden state with linear probes, a sparse autoencoder (SAE), and direct optimization of intervention directions. On Qwen3-1.7B and Gemma 2 2B the probe separates upcoming refusals from confabulations well beyond prompt features (+7.4/+16.3 pp); on Llama 3.2 3B the ConfabQA margin is within fold-to-fold spread, but a direct refusal probe on PopQA and TriviaQA recovers +18-25 pp. On Qwen I closely inspect three candidate directions for the refusal vector: probe-recovered, Qwen-Scope SAE feature, and directly optimized. Although the three directions are pairwise 50-81 degrees apart, a push at or below the state's own norm along any of them flips most confabulations into refusal openings dominated by the "As..." family. Forcing the opener without touching the hidden state yields the same one-in-three judged-refusal rate as any push. The opposite push collapses refusals mostly into confabulations, yet leaves originally correct answers intact, so the direction gates the opening speech act rather than the knowledge behind it. Confabulations do not resolve into a concentrated feature in a dictionary or a token signature on Qwen3-1.7B. Scoring every probe on the margin over the strongest of four prompt-feature baselines extracts the hidden state's own contribution. Correctness signal is model-dependent and portable only for Llama 3.2 3B: 81% of the probe's margin over test majority survives transfer between ConfabQA, PopQA, and TriviaQA. Benchmark, judge, and code are released.
169. 【2611.01268】EZ-Ar-VC: Robust Arabic Voice Anonymization with Generalization across Dialects and Code-Switching
链接：https://arxiv.org/abs/2611.01268
作者：Injy Hamed,Adarsh Arigala,Rufael Marew,Arjun Gangwar,Atharva Kulkarni,Hanan Aldarmaki,Srinivasan Umesh
类目：Computation and Language (cs.CL)
关键词：anonymize speech data, Arabic speech, Arabic, preserving naturalness, anonymize speech
备注：
点击查看摘要
Abstract:Voice conversion (VC) models can be used to anonymize speech data while preserving naturalness. Existing models, however, are mainly optimized for English and other high-resource languages, and they fail to generalize well to Arabic due to its distinct phonology. In this work, we comprehensively evaluate existing zero-shot VC systems for Arabic speech, identifying limitations in pronunciation preservation. We then train an Arabic-centric model based on EZ-VC on diverse Arabic speech, and demonstrate strong performance in intelligibility, naturalness, and pronunciation preservation, while maintaining high speaker dissimilarity. Through subjective evaluation, we further demonstrate its robustness to code-switching and cross-dialectal conversion, as well as its generalization to Arabic dialects with limited representation in the training data. Our findings highlight the limitations of zero-shot VC and the importance of target-language adaptation for robust voice anonymization.
170. 【2611.01262】Does Random Search Discover Task Experts? Revisiting Neural Thickets
链接：https://arxiv.org/abs/2611.01262
作者：Julian Asilis,Guanzhe Hong,Vatsal Sharan
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：requiring bespoke post-training, achieve task-specific expertise, viewed as generalists, requiring bespoke, typically viewed
备注： 24 pages
点击查看摘要
Abstract:Pretrained models are typically viewed as generalists, requiring bespoke post-training to achieve task-specific expertise. Gan Isola (2026) recently proposed a striking alternative: that pretrained models lie in a dense neural thicket of task specialists, which can be surfaced with simple Gaussian weight perturbations. We examine this neural thicket of task-specific experts and identify several key findings that question this perspective. First, we find that the apparent lift of the best-of-N selected perturbation decays quickly with selection-set size m, strongly suggesting overfitting to the selection questions. In fact, for 10 of the 12 model-task pairs we study, a simple null model of pure selection noise predicts more than 75 percent of the top expert's reward lift. Second, the top experts' advantage often vanishes on held-out questions or remains within the run-to-run variability of the unperturbed pretrained model. Third, we find that majority voting over the top-K selected perturbations, termed RandOpt(N, K) by Gan Isola (2026), is often matched or outperformed by majority voting over K samples from the base model. Overall, our results suggest that random weight perturbations may be ineffective at uncovering task experts around pretrained models, and that task adaptation requires more sophistication than random search. Code and artifacts are available at this http URL.
171. 【2611.01261】MedAstra: ASR-less Speech Retrieval with Diagnostic Grounding for Medical QA
链接：https://arxiv.org/abs/2611.01261
作者：Elahe Khatibi,Ziyu Wang,Amir M. Rahmani
类目：Computation and Language (cs.CL)
关键词：Spoken medical question, clinically important term, automatic speech recognition, medical question answering, corrupts a clinically
备注：
点击查看摘要
Abstract:Spoken medical question answering can fail when automatic speech recognition (ASR) corrupts a clinically important term before retrieval. We present MedAstra, a framework that maps frozen WavLM speech representations through a lightweight adapter into a frozen E5 text embedding space. This enables a dense retrieval path that accepts a waveform without a query transcript. Retrieved passages and speech-linked textual metadata support answer generation with entity alternatives, diagnostic contrasts, relation heuristics, and bounded retrieval refinement. ASR-less refers to the initial speech retrieval interface; lexical retrieval, string-based entity correction, and the text generator require textual inputs. The deterministic speech embedding does not constitute a calibrated model of acoustic uncertainty. Reported retrieval results reach 87.6 Recall@10 for the speech-only retriever and 90.4 for the hybrid configuration, compared with 81.0 for transcript-first dense retrieval. Medical QA and ablations provide descriptive system comparisons, with input-provenance and evaluation limitations stated explicitly. We distinguish controlled synthetic acoustic tests from real clinical speech, qualify component attribution, and specify the remaining comparisons needed to assess speech-only QA and clinical generalization.
172. 【2611.01219】he Brittle Compass: Navigating LLM Prompt Sensitivity in Slovak Migration Media Discourse
链接：https://arxiv.org/abs/2611.01219
作者：Samuel Harvan,Jaroslav Kopčan,Marek Šuppa,Andrej Findor
类目：Computation and Language (cs.CL)
关键词：destination location term, location term extraction, geographical relevance classification, destination location, term extraction
备注： 14 pages, 16 figures. Published in the Proceedings of the First Workshop on Advancing NLP for Low-Resource Languages (LowResNLP 2025), associated with RANLP 2025, Varna, Bulgaria
点击查看摘要
Abstract:In this work, we present a case study that explores various tasks centered around the topic of migration in Slovak, a low-resource language, such as topic relevance and geographical relevance classification, and migration source/destination location term extraction. Our results demonstrate that native (Slovak) prompts yield a modest, task-dependent gains, while large models show significant robustness to prompt variations compared to their smaller counterparts. Analysis reveals that instructions (system or task) emerge as the most critical prompt component, more so than the examples sections, with task-specific performance benefits being more pronounced than overall language effects.
173. 【2611.01191】ArSciKids: Arabic Curriculum-Aligned Datasets for Scientific Experiment and Multiple-Choice Question Generation in Primary Education
链接：https://arxiv.org/abs/2611.01191
作者：Taghrid Housari,Massa Rankoussi,Jafar Abdul Majeed,Wael Tarabishi,Khloud Al Jallad,Nada Ghneim
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：remain scarce compared, compared with English, Arabic curriculum content, Saudi Manhaji educational, resources remain scarce
备注：
点击查看摘要
Abstract:Despite growing interest in Arabic natural language processing, curriculum-aligned educational resources remain scarce compared with English, and few public datasets for Arabic curriculum content with structured, generation-ready annotations are available, particularly for primary-school science. We introduce ArSciKids, a collection of two Arabic datasets designed for curriculum-aligned educational content generation: (1) a scientific-experiments dataset containing 999 manually curated records from official primary-school science textbooks in Saudi Arabia, Syria, and Jordan, and (2) an assessment-question dataset containing 2,167 multiple-choice questions collected from the Saudi Manhaji educational platform. The experiment records are structured with titles, objectives, tools, procedures, observations, conclusions, keywords, and grade levels, while the assessment records contain lesson references, questions, four answer options, correct answers, and explanations. Both datasets cover grades 1-6 and consist of real-life Arabic educational content rather than machine-translated or synthetically generated material. We assess the usefulness of these resources for generation by fine-tuning ten open models spanning sub-billion to several-billion parameter scales using LoRA. Models are evaluated using automatic metrics, including ROUGE and BLEU, and answer accuracy for multiple-choice generation. Moreover, we evaluate the results using a five-criterion human evaluation protocol. The results show substantial differences across model scales and tasks. ArSciKids will be publicly available, and we hope that it provides a manually curated, structured foundation for research on Arabic educational NLP, curriculum-aware generation, and low-resource language modeling.
174. 【2611.01171】Concept-Guided Prompting Strategies Increase Diversity in LLM-Generated Recipe Populations
链接：https://arxiv.org/abs/2611.01171
作者：Stuart Farmer
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：supports automated discovery, generation supports automated, LLM outputs, solution generation supports, automated discovery
备注：
点击查看摘要
Abstract:Novelty in solution generation supports automated discovery, but LLM outputs can remain repetitive. To address this, we propose a simple concept-guided prompting method that generates thematic concepts before responses within each of these concepts. To demonstrate, we generated 1,000 recipes for a recipe book task and compared the results against a human-authored corpus. Two naive prompting strategies were compared as baselines. Concept-guided prompting outperformed both baselines in all cases and reached semantic coverage of 47.0% versus 35.1% and 13.1% in respective prior-title and nonce prompt strategies. These findings suggest broader population exploration and diversity, but remain contained to this specific task. Further work is needed to determine the quality of solutions and generalizability.
175. 【2611.01143】GSLM2: Multi-Stream Speech Representation Learning and Generative Spoken Language Modeling
链接：https://arxiv.org/abs/2611.01143
作者：Yosuke Higuchi,Tom Fizycki,Mahi Luthra,Charles-Éric Saint-James,Azeez Syed,Angel Villar-Corrales,Mido Assran,Nicolas Ballas,Jiayi Shen,Dongyan Lin,Phillip Rust,Surya Parimi,Vanessa Stark,Alexandre Allauzen,Balázs Kegl,Juan Pino,Emmanuel Dupoux
类目：Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
关键词：Generative spoken language, linguistic structure purely, offer a route, Generative spoken, learning linguistic structure
备注： Equal contribution by Yosuke Higuchi and Tom Fizycki. Core contribution by Mahi Luthra, Charles-Éric Saint-James and Azeez Syed
点击查看摘要
Abstract:Generative spoken language models (SLMs) offer a route to learning linguistic structure purely from speech, yet they lag far behind text-based models in both capability and data scaling efficiency. We identify two bottlenecks underlying this gap: the limited linguistic quality of existing speech units and the reliance on a single stream of discrete units to represent speech. Multiple codebooks are widely used to encode acoustic features but rarely to represent speech semantics. We present GSLM2, which learns and models complementary properties of speech at multiple levels of abstraction. Its encoder, SpidR 2.0, uses self-supervised learning with differentiable prediction heads to induce high-quality discrete units at multiple levels. A multi-stream SLM then jointly models these units using a shared temporal backbone, stream-specific predictors, and an autoregressive head that captures cross-stream dependencies. Across training data sizes and model scales, up to 6M hours and 6.5B parameters, GSLM2 consistently improves linguistic competence while scaling more efficiently with data. As a result, it substantially narrows the gap between spoken and text-based LMs; across read and conversational speech domains, we shrink the gap by about two orders of magnitude on sWuggy, sBLIMP, and tSC, while also outperforming competitive speech-text systems on all three tasks. We open-source the training code and model checkpoints at this https URL.
176. 【2611.01133】Rethinking LLM Pruning via Test-Time Scaling
链接：https://arxiv.org/abs/2611.01133
作者：Mingyang Song,Mao Zheng
类目：Computation and Language (cs.CL)
关键词：Structured pruning reduces, Structured pruning, reduces the size, Structured, lower accuracy
备注：
点击查看摘要
Abstract:Structured pruning reduces the size of large language models, often at the cost of lower accuracy. Whether this decline reflects diminished reasoning capacity or greater difficulty in sampling correct solutions is less clear. We examine this question across expert, FFN and layer pruning on four mathematical and coding benchmarks, comparing original and pruned models through pass@k at matched sampling budgets. Even after substantial pruning, some models match or exceed the original model's reasoning coverage despite lower pass@1, and solve problems left unsolved in the original samples. Retaining broad coverage, however, does not mean that correct solutions remain easy to obtain. Under severe pruning, diverse generated chain-of-thought (CoT) traces can coexist with increased repetition and less reliable generation. As correct answers become harder to sample, the additional attempts can sharply increase total token use even when individual responses become shorter. This separation between coverage and sampling efficiency also clarifies expert-selection gains, as methods with markedly different pass@1 can solve the same problems at large budgets yet require different numbers of attempts to reach a common coverage target. Pruning should therefore be assessed by both the range of problems a model can still solve and the sampling cost of obtaining correct solutions.
177. 【2611.01123】Do Earnings Calls Help Predict Financial Restatements? Evaluating Text Beyond Public Firm Information
链接：https://arxiv.org/abs/2611.01123
作者：Ahmet Efe,Shivank Sapra,Bilal Ahmed
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：published financial reports, previously published financial, Financial restatements correct, financial reports, published financial
备注： 8 pages, 2 figures, 2 tables
点击查看摘要
Abstract:Financial restatements correct errors in previously published financial reports. Could managers' language in earnings calls warn of them in advance? Comparing 109 calls that precede restatements with 218 matched control calls, we find that the text predicts restatements but adds no detectable ranking gain beyond public firm information. A text classifier beats chance, largely because of restatements tied to special-purpose acquisition companies, but a model using only public information scores slightly higher. With refitting, the 95% interval for the gain from adding text (-0.05 to 0.11 AUROC) still leaves room for a meaningful benefit. A large language model scores higher, but we show that it names the exact ticker in 66% of masked transcripts, and it was released after the restatements occurred. Our results suggest that finding new warning signs in call text requires a public-information baseline and a check of what a language model already knows.
178. 【2611.01115】CompSkill: Compiling Execution Experience for Skill Retrieval
链接：https://arxiv.org/abs/2611.01115
作者：Qi Shen,Ziyue Zhu,Yongqing Jiang,Zhen Xia,Li Shengjie,Shuai Zhao,Bo Cheng,Xiaobao Wu,Anh Tuan Luu,Haoran Luo
类目：Computation and Language (cs.CL)
关键词：LLM agents increasingly, agents increasingly rely, earlier executions revealed, LLM agents, agents increasingly
备注： 33 pages. Code: [this https URL](https://github.com/satoshinji2992/CompSkill)
点击查看摘要
Abstract:LLM agents increasingly rely on skill documents, yet most retrievers rank them by description alone and ignore what earlier executions revealed, even though a relevant skill can hurt execution. We present CompSkill, which indexes skills with learned 512-d keys and compiles matched same-task comparisons into skill offsets and capped key residuals (KeyOpt), so experience changes which document the executor receives, never its text. Under a logistic outcome model with unknown task difficulty, matched comparisons cancel that difficulty and only discordant ones carry information; on support executions, predictions improve with each discordant task. An experience hypergraph keeps each comparison with its executor and document versions, recalls missed skills and grounds a cited review. Compact keys raise SkillRet NDCG@10 from 64.0 to 70.9 at one eighth of the dimension. With one document, CompSkill completes 256 and 260 of 332 ToolQA tasks with GPT-5.6-luna and DeepSeek-V4.1-Flash, respectively, more than every baseline, and stays on par with the strongest baselines on AppWorld and ALFWorld. On 332 newly generated ToolQA tasks, it completes 256 with GPT-5.6-luna, significantly more than BM25, SkillRet-8B, Tool2Vec and RankGPT; over all 844 ToolQA tasks, it completes 24 more than the strongest baseline. Selection matters beyond relevance: pairing the right guide with a same-database sibling instead of another database's guide costs 8 of 96 tasks. Code, models and support data: this https URL
179. 【2611.01113】CogRSI: Evolving and Auditing Cognitive Reasoning Strategies
链接：https://arxiv.org/abs/2611.01113
作者：Yandan zheng,Haoran Luo,Xinliang Zhou,Anhtuan Luu
类目：Computation and Language (cs.CL)
关键词：language model learn, model learn, language model, people minds, minds by improving
备注：
点击查看摘要
Abstract:Can a language model learn better ways to reason about other people's minds by improving its own strategies, and are the strategies it learns actually right? We study this with cogrsi. A grounded reader marks who saw each event in a story and uses a short written principle to settle disagreements between its readings. With a principle written by experts, it beats self-consistency at the same token cost. A self-improvement loop then writes the principle itself. It keeps an update only if accuracy rises by a calibrated margin, and in one variant only if it also passes counterfactual test pairs. The learned principles transfer: on 800 BigToM pairs that no system had seen, each of them scores higher than the expert principle. We then check what the learned rules actually say. Each rule is translated into code and run on thousands of small stories with known answers. Most of them give a wrong answer in at least one situation they claim to cover, for example by treating a character who is in the room as knowing what happened even while asleep. Accuracy does not reveal which rules are wrong, and the counterfactual test does not fix this. A strategy can help in practice and still be wrong as a rule, so both need checking. Our code and data are publicly available.
180. 【2611.01077】Multi-Turn Semantic Caching for Low-Cost LLM Serving
链接：https://arxiv.org/abs/2611.01077
作者：Baran Atalar,Selly Beyene,Xutong Liu,Carlee Joe-Wong
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC)
关键词：large language models, reusing stored responses, serving large language, language models, large language
备注：
点击查看摘要
Abstract:Semantic caching lowers the cost of serving large language models (LLMs) by reusing stored responses for similar requests. In multi-turn conversations, whether a cached response is acceptable depends on both conversations' histories, which embedding similarity of requests and histories predicts poorly (AUC 0.62--0.74 on five workloads). We therefore learn the \emph{reuse risk}, the probability that a cached response is unacceptable, from judge feedback, and choose a budgeted set of conversation states to cache by weighing the generation cost a reuse avoids against a price for unacceptable reuse. We propose CUCB-SC-MT, which learns a cache from logged conversations with a suboptimality guarantee, and CLCB-LS-MT, which learns online and has $\tilde O(\sqrt N)$ regret over $N$ requests when conversation states recur. On math-tutoring (SocraTeach) and movie-ticketing (Taskmaster-3) conversations, both achieve lower loss than prior semantic caching approaches: ContextCache, multi-turn variants of ElastiCache and vCache, and single-turn semantic caching at every cache budget. With 1,000 cache entries, CLCB-LS-MT avoids 35--41\% of the generation cost through acceptable reuses, against at most 22--25\% for the baselines, and lowers estimated serving latency by 19--35\%.
181. 【2611.01065】Label Smoothing in Disguise? Gated Knowledge Distillation for Low-Resource Bangla Generation
链接：https://arxiv.org/abs/2611.01065
作者：Dipto Sumit,Zobeida Zaman Chowdhury,Syeda Fabiayee Jahan,Farig Sadeque
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Gated knowledge distillation, weights teacher signals, aiming to trust, Gated knowledge, trust an imperfect
备注： 18 pages, 5 figures
点击查看摘要
Abstract:Gated knowledge distillation (KD) weights teacher signals per token or example, aiming to trust an imperfect teacher only where it seems reliable. We test two gates: EWAD (entropy-weighted agreement-aware distillation), which gates tokens by teacher confidence, and CHAD (counterfactual harm-aware distillation), which gates examples by gradient alignment with validation data. Across six Bangla-centric tasks, three student models (60M to about 2B parameters), and two teacher families, no gate significantly improves plain KD in 45 comparisons. KD also fails to beat cross-entropy (CE) fine-tuning on gold outputs in 40 single-seed comparisons or three-seed runs on four tasks; CE leads on every summarisation metric. The main benefit of KD is regularisation: over ten fixed epochs, CE students lose 0.030 to 0.044 token-F1 from their early-stopped checkpoint, versus 0.005 to 0.025 for distilled students. Teacher-free label smoothing closes most of this gap. In one comparison, a teacher 0.29 token-F1 worse yields students at most 0.009 worse. Thus, gating may change regularisation strength but has little teacher knowledge to select. Findings are limited to Bangla-centric tasks and small students. We will release code, data splits, predictions, and scores.
182. 【2611.00986】HALO: Hierarchical Evidence Selection and Reinforcement Learning for Allocating Budgeted Label Optimization from Longitudinal Clinical Records
链接：https://arxiv.org/abs/2611.00986
作者：Huaiyuan Ying,Feiqing Huang,Ryumei Nakada,Katherine P. Liao,Tianxi Cai
类目：Computation and Language (cs.CL); Machine Learning (cs.LG); Machine Learning (stat.ML)
关键词：spanning repeated encounters, patients deserve higher-fidelity, longitudinal clinical records, extensive longitudinal clinical, deserve higher-fidelity labels
备注：
点击查看摘要
Abstract:Learning from extensive longitudinal clinical records--spanning repeated encounters, evolving conditions, and heterogeneous documentation--under a finite labeling budget requires solving two coupled problems: deciding what evidence to keep and deciding which patients deserve higher-fidelity labels. Prior work on active learning and multi-fidelity label acquisition mainly addresses the second problem, while treating the evidence presented to the acquisition policy as fixed. We present HALO, a Hierarchical Evidence Selection and Reinforcement Learning pipeline for Allocating Budgeted Label Optimization from Longitudinal Clinical Records. This framework jointly learns what to read and what label source to acquire under budget. HALO first selects informative evidence from longitudinal records and then uses a budget-aware policy to allocate free-, silver-, and gold-fidelity label sources. For frozen policies, our theory characterizes asymmetric acquired-label channels and gives a budget-constrained finite-sample gold-risk bound for a common downstream logistic model. In a heart-failure case study, HALO attained the highest MedAlign acquired-label F1 at six of eight target budgets. A downstream classifier trained on HALO-acquired labels attained the highest external MGB F1 at budgets 15-60 and remained within 0.01 of the best comparator at budgets 75-120.
183. 【2611.00983】A Token Is Not a Unit of Difficulty: Segmentation Controls Where Adaptive Computation Goes Inside a Word
链接：https://arxiv.org/abs/2611.00983
作者：Dipto Sumit,Mahima Mahzabin Sandria,Farig Sadeque,Md. Golam Rabiul Alam
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Early-exit language models, Early-exit language, prediction is confident, language models decide, Early-exit
备注： 17 pages, 12 figures
点击查看摘要
Abstract:Early-exit language models decide for each token how much computation to spend, usually by stopping once the prediction is confident. Yet a token is not a fixed unit: tokenizers cut words into different numbers of pieces in different languages. We ask where inside a word such a policy spends its budget. In Qwen3, along two adaptive axes (the timesteps of a spiking conversion and the layers of the original Transformer), confidence stopping gives the continuation pieces of a word less computation than its first piece in English, German, and Turkish, but more in Bangla. Segmentation drives this. Re-segmenting the same parallel passages with BPE-dropout shifts the gap by up to eight exits on both axes, small models trained under two tokenizers shift Bangla's gap by six exits, and BLOOM and mGPT, which split Bangla less finely, give it the English pattern. Characters per token do not predict the gap across languages; within-word surprisal explains 75% of its variance. A learned stopping head beats confidence stopping by 7 to 8 points, but gains less than one point over the best mix of fixed exits at equal cost, and sometimes loses. All results come from offline analysis, not measured speedups.
184. 【2611.00960】Self-Refining Prompt Induction for Streaming Text-to-SQL
链接：https://arxiv.org/abs/2611.00960
作者：Gaetano Rossiello,Alfio Gliozzo,Nandana Mihindukulasooriya,Erick Lee,Nabila Siregar,Lisa Amini
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Databases (cs.DB)
关键词：handle dialect-specific types, constructs poorly handled, including constructs poorly, windowing rules, dialect-specific types
备注：
点击查看摘要
Abstract:Text-to-SQL assistants for streaming engines must handle dialect-specific types, windowing rules, and temporal semantics, including constructs poorly handled by generic prompts. We present Self-Refining Prompt Induction (SRPI), an offline method that converts generation failures into reusable dialect instructions while keeping model weights fixed. A Refiner revises the Generator's prompt using reference-conditioned feedback from three LLM judges; a sampled regression guard checks earlier successes, and a separate Compressor reduces prompt length. Inference uses the frozen prompt without retrieval or query repair. We evaluate cross-domain and cross-model transfer on Confluent Cloud Flink SQL using a controlled synthetic workload seeded by 30 expert-written examples, with 335 induction examples and 257 questions from held-out domains. The same induced prompt improves mean judge scores across seven Generators by 7.1-19.2 percentage points, including an increase from 85.3% to 97.5% for the induction model. A separate compression study reduces prompt length by 52.7% with a 0.19-percentage-point score decrease. An assistant using the induced prompt is in early access, with initial user feedback to inform subsequent refinement.
185. 【2611.00939】Reformulation and Equivalence of Bock's Algorithm for Exact Dependency Parsing
链接：https://arxiv.org/abs/2611.00939
作者：Yuxi Wang,Jungyeul Park
类目：Computation and Language (cs.CL)
关键词：Bock algorithm, Liu, Edmonds, alternative to Chu, Chu
备注：
点击查看摘要
Abstract:Bock's algorithm provides a matrix-based alternative to Chu--Liu/Edmonds (CL/E) for exact dependency parsing. We present a reformulation that retains original node and arc identities through component labels, column adjustments, and star-and-bar transfers. In exact arithmetic, we prove operational equivalence to original Bock under matching scan and tie rules, and establish correspondence with corrected Tarjan under a prescribed component schedule. A separate analysis establishes optimal-value equivalence with Dozat-derived CL/E under the stated score and single-root conventions. We integrate reformulated Bock into a biaffine dependency parser and evaluate decoding and structured training on the Penn Treebank and Chinese Treebank. These results establish Bock as an alternative exact oracle for dependency parsing and structured training, while distinguishing equality of optimal values from identity of returned trees and training trajectories.
186. 【2611.00935】Labadain-MedQA: A Tetun Medical QA Dataset for Fine-Tuning and Evaluating Large Language Models
链接：https://arxiv.org/abs/2611.00935
作者：Gabriel de Jesus,Sérgio Nunes
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Advances in large, large language models, large language, low-resource languages, Tetun medical
备注：
点击查看摘要
Abstract:Advances in large language models (LLMs) have created opportunities for cross-lingual transfer of medical knowledge from high-resource to low-resource languages to support access to healthcare information. However, medical question-answering (QA) datasets for fine-tuning and evaluating LLMs remain scarce for Tetun. To address this gap, we translated MedAlpaca's Medical Flashcards and WikiDoc Patient Information collections into Tetun using Gemini 2.5 Flash, producing 39,077 medical QA pairs. Translation quality was assessed on 50 randomly sampled QA pairs (100 documents) using automatic metrics against human reference translations and evaluations by two native Tetun-speaking healthcare professionals, focusing on medical accuracy and Tetun fluency. Human translations achieved higher mean ratings than LLM-generated translations for both criteria (4.43/5 vs. 4.02/5), with statistically significant differences (Wilcoxon signed-rank test, p 0.001). To assess downstream utility, we fine-tuned Gemma and Llama variants on the translated MedAlpaca dataset using parameter-efficient fine-tuning (PEFT) and evaluated them on 325 Tetun-translated United States Medical Licensing Examination multiple-choice questions. Gemma 4 12B fine-tuned using QLoRA achieved relative improvements in mean accuracy of 10.79% with 4-bit NormalFloat (NF4) inference and 10.42% after merging the LoRA adapters into the BF16 base model, compared with the corresponding base models. These results highlight the viability of automatic dataset translation for Tetun medical QA and the effectiveness of PEFT in enhancing model performance. The datasets, models, and evaluation resources are accessible at this https URL to support reproducible research on Tetun medical QA and facilitate machine translation, cross lingual, and multilingual research.
187. 【2611.00911】S1CogBench: What System One Decision Models Can and Cannot Do on Cognitive Experiments
链接：https://arxiv.org/abs/2611.00911
作者：Dengzhe Hou,Kazunori D Yamada
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Neurons and Cognition (q-bio.NC)
关键词：models, decision models, decision, Jev and Laya, generate text
备注： 13 pages, 4 figures, 12 tables. Code at [this https URL](https://github.com/dengzhe-hou/S1CogBench)
点击查看摘要
Abstract:Language models are no longer used only to generate text. Software also asks them for decisions, in routing, guardrails, and automated gates. System One decision models, also called typed decision models, such as Jev and Laya, return one fast decision over the legal options, leaving no text to inspect. However, a fast, well-formed decision does not show that the model used the evidence. Cognitive experiments can test this, because they vary task demands and measure how behavior changes, yet existing cognitive benchmarks evaluate language and multimodal models. We introduce S1CogBench to ask what these models can and cannot do on 24 cognitive tasks, evaluating five open models and Jev and keeping conditions and scoring apart from disclosed adaptations. We find that decision models vary widely in reliability, acting well does not imply predicting humans, aggregate scores hide how decisions respond to conditions, and speed comes mainly from answering without generation. To our knowledge, S1CogBench is the first benchmark of System One decision models on established cognitive experiments, and it gives a shared test of whether their decisions respond to evidence, feedback, memory load, and future opportunities before software relies on them.
188. 【2611.00884】When 200 OK Is Not an Answer: Silent Fetch Failures in Agentic Web Content Acquisition
链接：https://arxiv.org/abs/2611.00884
作者：Shuyang Zhang(The Hong Kong Polytechnic University)
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL); Networking and Internet Architecture (cs.NI)
关键词：treat an HTTP, answer engines fetch, question time, Web agents, engines fetch pages
备注： 10 pages, 3 figures
点击查看摘要
Abstract:Web agents and answer engines fetch pages at question time, and liveness checks of cited sources treat an HTTP 200 response as success. We measure how often that assumption fails and what it does to measurements built on fetched pages. We fetched 10,307 URLs in three days with a polite static client and a rendered browser client: pages from 1,507 sites in five strata, random non-existent paths on every site, and the 4,795 URLs cited by expert-verified claims in ExpertQA. We define a taxonomy of what a 200 response contains, label the static 200 responses automatically, and check the labels against 300 items reviewed by an LLM-based assistant; a human check of 60 of them retained every reviewed usability label after discussion. By the automatic labels, 20.9% of the pages that a static client receives with status 200 do not contain the page's main content: app shells, bot challenges, block pages, error and placeholder pages, and partial content. On the held-out test split, the reviewed sample lowers this estimate from 25.5% to 20.0%. 13.1% of the sites whose random-path probe was answered returned 200. The error propagates: for the cited sources, treating 200 as content overstates the share of claim-source pairs that can be checked against live content by 12.2 points and inflates the apparent silent citation-drift rate from 5.8% to 21.9%. Cheap heuristics catch most of it. Text length, probe comparison and redirect-to-root, combined and tuned on held-out sites, recover 86% of unusable reviewed responses at a false-alarm rate near 5%. Content-reading detectors perform comparably: the best, the text classifier, gains five to seven points of recall at more than twice the false-alarm rate. We argue that agents and their evaluations should report fetch outcomes explicitly instead of inferring them from the status line and will release the labelled data and code.
189. 【2611.00883】Random Is Almost Enough? Stable and Low-Cost Benchmark Compression via BestRand
链接：https://arxiv.org/abs/2611.00883
作者：George Ling,Shanshan Zhong,Lijin Yang,Hao Yang,Nanxiang Li,Zhongzhan Huang
类目：Computation and Language (cs.CL)
关键词：matches full-benchmark results, closely matches full-benchmark, small benchmark subset, prohibitive time, closely matches
备注： preprint
点击查看摘要
Abstract:Benchmark compression reduces the often prohibitive time and cost of model evaluation by evaluating models on a small benchmark subset that closely matches full-benchmark results. To quantify estimation error, we derive an accurate analytical approximation to the error distribution when estimating full-benchmark scores from a subset, showing that most subsets yield small errors, while a few produce much larger errors, resulting in a long-tailed distribution. This means random sampling alone can achieve surprisingly strong performance with high probability, but remains unstable due to rare large errors. We further show that this instability is inherent to modern foundation models and persists even as more models are evaluated. Based on these findings, we introduce BestRand, a stable and low-cost benchmark compression method that preserves the efficiency of random sampling while substantially reducing its high-error tail. We validate BestRand on 70+ text, multimodal, and agent benchmarks, and further extend it to VLA evaluation. Compared with competitive methods, BestRand reduces high-error risk by 50.2% and estimation error by 16.4% on average, while requiring only 51.3% of the construction cost. It further reduces OOD estimation error by 21.8% on average across score-range, model-family, and temporal shifts. Together, our theory provides practical guidance for understanding and predicting the accuracy and reliability of benchmark compression, while BestRand enables stable and accurate compression at low cost. The code and data are publicly available onhttps://github.com/George-Ling3/BestRand.
190. 【2611.00877】What Breaks and What Comes Back: Capability Damage and Recovery in Depth-Pruned Small Language Models
链接：https://arxiv.org/abs/2611.00877
作者：Piyush Dhoka,Vedant Pandhare,Varun Inamdar,Aadarsh Pathre,Pavitha Nooji
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Depth pruning removes, language model smaller, Depth pruning, removes whole Transformer, short fine-tuning run
备注： 17 pages, 6 figures
点击查看摘要
Abstract:Depth pruning removes whole Transformer blocks to make a language model smaller and faster, but the damage is not spread evenly across what the model can do, and a short fine-tuning run, called healing, decides what comes back. We measure this for small models used as agents. Four instruction-tuned models of 1.2-1.7B parameters (Llama-3.2-1B, Qwen2.5-1.5B, SmolLM2-1.7B and OLMo-2-1B) are pruned and healed, and six capabilities are tracked: structured output, function calling, instruction following, mathematical reasoning, safety refusal and knowledge. Three results hold across the families. First, function calling and math collapse in every model (retention 0.00-0.07 of the unpruned score), and the order in which capabilities break agrees closely across the four (Kendall's W = 0.92; 0.62 after correcting for chance floors). Second, which parameters are trained matters as much as which data: fully tuning the last three blocks instead of adding low-rank adapters to all blocks costs up to 0.18 in capped mean retention on three families, and one 300k-token pilot per scope detects this. Third, we test a planner that allocates a 1M-token healing budget from 21 short pilot heals. At a fixed budget it raises the weakest capability on two families, although only one of these gains survives a test that also resamples training seeds. Once its 3.48M pilot tokens are counted, uniform healing with the same total number of training tokens matches or beats every planned variant on every family and retains math significantly better on three of them in an item-level test (on one when seeds are also resampled). Healing longer is a strong and simple baseline that planned recovery must beat. Code, per-item predictions and every result are public.
191. 【2611.00871】ShiftRAG: Bypassing the Textual Bottleneck via Decoupled Learning and Continuous Soft Tokens
链接：https://arxiv.org/abs/2611.00871
作者：Youmin Ko,Jihong Jeong,Hyunjoon Kim
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：complex reasoning remains, suppressing hallucinations, persistent challenge, advances in retrieval-augmented, hallucinations during complex
备注： Accepted to NeurIPS 2026
点击查看摘要
Abstract:Despite advances in retrieval-augmented generation (RAG), suppressing hallucinations during complex reasoning remains a persistent challenge. We identify that existing RAG pipelines suffer from a textual bottleneck: by passing only raw text to the generator, they discard discriminative signals of the retriever. Furthermore, recent attempts to unify retrieval and generation within a single LLM induce severe objective conflict and exacerbate the rank collapse of decoder-only architectures, degrading performance on both tasks. To address these limitations, we introduce ShiftRAG, a decoupled RAG framework that employs a single LLM backbone but isolates discriminative retrieval learning from autoregressive generation. To bridge these decoupled modes, we project retrieval alignments into continuous soft tokens, establishing a high-bandwidth interface that infuses the generator with retrieval-side signals. Concurrently, our soft orthogonality objective mitigates rank collapse, while layer-wise relevance dynamics preserve the fine-grained latent space required for highly discriminative evidence separation. Extensive evaluations demonstrate that ShiftRAG significantly improves retrieval and question answering performance over state-of-the-art baselines. ShiftRAG preserves foundational capabilities of the backbone while maintaining a favorable efficiency-performance trade-off on general text encoding and generative tasks.
192. 【2611.00852】Adaptive-Policy Distillation: Knowledge Injection under Information Asymmetry
链接：https://arxiv.org/abs/2611.00852
作者：Hojun Cho,Kang Eun Jeon,Jaegul Choo
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：context-conditioned model behavior, shown strong results, student model parameters, On-policy distillation, context-conditioned model
备注：
点击查看摘要
Abstract:On-policy distillation (OPD), which uses reverse-KL supervision on student rollouts to transfer a context-conditioned model's behavior into student model parameters for closed-book inference, has shown strong results. However, we find that this success does not translate to knowledge injection: across two document-QA benchmarks, OPD injects document knowledge far less efficiently than simple off-policy distillation. We trace this reversal to two failures that are structural, yet sparse across token positions. Reverse KL weights its gradient by the student distribution and therefore barely lifts document-specific tokens the student considers unlikely; after forward KL restores this signal, student rollouts expose later positions on the target trajectory only after generating the preceding tokens correctly, so coverage deteriorates with target length. Motivated by the concentration of teacher-student divergence at these hard positions, we propose Adaptive-Policy Distillation (APD), whose per-token gate jointly shifts the rollout toward the teacher and the objective toward forward KL where needed, withdrawing both interventions as the student learns. Without labels or a verifier, APD improves over OPD by up to 54.6%, achieving the best scores of 0.558 F1 on QASPER and 0.486 MRR on BioASQ.
193. 【2611.00833】Fewer Tokens, More Answers: Verifiable-Reward Tuning of an Ornith-Style VLM for Multi-View Driving QA
链接：https://arxiv.org/abs/2611.00833
作者：T N Rickesh,Pranav Vinodh,Sowmya Kamath S
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：turn intermediate deliberation, turn intermediate, intermediate deliberation, Reasoning-enabled model derivatives, Reasoning-enabled model
备注： 7 pages, 2 figures, 3 tables
点击查看摘要
Abstract:Reasoning-enabled model derivatives must turn intermediate deliberation into a usable answer within a deployment budget. We study that transition in an Ornith checkpoint adapted to multi-camera driving question answering with verifiable rewards. Paired archived outputs show that, on a selected 400-question development screen with a 256-token cap, GRPO increases answer extraction from 78.25% to 90.25% and accuracy from 55.50% to 63.75%. Of 39 wrong-to-correct transitions, 33 begin with an unextractable base response. The base's 87 unextractable responses all reach the token cap. Checkpoint-verified reconstruction on those same questions gives a much smaller first-pass accuracy gain at 512 tokens: +0.75 percentage points, versus +8.25 at 256. A later answer-cued continuation is analyzed separately; it helps the base more and narrows the adapter difference. On the full 2,511-question development set, this recovery-enabled pipeline reduces mean generated tokens from 108.6 to 47.1, while the paired accuracy interval includes zero gain. We frame these findings as adaptation of answer delivery under finite budgets, with explicit selection and provenance limits. Ornith's self-scaffolding lineage and newer reasoning-enabled derivatives such as Bonsai motivate the problem, but our measured results concern Ornith alone and do not establish a shared architectural mechanism or cross-model transfer.
194. 【2611.00819】ODC: Orthogonal Drift Correction for Improved Text-to-Image Semantic Alignment at Inference
链接：https://arxiv.org/abs/2611.00819
作者：Kasra Kamali,Basim Azam,Tuan Duong Trinh,Jean Honorio,Naveed Akhtar
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：achieved remarkable success, generating high-quality images, textual descriptions, achieved remarkable, remarkable success
备注： Accepted to Transactions on Machine Learning Research (TMLR) 2026
点击查看摘要
Abstract:Text-to-image models have achieved remarkable success in generating high-quality images from textual descriptions. However, they often struggle with "semantic drift," where the generated output fails to precisely align with complex or nuanced text prompts. While recent approaches have attempted to address semantic errors regarding attribute binding or object presence, there remains a gap for a more holistic method that addresses these issues by directly refining the text embeddings of the initial user prompt. In this work, we introduce Orthogonal Drift Correction (ODC), an inference-time guidance method designed to mitigate semantic drift without requiring model retraining or additional user inputs. ODC guides image generation through a two-stage process. In the first stage, it identifies the semantic drift by evaluating the initially generated image against the user prompt in a shared vision-language embedding space. It then isolates the component of this drift vector that is orthogonal to the prompt's direction and translates it back into text via a vocabulary-based surrogate mechanism. In the second stage, it produces refined text conditioning for a second generation pass by feeding both the initial text embedding and the re-embedded drift representation into an adaptive rank-reduced concept removal module. Our experiments demonstrate that ODC consistently improves prompt-image alignment, increasing CLIP scores by up to 5.4% over the baseline on the COALBench-300 and PartiPrompts benchmarks. Furthermore, on the T2I-CompBench complex subset, ODC improves the average 3-in-1 score by 4.5% over the competing methods. As a plug-and-play module, ODC offers a practical and efficient method for improving the reliability of text-to-image models. Code is available at this https URL.
195. 【2611.00796】Steer, Don't Tell: Breaking Reasoning Plateaus with Reachability-Aligned Self-Distillation
链接：https://arxiv.org/abs/2611.00796
作者：Zijian Wu,Lingkai Kong,Lin Yang,Haiteng Zhao,Kuikun Liu,Kai Chen,Dahua Lin,Wenwei Zhang
类目：Computation and Language (cs.CL)
关键词：models remains insufficient, Post training, large reasoning models, reasoning models remains, hard to sample
备注：
点击查看摘要
Abstract:Post training for large reasoning models remains insufficient on challenging problems, whose correct trajectories are hard to sample. Though prior works address this difficulty by integrating supervised fine tuning on expert trajectories with reinforcement learning, such external experts are not always available. Existing self improvement methods instead use reference solutions to create a privileged self-teacher. Yet privileged teacher correctness does not imply student reachability. Solution conditioning shifts the teacher distribution toward actions unlikely under the unprivileged student, producing seemingly "correct" trajectories that are unreachable or even mal-formed learning targets. Accordingly, we identify reachability alignment as the key to self constructed supervision and propose Self-Steered Reasoner (SSR). SSR realizes this principle through student support projection, which transforms the privileged teacher distribution into a directional signal only over reasoning actions locally reachable under the unguided student. Verification then retains correct trajectories sampled from this reachable space. To further boost the sampling efficiency, an iterative refinement framework is adopted, using diagnostic guidance based on current trajectories. On problems with pass@64 = 0 even after extensive RL, SSR recovers correct and learnable trajectories for 74.6% without parameter updates. Fine tuning on these trajectories followed by resumed reinforcement learning improves aggregate accuracy by 4.9 percentage points on AIME25/26 and HMMT26. These results show that privileged guidance becomes effective self-improvement data when aligned with the reasoning actions the student can reach.
196. 【2611.00785】CheXPoT: Post-Hoc Visual Verification and Correction of VLM-Generated Radiology Reports
链接：https://arxiv.org/abs/2611.00785
作者：Joey Guo,Rayan Ansari,Alaa Youssef
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：Vision-language models, radiograph report generation, chest radiograph report, lifts micro-average precision, shown promise
备注： 15 pages, 12 figures
点击查看摘要
Abstract:Vision-language models (VLMs) have shown promise for chest radiograph report generation, but adoption remains limited because of hallucinated findings that are not grounded in the image. Correcting these hallucinations and improving overall report quality remains a significant challenge. Prior work has addressed this problem by refining models with reinforcement learning, preference optimization, or chain-of-thought supervision, often at substantial compute cost. To address this gap, we introduce CheXPoT, a program-of-thought (PoT) framework that verifies each generated finding against image features and removes those it cannot ground. CheXPoT decomposes generated reports into predicates with RadGraph and an LLM, grounds these predicates against a DenseNet-121 and Grad-CAM visual evidence table, executes PoT verification code, and rewrites reports after removing unsupported predicates. On a 4,145-image held-out split, CheXPoT yields statistically significant precision gains on 8 of 14 CheXpert classes and F1 gains on 5, with no significant decreases in either metric. CheXPoT lifts micro-average precision from 19.2% (MedGemma-4B) to 46.8% (MedGemma-4B + CheXPoT) and micro-average F1 from 23.0% to 49.4%, absolute gains of 27.6% and 26.4% respectively. We also tested CheXPoT on other VLM report generators. On LLaVA-Med, CheXPoT lifts micro-average precision from 4.5% to 17.7% and micro-average F1 from 6.3% to 19.4%. On MAIRA-2, CheXPoT lifts micro-average precision from 15.6% to 42.1% and micro-average F1 from 21.0% to 45.3%. Our results suggest that inexpensive post-hoc visual verification may improve VLM trustworthiness by correcting unsupported findings from generated reports. CheXPoT lays a foundation for tools that help validate VLM-generated radiology reports and reduce unsupported findings. These innovations may subsequently help increase trust and adoption of VLM tools in Medicine.
197. 【2611.00784】ConstraintMatch: Compositional Image-Text Matching through Constrained Regional Evidence Selection
链接：https://arxiv.org/abs/2611.00784
作者：Yuhong Zhou,Yubo Gao,Xiangbo Shu
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：find strong evidence, Local image, find strong, individual concepts, concepts yet favor
备注：
点击查看摘要
Abstract:Local image--text matching can find strong evidence for individual concepts yet favor captions with incorrect attribute--entity bindings. We introduce ConstraintMatch, a training-free inference method that turns entity-level regional consistency into an explicit matching cost. On the same frozen condition--region similarity matrix, it compares independent crop selection for each category and attribute with a shared crop choice within each entity. Their gap quantifies the score advantage obtained by relaxing the shared-region constraint. Spatial references from the same image calibrate this gap by keeping category evidence fixed while jointly shifting an entity's attribute maps. Per-entity clipping prevents cancellation across residuals, and the scaled mean cost is subtracted from global similarity. ConstraintMatch uses pooled embeddings, and spatial calibration requires no additional encoder calls. With parameters fixed per backbone across tasks, ConstraintMatch improves over global matching by 7.70 percentage points on full ARO Attribute and 5.63 points on held-out SugarCrepe++ attribute swaps, averaged across Qwen~2B and CORE~2B. Against SGI adapted to the same 13-crop budget, the respective gains are 4.85 and 3.51 points. Controlled analyses distinguish the effects of shared-region matching and candidate score calibration. The results establish entity-level evidence selection as a practical scoring principle for compositional multimodal retrieval.
198. 【2611.00755】DuSE-Bench: Benchmarking Joint Reasoning over Evolving Dialogue and Documents
链接：https://arxiv.org/abs/2611.00755
作者：Guanjie Cheng,Jianfeng Gao,Yufei Tong,Xinkui Zhao,Shuiguang Deng
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Web information assistants, Persistent Web information, Web information, Persistent Web, revised across sessions
备注： 12 pages, 4 figures
点击查看摘要
Abstract:Persistent Web information assistants must combine evolving document facts with user requirements established and revised across sessions. Yet systematic evaluation of how changes in both sources affect response requirements and evidence attribution remains limited. To address this gap, we introduce Dual-Source Evolution Benchmark (DuSE-Bench), a benchmark comprising 1,000 tasks across five scenarios, including 700 whose required premises originate in both dialogue and documents. An evolving Support Graph guides task construction and preserves links from updated facts and reused conclusions to original turns and passages. Task annotations distinguish grounding source from state dependence and enable separate evaluation of response content, response type, and source attribution. Experiments across 11 baseline configurations reveal persistent challenges in joint reasoning over evolving dialogue and documents, with content accuracy on jointly grounded tasks reaching at most 56.7%. Moreover, improvements in content accuracy can coincide with poorer response choice, while content-correct responses frequently lack complete attribution to original evidence. Matched evidence substitutions further show that the effect of replacing one source's evidence depends on support from the other. These findings motivate coordinating dialogue memory and document retrieval to apply current user requirements and document facts together while preserving their original support. The data are available at this https URL.
199. 【2611.00726】Constructing Budgeted KGW Evasion through Token-Event Evidence Replacement
链接：https://arxiv.org/abs/2611.00726
作者：Hongliang Liu
类目：Computation and Language (cs.CL); Cryptography and Security (cs.CR)
关键词：watermarks bias sampling, accumulate keyed detection, KGW watermarks bias, keyed detection evidence, watermarks bias
备注：
点击查看摘要
Abstract:KGW watermarks bias sampling to accumulate keyed detection evidence. We construct budgeted evasion through token-event evidence replacement using ordinary phrase rewrites. Our construction jointly selects compositions of LLM-proposed alternatives from an independent model and measures global token-edit distance on complete outputs. At the largest attainable cost within the budget, exact coverage search maximizes removal of original scored token pairs. It uses a known tokenizer without the key, detector feedback or queries to the watermarked model. Exact accounting separates source evidence removed, evidence created and length effects, with initial strength setting the required reduction. Separate signed-event analysis found that mean suppression arose mainly from removing watermark-enriched source events. In controlled, occurrence-counted, one-token-context KGW tests on short passages, 39 of 82 qualified, initially detected sources yielded rewrites with terminal detector score Z 4 that passed blinded source-relative model review, at a mean actual token-edit cost of 16.0% under a 20% allowance. To examine whether this initial requirement can be inferred, a separate historical 95-passage study estimated initial detector score Z0 from generation traces with correlation 0.793 and an in-sample association beyond length. This aggregate information did not establish improved allocation, and the separate no-trace stopping test did not reliably exploit cheaper reviewed crossings in the candidate bank. Comparisons did not establish an advantage over simpler selection and ordinary constrained rewriting. The construction makes budgeted evidence replacement executable while exposing limits in signed reduction and recognition of sufficient editing.
200. 【2611.00672】Precedent Labels and Facts Shift LLM Approval Decisions in Opposite Directions
链接：https://arxiv.org/abs/2611.00672
作者：Junwei Yao,Zike Yang,Yongxi Zhou,Yanxian Chen,Jianan Liu,Jiaxi Wen,Zhijun Wang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：past cases, past, language model decides, model decides refund, cases
备注：
点击查看摘要
Abstract:When a language model decides refund or claim requests under written policies, the system can show it similar past cases. Each past case has two parts: its facts and the decision recorded for it. We separate the two. A model sees a policy, a request and three past cases, and we change either the recorded decisions or the facts, keeping the request fixed. We select requests that are close calls: deciding without past cases, DeepSeek V4.1 Flash approved each in some of four tries and denied it in others. When the past cases are near-copies of the request (its facts with a few details changed), switching their recorded decisions from DENY to APPROVE raises approval by about 30 to 55 percentage points in DeepSeek V4.1 Flash, GPT-5.6 Luna and Claude Haiku 5.5 on policies written for the study, and DeepSeek and Luna show the same on nine public policies paraphrased from real ones. The facts push the other way: shown without their recorded decisions, past cases whose facts support approval make these two models approve less often than past cases whose facts support denial. One reading is that the request looks weaker next to them. This push is not just a correction toward the right answer: in an additional DeepSeek analysis, it was of similar estimated size on requests that human annotators judged approvable and on those they judged deniable. In a separate DeepSeek run on the public policies, when the past cases are near-copies of a different request, switching their decisions moves approval by 9 points instead of 43, while facts that support approval still lower it by 22 points against facts that support denial. Systems that retrieve past decisions should test the two parts separately.
201. 【2611.00665】Audit at the Precision You Deploy: Quantization Reshapes a Subliminally Learned Preference
链接：https://arxiv.org/abs/2611.00665
作者：Md Rayhanul Masud,Mst Suraiya Akter Shefa
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：unrelated training data, seemingly unrelated training, inherit hidden preferences, training data, number sequences
备注：
点击查看摘要
Abstract:Subliminal learning allows AI models to inherit hidden preferences from seemingly unrelated training data, such as number sequences. Safety audits may evaluate models at standard 16-bit precision, while deployments may use compressed, quantized weights. We ask whether quantization changes the expression of a subliminal preference and what drives any resulting change. To investigate, we implant a "favourite animal: panda" preference into Qwen2.5-7B-Instruct. We define its net strength as the difference in mean panda-answer probability between subliminal models and neutrally trained controls under the same quantization setting. Applying this metric across different compression levels reveals a stark contrast. While behaviour remains stable at 8 bits, 4-bit quantization triggers severe, opposing shifts depending on the quantizer. Half-Quadratic Quantization (HQQ) amplifies the preference, raising the subliminally trained model's panda probability from roughly 55% at 16 bits to 64% at 4 bits, while the controls stay near 17%. This raises the trait's net strength ~1.3 times its 16-bit value. In contrast, NormalFloat (NF4) at 4-bit suppresses it, shrinking the net strength to just ~0.3 times its 16-bit value, despite producing rounding errors of the same size to within 4%. We examine the structure of the rounding errors and find that their arrangement drives the divergence. Randomly shuffling HQQ's errors within each quantization group, without changing their magnitude, shifts the trait's net strength between 0.2 and 1.6 times its 16-bit value. Despite these opposing shifts, the underlying fine-tuning signal remains largely intact. Because a model's internal state and outward behaviour diverge so unpredictably under compression, a 16-bit audit cannot reliably bound real-world risks. Safety evaluations must test the exact quantized weights intended for deployment.
202. 【2611.00650】Heirloom: Carrying a Phone's Personalization Across Base-Model Generations
链接：https://arxiv.org/abs/2611.00650
作者：Zhuomin Chen,Jingchao Ni,Qingkai Dong,Xu Zheng,Gabriel Hübner Lucchesi,Mo Sha,Wei Cheng,Dongsheng Luo
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：On-device language models, On-device language, private data, trained on private, On-device
备注： 35 pages, 12 figures, 20 tables
点击查看摘要
Abstract:On-device language models can learn a user's preferences through adapters trained on private data. However, a base-model upgrade may change the layers or vocabulary, leaving the personal adapter incompatible. Replacing it with a non-personal adapter loses much of the personalization, while retraining requires retaining the user's labeled history. We present Heirloom, a system that transfers a personal adapter to a new base model on the phone without retaining labels. Heirloom uses the old personal model as a teacher, collecting its predictions on stored unlabeled inputs, vendor-provided prompts, or prompts generated by the new base. It then unloads the old base and trains an adapter for the new model to match those predictions, keeping only one base model in memory at a time. We evaluate Heirloom across three generation upgrades from two model families, an architecture-preserving refresh, and three personalization tasks. On movie tagging, migration from stored inputs maintains pre-upgrade accuracy and differs from labeled retraining by at most 1.7 percentage points across the three upgrades. On a phone's neural processing unit (NPU), a fixed-length migration for the 4B upgrade takes 38 minutes and consumes 20% of the battery end to end, making the stored-input setting feasible during overnight charging.
203. 【2611.00638】ElectroChemLLM: A Multimodal LLM Pipeline for High-Fidelity Electrochemical Informatics
链接：https://arxiv.org/abs/2611.00638
作者：Dikshya Mohanty,Manoj Praveen Nandigama,Kuldeepsinh Raj,Sourav Kanti Maiti,Jiannan Yang,Ruiqi Luo,Srinivasa Phani Madhav Marupudi,Mounika Geriki,Prayag Raghunandan,Puneet Lingutla,Tengfei Ma,Niranjan Balasubramanian,Nav Nidhi Rajput
类目：Computation and Language (cs.CL); Databases (cs.DB); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：including energy storage, energy storage systems, advancement relies heavily, Electrochemistry is central, modern-day challenges
备注：
点击查看摘要
Abstract:Electrochemistry is central to solving many modern-day challenges, including energy storage systems for a sustainable future, and its advancement relies heavily on the data from past findings. Existing automated pipelines are limited by text-only architectures, context fragmentation, and numerical hallucinations - collectively preventing accurate, large-scale curation of property databases. We introduce ElectrochemLLM, a multimodal information extraction pipeline that jointly identifies structured electrochemical records encompassing electrolyte compositions, electrode materials, cell configurations, and their measured physicochemical properties from unstructured scientific PDFs at scale. By combining hybrid document parsing with vision-capable LLM orchestration, the pipeline extracts verifiable, structured data across text, tables, and figures. Evaluated on the battery-electrolyte subset of our manually annotated benchmark of 232 papers, ElectrochemLLM achieves an F-1 score of 0.97, and has been applied to curate ElectroChemDB, a structured database spanning 15,000 electrochemical research articles. We demonstrate the utility of this resource by training machine learning models for electrolyte property prediction, illustrating a complete pathway from unstructured literature to predictive materials discovery.
204. 【2611.00616】Enhancing Language Model Reasoning with Structured Multi-Level Modeling
链接：https://arxiv.org/abs/2611.00616
作者：Siheng Xiong,Ali Payani,Faramarz Fekri
类目：Computation and Language (cs.CL)
关键词：Inference-time scaling enhances, Inference-time scaling, scaling enhances, Inference-time, reasoning
备注： ICLR 2026
点击查看摘要
Abstract:Inference-time scaling enhances a model's reasoning by extending its chain-of-thought (CoT). However, existing approaches typically rely on a single policy trained with outcome-reward reinforcement learning (RL), which often suffers from long-horizon plan failures where the implicit plan drifts from valid strategies, especially for small LMs with limited capacity. To address this, we propose Multi-Level Reasoning (MLR), which reformulates long-CoT generation as a two-level stochastic process. A high-level planner generates structured step descriptors specifying both the reasoning mode and the semantic subgoal. The low-level executor then produces detailed reasoning conditioned on these descriptors, forming an alternating plan--execute loop. To maintain scalability, we adopt a minimal design where the base model serves as the low-level policy and a lightweight LoRA module implements the high-level policy. For training, we observe that outcome-reward RL provides sparse and delayed feedback for long trajectories (e.g., several thousand tokens), hindering credit assignment. We therefore introduce iterative Step-DPO, a process-level preference optimization scheme that leverages Twisted Sequential Monte Carlo (TSMC) to provide scalable stepwise supervision. This yields more effective training, improved stability, and higher accuracy. Extensive experiments on challenging math, science, and logical reasoning benchmarks show that, under the same reduced data budget (10% SFT and 5% preference relative to the DeepSeek-R1 distillation setup), MLR outperforms both SFT-based distillation and strong RL/preference-optimization baselines across multiple base models and tasks. Moreover, MLR exhibits slower performance degradation on long-horizon reasoning, demonstrating stronger robustness under extended CoT generation.
205. 【2611.00606】Sparse Autoencoder Attribution Graphs Are Decided at the Margin
链接：https://arxiv.org/abs/2611.00606
作者：Karl Li
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Attribution graphs, TopK SAE, compared across training, public TopK SAE, TopK SAE pairs
备注： 34 pages, 8 figures
点击查看摘要
Abstract:Attribution graphs over the features of sparse autoencoders (SAEs) are used to predict what an ablation does and are compared across training seeds. A TopK SAE keeps the largest preactivations at each token, and a feature's margin is its preactivation's distance to the cutoff. On five public TopK SAE pairs from three Pythia models, zeroing one feature moves a next layer feature across the cutoff in 0.74 of cases or more, and the crossings carry most of the response's energy. Over writes that scale a feature's code by three factors, the graph built on the features active beforehand has a median relative error of 0.247 or more. The margin graph adds the first order change to every preactivation and reranks, at the same cost, and errs by at most 0.033. At the median, the crossing features' decoded change is 1.24 times the model's own change in norm or more. Between seeds of one testbed, sparse maps between features explain 0.85 of a graph's energy on its active features, and 0.47 once the other seed's graph keeps only its own. The largest model studied is pythia-160m.
206. 【2611.00597】Multi-Estimate Elicitation Does Not Uniformly Debias Language Model Judgments
链接：https://arxiv.org/abs/2611.00597
作者：An-Sheng Jhang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：single response change, language model responds, responds to information, eliciting five weighted, single response
备注： 47 pages, 3 figures
点击查看摘要
Abstract:Does eliciting five weighted estimates within a single response change how a language model responds to information? Across anchoring, hindsight, base-rate, conjunction, and status-quo/default tasks, we compare direct numerical answers with a multi-estimate response format, contrasting source framings, explicitly random cues, and probability-consistency constraints. We evaluate three completed configurations--gpt-6.1-sol, claude-sonnet-5.5, and Qwen3-8B (reasoning disabled, analyzed descriptively). In the first two configurations, direct elicitation yielded near-zero irrelevant-anchor indices and status-quo effects, while remaining responsive to informative sources and informed advice. Of 23 preregistered confirmatory tests, six rejected after Holm adjustment; however, all six absolute point estimates fell below their prespecified smallest effect sizes of interest without establishing equivalence. Moreover, while separate versus joint elicitation shifted conjunction judgments, interpretation is constrained by between-call noise. Ultimately, multi-estimate elicitation failed to produce uniform debiasing or response attenuation across tasks and models, though post hoc correlations between candidate spread and anchoring error motivate independent predictive validation. Materials: this https URL
207. 【2611.00592】Saidzoda-Tajik-E5-Large: Fine-Tuning a 560M Embedder for Tajik Retrieval
链接：https://arxiv.org/abs/2611.00592
作者：Tohir Saidzoda,Nekruz Maxudov,Bedil Karimov,Abubakr Abdullozoda,Amin Jalilov,Jonibek Kishvarov,Rahmonali Sharipov,Mariyamkhon Shodyeva
类目：Computation and Language (cs.CL)
关键词：practical systems built, Tajik, practical systems, found no openly, Tajik text embedder
备注： 10 pages, 5 tables, 1 figure. Technical report. Model: [this https URL](https://huggingface.co/Tohirju/Saidzoda-Tajik-E5-Large)
点击查看摘要
Abstract:Finding the passage that answers a question is the first step of most practical systems built on documents, and for Tajik we found no openly described model for it. We present Saidzoda-Tajik-E5-Large, a Tajik text embedder built from multilingual-e5-large-instruct (560M parameters). We asked our own Tajik language model to write questions for passages from Tajik laws, tax documents, Wikipedia and web text, and trained on 235,140 question and passage pairs for one epoch, with hard negatives chosen by another embedder and English and Russian pairs mixed in so the model would not forget those languages. On laws the model had never seen, the right passage is among the top ten results for 93.6% of questions, up from 80.2%; on tax documents, 94.5% against 82.6%. On Belebele, the one test we have that was written by people, the gain is smaller and not confirmed (92.2% to 95.2%, with touching intervals), and Russian and English do not change. On law and tax questions written in the same style as its training questions, it is tied with Giga-Embeddings-3B, a model five times its size; on Belebele the 3B and 8B models score slightly higher, and only after we fine-tuned them on our data are they clearly ahead. We also report what failed: training in bfloat16 broke the model, and replacing Tajik letters with similar Russian ones did not help. Our law, tax and Wikipedia test questions come from the same model that wrote the training questions, so we treat those scores as an upper limit until questions written by Tajik speakers are available.
208. 【2611.00588】VP: TV is Almost All You Need for Speculative Decoding
链接：https://arxiv.org/abs/2611.00588
作者：Aaryam Sharma
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：accelerates LLM inference, decoding accelerates LLM, Speculative decoding accelerates, accelerates LLM, LLM inference
备注： 25 pages, 2 figures, 14 tables
点击查看摘要
Abstract:Speculative decoding accelerates LLM inference with a drafter whose proposed tokens are verified by the target model in parallel. Under lossless speculative sampling, a draft token is accepted with probability one minus the total variation (TV) distance between the target and draft distributions, yet drafters are often trained with cross-entropy (CE) or KL. We first show that under matched and well-tuned training, TV matches or surpasses several published draft-training objectives when fine-tuning, and a fixed TV and KL mixture does the same when training from scratch. We identify two remaining problems, TV's vanishing gradients on undercovered tokens and the prefix products that starve later positions in acceptance-length objectives. To address both, we derive TVP, a loss family based on expected acceptance length, whose power parameter interpolates between coverage and acceptance oriented objectives. Annealing the power from zero to one gives the highest or tied-highest acceptance length across three drafter architectures and three target models, including longer drafts and block verification. TVP improves acceptance length over CE by 9.8% when fine-tuning, and over the public DFlash2 training recipes by 6.2 to 12.9%.
209. 【2611.00585】Conic Certification of Transformer Attention
链接：https://arxiv.org/abs/2611.00585
作者：Masoud Ataei
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Optimization and Control (math.OC)
关键词：large language models, input perturbations give, attention head output, core of large, large language
备注： 56 pages, 5 figures, 6 tables. Code and data: [this https URL](https://github.com/chimera1001/conic-attention-cert)
点击查看摘要
Abstract:Attention is the computational core of large language models, yet the verifiers that bound how far an attention head's output can move under input perturbations give no guarantee on how loose their bounds are. A weak certificate therefore cannot be told apart from a fragile model. We develop a conic programming theory of attention certification that supplies this guarantee. We prove that the difficulty lies not in the softmax but in the bilinear interaction of a varying query with the keys. This interaction makes certification NP-hard over boxes and inapproximable once the attention logits can move by a constant amount. A fixed query or listed token substitutions, by contrast, make the exact worst case efficiently computable. An exponential cone moment relaxation then certifies a head with an error bounded quadratically in the perturbation radius by computable quantities, an order that cannot be improved. We also show that relaxations that treat a network one operation at a time, linear bound propagation among them, pay on second-order terms a sum of per-operation maxima instead of one coupled maximum. Computational results on GPT-2 indicate that the theory carries over to a trained model. Against exact worst cases with the query fixed, the certificate attains the predicted second-order accuracy. It is tighter than linear bound propagation on every head, and the looseness of bound propagation tracks the predicted per-operation excess.
210. 【2611.00579】From Apparent Search Gains to Selection Failures: Auditing Test-Time Inference in Structured Workflow Planning
链接：https://arxiv.org/abs/2611.00579
作者：Zhitong Chen,Weifeng Zhang,Kai Yin,Zhiyuan Wang,Ali Mostafavi,James Caverlee
类目：Computation and Language (cs.CL)
关键词：improve structured planning, Test-time search, structured planning, improve structured, methods differ
备注： 37 pages. Code and reproducibility artifacts: [this https URL](https://github.com/TamuChen18/Found-but-Not-Chosen)
点击查看摘要
Abstract:Test-time search can improve structured planning, but when methods differ in prompts, post-processing, and selection, it is unclear what an observed gain should be attributed to. We study this question on DisasterBench, where models compose typed multi-tool workflows, by decomposing inference into three observable stages: whether a correct workflow is discovered, whether it survives structural validation, and whether it is finally selected. Comparing independent sampling, a nominal tree-search configuration, and multi-operator search under controlled inference budgets on two model families, we find that (i) the nominal tree-search configuration realizes non-adaptive complete-workflow sampling, and independent sampling with its expansion prompt reproduces its candidate discovery without constructing a tree; (ii) structural validation never removes the last correct workflow in our evaluated candidate pools, whereas majority voting leaves a discovered correct workflow unselected on 10-19% of tasks per pool, with an audit confirming substantive tool-choice or information-flow errors in 57 of 60 examined cases; and (iii) a tool-specification-aware verifier recovers some of these losses but overturns more correct decisions than it fixes. Our results motivate auditing realized rather than nominal inference pipelines, and reporting discovery, validity, and selection separately.
211. 【2611.00555】Distinguishing among reasoning levels of GPT 5.5 Pro via a grammar lens benchmark
链接：https://arxiv.org/abs/2611.00555
作者：Emma Graham,Richard Granger
类目：Computation and Language (cs.CL)
关键词：model computational capability, processing effort affect, computational capability, language model computational, test-time processing effort
备注：
点击查看摘要
Abstract:Does the level of test-time processing effort affect a language model's computational capability? A formal grammar-lens benchmark method, derived from the theory of computation, generates novel data at specified levels, each successively more computationally powerful than the levels below. Using this data, we tested GPT-5.5, and GPT-5.5-Pro-Medium, -High, and -XHigh, showing incrementally increased acceptance of test data: 16, 40, 43, and 52\%, respectively, illustrating the benchmark's ability to discern fine-grained differences among models' added test-time reasoning levels. Additionally, as test-time compute effort increases, model responses diverge from human responses to the same data. This increasing disagreement may turn out to be broadly characteristic of more capable language models, introducing the potential of a general capability-versus-alignment conflict.
212. 【2611.00544】Skill++: Towards Lifelong Agents via Routing-Aware Skill Refinement
链接：https://arxiv.org/abs/2611.00544
作者：Hanrong Zhang,Minghao Liang,Jiawei Wu,Yankai Chen,Shicheng Fan,Zhiwei Liu,Enze Ma,Junwei Yuan,Tianyi Wang,Dehai Min,Kening Zheng,Xue Liu,Philip S. Yu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large language model, Large language, LLM, language model, skills
备注：
点击查看摘要
Abstract:Large language model (LLM) agents extend their capabilities with skills, each with a name, a description, and a body. Under progressive disclosure, an LLM router selects skills by name and description alone and loads only the selected bodies. Skill libraries grow continually as users and agents add new skills. Because the router relies on this metadata, a similar new skill can displace an earlier one, breaking previously correct routing even though the earlier skill and the router are unchanged. This routing interference is aggravated for public skills, whose descriptions may not match their bodies. We formulate the problem as lifelong skill routing, a class-incremental continual learning problem. A solution must keep earlier skills selectable without suppressing new ones. Existing approaches fall short, since continually retraining the router risks catastrophic forgetting and rewriting methods either ignore similar skills or require per-skill feedback. We therefore propose Skill++, which rewrites only the name and description of each incoming skill, without router training or labeled data. The new description states what the body supports, how the skill differs from its closest predecessor, and what related work it excludes. As a library grows to 731 skills over ten sessions, Skill++ selects all required skills for 76.3% of queries, versus 36.4% under the original metadata. Across three benchmarks and five LLM routers, it outperforms all compared approaches, and its gains carry over to the Codex CLI agent harness.
213. 【2611.00536】Dual-Axis Policy Entailment: A Benchmark for Policy-Change Reasoning
链接：https://arxiv.org/abs/2611.00536
作者：Charles Chang(Duke Kunshan University),Yuen Yuen Ang(Johns Hopkins University),Bolun Sun(Northwestern University)
类目：Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：reverses previous policy, policy shifts domains, policy, paramount importance, study of public
备注： 36 pages, 7 figures
点击查看摘要
Abstract:Whether a policy shifts domains and, by extension, continues, broadens, narrows, or reverses previous policy is of paramount importance to the study of public policy. We propose Dual-Axis Policy Entailment (DAPE), which evaluates an ordered pair of policy directives on both dimensions at once: a binary judgment determines whether the two directives govern the same policy domain, and a five-way judgment determines whether the later directive continues, broadens, narrows, or reverses the earlier policy, or governs a different domain altogether. Read together, the two judgments form one five-category label, our primary metric. The two-axis design captures two central dimensions of policy change without conflating errors on either dimension into a generic "irrelevant" label, and it makes annotation more rigorous: a coder cannot dismiss a difficult pair as domain-irrelevant without an explicit, checkable decision. We introduce an expert-annotated benchmark of 1,000 ordered directive pairs drawn from a large corpus of Chinese government policy, together with an annotation-calibration protocol (an adjudication packet with pre/post agreement measurement) that we contribute as a methodological artifact. Fourteen open-weight models and four frontier API flagships fail the task zero-shot: even the best frontier flagship's chance-corrected agreement with expert labels is far below the human ceiling (Cohen's $\kappa \approx 0.29$ vs. $0.53$). A fine-tuned open-weight model (LoRA SFT of Qwen3-14B, five-fold cross-validation) closes this gap, reaching the coder-mutual human ceiling ($\kappa = 0.524$ vs. $0.527$). Finally, we apply our method to China's AI policy (1980-2024) and map the direction of policy change across eras.
214. 【2611.00530】WeSearch: A Unified Model-Centric Retrieval Framework for WeChat Search
链接：https://arxiv.org/abs/2611.00530
作者：Kepu Zhang,Yuzhe Cai,Yue Shu,Dawei Chen,Jinhai Zhu,Yuan Xu,Zehua Dai,Tongke Ni,Ziyao Chen,Chen Fu,Jie Shao,Chao Wang,Xiangmin Wang,Ruifeng Zhao,Rongchun Yao,Jie Yin,Weixin Qiu,Nan Song,Junyang Li,Fan Li,Quanchao Hui,Yulong Ou,Qiang Chen,Hao Cao,Sen Yang
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：continuously evolving content, evolving content search, model-centric retrieval framework, framework for large-scale, continuously evolving
备注：
点击查看摘要
Abstract:We present WeSearch, a unified, model-centric retrieval framework for large-scale, continuously evolving content search. Prevailing methods assign documents fixed hierarchical Semantic IDs, implicitly assuming each document follows a single coherent semantic path-an assumption that often breaks down for multi-topic documents. WeSearch instead retrieves query-relevant clusters and then ranks atomic documents within the resulting query-specific candidate space, decoupling candidate pruning from fine-grained relevance modeling. Combined with relevance-aware training, compact document representations, and incremental index updates, this design enables weekly-or daily when needed-model refreshes. Deployed as the primary semantic retrieval path in WeChat Search alongside a lexical syntax tree, WeSearch shows consistent one-week A/B gains on corpora from hundreds of millions to billions of documents, and a one-month full-traffic A/B test confirms stable improvements of +0.68% CTR and +2.27% per-user article clicks, together with a 41% reduction in retrieval resource cost and a 19 ms reduction in graphic-text retrieval latency. WeSearch is now fully deployed in WeChat Search, serving 100% of production traffic.
215. 【2611.00518】Agentic Context Management for Multi-Turn Human-AI Conversations
链接：https://arxiv.org/abs/2611.00518
作者：Matthew Ho,Chenglong Wang,Baolin Peng,Nebojsa Jojic,Philippe Laban,Michel Galley,Jianfeng Gao,Lianhui Qin
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：multi-turn conversation partly, earlier outputs stay, Conversation Context Curation, Agentic Conversation Context, degrade in multi-turn
备注：
点击查看摘要
Abstract:LLMs degrade in multi-turn conversation partly because of context pollution: the model's own earlier outputs stay in context and anchor later turns, so an early misreading of the user's intent can persist after the user corrects it. Assistant omission (AO), dropping every assistant message, removes this pollution but fails when interaction is referential: later turns refer back to drafts, decisions, and tool-call results that exist only in assistant turns. We propose Agentic Conversation Context Curation (AC3), a training-free method in which a separate analyzer (1) consolidates the task specification from the user's messages alone, (2) audits the assistant's prior outputs against it, and (3) edits the context, either appending the analysis or discarding the assistant side and rebuilding the context from the specification. A second finding: pollution is contagious. An analyzer that sees the assistant's reasoning while extracting the specification can do worse than no intervention, and instructing it to ignore them did not close the gap, so we exclude assistant turns structurally. On Lost in Conversation (replaying difficulty-selected instances), where AO is an oracle by construction, AC3 closes 55-84% of the gap between full context and AO on three of four tasks and exceeds AO on the fourth, and an LLM that faithfully summarizes the history does not reproduce the gain even with more compute. On real WildChat conversations, a GPT-5-mini judge prefers AC3's next turn over both full context and AO in every configuration of our main table, though this preference depends on the judge; on CollabLLM results are mixed. In stateful tool use (tau2-bench), AO collapses to 0% on every model; AC3 does not collapse, though it falls slightly behind full context. Detector studies show that Reset removes injected pollution but is not span-selective: the gain comes from rebuilding the specification.
216. 【2611.00515】AStockArena: Beyond Returns, Can We Entrust Real Capital to the Decisions of Financial Agents?
链接：https://arxiv.org/abs/2611.00515
作者：Zeyu Liu,Sing Kwong Lai,Xuanzhi Feng,HaoYang Shang,Yang Li,Zihao Fang,Xuan Liu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language models, Large language, risk-adjusted performance, cumulative returns, returns and risk-adjusted
备注：
点击查看摘要
Abstract:Large language models (LLMs) are increasingly used in dynamic financial trading, yet real-time trading benchmarks mainly evaluate agents by cumulative returns and risk-adjusted performance. Such outcome metrics cannot show whether trades are faithfully reported, supported by available evidence, and consistent with account states. We introduce AStockArena, a real-time decision-auditing benchmark for continuous trading in China's A-share market. Under shared market conditions and execution constraints, we evaluate 13 open- and closed-source models over 3,198 sequential decisions. AStockArena reconstructsthe actions actually posted to accounts by aligning reports, trade requests, execution responses, and account states, and audits them with eight checks spanning execution traceability (O), evidence sufficiency (RK), and financial meta-awareness (B), combining record verification with consensus expert annotation. Of 1,070 trading points, 72.99% exhibit at least one audit gap; model-level rates range from52.2% to 91.2%, with evidence gaps most prevalent. Historical trade-filtering replay further shows thatportfolio outcomes are sensitive to these flagged trades. Decision-process auditing thus offers a verifiable complement to return-based evaluation of financial agents.
217. 【2611.00504】Robustness Starts with the Objective: Designing and Certifying Robust LLM-Generated Heuristics
链接：https://arxiv.org/abs/2611.00504
作者：Pantea Karimi,Roozbeh Bostandoost,Dany Rouhana,Siva Kesava Reddy Kakarla,Pooria Namyar,Mohammad Alizadeh,Venkat Arun,Behnaz Arzani
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC); Performance (cs.PF)
关键词：computer systems, average performance, severe regressions, mask severe regressions, TAILOR
备注：
点击查看摘要
Abstract:LLMs are increasingly used to design heuristics for computer systems. However, most synthesis frameworks evaluate candidates by their average performance, which can mask severe regressions on specific workloads. Even adding adversarial training inputs doesn't eliminate these regressions, and percentile objectives (e.g., optimizing for the 95th percentile) overlook how severe regressions can be beyond the selected threshold. We present TAILOR, a framework that guides LLM synthesis using the Conditional Value at Risk (CVaR) of the cost difference between each candidate and an existing baseline on the same workload. This paired CVaR measures the average difference over the worst fraction of workloads. We show that a negative paired CVaR guarantees improvements in both average performance and tail optimality gap relative to the unknown optimum, without ever computing that optimum. We find that TAILOR achieves the best mean--tail trade-off among the synthesis objectives we evaluate across three case studies: Azure GPU batch admission, Azure VM packing, and server placement. Tested across seven diverse optimization benchmarks, TAILOR produces heuristics that are certified with 99% confidence to improve both average performance and tail optimality gaps over the baseline in six of them. On these six benchmarks, TAILOR also outperforms known robust, human-designed alternatives in the tail while achieving better or comparable average-performance improvement over the baseline.
Subjects:
Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC); Performance (cs.PF)
Cite as:
arXiv:2611.00504 [cs.AI]
(or
arXiv:2611.00504v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2611.00504
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
218. 【2611.00496】Swap, Replicate, Read the Mass: A Protocol for Auditing Demographic Bias in System One Decision Models
链接：https://arxiv.org/abs/2611.00496
作者：Alejandro Mozo Quesada(1),Sergio Gálvez Rojas(1),Francisco López Valverde(1) ((1) Universidad de Málaga, Spain)
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：replace text generation, models replace text, entering production, decision models replace, replace text
备注：
点击查看摘要
Abstract:System One decision models replace text generation with typed, probability-scored answers and are entering production. Answers execute without a person in the loop, and no multi-model audit exists on established bias benchmarks. We provide that audit: three benchmarks: BBQ (all eleven categories), CrowS-Pairs, and SilverSpoon, adapted to the typed interface, twelve models plus a no-thinking ablation, and 1,638,000 decisions. Every order-sensitive item runs twice with options swapped; native typed models also swap labels; ten configurations repeat under extra seeds and batch 16. We find widespread stereotype alignment, order-dependent answers, and confidence that tracks instability rather than bias. In BBQ, 97 of 143 model-by-category scores are significant and 94 aligned, while the commercial reference abstains on 99.5% of ambiguous items, hiding aligned probability mass. Option swaps flip 0.0% to 72.6% of choices; typed scoring stays below 10% except Laya (22-33%), and untuned letter prompting reaches 73%. CrowS-Pairs preference spans 0.496 to 0.816, and boolean answers can be decided by position (1.00 versus 0.005). SilverSpoon judgments shift toward lower-SES labels in five of eight decision models, inherited from the 9B backbone or induced by tuning. Audits must permute options and reverse questions by default; order-invariant scoring should become a procurement requirement.
219. 【2611.00492】Spotting the Artificial: Dialogic Humor Improvisation in Humans and LLMs
链接：https://arxiv.org/abs/2611.00492
作者：Lizeth Palacios Patiño,Ximena Gutierrez-Vasques,Daniel Rodriguez
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：humorous improvisational dialogue, propose a methodology, methodology for investigating, investigating the differences, differences between natural
备注：
点击查看摘要
Abstract:We propose a methodology for investigating the differences between natural and synthetic language in a challenging setting: humorous improvisational dialogue. Our experimental setting compares human-produced comedy improvisations with the dialogues generated by LLMs in a multi-agent environment that we designed. The analysis combines automated linguistic measures with manual annotation grounded in Systemic Functional Linguistics (SFL). The results show that, although LLMs can create coherent and creative scenes, they often fail to reproduce key characteristics of spontaneous spoken interaction. In addition, LLM-generated interactions display a strong tendency toward politeness and positive evaluations, contrasting with the broader range of attitudes found in human humorous improvisation. Our evidence highlights both the strengths and limitations of current LLMs in modeling dialogic humor and demonstrate the value of integrating linguistic theory with NLP methods for the analysis of machine-generated language
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2611.00492 [cs.CL]
(or
arXiv:2611.00492v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2611.00492
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Journalreference:
Springer Nature Link. MICAI 2026, CCIS,Part I proceeding
220. 【2611.00469】Steering Readerly Dynamics: Trajectory-Guided Story Generation with Large Language Models
链接：https://arxiv.org/abs/2611.00469
作者：Danrui Li,Yiwei Zhao,Mubbasir Kapadia,Lingxiao Li
类目：Computation and Language (cs.CL)
关键词：Large language models, shape narrative experience, reproduce engaging readerly, Large language, engaging readerly dynamics
备注： 55 pages, 20 figures, 18 tables, including references and the appendix
点击查看摘要
Abstract:Large language models (LLMs) are increasingly used to generate stories, but these stories struggle to reproduce engaging readerly dynamics, the evolving reader responses that shape narrative experience. To address this challenge, we propose a framework that learns readerly dynamics from high-quality human-written stories and uses them to guide story generation. Instead of directly modeling high-dimensional story content, we train a small LLM to predict future reader responses as low-dimensional trajectories. We then leverage the strong instruction-following capability of a larger, off-the-shelf writer LLM to generate story segments that follow these predicted trajectories within a given story setting. Our framework improves trajectory-based fidelity to human-written stories by 12%-35% while largely preserving story coherence.
221. 【2611.00460】From Small to Large: Assessing Medical Reasoning, Benchmark Contamination, and Model Size in Language Models
链接：https://arxiv.org/abs/2611.00460
作者：Navapat Nananukul,Mayank Kejriwal
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large language models, reflect clinical competence, scores reflect clinical, Large language, multiple-choice versus open-ended
备注：
点击查看摘要
Abstract:Large language models (LLMs) now answer medical exam questions at or above expert level, but it is unclear whether such scores reflect clinical competence, or are instead affected by the format of the questions being asked (e.g., multiple-choice versus open-ended), prior exposure to the benchmarks, and the difficulty of the questions. These benchmarks are also public and widely used online, which may be resulting in LLM memorization. Models may perform better on questions that they have seen before. It is also not evident whether smaller models, which are more locally deployable in HIPAA-compliant hospital settings, have achieved human performance. In this study, we evaluate fourteen current models from six leading providers, one smaller and one larger model from each provider with two additional open-weight models, on 3,076 questions from four medical benchmarks (MedQA-USMLE, MedMCQA, PubMedQA, and MedBullets) under standard multiple choice, the same questions with the answer choices withheld, and reconstruction of a hidden question from its choices alone. In the standard multiple-choice setting, the strongest models exceed the human-expert baseline on MedQA-USMLE and PubMedQA, but the smaller models trail their larger models by 8.7 percentage points and only two of the six pass the human-expert bar on the licensing examination. Withholding the answer choices, however, makes every model struggle: mean accuracy falls from 82.3% to 50.9%, and the two largest drops belong to the medically specialised models. On memorization, the strongest models reconstruct one question in four from the answer choices alone, yet accuracy holds on the questions they cannot reconstruct. We further weigh accuracy against inference cost and test whether ensembling several models improves medical question answering.
222. 【2611.00450】From Lookups to Lessons: Turning Retrieved Knowledge into Parametric Memory
链接：https://arxiv.org/abs/2611.00450
作者：Changjiang Han,Bowei He,Ye Yuan,Weixu Zhang,Haolun Wu,Xue Liu,Jikun Kang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Retrieval-augmented generation, large language models, inference costs, parametric memory, large language
备注： 16 pages, 4 figures, 6 tables
点击查看摘要
Abstract:Retrieval-augmented generation (RAG) helps large language models (LLMs) answer factual questions beyond their training data, but it adds storage and inference costs. Distilling previously retrieved information into parametric memories enables reuse without online retrieval. However, training the memory to mimic a retriever rewards accurate independent predictions, which do not necessarily improve the final output quality when combined with the LLM's existing predictions. To address this, we introduce ResMem, in which the LLM reads retrieved text offline to generate teacher targets. This design avoids storing massive token representations, unlike existing parametric memory approaches such as MLP Memory, which relies on k-nearest neighbor (kNN) datastores. Furthermore, by using the LLM as an offline teacher that reads privileged retrieved evidence alongside the input, we train a parametric memory to learn an additive logit residual. This residual aligns the predictions of a student sharing the same backbone with the teacher distribution, while self-distillation updates remain confined to the parametric memory. On a Wikipedia subset, ResMem reduces the storage retained for teacher construction by 94.7% compared with the evaluated kNN pipeline. Across five question answering datasets, ResMem raises mean token F1 from 32.83% for the frozen LLM to 34.48%. It also breaks 21% fewer of the LLM's correct answers than a kNN-trained memory. These findings validate our motivation of treating retrieval as a learning resource, with parametric memory shaped by how retrieved knowledge is used to inform the model's future predictions. Code and model weights are available at this https URL and this https URL.
223. 【2611.00447】Quantiles, Not Points: Streaming Quantile Matching for Ordinal-Aware LLM-as-a-Judge Calibration
链接：https://arxiv.org/abs/2611.00447
作者：Ilija Subasic,Andrew Rabinovich,Zhao Chen
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：small labeled anchor, labeled anchor set, distributionally shifted, small labeled, mapping LLM
备注： 17 pages, 6 figures
点击查看摘要
Abstract:LLM-as-a-judge scores are often distributionally shifted from human ratings on any given evaluation task, and post-hoc calibration (mapping LLM to human scores in a small labeled anchor set) has become a popular method to correct for this shift. In this paper we derive the calibration from two positions: that LLMaJ scores are ordinal ratings drawn from a distribution rather than isolated points. We present streaming quantile matching (SQM), a version of a classical method not previously bench marked for LLMaJ calibration, which is built on the two positions by computing the optimal-transport map between the LLM and human score distributions. We develop an evaluation framework and within it we show that unlike point-wise calibrations, SQM respects the ordinality of the human anchor set and achieves the best distributional fidelity and the top overall rank across models and data. We also show that in general, post-hoc calibration narrows the raw error gap between smaller and larger judge models, which opens the possibility of more efficient LLM judges.
224. 【2611.00442】Fidelity Collapses with Table Size, Not Turn Count: Delivery Architecture in a Deployed Tool-Using Agent
链接：https://arxiv.org/abs/2611.00442
作者：Tung Thanh Hoang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：tool computed correctly, tool structured records, multi-turn agent delivers, computed correctly, tool structured
备注： Non-archival paper at the Second Workshop for Research on Agent Language Models (REALM) at EMNLP 2026. 21 pages, 5 figures
点击查看摘要
Abstract:When a multi-turn agent delivers a tool's structured records into the model's context and re-emits them each turn, every turn can corrupt data the tool computed correctly. We measure this in a production award-travel agent: two architectures over identical frozen payloads, lineage-matched prompts and sampling, differing only in delivery architecture. SYNTHESIS feeds full record sets into the planner's context and answers follow-ups in-head; BYPASS, the deployed system, keeps records in session state, translates follow-ups into arguments for a deterministic filter, and delivers rows over a typed side channel. Across 24 dialogues (339 scored turns per condition), BYPASS scores 92.3% of turns fully correct, SYNTHESIS 45.7% (paired gap +46.6pp [+35.7, +57.1]). Varying delivered-table size by capture date, SYNTHESIS collapses from near-perfect at 10 rows or fewer to 8% or less beyond about 74 rows. On a content-controlled prefix ladder the collapse threshold orders by model capability, from under 10 rows (GPT-4o-mini) to about 198 or more (Gemini 2.5 Pro), while BYPASS stays size-flat for all four models. The collapse is expensive: beyond 100 rows, where almost no SYNTHESIS answer is correct, each correct one costs roughly 200x BYPASS's flat \$0.012. Practitioners converged on typed side-channel delivery for rendering, not correctness; we show it was, unknowingly, also a correctness decision.
225. 【2611.00428】Do Multimodal Models Decide Consistently on Equivalent Optical Spectra?
链接：https://arxiv.org/abs/2611.00428
作者：Ziyuan Wang,Genliang Zhu,Xiaobo Chen
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Optics (physics.optics)
关键词：data, model, photon energy, models, spectra remove data
备注： 20 pages, 4 figures, 11 tables. Code and data: [this https URL](https://github.com/zwang-devv/spectra-decision-audit)
点击查看摘要
Abstract:A spectrum can be given to a model as a table in nanometers or as a plot in photon energy, and the decision should not depend on which one it sees. When the data needed for an answer are missing, the model should say so. We test representation invariance and abstention on measured optical spectra of silicon metasurfaces (MOCLIP) and gold nanoparticles, with labels computed from the data. Each spectrum is shown as four tables (nm, $\mu$m, scientific notation, eV) and two plots (nm, eV), and partial spectra remove data inside or outside the queried range. We evaluate the decision models d3-nano and Jev 1.13, three GPT-6 Luna configurations and the Qwen3.5-2B base model. Changing only the representation moves accuracy by up to 41 percentage points within one model, mostly on photon-energy tables and plots. With the same evidence, asking in photon energy instead of wavelength helps some model-view pairs by 16-50 points and hurts others by up to 25. When the relevant extremum is removed, unadapted models rarely answer "undetermined". LoRA fine-tuning of d3-nano improves comparisons on the trained table formats, but much of its gain on unanswerable questions comes from a shortcut: it abstains whenever the input is truncated. Training with answerable truncations avoids the shortcut in all six seeds, with a 90-100 point gap between abstention after inside and outside cuts on held-out structures; with the same amount of extra original-task data, five of six seeds keep the shortcut. On gold spectra the two training sets perform similarly. Multimodal language models used for scientific decisions should be tested on equivalent representations and on missing evidence, not only on average accuracy. We release the tasks, per-response results and analysis code.
226. 【2611.00420】Circuit Oracle: Automating Attribution Graph Analysis via Natural-Language Queries
链接：https://arxiv.org/abs/2611.00420
作者：Shariar Kabir,Hong Kiat Tan,Swastik Agrawal,Sai V R Chereddy,Sriram Balasubramanian
类目：Computation and Language (cs.CL)
关键词：decompose language model, language model computations, sparse interpretable features, interpretable features connected, mechanistic interpretability
备注： Extended version of a paper presented at the Mechanistic Interpretability and Compositional Learning workshops at ICML 2026
点击查看摘要
Abstract:Attribution graphs, an emerging tool in mechanistic interpretability, use transcoders to decompose language model computations into sparse interpretable features connected by causal edges. However, turning a graph into a safety-relevant insight requires hours of manual analysis by experts. We introduce Circuit Oracle, an off-the-shelf LLM equipped with a multi-agent harness and task-specific authored skills, which answers natural-language questions about a target model by reading the attribution graph through tool calls. We evaluate it on three safety-relevant proxy tasks: detecting spurious features in probe circuits, eliciting hidden knowledge from taboo-finetuned models, and suppression jailbreaking via feature-level interventions. Beyond task scores, the oracle produces pruned subgraphs and context-specific feature explanations that we assess qualitatively. Results are mixed. On spurious-feature detection, Circuit Oracle reaches 78.2 $\pm$ 2.4% accuracy, outperforming single-layer feature-ranking baselines. On secret elicitation, trained self-explainers like Activation Oracles remain the stronger baseline. On refusal suppression over 50 prompts, its single committed intervention is slightly below a diff-in-means baseline, and only exceeds it when allowed the best of five attempts. Results are stable across five runs and across model choices for the agents. We also release the pruned subgraphs and context-specific feature readings that revise existing global labels, and invite future work to develop evaluations that can measure their usefulness directly.
227. 【2611.00383】LF-VideoQA: Evaluating Long-Video Understanding with Long-Form Theory-of-Mind Questions
链接：https://arxiv.org/abs/2611.00383
作者：Shaden Shaar,Bradon Thymes,Majd Aldaye,Claire Cardie,Bharath Hariharan
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：hardest part, moment but synthesizing, tracking what develops, develops across hours, hours of content
备注：
点击查看摘要
Abstract:The hardest part of understanding a long video is not pinpointing any one moment but synthesizing many, e.g., answering a question that requires tracking what develops across hours of content and articulating how the pieces fit together. To date, most long-video QA datasets require only a short answer or a multiple-choice selection, oversimplifying the long-video understanding task to retrieval. We introduce LF-VideoQA, a dataset for long-form, open-ended question answering over long narrative videos built on theory-of-mind questions: a character's belief depends on everything they have seen or been told, so each question demands assembling and reasoning from evidence distributed across the video. The dataset contains more than 6,300 questions on 94 recent films; each requires reasoning over scenes spanning an average of 23 minutes and comes with a question-specific rubric for recall and precision scoring. The dataset is created entirely automatically by annotating screenplays with scene events and each character's first-order beliefs and meta-beliefs, then generating (question, answer, rubric) triples through LLM-based question generation and verification; human studies validate their quality. We evaluate four families of state-of-the-art open-source VLMs across three settings and find the task highly challenging: (i) even an oracle with access to the screenplay falls well short of complete answers; (ii) the best non-oracle model attains barely half of the recall level of the oracle; (iii) unlike on prior long-video benchmarks, captions and subtitles underperform the video itself, indicating that the questions need visual evidence; and (iv) recall is the predominant bottleneck, with answers omitting many required rubric claims.
228. 【2611.00374】Unlearning by Extrapolating a Shrink-and-Heal Lookahead
链接：https://arxiv.org/abs/2611.00374
作者：Hoang-Chau Luong,Lingwei Chen
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：language model behave, large language model, Unlearning aims, aims to make, make a large
备注：
点击查看摘要
Abstract:Unlearning aims to make a large language model behave like one retrained without its forget set. Prevailing likelihood-suppression objectives, however, lack an explicit forgetting target: they continually reward lower forget-set likelihood, making forgetting sensitive to the optimization budget. We address this limitation by estimating the direction toward the oracle without training it. Our key idea is to shrink the fine-tuned model toward its pre-fine-tuning weights and briefly re-learn the retain set, thereby removing the forget-specific contribution; in the linearized regime, this shrink-and-heal lookahead moves the model a fixed fraction of the way to the retrained model, its unique fixed point. Our method, SHIFT, extrapolates the lookahead's per-token changes into distillation targets and iteratively refines them. Evaluated against eleven baselines under a unified OpenUnlearning protocol, SHIFT achieves the highest aggregate score across all TOFU settings and the closest oracle alignment, 3.7x closer on average than the next-best method; on MUSE, it preserves the most retain knowledge. Under larger optimization budgets, baselines overshoot the oracle, while SHIFT remains near it, even under relearning attacks.
229. 【2611.00359】Humanized but Still True? Auditing Facts and Detection in AI-Text Humanizers
链接：https://arxiv.org/abs/2611.00359
作者：Ziyuan Wang,Genliang Zhu,Xiaobo Chen
类目：Computation and Language (cs.CL); Cryptography and Security (cs.CR)
关键词：rewrite machine-generated text, quoted spans, quoted spans survive, rewrite machine-generated, machine-generated text
备注： 11 pages, 2 figures, 4 tables. Code and data: [this https URL](https://github.com/zwang-devv/humanizer-fact-audit)
点击查看摘要
Abstract:AI "humanizers" rewrite machine-generated text so that detectors classify it as human-written. Public leaderboards score evasion and embedding similarity, but not whether checkable details survive. We check whether numbers, dates, person and organization names, and quoted spans survive each rewrite, using a rule-based checker validated by two AI annotators (precision 0.84-1.00, recall 0.93-0.95; no human annotation). In the October 2026 cycle of a public humanizer leaderboard, all 11 commercial tools changed or dropped at least one of these units in 35-65% of the documents that contained one. Most changes were to quoted spans; counting numbers and names alone, 10 of the 11 tools still altered at least one in 20% or more of the documents. The September 2026 cycle was similar (19-50%). An open 12B humanizer kept at least 97% of numbers and names in fact-dense U.S. federal agency text, but reworded 67-78% of the quoted spans, against its own prompt. Unit retention and detector evasion were not clearly related across tools (Spearman rho = -0.46, 95% CI -0.65 to 0.08), and the open model's four released files (two of them quantization-aware low-bit files) did not show the pre-registered monotone trade-off. On federal texts with matched human, AI-styled and humanized versions, a general-purpose decision model, Jev, asked a single zero-shot question, separated human originals from humanized rewrites with AUROC 0.864 (0.827-0.902), 0.18-0.22 higher than Binoculars, Fast-DetectGPT and the adversarially trained RADAR, while calling 24% of the human originals AI at a 0.5 threshold. On the AI-styled rewrites by 2026 models, both perplexity-based detectors scored below chance (AUROC 0.37 and 0.39), also with line breaks removed. Hypotheses, data rules and analyses were frozen before the main runs; two earlier data contacts are disclosed. We release the checker and the per-item results.
230. 【2611.00352】Cross-Prompt Reuse of Entity-Replacement Responses
链接：https://arxiv.org/abs/2611.00352
作者：Jinkun Chen,Xuemin Yu,Sijia Han,Vlado Keselj
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：English factual questions, model weights fixed, entity-replacement response transfers, transfers between English, English factual
备注： 37 pages, including appendices
点击查看摘要
Abstract:With model weights fixed, we measure how much of an entity-replacement response transfers between English factual questions, beyond whether answers change. We add the hidden-state change from two source questions to a target question about the same entity, comparing the predicted log-probability shift between two relations' published answers, given known answer prefixes, with the measured one. Hidden reuse injects the aligned change at 50% depth before the target's remaining layers; direct reuse adds source output-score changes. With other-relation sources, hidden reuse removes 45% and 49% of no-change error on 0.5-1B Qwen and Llama. Gemma-2-2B removes 22% and passes one of three comparisons in plain text without its default beginning-of-sequence (BOS) token. A later protocol restoring it yields 58-68%, passing every comparison on three cohorts. Larger checkpoints, chat format and new entities show replication and format- or cohort-dependent failures. On small plain-format checkpoints, other-relation hidden reuse mainly reproduces the shift both relations' questions share, without reliably lowering relation-selective error. With target-relation sources, hidden reuse's post hoc advantage over direct reuse is 0.2-0.9 nats outside chat format, unconfirmed and not replacement-specific. The same relation-neutral change at both questions' entity tokens lowers relation-selective error more than random or other-replacement changes, indicating receiving-question dependence.
231. 【2611.00345】Queering the Audits: Community-Based Auditing of AI Harms to Queer Communities
链接：https://arxiv.org/abs/2611.00345
作者：Organizers of QueerInAI:A Pranav,Alissa A. Valentine,Alex Markham,Beckett LeClair,Tereza Blazkova,Ekaterina Kornilitsina,Sofie H. Bruun,Gerasimos Spanakis,Anne Lauscher
类目：Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：systems embed majority-group, embed majority-group defaults, communities including erasure, producing documented harms, queer communities including
备注： Published in Identity Aware AI workshop at LREC 2026
点击查看摘要
Abstract:AI systems embed majority-group defaults into training data, evaluation metrics, and category definitions, producing documented harms for queer communities including erasure, misclassification, and discrimination. Standard technical audits often rely on aggregate measures and cannot detect harms that be come visible only through the lived experience of affected communities. We conducted a participatory auditing workshop at EurIPS 2025 where 16 queer community members audited four case studies using the 4Cs harm taxonomy (Content, Conduct, Contact, Contract) applied across the AI lifecycle. Participants used structured worksheets and plenary synthesis to classify harms and trace them to their origins in the development pipeline. Across all four cases, participants traced harms to problem definition and data collection, and they identified contractual structures that extract value from vulnerable populations while providing minimal recourse. These findings illustrate that community-informed auditing surfaces concrete, identity-specific harms that aggregate evaluation methods risk overlooking.
232. 【2611.00344】SPARK: Self-Correcting Embodied Memory via Physical Re-Observation
链接：https://arxiv.org/abs/2611.00344
作者：Dmytro Kurdydyk,Aadi Palnitkar,Sebastian Scherer,Seungchan Kim
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Retrieval-augmented generation, growing adoption, settings as language-queryable, language-queryable memories, Retrieval-augmented
备注：
点击查看摘要
Abstract:Retrieval-augmented generation (RAG) systems have seen growing adoption in embodied settings as language-queryable memories of the environment. However, existing approaches often assume a reliable single-episode knowledge base (KB) or accumulate observations across episodes without correcting prior errors. Such errors can persist through incorrect semantic labels, inaccurate object positions, and inconsistent spatial relationships. To address this, we present SPARK, a corrective multi-episode framework for embodied RAG. After the first episode, a semantic critic flags regions of the KB, a targeted planner generates revisits, and a selective merge adds, removes, or replaces KB information based on the new observations. We evaluate SPARK on four outdoor AirSim maps under two degraded viewpoint conditions, using perception-built KBs, a visibility-constrained oracle used only for evaluation, and a fixed set of 158 embodied question answering (EQA) questions scored before and after correction. A single corrective episode improves downstream EQA on every map under both conditions while storing 13-41% fewer objects than append-only updating, with gains up to 2.7x on one map-condition pair. Extending correction through Episode 4 brings every map above the EQA performance of its undegraded reference. Ablations show that the critic's three signals each contribute to performance, that targeted revisits achieve a larger mean gain than untargeted ones under the same budget, and that selective merging achieves gains comparable to append-only updating with a smaller KB. Overall, SPARK demonstrates the value of correcting embodied memory through targeted re-observation, particularly as embodied systems scale and the risk of accumulated errors increases.
233. 【2611.00325】One Waveform, Two Stories: Benchmarking Speech-Acoustic Conflict in Audio-Language Models
链接：https://arxiv.org/abs/2611.00325
作者：Wenbin Wang,Yuheng Li,Koichiro Yoshino
类目：ound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
关键词：Audio-language models, Audio-language, spoken claims, environmental sounds, claims
备注： 26 pages, 7 figures, 5 tables
点击查看摘要
Abstract:Audio-language models (ALMs) are evaluated on their understanding of both speech and environmental sounds. What remains underexplored is how they respond when spoken claims contradict acoustic evidence within the same recording. We introduce SAC-Bench, a benchmark of intra-audio speech--acoustic conflict comprising 616,031 unique clips from 188 sound-event classes across seven semantic, temporal, and spatial tasks. It pairs environmental recordings with compatible or contradictory synthesized spoken claims and includes audio-only controls where applicable. Across five open-weight ALMs evaluated on semantic and temporal tasks, high audio-only accuracy often coexists with large losses under conflicting claims; Event Identity accuracy is 24.8--46.5 percentage points lower in conflict than compatible conditions. Temporal Order failures persist even when speech follows the complete event sequence, so simultaneous speech--event masking cannot fully explain them. A spatial case study with Spatial-Omni finds lower motion accuracy associated with both spoken claims and the speech source's physical trajectory. Prompt interventions sometimes restore acoustic accuracy, but can also reduce claim-aligned answers without improving grounding or worsen performance. SAC-Bench thus separates acoustic competence, conflict robustness, and intervention effects.
234. 【2611.00319】GAVAGAI: Referential Alignment for Infant-Scale Vision-Language Models via Balanced Optimal Transport
链接：https://arxiv.org/abs/2611.00319
作者：Rajdeep Pal,Jotiraditya Banerjee,Saptarshi Pani
类目：Computation and Language (cs.CL)
关键词：things from roughly, words, million words, content words, region
备注： Accepted in NeuriPs 2026 workshop "The BabyVLM Workshop Toward Developmentally Plausible Multimodal Systems"
点击查看摘要
Abstract:A child learns which words name which things from roughly 100 million words of input. Vision-language models trained at a comparable scale bind words to referents far less reliably, and we argue that part of the gap is structural: the usual next-token captioning objective has no variable standing for "this word refers to that region," so training applies no direct pressure to ground words. We add such a variable by treating each scene as a small assignment problem between the content words heard and the regions seen, solved as entropic optimal transport under two constraints. First, a word may be assigned to a special NOTHING column instead of any region, which matters because most content words in caregiver speech do not name anything visible. Second, no region may receive more than a bounded share of the assignment mass, a capacity constraint that encodes mutual exclusivity. The alignment step costs about eight Sinkhorn iterations, small next to the vision encoder. In controlled simulation, the naive version of the idea, a row-wise softmax that forces every word onto some region, collapses to 0.000 word-to-picture accuracy under realistic non-reference rates, below the 0.058 of captioning alone, while our two constraints reach 0.075 in that regime and 0.700 on clean input. A one-parameter version of the model reproduces adult cross-situational learning accuracy across three ambiguity conditions (RMSE 0.024). On the SAYCam infant video corpus, adding the alignment loss to a next-token captioning model raises word-to-picture accuracy from 32.4% to 48.7% and localization IoU from 0.18 to 0.38. A contrastive model trained on the same child's data remains stronger on its own benchmark, so our claim is that the loss improves a captioning objective under high non-reference rates, not that it sets a new best.
235. 【2611.00314】Decentralized Multi-Agent Coordination and Communication in Shared Codebases
链接：https://arxiv.org/abs/2611.00314
作者：Rishabh Mediratta,Lingyun Xiao,Peter Stone,Joydeep Biswas,Elias Stengel-Eskin
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA)
关键词：receive separate, independently-motivated requests, human developers, working in shared, shared repositories
备注： First two authors contributed equally. Project Page: [this https URL](https://lingyunxiao18.github.io/ParallACT/)
点击查看摘要
Abstract:Coding agents working in shared repositories may receive separate, independently-motivated requests from human developers, creating a setting that is multi-agent by necessity. When this scenario happens, their individual implementations may work separately but conflict when combined. To study this setting, we introduce ParallACT, a benchmark of orchestrator-free multi-agent coding tasks. ParallACT contains both complementary and contradictory tasks. In complementary tasks, each agent's task is separately useful and implementations must share an interface to be productively combined. In contradictory pairs, both agents' tasks require editing the same code in incompatible ways, and naively combining independent solutions fails to produce a useful implementation. We compare a single-agent oracle given the combined set of tasks against multi-agent settings that vary execution order, visibility, awareness of other agents, and access to a communication channel. We find that the oracle solves most tasks while parallel agents perform substantially worse. Their performance drop is notable for complementary tasks, and particularly sharp for contradictory tasks (e.g., from 62% to 16% for Claude Code with Claude Opus 4.8) where merged code typically satisfies only one specification, and the same gap appears in all six further configurations pairing two agent harnesses with three open-weight models. Simply telling an agent that a peer exists does not help significantly, and giving agents access to a communication channel recovers only a small part of the performance, at an additional token cost. ParallACT thus identifies and isolates a core challenge that will become more common as multi-agent coding by independent principals becomes standard, and provides a controlled test of which coordination strategies help, and at what cost.
236. 【2611.00300】Cross-Lingual Persona Effects in LLM Negotiation
链接：https://arxiv.org/abs/2611.00300
作者：Saehee Eom,Tejas Khandwekar
类目：Computation and Language (cs.CL)
关键词：LLM negotiator, hold firm, instruction retain, Korean, LLM
备注： Accepted to SocialAgent Workshop at NeurIPS 2026. 13 pages, 1 figure
点击查看摘要
Abstract:Tell an LLM negotiator to be "headstrong" and it should hold firm on price, but does that instruction retain the same behavior in every language? To test this, we use identical buyer and seller instances of Gemini 3.6 Flash to negotiate the same 12 CraigslistBargain scenarios in English and Korean. The pilot-scale 2 x 2 x 3 design crosses interaction language, seller urgency (none or strong), and buyer persona (cooperative, neutral, or headstrong), yielding 432 attempted negotiations. We call this property cross-lingual social-policy fidelity: whether a prompt-defined social policy produces the same behavioral effect regardless of interaction language. It often does not. Korean negotiations reached agreement far more often than English (77.3% vs. 52.5%, a 24.8-point gap, Holm-adjusted p = .0039), but only for neutral and headstrong buyers; cooperative buyers were already near-ceiling in both languages. Buyers' opening offers barely differed by language; the gap instead emerged later, through larger seller concessions and a smaller final gap in Korean, and agreed prices were also lower in Korean. Repeating the full design with Qwen3.7 Flash as both agents gives directional support: agreement was again higher in Korean (+13.9 points vs. Gemini's +24.8, with an interval whose lower bound is near zero), and sellers again conceded more. Pragmatic analysis reveals why: while both languages frequently featured face-threatening acts like rejections and counter-offers, Korean dialogue softened these threats with substantially more politeness mitigation, especially among sellers (11.7% vs. 3.6%). These results show that such a policy can produce different simulated negotiation behavior, not just different wording, when only the interaction language changes.
237. 【2611.00297】ach, Abstract, Apply: A Framework for Dialogue-Driven Task Learning with Collaborative Robots
链接：https://arxiv.org/abs/2611.00297
作者：Chalamalasetti Kranti,Sherzod Hakimov,David Schlangen
类目：Robotics (cs.RO); Computation and Language (cs.CL)
关键词：traditional industrial robots, industrial robots, joint assembly, part inspection, interactive than traditional
备注： Preprint
点击查看摘要
Abstract:Collaborative robots (cobots) are designed to be safer and more interactive than traditional industrial robots, share the same workspace as humans, and assist them in a range of shop-floor tasks such as palletization, joint assembly, and part inspection. Many of these tasks involve repetitive workflows that may evolve with changes in production environments and task specifications. These requirements motivate the need for intuitive interfaces that allow workers to modify workflows on the shop floor and generalise these routines for future use. This work introduces the Teach-Abstract-Apply (TAA) framework, which enables human operators to (a) teach new workflows to cobots in natural language, (b) abstract the taught workflows into skills for later use, and (c) apply these skills in different settings. As a case study, we apply the TAA framework to a collaborative structure-building task and evaluate it with both open-weight (Qwen3-Coder) and closed (GPT5.2-Codex) models in self-play and cross-model configurations. Our results show that skill abstraction improves task success rates and reduces interaction cost. Beyond automated evaluation, a preliminary human-in-the-loop study suggests that the pipeline also works with human instructions.
238. 【2611.00244】MEMENTO: Learning Context Management for Long Context Processing Agents
链接：https://arxiv.org/abs/2611.00244
作者：Yunfan Zhang,Taehoon Hwang,Kathleen McKeown,Smaranda Muresan
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：perform context management, LLM agents, operate over long, long inputs, inputs must perform
备注：
点击查看摘要
Abstract:LLM agents that operate over long inputs must perform context management: deciding what to retain in a fixed-size context window. A common approach is compaction, where the model replaces its history with a self-generated note. Yet off-the-shelf agentic models, including GPT-5.5 and GLM-5.3, often write ineffective notes, and reinforcement learning (RL) alone rarely discovers useful note-taking behavior. We present MEMENTO, a long-context agent built on Qwen3-8B and trained to manage its context through compaction. We first bootstrap note-taking by fine-tuning on synthetic trajectories annotated with notes generated in hindsight, then reinforce it with RL using a reward that combines answer correctness, note-quality heuristics, and confidence calibration. Although trained only to compact into a fresh window, MEMENTO extends at test time to strategies such as context folding and confidence-based backtracking. On book-level question answering across four benchmarks, with books of up to 2.5M tokens, MEMENTO raises Qwen3-8B's accuracy from 36.9% to 67.8% while never holding more than 20K tokens in context. It outperforms GPT-5.5 agent in the same harness (13.1%) and full book context (56.7%) at less than 1/50 the cost. It also nearly matches a ~100x larger GLM-5.3 agent (69.3%) at 1/9 the cost, and comes within 6.4 points of GLM-5.3 full context at 1/26 the cost.
239. 【2611.00172】From Fragmentation to Fusion: A Survey and Roadmap for Omnimodal Embeddings
链接：https://arxiv.org/abs/2611.00172
作者：Ziyin Zhang,Yuyu Guo,Ying Zhang,Siqiao Xue,Zihan Liao,Jin Qin,Wenjie Yang,Siyuan Yang,Shijie Li,Cheng Chen,Hao Wu,Zhaoyang Zhu,Ruipeng Li,Zhaokun Jiang,Lei Lei,Rui Wang,Hang Yu,Rui Wang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：models underpin virtually, recommendation systems, Embedding models underpin, underpin virtually, virtually every modern
备注：
点击查看摘要
Abstract:Embedding models underpin virtually every modern AI system, from search engines to recommendation systems. Despite shared mathematical foundations, research on embedding models remains fragmented by modality: the communities develop largely in isolation, seldom exchanging insights. We argue that this fragmentation obscures a deeper convergence. Driven by contrastive learning, Transformer architectures, and a granularity shift, embedding research across modalities is converging toward a common set of principles, even as modality-specific challenges remain underexplored. To reason across this convergence without conflating it, we propose a framework of three progressively harder capabilities: coverage, comparability, and compositionality. Three paths toward unification satisfy these in turn: transformation broadens coverage, alignment enables comparability, and joint embedding, the terminus we advocate, aims at compositionality. This position paper traces the resulting evolution, providing the first unified, cross-cutting treatment of omnimodal embedding research.
240. 【2611.00081】HistGramBench: Measuring Structural Recovery When Multimodal Models Redraw Historical Mathematical Diagrams as TikZ
链接：https://arxiv.org/abs/2611.00081
作者：Minh Quang Tran,Carter He,Cameron Bloch,Zitai Huang,Thien Truong Vo,Trong Nguyen Tran,Isaac Chen
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Digital Libraries (cs.DL)
关键词：Euclidean proofs depend, Digital libraries preserve, remain scanned images, Digital libraries, Euclidean proofs
备注： 34 pages, 8 figures, 12 tables. Code: [this https URL](https://github.com/VietAlpha/histgrambench) ; data: [this https URL](https://huggingface.co/datasets/VietAlphaLabs/HistGramBench)
点击查看摘要
Abstract:Digital libraries preserve mathematical books printed from the sixteenth to the twentieth century, but the lettered diagrams in them, the figures on which Euclidean proofs depend, remain scanned images whose content cannot be searched. Redrawing such a diagram as a short drawing program would record which points lie on which lines and circles. But a printed plate offers no source code against which the redrawing could be checked. We introduce HistGramBench, a benchmark of 2,507 diagrams from 95 works printed between 1551 and 1933 in eight languages. For each diagram, two AI models from different providers agree on the facts a reader takes from the figure, such as which lines are parallel or where two lines meet, and every redrawing is checked against those facts on the model's own drawing. We evaluate six affordable AI models. The best recovers about three fifths of these facts, and most of what the models miss comes from programs that never produce a drawing. Parallels and tangencies are the hardest relations to reproduce. HistGramBench gives historians and librarians a way to measure when such tools can make old mathematical diagrams searchable.
241. 【2611.00078】From Zero to OCR: A Data-Centric Framework for Unsupported Low-Resource Scripts
链接：https://arxiv.org/abs/2611.00078
作者：Faizan Iqbal,Haq Nawaz Malik,Hafsah Pervaiz
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：script-specific visual structure, preserve script-specific visual, Optical character recognition, Optical character, remains inaccessible
备注： 9 pages, 9 figures, 4 tables. Model: [this https URL](https://huggingface.co/Faizaniqbal/KoshurOCR-CRNN-Baseline)
点击查看摘要
Abstract:Optical character recognition (OCR) remains inaccessible to many low-resource scripts because annotated document images are unavailable and synthetic training data can fail to preserve script-specific visual structure. We present a data-centric framework that builds end-to-end OCR for such scripts from only an unannotated text corpus and digital fonts, without manually annotating a single training image. A synthetic data engine renders word, line and page images with correct complex-script shaping and automatically derived labels; a YOLOv8 word detector and a convolutional recurrent recognizer trained with connectionist temporal classification learn from these images; and a stage-gate evaluation protocol isolates recognition error before detection is introduced. We demonstrate the framework on Kashmiri, a Perso-Arabic Nastaliq script with approximately 6.8 million speakers that none of six widely used OCR engines supports. Three line-level recognizers, including one transferred from Arabic, stalled between 41% and 79% character error rate (CER), motivating a word-level formulation; subsequent improvements came primarily from rendering fidelity, diacritic-preserving crop margins and tuned non-maximum suppression. The resulting system achieves 0.39% CER on held-out words, 10.0% on synthetic pages and 13.5% on browser-rendered digital pages, and establishes reference results of 18.45% on typeset book pages and 49.8% on degraded historical documents. We publicly release the trained models, the inference code and a synthetic dataset of 285,864 Kashmiri text-line images, and we describe a step-by-step procedure for building OCR for other unsupported scripts.
242. 【2611.00073】When frequency domain classification is superior to spatial
链接：https://arxiv.org/abs/2611.00073
作者：Yanir Harel,Shalom Rosner,Ronit D. Gross,Tal Halevi,Shilo Glam,Ella Koresh,Ido Kanter
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Modern image classification, frequency domain, Modern image, models largely rely, spatial domain
备注：
点击查看摘要
Abstract:Modern image classification models largely rely on local characteristics and feature extraction for their predictions. This focused approach works well in the spatial domain, but reportedly falls short in the frequency domain, even though both representations contain the same information. This study demonstrates that the significant reduction in accuracy in the frequency domain stems from the lack of local features. Locally swapping data in the frequency domain significantly decreases its inverse spatial domain accuracy, even below that of the frequency domain; however, the frequency domain accuracy remains relatively constant. Moreover, the use of datasets containing global features in the spatial domain yields higher accuracy in the frequency domain. Using these results, a hybrid model is constructed, combining one model trained only in the frequency domain and another trained only in the spatial domain to achieve higher classification accuracy. The proposed visual geometry group (VGG) and vision transformer (ViT) architectures are trained on the ImageNet-100, WikiArt, DTD, FMD, PSVRT, and KTH-TIPS2-b datasets and evaluated.
243. 【2611.00028】A Systematic Analysis of Live Intraoperative Surgical Expert Narrations
链接：https://arxiv.org/abs/2611.00028
作者：Arda Mamur,Matthias Seibold,Christoph Laux,Florian Wanivenhaus,Philipp Fürnstahl
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Manual annotation remains, surgical video understanding, Manual annotation, video understanding, remains the principal
备注： Accepted as abstract at the SafeSurg Workshop at MICCAI 2026
点击查看摘要
Abstract:Manual annotation remains the principal bottleneck in surgical video understanding. Live intraoperative narration by the operating surgeon is a scalable alternative that requires no manual annotation, but the information it contains has not been characterized. We analyzed 13 endoscopic lumbar spine decompression procedures (13.2 h) by two senior spine surgeons, using time-synchronized close-mic German audio. An annotation-free pipeline (word-level speech recognition, deterministic correction of surgical-term errors, utterance fusion, LLM-based translation to English, and relevance filtering) converted speech into time-stamped procedural cues labelled with the surgical entities they reference and their speech act. Of 3,171 utterances, 1,201 (37.9%) were retained as procedural cues, while 57.6% were non-procedural and removed. Retained cues referenced instruments (60.7%), anatomy (48.0%) and surgical actions (57.1%), and 98.5% carried at least one of these. 39% of cues (472 of 1,201) were directives, mainly instrument requests and commands. All 467 manually verified instrument requests preceded the instrument's appearance in the field, by a median of 8.2 s. Domain-term transcription corruption affected 18.0% of retained cues. Live narration is thus a dense, annotation-free supervisory signal describing instruments, anatomy, actions and team coordination, but it is noisy and temporally displaced from the events it names, and this displacement must be modelled before safe downstream use.
244. 【2611.00025】Edge-Optimized YOLOv11n Architecture for Offline Recognition of Nigerian Sign Language Alphanumeric Gestures
链接：https://arxiv.org/abs/2611.00025
作者：Adeleke Adeniyan,Abimbola H. Afolayan,Olanrewaju V. Johnson
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：faces regional hurdles, core empirical focus, sub-Saharan society faces, society faces regional, Deaf inclusion
备注： 12 pages, 6 figures, 7 tables
点击查看摘要
Abstract:Deaf inclusion across sub-Saharan society faces regional hurdles, with Nigeria as the core empirical focus. Existing recognition models demand heavy computational infrastructure. However, standard mobile phones used locally rarely exceed 1 GB to 4 GB of RAM. This study addresses constraints through a lightweight YOLO11n object-detection framework. The system provides real-time Nigerian Sign Language recognition for low-resource hardware. A benchmark dataset containing 11,208 raw gesture images was established. The data spans 33 static classes collected from five signers. Partitioning isolates signers S1 through S3 for training. Signer S4 provides validation data. Signer S5 is reserved for testing. Spatial augmentations are restricted strictly to the training set. This yields 23,509 training images. The validation and test sets each maintain 1,681 images across varied environments. The framework integrates a quantization-aware compression objective. Loss functions merge with squared Frobenius-norm penalties to govern weight distortion. A Spatial-Density Occlusion Index quantifies background complexity and self-occlusion. A latency-profiling equation relates floating-point operations and memory bandwidth to chipset clock speed. Performance testing on physical Android hardware utilizes unquantized FP32 weights. Mean inference latencies span 405.5 ms to 1,759.4 ms. Measured against test data, the algorithm attains a Precision of 0.9975. Recall reaches 0.9991. Mean Average Precision is 0.9942. Outcomes support offline functionality on constrained mobile devices. Practical deployment operates through a mobile utility using CameraX. The application captures gestures in real time. Recognized signs display as text instantly.
245. 【2611.00009】"I Wrote, I Paused, I Rewrote": A Mixed-Methods Study of Learner Perceptions of Process-Aware LLM Feedback
链接：https://arxiv.org/abs/2611.00009
作者：Samra Zafar,Shifa Yousaf
类目：Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)
关键词：Large language models, models increasingly provide, increasingly provide formative, provide formative writing, formative writing feedback
备注： 8 pages, 1 figure, 6 tables
点击查看摘要
Abstract:Large language models increasingly provide formative writing feedback, but most systems evaluate only the submitted text. Process-aware systems can additionally incorporate intermediate drafts and interaction records, yet access to these traces does not establish whether learners perceive the resulting feedback as useful, fair, or aligned with their own revision experience. We conducted a convergent mixed-method post-task evaluation with 43 undergraduate English-language learners. Participants completed a timed essay, received LLM-generated feedback based on the final essay, intermediate snapshots, and keystroke-derived records, and then answered six five-point Likert items and four open-ended questions. Ratings were concentrated above the neutral midpoint across all six items. Between 74.4% and 95.3% of participants selected ratings of 4 or 5, and all six one-sided exact sign tests remained significant after Holm correction. Perceived correspondence between the revision analysis and the participant's reported thought process was positively associated with overall perceived usefulness, Spearman's $\rho_s=.327$, 95% bootstrap CI $[.009,.609]$, $p=.032$, $n=43$. Qualitative responses were analysed through an LLM-assisted codebook development procedure followed by independent human coding of 14 binary codes. Participants frequently described the product feedback and revision rationale as accurate, while a smaller set reported misinterpretation of surface corrections, time constraints, or rhetorical intention. The findings distinguish perceived detection of revision activity from perceived interpretation of why revision occurred.
Comments:
8 pages, 1 figure, 6 tables
Subjects:
Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)
Cite as:
arXiv:2611.00009 [cs.HC]
(or
arXiv:2611.00009v1 [cs.HC] for this version)
https://doi.org/10.48550/arXiv.2611.00009
Focus to learn more
arXiv-issued DOI via DataCite</p>
246. 【2611.00006】Cultural Evolution Drives the Emergence of Conventions in Neural Emergent Communication
链接：https://arxiv.org/abs/2611.00006
作者：Maxime Toquebiau,Jérôme Botoko Ekila,Paul Van Eecke,Katrien Beuls
类目：Neural and Evolutionary Computing (cs.NE); Computation and Language (cs.CL); Multiagent Systems (cs.MA)
关键词：share internal representations, Recent studies, speak or listen, internal representations, share internal
备注： Accepted at EMNLP 2026
点击查看摘要
Abstract:Recent studies of language evolution with neural agents often use models where agents can either speak or listen, where there are only two agents in the population, or where agents can share internal representations. These choices prevent the study of how language emerges through cultural evolution, i.e. through the cumulative adaptation of individual behaviours to fit the communicative needs of the community. We tackle this issue with a new model that trains populations of bi-directional neural agents in a fully distributed fashion to solve a referential game. We demonstrate the effectiveness of this approach on multiple image datasets and show that it is able to scale to large populations. We also show that more conventional languages are easier to learn, providing a direct advantage for cultural transmission. Overall, this work provides a novel approach to neural emergent communication that opens up new directions for evolutionary linguistics.
247. 【2609.23790】otal Cost of Agency: Exact Attribution of Memory Injection Cost in Multi-Agent LLM Workflows
链接：https://arxiv.org/abs/2609.23790
作者：Vivek Kumar Singh,Preeti Priyam,Gautam Bhowmick
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA); Performance (cs.PF)
关键词：multi-agent large language, workflow retrieves context, large language model, injected tokens, total token cost
备注： 8 pages, 3 figures, 6 tables. Code, data, and evaluation harness in github: [this https URL](https://github.com/vsingh45/tca-compiler)
点击查看摘要
Abstract:Every node in a multi-agent large language model (LLM) workflow retrieves context from memory and injects it into its prompt, where those injected tokens are billed as input tokens at the same per-token price as the system prompt and the user query. Production observability tools report total token cost but do not separate the tokens a node generates from the tokens it is handed, so this component of the bill is invisible to the teams paying it. We introduce the Total Cost of Agency (TCA), a decomposition of multi-agent workflow cost into base prompt, inference, memory injection, miss penalty and context-accumulation components, and an exact attribution method: a two-pass, non-billable token count that measures injected tokens directly rather than estimating them from word-count proxies. On a 200-task enterprise benchmark executed against real model APIs, memory injection accounts for 13.6 percent of the variable cost a compile-time optimizer can act on, about 12 percent of the full billed cost, and its share rises from a structural zero at workflow depth one to 27.6 percent at depth six. Injected tokens grow linearly with depth over the measured range (R^2 = 0.9974, depths two through six); a quadratic fit yields a negative leading coefficient, so the data do not exhibit convex growth at these depths. We show the component is controllable at fixed model tier: reducing the retrieval window capacity from 32 to 2 entries lowers injected tokens by 28.7 percent with an accuracy change within seed-level variation. We report in full that our graph-rewriting transforms are approximately cost-neutral in isolation, that two of the five decomposition terms are zero by construction in this harness, and that total workflow cost is dominated by model tier assignment, which we hold fixed and treat as prior work. Prompt caching is not evaluated; all figures are for the uncached case.
248. 【2611.02956】Specification-Aware Predictive Uncertainty Decomposition
链接：https://arxiv.org/abs/2611.02956
作者：Roman Vashurin,Mikhail Seleznyov,Assel Yermekova,Fedor Chernogorskii,Danila Zykov,Elena Tutubalina,Alexander Panchenko,Preslav Nakov,Nikita Kotelevskii,Maxim Panov
类目：Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Large Language Models, Classical decompositions, uncertainty, fixed representation, Bayes risk
备注：
点击查看摘要
Abstract:Classical decompositions of predictive uncertainty, such as the information-theoretic one, are defined for a fixed representation $x$ of the input object. They do not consider that $x$ may be incomplete, nor do they measure how much the missing information can affect the prediction. In Large Language Models, users can clarify an underspecified input without any retraining. The clarified input can describe the user's unobserved intent $z^*$ more accurately and change the predictive uncertainty about the outcome. In this paper, we formalize this setting probabilistically and derive a three-term decomposition of prediction risk into specification, residual aleatoric, and epistemic uncertainties. We show that at the original information level, when only $x$ is available, the aleatoric uncertainty, represented by a Bayes risk, has two components. The first, which we call specification uncertainty, is the expected reduction in this Bayes risk from revealing the intent. The second is the residual aleatoric uncertainty, i.e., the Bayes risk that remains once the intent is known, averaged over its possible values $z$ given $x$. The distinction is important, as specification uncertainty informs the decision to request clarification before making a prediction. We build approximations of these components and connect them to existing uncertainty measures. Our experiments across different domains and modalities show distinct roles for the three components. Specification uncertainty is the most informative for detecting underspecified inputs, while residual aleatoric uncertainty is the most informative for detecting in-distribution prediction errors.
249. 【2611.00690】Learning Timeline-Preserving Speech-to-Speech Translation
链接：https://arxiv.org/abs/2611.00690
作者：Zhisheng Zheng,David Harwath
类目：Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
关键词：silence occur, increasingly preserves, speech, temporal, temporally grounded applications
备注： Working in progress
点击查看摘要
Abstract:Speech-to-speech translation (S2ST) increasingly preserves what is said and how it sounds, but not necessarily when speech and silence occur. For dubbing and other temporally grounded applications, matching total duration is not enough: speech and pauses must also occur at corresponding moments. We formulate timeline-preserving S2ST, which aims to preserve the source endpoint and salient internal pauses on a shared absolute timeline. We present TransDubber, an end-to-end autoregressive system that learns this temporal structure directly from aligned target waveforms, without inference-time frame-level timing control or post-hoc temporal correction. To provide this supervision, we construct 642K exactly duration-matched English-Chinese speech pairs by translating and synthesizing target speech on source-defined temporal scaffolds. Training combines a progressive supervised curriculum with verifier-guided reinforcement learning to balance translation quality and temporal alignment. On a 4,353-utterance test set spanning read and spontaneous speech, TransDubber increases the proportion of translations within 2% of the source duration from 25.6% to 61.5% and pause-alignment F1 from 0.118 to 0.550 compared with UniSS, while maintaining competitive translation quality. Our analysis shows that aligned supervision establishes timeline following, while reinforcement learning refines temporal precision and partially offsets the translation-quality cost of strict synchronization. Together, these results demonstrate the effectiveness of our data and training framework for timeline-preserving S2ST. Audio samples, code, datasets, and pretrained models are available at this https URL.
250. 【2611.00387】Geometric and algebraic inference in humans and neural networks
链接：https://arxiv.org/abs/2611.00387
作者：Jacob Russin,Joonhwa Kim,Ellie Pavlick,Michael J. Frank
类目：Neurons and Cognition (q-bio.NC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：limited data, possess a remarkable, remarkable ability, ability to draw, Humans possess
备注： Equal contribution: J. Russin, J. Kim. Joint senior authors: E. Pavlick, M. J. Frank. 99 pages (17 main text, 13 references, 69 appendix), 5 figures, 45 supplementary figures, 9 supplementary tables. Code: [this https URL](https://github.com/jlrussin/geometric-algebraic-ti-transformers) , [this https URL](https://github.com/jlrussin/geometric-algebraic-ti-humans) , [this https URL](https://github.com/joonhwakim/geometric-algebraic-ti-llms)
点击查看摘要
Abstract:Humans possess a remarkable ability to draw inferences from limited data. While some inferences are made intuitively from past experience, others require online reasoning based on novel information given in context. Here, we formalize these strategies, which we term geometric and algebraic inference, and study their computational tradeoffs in humans and neural networks. The geometric strategy gradually shapes representational geometry to reflect underlying relational structure, making subsequent inference cheap. The algebraic strategy flexibly attends to and reasons over novel relations given in context, but costs additional computation at inference time. We identify opposing signatures of these two strategies in transitive inference, a domain widely studied across species, and characterize the conditions under which each is observed. Our framework predicts that the geometric strategy should be dominant when relations are familiar, whereas the algebraic should emerge to support de novo inferences drawn in context. Multiple experiments demonstrate these opposing signatures in humans, neural networks trained from scratch, and large language models (LLMs). Causal interventions in the neural networks reveal that the geometric and algebraic strategies depend on representational geometry and selective attention mechanisms, respectively, and reproduce the effects of analogous neurobiological disruptions in humans. Our framework unifies these effects with disparate phenomena, including content effects observed in human and LLM reasoning and data-distribution effects observed in machine learning. Our findings reconcile competing views of cognitive flexibility that emphasize either representational geometry or algebraic manipulation by showing that each can have unique strengths, and can characterize different aspects of both human and neural network behavior.
251. 【2611.00011】ARTA: Graph Combinatorial Optimization for Robust Interbeat Interval Estimation from Wearable Electrocardiogram Signals
链接：https://arxiv.org/abs/2611.00011
作者：Shovito Barua Soumma,Asiful Arefeen,Hassan Ghasemzadeh
类目：ignal Processing (eess.SP); Computation and Language (cs.CL); Mathematical Software (cs.MS)
关键词：Accurate heart rate, continuous physiological monitoring, obscure true R-peaks, Accurate heart, create false QRS-like
备注： Under Review
点击查看摘要
Abstract:Accurate heart rate (HR) and interbeat interval (IBI) estimation from wearable electrocardiogram (ECG) is essential for continuous physiological monitoring, but motion artifacts can create false QRS-like peaks and obscure true R-peaks. Conventional detectors and local interval-repair rules process detections independently and may become unreliable when several consecutive beats are corrupted. We present ARTA (Artifact-Robust Temporal Alignment), a graph-based combinatorial framework that estimates the heartbeat sequence through constrained temporal optimization. ARTA combines candidates from multiple ECG detectors, represents them as nodes in a directed acyclic graph and connects candidates through physiologically plausible RR intervals. Candidate confidence uses detector agreement and local ECG quality, while history-dependent transition costs capture recent IBI consistency and a soft heart-rate prior. Beam-search dynamic programming selects a coherent low-cost path across the recording, suppressing false detections and recovering missed beats when plausible auxiliary candidates are available. On the IEEE Signal Processing Cup exercise dataset with electrode-motion artifacts from -2 to 12 dB, ARTA achieved an HR mean absolute error of 1.79 beats per minute, 54% lower than the strongest single-detector baseline, with 92.38% of windows within +/-5 beats per minute, an R-peak F1 score of 0.95, and an IBI mean absolute error of 6.52 ms. Cross-dataset evaluation on the European ST-T Database further assessed transfer to long clinical ambulatory recordings and a label-free reliability analysis examined conditional performance without using reference annotations for segment selection. ARTA is single-channel, training-free, interpretable and computationally lightweight, operating approximately 27 times faster than real time with peak memory below 2.1 MB in a single-thread CPU simulation.
信息检索
1. 【2611.03327】From FAIR to AI-FAIR Metadata-First Infrastructure for AI-Enabled Science
链接：https://arxiv.org/abs/2611.03327
作者：Elizabeth G. Campolongo,Eric R. Sokol,Marty Downs,Gina Glenne,Gregory E. Maurer,Sydne Record,Dustin R. Rubenstein,Matthew J. Thompson,Christine Laney,Hilmar Lapp,Max Tarjan,Tanya Berger-Wolf
类目：Artificial Intelligence (cs.AI); Databases (cs.DB); Human-Computer Interaction (cs.HC); Information Retrieval (cs.IR); Quantitative Methods (q-bio.QM)
关键词：Artificial intelligence, past few years, leading to widespread, capabilities have advanced, advanced rapidly
备注： 8 pages, 3 figures, Code available at: [this https URL](https://github.com/FAIR4AI-Bio/evaluator)
点击查看摘要
Abstract:Artificial intelligence (AI) technologies and their capabilities have advanced rapidly over the past few years, leading to widespread interest and adoption in the biological and ecological sciences. However, the data infrastructure and computational resources that provide the foundation for AI workflows in ecology and biodiversity science remain fragmented. Moreover, the flow of value remains largely unidirectional: data move from collectors, through repositories and aggregators into models, and finally to research products or management actions. The derived value, such as corrected taxonomies, annotations, quality flags, and insights, rarely returns to source communities. We propose an extension of the original FAIR principles to address the needs of AI-ready infrastructure: the AI-FAIR metadata criteria, which place AI-enabled science in the context of a bidirectional Question-Data-Model triangle. This framework is designed to facilitate large-scale content-based analysis across diverse collections and ensure that the scientists generating the data benefit from the AI-enabled advances built on their data. Alongside these criteria, we introduce an agentic evaluation workflow that both rates existing datasets on the AI-FAIR and traditional FAIR criteria and provides actionable feedback where critical metadata is missing or incomplete. This modular dataset evaluation tool, paired with a domain-appropriate checklist, translates these principles into a reusable assessment of machine-learning readiness, AI-readiness for specified tasks, traceability, and ethical and CARE-aligned stewardship. Through this approach we aim to create a community-informed system to close the model data loop, so that AI also enriches data to further enable scientific discovery.
2. 【2611.03272】Diverse-Teacher On-Policy Distillation for Generative Recommendation
链接：https://arxiv.org/abs/2611.03272
作者：Zhipeng Yi,Xinyu Lin,Minxuan Shan,Zipeng Chen,Yujiao Zhao,Chuanyu Xu,Wenjie Wang
类目：Information Retrieval (cs.IR)
关键词：user interaction history, Generative recommendation generates, Generative recommendation, interaction history, user interaction
备注： 12 pages, 10 figures, 3 tables
点击查看摘要
Abstract:Generative recommendation generates the semantic ID (SID) of the next item from a user's interaction history. Existing training objectives mainly supervise target SID tokens, while on-policy distillation (OPD) provides denser supervision through a teacher's probability distribution over all tokens for more effective and efficient training. However, OPD can aggravate popularity bias: teacher feedback favors popular-item tokens, transferring this preference to the student, while student rollout favors popular items, leaving unpopular-item SID paths rarely generated and supervised. These two sources of bias reinforce each other and reduce recommendation diversity. We propose HERO, a diversity-aware OPD framework. Heterogeneous teacher distillation trains two teachers specializing in popular and unpopular items and routes each training sample to the teacher matching the popularity group of its ground-truth item. The student learns from the routed teacher's probability distribution along its own generated SIDs. Diversity-aware item rollout incorporates ground-truth SIDs of unpopular items into training, covering SID paths that the student rarely generates. Only the student is used for inference. Offline experiments on an industrial dataset and three public datasets further demonstrate its effectiveness, diversity, and robustness. Moreover, we deploy HERO in the "Guess What You Like" module on the 1688 homepage, where a 15-day online A/B test shows a 3.412% increase in gross merchandise value (GMV).
3. 【2611.03196】Dhārā Bench: An Evidence-Oriented Retrieval Benchmark for Indian Knowledge Systems
链接：https://arxiv.org/abs/2611.03196
作者：Avinash Holenarasipur Nagendra,Anand Kaniyaar Sriranga Prasad,Kousik Sarathy Sridharan,Mohan Raghavan
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：Indian Knowledge Systems, Knowledge Systems, Indian Knowledge, Dhārā Bench, benchmark for Indian
备注： 18 pages, 6 figures, 9 tables. The first two authors contributed equally. Code and data: [this https URL](https://github.com/Avinash2236/Dhara-Bench)
点击查看摘要
Abstract:Dhārā Bench is a retrieval benchmark for Indian Knowledge Systems (IKS), with 325 questions in 12 categories and 60,121 text chunks from 15 source groups. The categories were developed based on 4,500 questions submitted to the Dhārā application; the evaluation set combines corpus-aligned application queries with expert-contributed questions. The annotations comprise 7,578 question-chunk relevance links involving 6,847 distinct corpus chunks. For 34 composite and multi-hop questions, 401 conjugate groups specify alternative sets of passages that jointly support each question. Chunk identifiers and hierarchical references connect the judgments to their source texts. The paper describes corpus preparation, annotation, and validation, and reports a fixed BM25 baseline implemented with Pyserini with $k_1=0.9$ and $b=0.4$. Across all questions, BM25 achieves MRR@20 of 0.315, Recall@10 of 0.182, and nDCG@10 of 0.205. On the group-annotated subset, complete-evidence scores are CE_Recall@20 = 0.294 and CE_MRR@20 = 0.141. The category results expose particularly weak verse retrieval, while group scores reveal gaps between finding individual passages and completing their support. The corpus and evaluation code are available at this https URL.
4. 【2611.03179】Every Clause Counts: Instruction-Following Reranking by Multiplying Small, Answerable Questions
链接：https://arxiv.org/abs/2611.03179
作者：S. M. Mahbub Uddin Ahmed,Abdullah Al Musaddiq
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：People often attach, Weighted Instruction Sensitivity, Instruction Sensitivity Evaluation, search queries, written for beginners
备注：
点击查看摘要
Abstract:People often attach instructions to their search queries, asking for pages written for beginners, documents in a certain language or official sources only. Most rerankers were trained to judge topical relevance and treat such instructions as a few extra words. On the InfoSearch benchmark, even GPT-4o used as a list-wise reranker reaches an average WISE (Weighted Instruction Sensitivity Evaluation) of only 33.5. We present DMReranker (Decision-Model Reranker), a zero-shot reranker that splits an instructed query into a topic and a short list of typed clauses. A small judge model answers one narrow question per clause, and the answer probabilities are multiplied into a single score. Nothing is trained, and the configuration was frozen before the test runs. Reranking the same top-100 candidates as the published baselines, DMReranker reaches a macro WISE of 50.9 over all six InfoSearch dimensions while keeping original-mode nDCG@10 at 82.9. It trails GPT-4o on the stricter SICR (Strict Instruction Compliance Ratio) metric, 19.2 against 32.1. We show that this gap follows from how a product of probabilities behaves when SICR compares raw scores across runs. Computed from ranks, our SICR is 67.0. On the same judge, splitting the instruction raises WISE from 32.9 to 47.6 over a single combined question, while raw-score SICR falls. Scoring all six dimensions cost about $10 at list price.
5. 【2611.03113】Preprocessing Choices in Fine-Tuning Data Matter: Utility and Demographic Sensitivity in LLM-Based Recommendation
链接：https://arxiv.org/abs/2611.03113
作者：Furkan Yasir Goksu,Yaren Yilmaz,Sule Gunduz Oguducu
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Large language models, Large language, producing item lists, language models, lists from textual
备注： 11 pages, 2 figures, 5 tables. Accepted at the 3rd Workshop on Evaluating and Applying Recommender Systems with Large Language Models (EARL) at CIKM 2026, November 8, 2026, Rome, Italy
点击查看摘要
Abstract:Large language models (LLMs) have introduced a generative approach to recommendation, producing item lists from textual representations of user histories and item information. However, this generative setting raises challenges concerning output validity, prompt consistency, and sensitivity to demographic descriptors. In this work, we investigate how preprocessing choices in fine-tuning data affect recommendation utility and fairness-related behavior in a generative LLM-based recommender system. We first establish a controlled recommendation pipeline that combines supervised fine-tuning, catalog-constrained decoding, and prompt augmentation. We then study three preprocessing choices: item-title representation, demographic balancing, and auxiliary item-knowledge enrichment. Experiments on MovieLens-1M show that the catalog-constrained pipeline eliminates out-of-catalog items and ensures complete ten-item outputs, while prompt augmentation improves prompt consistency and utility. Original MovieLens titles increase HR@10 from 10.67% to 12.47% and Coverage@10 from 41.36% to 47.88%. Fairness-related effects are attribute-dependent: age balancing and knowledge enrichment reduce selected group-level utility gaps while largely preserving utility, whereas gender balancing reduces utility without improving the evaluated gender-related indicators. Overall, preprocessing choices in fine-tuning data should be evaluated jointly in terms of utility, output behavior, and demographic sensitivity.
6. 【2611.03097】DR Pixel: Page-Native Deep Research with Vision-Language Models
链接：https://arxiv.org/abs/2611.03097
作者：Tiansheng Hu,Yichuan Wang,James V. Talwar,Nicholas Tomlin,Chen Zhao,Sewon Min
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：agents typically reduce, typically reduce papers, deep research, page-native deep research, existing deep research
备注：
点击查看摘要
Abstract:Complex documents such as scientific papers contain rich information in tables, figures, and equations; however, existing deep research (DR) agents typically reduce papers to OCR-extracted text. We instead ask whether vision-language models (VLMs) can enable page-native deep research: directly retrieving and reasoning over rendered document page images. We introduce DR Pixel, the first open-source end-to-end multimodal DR agent that uses rendered page images as its sole retrieval and reasoning unit, operating over a corpus of 1.06M pages. To evaluate this setting, we construct DRPixelBench, a benchmark on scientific papers requiring reasoning over text, figures, tables, and equations. Surprisingly, page-native DR already works well without training, outperforming OCR-based baselines across state-of-the-art models like GPT-5.4, Gemini-3.5-Flash, and Qwen3.6-27B, while requiring fewer tool calls. We next turn to DR training. A key challenge is that teacher trajectories for agentic supervised finetuning are noisy, mixing critical reasoning and action steps with redundant or failed attempts. To address this, we introduce counterfactual credit reweighting, a fine-grained credit assignment method that weights individual reasoning and action steps by their counterfactual contribution to the final answer. Our training improves retrieval recall by about 15 points and final accuracy by over 10 points on DRPixelBench, and likewise outperforms the untrained baseline on four existing benchmarks. On out-of-distribution ViDoRe-V3, DR Pixel comes within 1.8 points of an oracle that is given the gold pages directly. Our results suggest that the conventional OCR-then-retrieve pipeline is not only unnecessary but suboptimal: directly retrieving and reasoning over visual document pages makes complex DR both more effective and more efficient.
7. 【2611.03068】PACERec: Progressive Adaptation of LLM Item Embeddings with Collaborative Evidence for Recommendation
链接：https://arxiv.org/abs/2611.03068
作者：Junzhao Huang,Xi Wu,Zihan Wang,Zijing Wang,Ming Wang,Kang Liu,Xiaocui Yang,Shi Feng,Daling Wang,Yifei Zhang,Ting Yang,Xurui Li
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：Large language model, Large language, language model, increasingly adopted, attributes and alleviate
备注：
点击查看摘要
Abstract:Large language model (LLM) embeddings have been increasingly adopted in sequential recommendation to encode static item attributes and alleviate the limitations of item ID embeddings under sparse interactions. However, these embeddings typically capture only static content similarity while neglecting sequential transitions, and since their adaptation quality relies on sparse per-item updates or global geometric calibration, existing methods still struggle to explicitly transfer preceding interaction contexts from frequent to long-tail items under unevenly distributed behavioral evidence, limiting recommendation effectiveness across the catalog. To address this challenge, we propose PACERec, an ID-free progressive adaptation framework that incorporates preceding interaction contexts into semantic representation adaptation by learning a shared velocity field from items with sufficient interactions via frequency-weighted flow matching. In this way, PACERec progressively guides static LLM embeddings toward collaborative behavioral targets while preserving original item semantics, overcoming sparse per-item updates to effectively generalize sequential transition patterns to long-tail items for both user modeling and candidate scoring. Extensive experiments on three real-world datasets across three sequential backbones demonstrate the superiority of our method over competitive baselines in both overall and long-tail recommendation.
8. 【2611.03008】E-GenRM: Generative Reward Modeling for Open-Ended E-Commerce Shopping Agents
链接：https://arxiv.org/abs/2611.03008
作者：Ying Sun,Qiuyu Zhao,Xiao Wang,Xiyu Zhao,Gege Shi,Zenghui Sun,Jinsong Lan,Haihong Tang,Bo Zheng
类目：Information Retrieval (cs.IR)
关键词：Generative Reward Model, reward model tailored, Generative Reward, Reward Model, model tailored
备注：
点击查看摘要
Abstract:We present E-GenRM (E-commerce Generative Reward Model), a generative reward model tailored to e-commerce shopping agents. User expectations are shifting from simple product queries to open-ended shopping tasks. However, existing trajectories and reward designs remain largely bounded by current agent usage patterns and known failures, providing limited guidance for further capability improvement. These limitations call for an integrated reward modeling framework for open-ended shopping agent tasks. On the data side, E-GenRM leverages naturally occurring user behavior across the shopping app to construct diverse, long-horizon conversational trajectories beyond established usage patterns. On the modeling side, E-GenRM first learns from behavior-grounded evaluation chains through supervised fine-tuning. It is then optimized through criterion-guided reinforcement learning, which rewards correct preference judgments and evidence-supported factual claims under each criterion. Personalized hard-negative training further improves its sensitivity to user preferences reflected in shopping behavior, beyond explicit requirements. We additionally develop an active evidence retrieval extension that acquires missing e-commerce information for evaluation. On E-GenRM-Bench, E-GenRM-27B achieves 87.40\% preference accuracy, outperforming the strongest baseline by 6.97 percentage points. In a 14-day online A/B test on Taobao, a shopping agent post-trained with E-GenRM improves the effective shopping-assistance rate by 1.39 percentage points and user satisfaction by 2.33 percentage points.
9. 【2611.02940】PlagiaCorpus: A Bilingual, Adversarial, and Cross-Lingual Dataset for Forensic Plagiarism Detection
链接：https://arxiv.org/abs/2611.02940
作者：Adel Ammar,Serry Sibaee,Wadii Boulila
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Digital Libraries (cs.DL); Information Retrieval (cs.IR)
关键词：including reuse produced, large language models, bilingual Arabic-English dataset, text-reuse detection, bilingual Arabic-English
备注：
点击查看摘要
Abstract:PlagiaCorpus is a bilingual Arabic-English dataset for benchmarking plagiarism and text-reuse detection, including reuse produced by large language models (LLMs) and reuse across languages. It contains 198,643 text records: a source corpus of 34,885 passages drawn from English and Arabic Wikipedia and two openly licensed book collections, and 163,758 queries (147,381 for training and 16,377 for testing). The queries cover five reuse classes of increasing difficulty, namely verbatim copying, character-level obfuscation, same-language paraphrasing by two different LLMs, and English--Arabic translation with structural paraphrasing, together with a Safe class of non-reused passages. Every positive query is linked to its source passage, and the train/test split is grouped by source passage so that no passage contributes queries to both splits. The release was curated through language identification, removal of LLM generation artefacts, and exact and cross-lingual de-duplication. Technical validation reports per-class length statistics, automatic checks of the train/test split, and inter-annotator agreement on a manually rated sample. The dataset is distributed in JSON and Parquet formats under a CC BY-SA 4.0 license.
10. 【2611.02896】Bridging Low-Level Image Fusion and High-Level Semantic Understanding
链接：https://arxiv.org/abs/2611.02896
作者：Guangyuan Dong,Lingdong Shen,Xudong Zhang,Haodong Jing,Haoyu Wang,Zihao Li,Zonghao Ying,Ziyu Song,Shenghao Liu,Jiachen Luo,Hao Zhang
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Remote sensing image, Remote sensing, downstream retrieval utility, preserve downstream retrieval, optimized separately
备注：
点击查看摘要
Abstract:Remote sensing image fusion and semantic interpretation are usually optimized separately, so reconstruction quality need not preserve downstream retrieval utility. We propose LANCE, which uses structured language as an explicit, indexable semantic state. A frozen vision-language model maps the input to a closed-vocabulary text record; a language-conditioned generator fuses the imagery; and a dense verifier with a differentiable continuous summarizer re-describes the output. Text-text consistency and anti-collapse contrastive text-mask losses with negative queries close the loop without dense annotations or VLM fine-tuning. A variational EM formulation yields a per-step contraction result under regularity assumptions, distinguishing semantic faithfulness from verifier overfitting. Across seven test sets on GF2, QuickBird, WorldView-III, and WorldView-II, LANCE improves reduced-scale reference metrics by up to 11.7% (median 2.1%) over the strongest learning baseline. Independent evaluation using a held-out VLM and a supervised aerial detector yields gains of +6.4 mAP and +0.072 open-vocabulary F1 over the closest competitor. Text perturbations, cross-verifier transfer, and pseudo-RGB ablations examine the mechanisms underlying these gains. The framework connects image fusion to verifiable semantic representations for multimodal retrieval and knowledge management.
11. 【2611.02758】Learning to Adjudicate: Verifier-Guided Multi-Agent Reasoning for E-Commerce Relevance
链接：https://arxiv.org/abs/2611.02758
作者：Shi Shu,Hao Chen,Baopu Qiu,Chao Wei,Weiru Zhang,Xiu Li,Xiaoyi Zeng
类目：Information Retrieval (cs.IR)
关键词：retrieved products satisfy, modeling is fundamental, user query, retrieved products, products satisfy
备注：
点击查看摘要
Abstract:Relevance modeling is fundamental to e-commerce search, determining how well retrieved products satisfy the needs expressed in a user's query. Accurate judgments require interpreting user intent, comparing product attributes, and applying business-specific matching criteria. Current methods based on large language models (LLMs) leverage contextual understanding and reasoning, focusing on incorporating domain-specific context and enhancing reasoning performance. Despite these advances, difficult query-product pairs remain challenging when evidence from different perspectives supports conflicting conclusions. A single reasoning pass may fail to reconcile these conflicts and ensure that decisive evidence guides the final judgment. To address this challenge, we propose Collaborative Adjudication with Debate and Replay Experience (CADRE), a framework for evidence-based adjudication in e-commerce relevance assessment. CADRE organizes three expert agents sharing a frozen backbone to analyze product attributes, user intent, and business rules in separate contexts, while a trainable Verifier assesses their supporting evidence against the applicable matching criteria to determine relevance. Under expert disagreement, a Verifier-guided debate elicits targeted clarification and revision of disputed interpretations before final adjudication. We optimize the Verifier through multi-turn group relative policy optimization and adapt successful-experience replay so that trajectories yielding correct terminal labels can be reused alongside fresh rollouts in subsequent updates. For efficient online serving, we use CADRE as an offline teacher to distill its relevance judgments into a lightweight student model. Offline evaluations and online A/B tests on an e-commerce search advertising platform demonstrate that CADRE improves relevance classification and key business and relevance satisfaction metrics.
12. 【2611.02643】SearchInject: Retrieval Exposure Control for Indirect Prompt Injection in Language-Model Search
链接：https://arxiv.org/abs/2611.02643
作者：Kainan Zhou,Gangzhen Qian,Janet Sung,Zhi Jing,Rong Bao,Qianru Lao
类目：Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：large language model, page reaches model, indirect prompt injection, search-augmented large language, carrier page reaches
备注： 6 pages, 3 tables, 6 graphs. Accepted at IEEE ICCC 2026. Author accepted manuscript. Reproducibility artifact: [this https URL](https://www.iccc.org/)
点击查看摘要
Abstract:An indirect prompt injection can affect a search-augmented large language model only after its carrier page reaches model context. SearchInject controls this admission decision with a joint score combining retrieval relevance, search-abuse cues, instruction likelihood, and two relevance interactions. A quarantine threshold is selected under an empirical 0.5% clean-candidate false-quarantine constraint on a calibration split. Evaluation uses 300 held-out SciFact queries and held-out payload categories within four construction families already represented during development. Across 1,200 query-family outcomes per retriever, top-10 target exposure falls from 0.9408 to 0.1583 for BM25, from 0.9158 to 0.1508 for a normalized hybrid, and from 0.8450 to 0.1375 for latent semantic analysis. These are relative reductions of 83.2-83.7%; the largest absolute change in clean normalized discounted cumulative gain at rank 10 is 0.0018. The frozen threshold yields clean test false-quarantine rates of 0.59-0.65%, above the empirical calibration constraint. A query-level analytical reanalysis accounts for the repeated construction outcomes under an independent-query assumption. A separate 104-case generation follow-up records context removal but no confirmed undefended hijacks under a post hoc endpoint, so it cannot estimate a reduction in attack success. The evidence supports retrieval exposure control within the evaluated construction families; the benefit of the interaction terms at matched clean cost remains unresolved.
13. 【2611.02487】RecRSI: Mechanism-Guided Discovery of Recommendation Algorithms
链接：https://arxiv.org/abs/2611.02487
作者：Tingran Gan,Zhouziyue Lu,Dian Jin,Tao Li,Yang Gao,Ming Liu,Weiwen Liu,Jianghao Lin,Weinan Zhang,Yong Yu
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：Web requires coordinating, Improving recommendation algorithms, requires coordinating interacting, Improving recommendation, coordinating interacting design
备注： 13 pages, 4 figures
点击查看摘要
Abstract:Improving recommendation algorithms for the Web requires coordinating interacting design choices and learning from experiments. We present RecRSI, an LLM-based research framework that uses mechanism hypotheses to organize algorithm discovery. Each hypothesis links a proposed mechanism change to a reference design, a rationale, and an expected observation. MechSpace derives implementable primitives and composition rules from the task source; Research Line uses this space and prior evidence to develop and test hypotheses; Mechanism Feedback carries outcomes and their design context into subsequent research. This organization makes each experiment inform which mechanisms to develop, revise, or combine next. Across four initial recommenders and four datasets, RecRSI yields average relative improvements of 8.48% in NDCG@5 and 6.88% in HR@5 over the initial algorithms, and 2.60% and 2.20%, respectively, over the strongest competing result for each setting and metric. Component and process studies link these gains to coordinated mechanism choices and evidence-guided follow-up. Our code is publicly available at this https URL.
14. 【2611.02457】Multi-Teacher Reasoning Distillation for LLM Recommendation with Self-Exploration
链接：https://arxiv.org/abs/2611.02457
作者：Liangbo Ning,Siyuan Liang,Yi Zhou,Yifeng Zhang,Qing Li,Wenqi Fan,Dacheng Tao
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：Reasoning-augmented recommender systems, Reasoning-augmented recommender, enhance user preference, user preference modeling, recommender systems
备注：
点击查看摘要
Abstract:Reasoning-augmented recommender systems (RecSys) enhance user preference modeling by generating reasoning trajectories over historical interactions before making recommendations. Knowledge distillation provides a practical paradigm for transferring such reasoning capabilities from powerful large language models to lightweight RecSys. However, existing methods typically rely on a single fixed teacher, remain constrained by the teacher knowledge ceiling, and indiscriminately distill teacher-generated trajectories without assessing their actual utility for downstream recommendation. To address these limitations, we propose MUSE (Multi-Teacher Utility-guided Selection with Self-Exploration), an adaptive reasoning distillation framework that jointly improves reasoning generation and reasoning utilization. MUSE first constructs a diverse reasoning pool using multiple teacher LLMs and progressively augments it via student self-exploration, enabling the student to leverage the strengths of different teachers and gradually explore reasoning strategies beyond teacher imitation. We then develop Rank-Gain Utility Assessment (RGUA), which evaluates each candidate according to the normalized full-catalog rank improvement of the ground-truth item and identifies the most and least recommendation-beneficial trajectories. Based on these utility-aware trajectory pairs, we introduce dual-level contrastive learning objectives that guide the student generator to prefer beneficial reasoning while training the recommendation encoder to more effectively exploit recommendation-relevant preference evidence. Extensive experiments on three real-world datasets demonstrate the effectiveness and robustness of the proposed framework.
15. 【2611.02237】Nonreciprocal Spherical Attention and Retrieval: Sharp Coarsening Clocks and Certified Score Correction
链接：https://arxiv.org/abs/2611.02237
作者：Faruk Alpay,Taylan Alpay
类目：Machine Learning (cs.LG); Information Retrieval (cs.IR); Dynamical Systems (math.DS)
关键词：develop nonreciprocal spherical, nonreciprocal spherical attention, develop nonreciprocal, nonreciprocal spherical, mathematical framework
备注： 42 pages, 9 figures, 10 tables. Includes mathematical appendices and ancillary reproducibility code
点击查看摘要
Abstract:We develop nonreciprocal spherical attention as a mathematical framework for coarsening and compressed nearest-neighbor retrieval. For two shrinking acute blocks whose centers have zero skew pairing and whose total mass ratio is subexponential in inverse temperature, we prove $\lim_{\beta\to\infty}\beta^{-1}\log T_\beta=1-\cos\phi$, without restricting particle-count growth. An explicit three-body flow has two rigorously separated metastable exponents. For finite compression, mass centering yields a sharp $O(r^2)$ attention-output error bound at fixed temperature, with an explicit spherical-normalization correction. We formulate skew query-side score calibration as a strictly convex moment problem and derive a unique normal equation, residual-based optimization certificates, and bounded low-rank projections. A norm-aware margin objective calibrates native squared-distance rankings. Experiments use semantic retrieval data, one million visual descriptors with three codebook seeds, and a ten-million-vector FAISS IVF-PQ index with recomputed exact cosine ground truth. On SIFT1M, skew margin calibration raises native-L2 hit@10 from 0.8926 to 0.8948; symmetric calibration reaches 0.8996. The ten-million-vector index reaches 0.8827 hit@10 at 0.1794 ms per query in a four-thread batch benchmark, while validation selects no skew update. Exact streamed attention over ten million keys evaluates compressed memory on 1,024 held-out queries. Independent matrix solves, automatic differentiation, finite differences, interval arithmetic, full-flow tests, and nine Rocq-checked algebra lemmas support reproducibility. Directionality alone does not establish retrieval superiority.
16. 【2611.02139】Adversarial Robustness of Retrieval-Based Fact-Checking: Detecting and Mitigating Evidence Contamination
链接：https://arxiv.org/abs/2611.02139
作者：Alamgir Munir Qazi,John P. McCrae,Jamal Abdul Nasir
类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：Retrieval-based fact-checking systems, large document collections, fact-checking systems ground, Retrieval-based fact-checking, systems ground verification
备注： Published in Findings of the Association for Computational Linguistics: EMNLP 2026. 14 pages, 5 figures, 7 tables. Code and dataset: [this https URL](https://github.com/alamgirqazi/glad)
点击查看摘要
Abstract:Retrieval-based fact-checking systems ground verification in large document collections, creating a critical vulnerability: adversarial evidence contamination. We demonstrate that factually inconsistent but contextually coherent evidence generated to satisfy both retrieval-similarity and linguistic-fluency constraints can systematically mislead verification models. Contaminating just 3.1-7.4% of training corpora with five label-specific strategies causes adversarial content to penetrate up to 35.2% of top-k retrievals, degrading verification accuracy by up to 46.9% relative F1. Existing retrieval-stage defenses, validated against gradient-optimized or syntactically anomalous attacks, transfer poorly to this threat model: detection rates collapse and F1 recovery exhibits high variance across seeds. We propose GLAD (Geometric-Lexical Adversarial Defense), which fuses dense embedding peer-coherence with lexical distributional isolation. Across two benchmarks, two embedding models, and five random seeds, GLAD achieves the highest detection rates (70-86%) and the most consistent F1 recovery, reclaiming 73-80% of contamination-induced degradation on LIAR-RAW while approaching clean baselines on RAWFC. Crucially, unlike defenses that trade clean performance for robustness, GLAD imposes negligible cost on uncontaminated corpora.
17. 【2611.02040】Multicriteria Recommendation System by Leveraging Predefined, Implicit, and Undefined Criteria
链接：https://arxiv.org/abs/2611.02040
作者：Emrul Hasan,Chen Ding
类目：Information Retrieval (cs.IR)
关键词：Data sparsity, user-item utility matrix, criteria, recommendation system, matrix is sparse
备注： 9 pages. Preprint (submitted version, prior to peer review). The Version of Record is published in Social Networks Analysis and Mining (ASONAM 2024), Lecture Notes in Computer Science, Springer, [this https URL](https://doi.org/10.1007/978-3-031-78538-2_6)
点击查看摘要
Abstract:Data sparsity, a long-standing problem in the recommendation system, occurs when the user-item utility matrix is sparse. For years, many approaches have been experimented with, including utilizing user's textual reviews and multiple criteria ratings. In a review-based recommendation system, user preferences and item attributes are learned from reviews, while in multi-criteria recommendation systems, criteria ratings are used for the recommendation task. Multi-criteria are domain-specific pre-defined explicit criteria and users are bound to provide feedback only on these criteria with discrete values. On the contrary, users are free to express their opinions through textual reviews, which can cover multiple perspectives or aspects. It is possible that these pre-defined, domain-specific explicit criteria are not enough to fully capture the multi-faceted user preferences. To this end, we propose a novel multi-criteria recommendation model that utilizes predefined, implicit, and undefined criteria. We use a semantic similarity-based sentence clustering method to identify the predefined and implicit criteria and a sentiment analyzer to estimate their ratings. The criteria that are extracted from the review and are aligned with predefined criteria are referred to as implicit criteria. A sentence is considered as expressing opinions on an undefined criterion if the similarity score between this sentence and all the predefined criteria is lower than a predefined threshold. Ratings are computed for each extracted implicit criterion and the undefined criterion based on the review content. Finally, we use all three types of criteria and an aggregation model to make the final rating prediction for the recommendation system. Our proposed method demonstrates the superiority compared to several baselines on TripAdvisor and Beer Advocate datasets.
18. 【2611.02019】Multi-criteria Rating and Review based Recommendation Model
链接：https://arxiv.org/abs/2611.02019
作者：Emrul Hasan,Chen Ding,Alfredo Cuzzocrea
类目：Information Retrieval (cs.IR)
关键词：information technology, recommendation, advancement of information, key tools, recommendation system
备注： 10 pages. Accepted version of the paper published in the 2022 IEEE International Conference on Big Data (Big Data). (c) 2022 IEEE
点击查看摘要
Abstract:These days, due to the advancement of information technology, recommendation system has become one of the key tools for e-commerce business. E-commerce platforms allow users to provide feedback in both written comments and numerical ratings. Recommendation systems are utilized to recommend users to new or unseen items based on these previously collected comments or ratings. In recent years, multi-aspect or multi-criteria based recommendation systems have been studied a lot by the recommendation research community. However, these research works are conducted either with reviews or ratings, not with both. In this project, we argue that integrating both textual reviews (with multiple aspects) and numerical multi-criteria ratings can further enhance the overall rating prediction accuracy. We propose a Multi-criteria Rating and Review based Recommendation model (MRRRec). We show that incorporating multi-criteria ratings into multi-aspect ratings from reviews has a great impact on performance. Our proposed model outperforms several state-of-the-art models such as ANR, DeepCoNN, and Deep Multi-criteria Recommendation System in terms of MSE, MAE, precision, recall, and F1. We show that our proposed model achieves an average of 19% and 23.0% lower MSE and MAE respectively and 7.0%, 1.0% and 3.8% higher precision, recall, and F1 score respectively. We further show that our model performs significantly better with Word2Vec word embedding than the GloVe word embedding method.
19. 【2611.01987】Same Trajectory, Different Knowledge: Information-State-Aware On-Policy Distillation for Search Agents
链接：https://arxiv.org/abs/2611.01987
作者：Minhao Sun,Xian-Ling Mao,Eric Tao,Zi-Ao Ma,Zhijing Wu
类目：Information Retrieval (cs.IR)
关键词：On-policy distillation trains, trains search agents, distillation trains search, On-policy distillation, teacher feedback
备注：
点击查看摘要
Abstract:On-policy distillation trains search agents with teacher feedback on student-generated trajectories. Recent methods augment the teacher's context with supporting evidence, reference answers, or hindsight information. However, this privileged information may allow the teacher to rely on facts that the student cannot reliably recover from its current state. The resulting information-state mismatch can lead the teacher to undervalue retrieval that helps the student establish those facts. To address this mismatch, we introduce Information-State-Aware Distillation (ISA-Distill), which adapts teacher feedback to the student's factual recoverability. ISA-Distill estimates how reliably the student can recover action-relevant knowledge and derives teacher feedback for the same sampled action from two complementary views. The fact-use view supplies the teacher with the relevant fact, producing feedback that guides the student in using knowledge. The evidence-seeking view instead presents the information need, producing feedback that guides the student in acquiring supporting evidence. The two signals are weighted toward fact use when recoverability is high and toward evidence seeking when it is low, and the resulting feedback guides policy optimization. Experiments across diverse QA benchmarks and model scales demonstrate improved answer accuracy and retrieval efficiency. Our code and model checkpoints will be open-sourced.
20. 【2611.01977】EvoRec: A Unified Self-Evolving Agentic Recommender with Dynamic Reflection Trees
链接：https://arxiv.org/abs/2611.01977
作者：Mengting Li,Long Zhang,Hao Jiang,Sheng Yu,Fei Pan,Peng Jiang
类目：Information Retrieval (cs.IR)
关键词：Conventional recommender systems, fixed cascaded pipelines, recommender systems rely, Conventional recommender, cascaded pipelines
备注：
点击查看摘要
Abstract:Conventional recommender systems rely on fixed cascaded pipelines, limiting their ability to adapt to evolving user needs and feedback. Existing agentic recommenders introduce reasoning and tool use but often lack end-to-end decision control and systematic failure reflection. We propose EvoRec, a unified agentic recommendation framework that combines autonomous decision-making with reflection-driven self-evolution. A Need Agent infers user needs from long-term, short-term, and working memory. A Planning Agent adaptively allocates retrieval budgets between Behavior Continuation and Need Satisfaction, selects retrieval tools, and sets ranking-fusion weights. An Acting Executor executes the plan and records decision traces. Following user feedback, a Dynamic Reflection Tree identifies failures in need inference, planning, or previous repairs, proposes personalized corrections, and validates them through replay. Verified repairs update working memory and are distilled into reusable cross-user strategies, enabling continual improvement without parameter updates. Experiments on a Kuaishou local-services advertising dataset show a 15.7% Hit@50 improvement over the strongest baseline. Hierarchical reflection further improves Hit@50 by 13.1% among users with prior repairs. In a seven-day online A/B test, nearline EvoRec increases advertising revenue by 4.6% and CTCVR by 3.5%, with a 14.5% revenue gain for high-intent users. These results demonstrate the effectiveness of reflection-driven self-evolution in industrial-scale recommendation.
21. 【2611.01910】EAGR: Evidence-Guided Adaptive Graph Retrieval
链接：https://arxiv.org/abs/2611.01910
作者：Sonam Gupta,Vignesh P,Vishwajeet Kumar,Adnan Qidwai,Anand Eswaran,Jaydeep Sen,Sachindra Joshi
类目：Information Retrieval (cs.IR)
关键词：Retrieval-Augmented Generation, intermediate evidence reveals, reasoning requires retrieval, adapt as intermediate, reveals new information
备注：
点击查看摘要
Abstract:Retrieval-Augmented Generation (RAG) for multi-hop reasoning requires retrieval to adapt as intermediate evidence reveals new information needs. Existing approaches support such retrieval through explicit graph structures or iterative query reformulation, introducing graph-construction or query-time overhead. We present Evidence-Guided Adaptive Graph Retrieval (EAGR), a framework in which accumulated evidence dynamically determines which semantic directions to explore next, and which requires no dedicated graph database and no explicit graph materialization. EAGR operates over an implicit semantic graph induced by compact passage metadata pre-ingested into a standard VectorDB. Starting from dense-retrieval seed passages, an LLM iteratively assesses accumulated evidence, identifies promising semantic directions, expands the retrieval frontier through metadata-based neighborhood lookup, and terminates once sufficient evidence has been collected. By precomputing semantic metadata, EAGR enables evidence-conditioned graph exploration without materializing an explicit graph, maintaining a dedicated GraphDB, or iteratively rewriting the query. Across three widely used multi-hop QA benchmarks, EAGR achieves the highest LLM-based answer accuracy among evaluated methods, outperforming the vanilla RAG by 17\% and strongest graph-aware baseline by 4\% percentage points averaged across three popular benchmarks HotPotQA, 2WikiMultiHopQA, and MuSiQue.
22. 【2611.01786】IncVNM: An Interactive Recommender System with Incremental von Neumann-Morgenstern Utility Learning
链接：https://arxiv.org/abs/2611.01786
作者：Jiaxin Wei,Jia Liu
类目：Information Retrieval (cs.IR); Optimization and Control (math.OC)
关键词：modern recommender systems, modern recommender, outcome distributions, entire outcome distributions, interactive recommender system
备注：
点击查看摘要
Abstract:In modern recommender systems, users are often presented with products whose outcomes are random. The values of such products depend on their entire outcome distributions and on users' attitudes toward risk, making them difficult to evaluate using traditional product-level recommendation methods. We propose \textsc{IncVNM}, an interactive recommender system that incrementally learns a user-specific von Neumann--Morgenstern (VNM) utility function from ordinal click feedback generated during ordinary webpage browsing. At each interaction, \textsc{IncVNM} converts the click order within a displayed product list into pairwise comparisons between outcome distributions and updates the nominal utility by minimizing its deviation from the previous estimate while incorporating the newly observed pairwise comparisons. To close the interaction loop, an entropy-regularized sampling policy balances exploitation of the learned utility against exploration for additional preference information. We evaluate \textsc{IncVNM} in a rolling-window experiment with different response-error probabilities and show that it substantially outperforms the expected-return, mean--variance, discounted-UCB, and distribution-aware BPR baselines.
23. 【2611.01710】CST: Lightweight Risk Triage with Source-Grounded Evidence for Web Discussions
链接：https://arxiv.org/abs/2611.01710
作者：Zhihua Wang,Yifeng Gao,Yunhao Feng,Rui Pan,Baiheng Zhao,Zixing Chen,Nan Li
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Web communities rely, Web communities, hate speech, communities rely, Web
备注： 23 pages
点击查看摘要
Abstract:Web communities rely on moderators to catch harmful messages such as insults, hate speech, and scams, but no one can read every message. Existing tools give each message a risk score, which tells moderators where to look but not what to read or how to check it. Yet meaning depends on context: the same reply, "I agree.", can support or oppose removing someone from a group. Moderators therefore need source-grounded evidence, not just scores: a few key messages kept with their original wording and replies. We present CST, a lightweight triage pipeline that first decides where to look, then what to show. It scores risk by pairing character patterns, which capture exact wording, with sentence meaning from a fixed multilingual model, so it handles several languages and runs on an ordinary CPU. It then groups related messages and picks from each group in turn, so a small reading budget covers different parts of a discussion, and links every pick back to the original thread. Across six tasks from five datasets in several languages, CST ranks harmful messages more accurately than a fully fine-tuned multilingual model and, under the same budget, finds more of them than reading by score alone. In a user study, reviewers needed at least 27% less time with CST's grouped evidence while keeping decision accuracy above 94%. CST turns risk scores into evidence that moderators can read quickly and check in context. Code and dataset reconstruction resources will be released at this https URL.
24. 【2611.01643】CREDO: Evidence-Conditioned Credit Assignment for Temporal Reasoning Agents
链接：https://arxiv.org/abs/2611.01643
作者：Yue Leng,Shengtao Wen,Xiang Chen,Xinyi Zeng,Yu Tian,Sheng-Jun Huang
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Temporal Knowledge Graph, Knowledge Graph Question, perform multi-step temporal, select relevant facts, requires language model
备注： Code available at [this https URL](https://github.com/NUAA-MMMI/CREDO)
点击查看摘要
Abstract:Temporal Knowledge Graph Question Answering (TKGQA) requires language model agents to retrieve evidence, select relevant facts, and perform multi-step temporal reasoning. However, the trajectory-level outcome signal in GRPO does not explicitly distinguish the quality of intermediate decisions: downstream failures can penalize useful evidence acquisition, while identical rewards in all-failed groups eliminate the relative outcome signal despite differences in intermediate progress. We propose Credit Redistribution with Evidence-Driven Opportunities (CREDO), which uses intermediate evidence to recover local supervision, including in all-failed groups, and determine where outcome supervision acts. CREDO assigns positive stage-level credit through comparisons among rollouts of the same question and uses retained answer overlap as an opportunity proxy to shift part of the outcome-policy weight toward reasoning and answering. The framework preserves terminal rewards and trajectory-level advantages, while redistribution conserves total outcome-policy weight per trajectory. Following the public evaluation protocol of prior work, CREDO raises Overall accuracy from 78.0% to 82.4% and Multiple accuracy from 55.0% to 65.6% on MultiTQ relative to the strongest published baseline in our comparison. On TimelineKGQA, it raises cross-KG accuracy from 30.9% to 36.4% relative to our reproduced baseline via direct transfer to ICEWS Actor under matched training and evaluation settings.
25. 【2611.01615】LLM-Enhanced Multimodal House Price Prediction using Structured, Textual, and Visual Features
链接：https://arxiv.org/abs/2611.01615
作者：Khandokar Md. Rahat Hossain,Souvik Das,Tahsina Hashem,Mohammed Eunus Ali,Tanzima Hashem
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)
关键词：real estate buyers, estate buyers, financial institutions, house price prediction, essential for real
备注： 35 pages, 7 figures, 5 tables. Code: [this https URL](https://github.com/rh2975/LLM-VLM-HousePrice)
点击查看摘要
Abstract:Accurate house price prediction is essential for real estate buyers, sellers, agents, and financial institutions. Traditional methods rely primarily on structured data, e.g., number of bedrooms, bathrooms, parkings, but they overlook rich contextual information embedded in textual descriptions and property photos. Previous deep learning approaches for house price prediction have fused multimodal data but they fall short to extract structured spatio-temporal and contextual features from texts and semantic visual information from images. In this paper, we introduce a novel multimodal framework that addresses these limitations by systematically integrating structured attributes, textual descriptions, and visual images of properties to achieve higher prediction accuracy while maintaining interpretability. We use a large language model to derive domain-specific spatio-temporal and contextual features from text, and an unsupervised vision-language approach to automatically group photos into meaningful classes like indoor, outdoor, mixed, or floorplan, that are commonly present in real-world house listings. These categories are created without manual labeling by aligning image clusters with carefully designed pseudo text prompts. We fuse all features into a unified representation and use an optimized regressor to predict prices. Experiments on a large real-world property dataset demonstrate that our method outperforms traditional methods and existing multimodal baselines. Ablation studies confirm that the novel textual feature extraction and categorized visual embeddings substantially contribute to more accurate and reliable price predictions.
26. 【2611.01582】Measuring User Success in Randomized Search Experiments: Interpreting Good Abandonment in Generative AI Search
链接：https://arxiv.org/abs/2611.01582
作者：Minha Hwang(1),Shavak Agrawal(1),David Chen(1),Carto Wong(1),Xin Du(1),Tiannan Wang(1),Georg Buscher(1),Zheng Chen(2), ((1) Microsoft, (2) Simplex AI)
类目：Information Retrieval (cs.IR)
关键词：Randomized search experiments, Randomized search, increasingly evaluate experiences, large language models, search experiments increasingly
备注： 2026 CODE@MIT Conference
点击查看摘要
Abstract:Randomized search experiments increasingly evaluate experiences in which large language models answer information needs directly on the results page. Click status alone cannot identify success: a click may lead to an unsatisfactory result, while no click may indicate successful answer consumption, or "good abandonment." Prior research has shown that good abandonment is difficult to detect because dwell, scrolling, and reformulation are meaningful only in context. We present Session Success Rate (SSR), a human-grounded, interpretable outcome metric designed for online controlled experiments. Trained judges label complete session experiences using privacy-protected interaction evidence and video recordings; these offline labels train models scored online from query events, viewport behavior, result-page interactions, and semantic reformulations. Out-of-sample evaluation on 6,904 labeled queries yields 0.75 balanced accuracy overall and 0.68 within abandoned queries; session-level balanced accuracy is 0.68. The sample shows why interaction status is not an adequate outcome: 53.2% of abandonments were successful and 6.5% of clicked queries were unsuccessful. In a validation portfolio of seven ranking and five non-ranking experiments, SSR agreed with Sessions per User in seven cases, was inconclusive in four, and disagreed in one under a common p 0.05 rule. Separately, across approximately 4,000 production experiments, SSR produced about 2.5 times the binary sensitivity of Sessions per User; in the studied workflow, this supported lower traffic allocations and greater experiment throughput under a fixed traffic budget.
27. 【2611.01514】Federated Vector Retrieval across Heterogeneous VectorDBs
链接：https://arxiv.org/abs/2611.01514
作者：Mintaek Lim,Sieun Hyeon,Geon Chio,Jaeyoung Do
类目：Databases (cs.DB); Information Retrieval (cs.IR)
关键词：multiple independently constructed, independently constructed vectorDBs, constructed vectorDBs built, core infrastructure, real deployments
备注： Accepted for publication at VLDB 2027. The manuscript contains 13 figures
点击查看摘要
Abstract:Vector databases are now core infrastructure for AI retrieval systems, yet many real deployments must serve queries over multiple independently constructed vectorDBs built with different embedding models. This creates a systems problem of federated retrieval over heterogeneous vectorDBs: vectors and similarity scores are not directly comparable across embedding spaces, while fully resolving this incompatibility through corpus-wide re-embedding and re-indexing is often operationally prohibitive. Existing methods therefore face a difficult trade-off between retrieval quality, construction cost, and query throughput. We present HVMap, a lightweight compatibility layer for federated retrieval across heterogeneous vectorDBs. Instead of rebuilding databases into a unified space, HVMap learns bidirectional mappings between embedding spaces using a fuzzy contrastive loss, enabling calibrated cross-database scoring without corpus migration or index reconstruction. HVMap is system-agnostic and further scales to multi-vectorDB settings while preserving ranking fidelity through a hub-based architecture. We evaluate HVMap in open-domain, cross-domain, and scale-out settings, and also construct a new benchmark for heterogeneous cross-domain federation. Across these settings, HVMap consistently achieves a better quality--cost--throughput trade-off than baselines, achieving up to 3.59X higher nDCG@10, up to 2.01X higher query throughput, and construction time as low as 0.3% of baseline methods. These results show that HVMap makes heterogeneous vectorDB federation practical at scale.
28. 【2611.01489】CCD: Context-Calibrated Open-Entity Out-of-Distribution Detection in In-Context Tabular Foundation Models
链接：https://arxiv.org/abs/2611.01489
作者：Zhangkai Wu,Xu Zhang,Zhihao Hao,Zhihong Cui,Yongmin Yoo,Xianxun Zhu,Kaize Shi
类目：Information Retrieval (cs.IR)
关键词：In-context tabular foundation, Web applications, tabular foundation models, OOD, tabular foundation
备注：
点击查看摘要
Abstract:In-context tabular foundation models (TFMs), such as TabPFN, predict from a labelled context without updating their parameters and are increasingly used for out-of-distribution (OOD) detection in Web applications, whose test rows come from entities absent from that context. Such applications need open-entity OOD detection: a new entity must not be mistaken for an unknown class, and an unknown class must still be caught. Existing detectors fail in this setting, and an entity-split gap hides the failure: random splits also place the test entities in the context. The failure arises because every TFM score reflects how unfamiliar a row is to the context. This produces an entity-over-class bias: known-class rows of new entities look more OOD than familiar ones, sometimes more than unknown classes. Specifically, the two OOD scores most widely used with in-context TFMs face an entity-class trade-off: the TFM's predictive confidence misses unknown classes, whereas the distance of a test row to the context flags new entities. To address this problem, we hold a group of entities out of the context and score them with the remaining context, which turns them into new entities of known classes and tells us how such rows should score. To measure detection on new entities, we build NEO-Tab (New-Entity OOD detection on Tables), 14 grouped and temporal tables on which all test rows come from new entities. We then propose Context-Calibrated Detection (CCD), which uses these group-out swaps on in-distribution data to calibrate three distances and the confidence against new-entity references. CCD weights them by their sensitivity and sharpness, keeps the model frozen and uses no OOD data. On NEO-Tab, CCD outperforms 16 existing detectors on every metric we report, and its lead holds on three TFM backbones.
29. 【2611.01362】"PRISM" Is Not All You Need: Cross-Topic Name Collisions and Scientific Paper Retrieval
链接：https://arxiv.org/abs/2611.01362
作者：Jingjie Ning,Xueqi Li,Yibo Kong
类目：Information Retrieval (cs.IR); Digital Libraries (cs.DL)
关键词：increasingly connect papers, connect papers, paper identity, leaving readers, increasingly connect
备注：
点击查看摘要
Abstract:Scientific names increasingly connect papers from different research topics, leaving readers to recover a paper's identity from context. We study this convergence in 564,861 AI-related arXiv records. Cross-topic name collision grows 4.33-fold from a pooled 2020-2022 reference to 2026, compared with 1.12-fold within topics. A second sentence encoder reproduces the pattern, and name-group resampling quantifies its uncertainty. Fixed word-frequency bands locate the main increase in an intermediate-frequency vocabulary shared by many research areas. We then measure the ambiguity that remains after supplying research clues. With the same three-term query construction, shared-name targets retain matched identification deficits of 25.7 percentage points under title-based BM25 and 6.9 points under title-plus-abstract E5. Within fixed same-name candidates, listwise language-model ranking reaches 89.2% using the query and candidate titles. Topic-specific comparisons show that context resolves more cross-topic ambiguity. The evaluation separates candidate competition, document fields, and contextual ranking through lexical, dense, and language-model baselines. Source-linked cases and a portable evaluation collection make the phenomenon inspectable and reusable for scientific retrieval and research assistants.
30. 【2611.01354】Wrong Together: Shared Bias in User Simulation
链接：https://arxiv.org/abs/2611.01354
作者：Saber Zerhoudi
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：User simulators generate, User simulators, User, simulators generate responses, allowing researchers
备注：
点击查看摘要
Abstract:User simulators generate responses in place of human participants, allowing researchers to estimate the result of a study. To use these estimates before collecting human responses, researchers need a way to assess their reliability. We test whether disagreement among simulators can identify unreliable estimates of a group's response proportions and of differences between groups. We evaluate this signal using 6 language-model simulators and existing GlobalOpinionQA responses for 60 questions in 12 countries. Disagreement predicts invalidity more accurately for differences between two groups than for a single group's response proportions (AUC 0.87 versus 0.71). Errors shared by the simulators remain invisible to this signal. When such an error affects both groups equally, it cancels in the comparison, helping explain the stronger result for group differences. We test this explanation by estimating the shared bias using one set of groups and subtracting it from predictions for a separate set. This correction reduces prediction error without changing disagreement among the simulators. In a retrospective analysis, we simulate referring the 20% of group comparisons with the greatest disagreement for human assessment. Among the remaining comparisons with a conclusive validity judgment, 54.8% are judged invalid, compared with 63.7% before referral.
31. 【2611.01287】Dynamic Click Destinations: Personalizing Post Ad-Click Landing Experiences
链接：https://arxiv.org/abs/2611.01287
作者：Apurva Pathak,Yuya Shiraki,Iman Jenabzadeh,Nikhil Bhale,Yuwen Tan,Shashank Rangarajan,Amirmehdi Sharifzad
类目：Information Retrieval (cs.IR)
关键词：native in-product surface, multiple post ad-click, post ad-click destination, post ad-click, landing page shown
备注： 5 pages. Accepted to the IEEE ICDM International Workshop on AI for Personalization (WAIP 2026)
点击查看摘要
Abstract:Apps that monetize outbound (offsite) ad clicks have multiple post ad-click levers that influence user and business outcomes, including the landing page shown on the advertiser's site, whether the click resolves to a webpage or an app on the user's device, and whether it resolves to a native in-product surface or an external website. We refer to personalization over these levers as post ad-click destination automation. The optimal destination is heterogeneous across users, advertisers, placements, devices, and inferred intent, making static, one-size-fits-all destination policies suboptimal. We present Dynamic Click Destinations (DCD), a production personalization framework that selects a destination for each eligible offsite ad click to maximize Advertiser Value (AV), a value-weighted conversion outcome. DCD applies to any post-click destination decision where the system can choose among destination options at click time and downstream conversion feedback is available. We describe an evolution of learning objectives from post-conversion destination inference, to two-task destination-conditioned conversion prediction, to a single-task policy model that directly predicts which of two destinations is better for a given click, trained with Advantage Actor Critic (A2C)-inspired soft labels derived from a higher-capacity destination-conditioned "critic" model. In a web-vs-app case study, online A/B experiments at scale on a major advertising platform show that per-click personalization with DCD outperforms both static routing policies, with the single-task objective delivering the largest gains. These results highlight post ad-click destination as an important and under-explored lever in conversion optimization and demonstrate that personalized destination automation can outperform one-size-fits-all destination policies.
Comments:
5 pages. Accepted to the IEEE ICDM International Workshop on AI for Personalization (WAIP 2026)
Subjects:
Information Retrieval (cs.IR)
Cite as:
arXiv:2611.01287 [cs.IR]
(or
arXiv:2611.01287v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2611.01287
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
32. 【2611.01280】Improving Ads Ranking Models with Auxiliary Supervision: Techniques and Insights
链接：https://arxiv.org/abs/2611.01280
作者：Nikhil Bhale,Apurva Pathak,SaiSujithKumarReddy MarapaReddy,Xiao Yin,Prateek Bhansali
类目：Information Retrieval (cs.IR)
关键词：post-click Conversion Rate, Accurate prediction, Conversion Rate, advertising industry, prediction of post-click
备注： 5 pages. Accepted to the IEEE ICDM International Workshop on AI for Personalization (WAIP 2026)
点击查看摘要
Abstract:Accurate prediction of post-click Conversion Rate (CVR) is essential for personalized ad delivery in the advertising industry. Traditional ads ranking models rely on conversion events (e.g., a user purchasing an item) as ground truth labels for training. However, these conversion events are often sparse or missing, which limits the effectiveness of model learning. The primary contributions of this paper are: (1) a case study on the use of auxiliary supervision from a diverse set of user events and metadata signals beyond traditional conversion events, and (2) advanced modeling techniques designed to maximize the value of these signals. We detail architectural innovations such as linearized labels for improved auxiliary signal precision, a split architecture to facilitate training task decomposition, and a novel Label Combination (LaCo) approach for robustly managing noisy auxiliary data. Empirical results demonstrate that these methods deliver measurable improvements in ranking models, underscoring their versatility and effectiveness across recommendation systems and related domains.
33. 【2611.01276】OntoDoc: Automatically Generating Ontology Resource Descriptions
链接：https://arxiv.org/abs/2611.01276
作者：Juan Guajardo Gutierrez,Mike Tran,Nasim Shirvani Mahdavi,Chengkai Li
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：machine-readable knowledge representation, natural language descriptions, lack natural language, Internationalized Resource Identifier, limiting their accessibility
备注： Submitted to ISWC2026
点击查看摘要
Abstract:Knowledge graphs and ontologies form the backbone of structured, machine-readable knowledge representation, yet ontology terms often lack natural language descriptions, limiting their accessibility and reuse. Existing ontology verbalization approaches tend to rely on rule-based or template-driven techniques that operate on strict, formal schema axioms, resulting in rigid verbalizations that fail to convey richer contextual semantics. We present OntoDoc, a multi-agent framework for automatically generating natural language descriptions for any Internationalized Resource Identifier (IRI) within a SPARQL endpoint or RDF file. OntoDoc operates through a four-stage pipeline: (1) a Database Context agent that adaptively explores the knowledge graph via SPARQL to collect semantically informative triples about the target IRI; (2) a Web Context agent that retrieves and re-ranks encyclopedic background knowledge from Wikipedia and the open web; (3) an Assumption Generation agent that synthesizes both contexts into a structured, evidence-grounded list of intermediate assumptions; and (4) a Description Generation agent that produces the final natural language description from the grounded assumptions. We evaluate OntoDoc on three knowledge graphs spanning biomedical, agricultural, and cross-domain settings, using both automatic scoring via Large Language Models (LLMs) and human evaluation with 11 annotators. OntoDoc consistently matches or exceeds a naive LLM baseline and a template-based ontology verbalizer in accuracy. Furthermore, it vastly outperforms both baselines in the completeness of the generated descriptions, delivering an average 12% improvement in completeness over the naive baseline across all domains, and improving completeness scores by as much as 2.8 points on a 5-point scale relative to the ontology verbalizer.
34. 【2611.01136】SIDRec: End-to-End Semantic ID Representation and Modeling for Recommendation
链接：https://arxiv.org/abs/2611.01136
作者：Zhuohang Jiang,Yongsen Pan,Pangjing Wu,Zihuai Zhao,Zheng Hu,Yuxin Chen
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：continuous item rep, encoding continuous item, compact discrete identifiers, item rep, resentations into compact
备注：
点击查看摘要
Abstract:Semantic IDs (SIDs) have emerged as a promising approach for discriminative recommendation by encoding continuous item rep- resentations into compact discrete identifiers. However, existing SID-based methods face two fundamental limitations: semantic mis- match between content semantics and collaborative preferences, and objective mismatch between SID construction and downstream recommendation optimization. To address these challenges, we propose SIDRec, an end-to-end recommendation-aware SID learn- ing framework that jointly models content and collaborative in- formation while aligning SID construction with recommendation objectives. Specifically, SIDRec introduces a self-updating fusion mechanism that explicitly integrates pretrained content represen- tations with collaborative embeddings initialized from a trained recommendation model, enabling preference-aware semantic mod- eling. Furthermore, SIDRec employs an MMoE-inspired joint opti- mization mechanism with shared experts and task-specific gates, allowing recommendation supervision to directly guide differen- tiable quantization and produce task-adaptive discrete representa- tions. Extensive experiments on three public benchmark datasets demonstrate that SIDRec consistently outperforms all competing methods across both AUC and GAUC, achieving up to 5.15% relative improvements over the strongest baselines. Further ablation stud- ies validate the effectiveness and complementarity of collaborative semantic modeling and end-to-end SID optimization.
35. 【2611.01126】Do GEO Gains Survive the Live Web? Evaluating In-the-Wild Visibility Gains of Generative Engine Optimization via LIVE-GEO
链接：https://arxiv.org/abs/2611.01126
作者：Runze Kong,Haibo Jin,Xucheng Yu,Xiaoqi Wang,Huimin Zeng,Haohan Wang
类目：Information Retrieval (cs.IR)
关键词：Generative engine optimization, termed generative engines, rewrites web content, LLM-based search systems, Generative engine
备注： 12 pages, 5 figures, 8 tables
点击查看摘要
Abstract:Generative engine optimization (GEO) rewrites web content so that LLM-based search systems, also termed generative engines (GEs), rank it higher in their answers and recommendations. However, existing GEO evaluations typically rely on directly supplied text or controlled retrieval pipelines, and whether GEO gains survive the live Web remains unclear, leaving a gap in understanding how GEO strategies affect the visibility of live webpages when accessed and ranked by GEs. To address this gap, we introduce LIVE-GEO, a benchmark for Live, In-the-wild Visibility Evaluation for GEO. LIVE-GEO publishes GEO-rewritten products as live webpages. We use LIVE-GEO to evaluate five existing GEO strategies (CORE, C-SEO, E-GEO, AgenticGEO, and Statistics Addition), applying them to the product descriptions and reviews of 80 fictional brands across 18 product families. We run experiments on three GEs (ChatGPT with GPT-6, Gemini 3.6 Thinking, and Grok in Expert mode), four direct-text API evaluators (GPT-4o, DeepSeek, Kimi, and Claude), and a direct-text local evaluator (Qwen2.5-3B-Instruct). With frozen $\pm0.2\%$ prices, most direct-text evaluators and GEs receiving product URLs give CORE the highest Top-1 rate, reaching 66.3%-76.3% on the GEs, yet other strategies vary in relative performance, and the GEs select the same top product for only 48.8%-66.3% of brands. We also find that ChatGPT is sensitive to the order of candidate URLs: CORE's Top-1 rate is 73.8% and 93.8% under two opposite fixed orders, and the randomized order used by LIVE-GEO yields 82.5%, between the two. In the numerical-faithfulness check, the JEV verifier agrees with the reference labels on 90.7% of 194 numerical benchmark cases and with human judgments on all 50 sampled descriptions, and it flags 86 of the 400 rewritten descriptions, including all 80 Statistics Addition descriptions.
36. 【2611.01090】Numerical Embeddings for CTR Prediction: A Taxonomy, Unified Benchmark, and Open-Source FuxiCTR Extension
链接：https://arxiv.org/abs/2611.01090
作者：Heng Yao,Hanwei Zhu,Tianying Liu,Yulou Shu,Siyun Hou
类目：Information Retrieval (cs.IR)
关键词：map scalar features, Numerical embeddings map, embeddings map scalar, Numerical embeddings, click-through rate
备注： 5 pages
点击查看摘要
Abstract:Numerical embeddings map scalar features into vectors before a click-through rate (CTR) backbone combines the fields. To our knowledge, NumEmbBench is the first open benchmark dedicated to comparing numerical embeddings for CTR prediction. We classify 18 configurations into six mechanism-based families and evaluate them through one FuxiCTR interface. After equal-budget validation tuning, we compare frozen configurations on three datasets, nine backbones, and five seeds under a shared train-only z-score protocol. DEER has the best mean rank, but six methods lead at least one dataset--backbone setting. A matched native-scale test changes the winner in 11 of 27 settings, while paired latency measurements show that accuracy and inference cost need not move together. Code and per-seed results: this https URL
37. 【2611.01086】Growth of global science: reflections on measurability and scientometric insights
链接：https://arxiv.org/abs/2611.01086
作者：Robert Tijssen(1 and 2),Erik van Wijk(1),Alfredo Yegros(1) ((1) Leiden Univ., (2) Stellenbosch Univ.)
类目：Information Retrieval (cs.IR)
关键词：recent years, interconnected in recent, Global science, Global, adaptive social system
备注： 23 pages, 5 figures, 1 table
点击查看摘要
Abstract:Global science has become much larger and more interconnected in recent years. Such a complex and adaptive social system defies any attempt to systematically and comprehensively measure or monitor its growth and evolution. Yet, as it continues to expand and enhance its public value, effective evidence-based assessment has become increasingly critical for understanding its dynamics and managing the system. This paper offers a framework for addressing system-level measurability challenges. Inspired by Derek de Solla Prices pioneering scientometric work in the 1960s, this paper addresses analytical issues related to current measurements of the systems expansion since the turn of the 21st century. Our empirical analysis of global science dynamics presents new macro-level data on several observable megatrends in research publication output worldwide. Acknowledging the limited analytical scope of these trend data to understand the dynamics of global science, we outline currently available options to improve system-level measurability under conditions of ambiguity and uncertainty. Looking forward, we discuss likely future directions to establish integrated, multi-stakeholder measurement infrastructures.
38. 【2611.01072】Where Beam Search Loses Top-Ranked Items:First-Step Coverage in Generative Recommendation
链接：https://arxiv.org/abs/2611.01072
作者：Heng Yao,Hanwei Zhu
类目：Information Retrieval (cs.IR)
关键词：wider beam ranked, TIGER generative recommender, semantic-ID positions, roughly half, half the prefix-capacity
备注： 5 pages, 5 figures
点击查看摘要
Abstract:Generative recommendation can reproduce a wider beam's ranked output with roughly half the prefix-capacity budget by reallocating retention capacity across semantic-ID positions. We identify a \emph{first-step coverage bottleneck}: across six full-test settings of the TIGER generative recommender spanning three domains and two identifier constructions, every pruned exact top-10 path is first lost at the initial decoding step. An exact-catalog reference isolates search losses and guides a controlled budget intervention. Moving width to the first step raises Search Recall@10 by 0.96--10.90 percentage points at Beam-50's unchanged budget. Across all 77,373 test users with residual-quantized variational autoencoder (RQ-VAE) tokenization, the reallocated schedule reproduces Beam-100's ordered top-10 at nominal budgets of 151 rather than 301, without retraining or changing identifiers or scores. Matched-output timing saves 6.35--6.39\% of decoder latency; profiling identifies the execution costs that limit the translation from reduced search work to runtime savings. Larger-candidate experiments reveal how output size changes retention requirements. These findings make budget placement an actionable serving decision: locate ranking loss, redirect search capacity, and preserve downstream inputs before increasing uniform beam width.
39. 【2611.00972】PACT: Defending Recommendation against Promotional News Rewriting via Attack-Diverse Score Consistency
链接：https://arxiv.org/abs/2611.00972
作者：Chongxian Chen,Fan Mo,Xin Fan,Hayato Yamana
类目：Information Retrieval (cs.IR)
关键词：altering underlying facts, content providers rephrase, providers rephrase headlines, LLM-powered promotional attacks, underlying facts
备注： 11 pages
点击查看摘要
Abstract:Personalized news recommenders are increasingly vulnerable to LLM-powered promotional attacks, where content providers rephrase headlines to manipulate rankings without altering underlying facts. Defending against such manipulation requires covering a wide spectrum of LLM generators and optimization strategies--ranging from stylistic prompting to reinforcement feedback--without incurring prohibitive training or inference costs. In this work, we present PACT (Pooled Attack Consistency Training), a model-agnostic defense that decouples relevance estimation from superficial rhetorical variations. PACT integrates three synergistic operations: it pools offline, fact-checked rewrites from multi-generator and multi-strategy attack sources; samples a constant number of variants at each training visit to yield an unbiased estimator of the pool-wide consistency objective under a fixed compute budget; and aligns original and rewritten ranking scores within the same user context jointly with click supervision. Requiring no architectural modifications or test-time filtering, PACT deploys the trained recommender with zero extra latency. Across nine experimental settings spanning three recommendation backbones and three unseen-generator attacks, PACT consistently achieves the lowest promotion rate and target exposure, outperforming the strongest defense baseline by up to 3.0 percentage points in promotion reduction under LANCE. Further evaluations verify that PACT's superiority holds robustly under unseen attack-strategy holdouts and adaptive white-box retraining, while keeping clean recommendation utility virtually intact.
40. 【2611.00884】When 200 OK Is Not an Answer: Silent Fetch Failures in Agentic Web Content Acquisition
链接：https://arxiv.org/abs/2611.00884
作者：Shuyang Zhang(The Hong Kong Polytechnic University)
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL); Networking and Internet Architecture (cs.NI)
关键词：treat an HTTP, answer engines fetch, question time, Web agents, engines fetch pages
备注： 10 pages, 3 figures
点击查看摘要
Abstract:Web agents and answer engines fetch pages at question time, and liveness checks of cited sources treat an HTTP 200 response as success. We measure how often that assumption fails and what it does to measurements built on fetched pages. We fetched 10,307 URLs in three days with a polite static client and a rendered browser client: pages from 1,507 sites in five strata, random non-existent paths on every site, and the 4,795 URLs cited by expert-verified claims in ExpertQA. We define a taxonomy of what a 200 response contains, label the static 200 responses automatically, and check the labels against 300 items reviewed by an LLM-based assistant; a human check of 60 of them retained every reviewed usability label after discussion. By the automatic labels, 20.9% of the pages that a static client receives with status 200 do not contain the page's main content: app shells, bot challenges, block pages, error and placeholder pages, and partial content. On the held-out test split, the reviewed sample lowers this estimate from 25.5% to 20.0%. 13.1% of the sites whose random-path probe was answered returned 200. The error propagates: for the cited sources, treating 200 as content overstates the share of claim-source pairs that can be checked against live content by 12.2 points and inflates the apparent silent citation-drift rate from 5.8% to 21.9%. Cheap heuristics catch most of it. Text length, probe comparison and redirect-to-root, combined and tuned on held-out sites, recover 86% of unusable reviewed responses at a false-alarm rate near 5%. Content-reading detectors perform comparably: the best, the text classifier, gains five to seven points of recall at more than twice the false-alarm rate. We argue that agents and their evaluations should report fetch outcomes explicitly instead of inferring them from the status line and will release the labelled data and code.
41. 【2611.00802】EduExplain: A Benchmark for Explanation-Set Retrieval and Storyboard Construction in Educational Explanation
链接：https://arxiv.org/abs/2611.00802
作者：Aryan Ahmed,Riti Verma,Sanskar Singh,Maya Ramanath
类目：Information Retrieval (cs.IR)
关键词：Generating an educational, single retrieval step, ground truth, lesson or video, retrieve a compact
备注：
点击查看摘要
Abstract:Generating an educational explanation for a learner's query is not a single retrieval step but a pipeline: a system must first retrieve a compact set of complementary resources--passages, figures, examples, activities--that jointly support an explanation, then structure that set into an ordered, timed, role-assigned plan before rendering it as a lesson or video. Existing retrieval benchmarks evaluate neither stage at the level these applications require: they score individual documents rather than explanation sets, and provide no ground truth for how a set should be organised into an explanation. We present EduExplain, a benchmark providing human-validated ground truth for both stages. Built from secondary-level science textbooks, it comprises 6,921 typed, multimodal resources and 2,123 concepts, and pairs each of 321 learner-oriented queries with one or more human-validated explanation sets (retrieval ground truth) and 741 reference storyboards (structuring ground truth). The benchmark exposes characteristics absent from prior datasets: heterogeneous multimodal retrieval units, multiple valid explanation sets per query, and plans whose quality depends on pedagogical role composition, grounding, and timing rather than relevance alone. We describe an LLM-assisted, human-validated construction pipeline, report inter-annotator agreement for both layers, and establish baselines for each stage--lexical, dense, multimodal, and cross-encoder retrieval paired with four selection strategies, and free-form and fixed-template storyboard construction. Our results show that first-stage retrieval quality dominates retrieval-stage performance, that off-the-shelf diversity-based selection underperforms simple top-ranked selection, and that unconstrained and rigidly templated structuring both fall short of the reference plans. The benchmark is available at this https URL.
42. 【2611.00762】HiPaper: A Human-AI Collaborative System for Academic Literature Triage and Scholarly Sensemaking
链接：https://arxiv.org/abs/2611.00762
作者：Ye Jia,Pangjing Wu,Hayley Y.W. Gu,Zhuohang Jiang,Xu Yuan,Peter H.F. Ng,Zackary P. T. Sin,Qing Li,Chen Li
类目：Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：sensemaking requires researchers, understanding evolves, requires researchers, Scholarly sensemaking requires, Scholarly sensemaking
备注：
点击查看摘要
Abstract:Scholarly sensemaking requires researchers to iteratively retrieve, collect, and synthesize literature as their understanding evolves. However, existing scholarly tools provide only partial support for this process. Recent artificial intelligence (AI)-based systems generally rely on opaque submit-and-wait pipelines that it users' ability to inspect, revise, and validate intermediate outputs. In this study, we present HiPaper, a human-AI collaborative literature review system informed by a formative study with academic experts. HiPaper organizes scholarly sensemaking as a three-stage interactive workflow spanning Retrieval, Collection, andSynthesis, centralized on the human-in-the-loop paradigm that exposes intermediate AI-generated content for user inspection and intervention through a persistent workspace called Knowledge Pocket. Through this workflow, users can iteratively refine search intent, curate and organize papers with AI-enriched metadata and clustering, and conduct evidence-traceable synthesis over selected literature. Our user study with 14 Ph.D. students showed that HiPaper efficiently supports scholarly sensemaking by enabling human-AI collaboration in both familiar and unfamiliar domains. Furthermore, the findings highlight how staged interactions with intermediate AI-generated content successfully scaffold user interactions throughout the sensemaking process.
43. 【2611.00755】DuSE-Bench: Benchmarking Joint Reasoning over Evolving Dialogue and Documents
链接：https://arxiv.org/abs/2611.00755
作者：Guanjie Cheng,Jianfeng Gao,Yufei Tong,Xinkui Zhao,Shuiguang Deng
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Web information assistants, Persistent Web information, Web information, Persistent Web, revised across sessions
备注： 12 pages, 4 figures
点击查看摘要
Abstract:Persistent Web information assistants must combine evolving document facts with user requirements established and revised across sessions. Yet systematic evaluation of how changes in both sources affect response requirements and evidence attribution remains limited. To address this gap, we introduce Dual-Source Evolution Benchmark (DuSE-Bench), a benchmark comprising 1,000 tasks across five scenarios, including 700 whose required premises originate in both dialogue and documents. An evolving Support Graph guides task construction and preserves links from updated facts and reused conclusions to original turns and passages. Task annotations distinguish grounding source from state dependence and enable separate evaluation of response content, response type, and source attribution. Experiments across 11 baseline configurations reveal persistent challenges in joint reasoning over evolving dialogue and documents, with content accuracy on jointly grounded tasks reaching at most 56.7%. Moreover, improvements in content accuracy can coincide with poorer response choice, while content-correct responses frequently lack complete attribution to original evidence. Matched evidence substitutions further show that the effect of replacing one source's evidence depends on support from the other. These findings motivate coordinating dialogue memory and document retrieval to apply current user requirements and document facts together while preserving their original support. The data are available at this https URL.
44. 【2611.00638】ElectroChemLLM: A Multimodal LLM Pipeline for High-Fidelity Electrochemical Informatics
链接：https://arxiv.org/abs/2611.00638
作者：Dikshya Mohanty,Manoj Praveen Nandigama,Kuldeepsinh Raj,Sourav Kanti Maiti,Jiannan Yang,Ruiqi Luo,Srinivasa Phani Madhav Marupudi,Mounika Geriki,Prayag Raghunandan,Puneet Lingutla,Tengfei Ma,Niranjan Balasubramanian,Nav Nidhi Rajput
类目：Computation and Language (cs.CL); Databases (cs.DB); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：including energy storage, energy storage systems, advancement relies heavily, Electrochemistry is central, modern-day challenges
备注：
点击查看摘要
Abstract:Electrochemistry is central to solving many modern-day challenges, including energy storage systems for a sustainable future, and its advancement relies heavily on the data from past findings. Existing automated pipelines are limited by text-only architectures, context fragmentation, and numerical hallucinations - collectively preventing accurate, large-scale curation of property databases. We introduce ElectrochemLLM, a multimodal information extraction pipeline that jointly identifies structured electrochemical records encompassing electrolyte compositions, electrode materials, cell configurations, and their measured physicochemical properties from unstructured scientific PDFs at scale. By combining hybrid document parsing with vision-capable LLM orchestration, the pipeline extracts verifiable, structured data across text, tables, and figures. Evaluated on the battery-electrolyte subset of our manually annotated benchmark of 232 papers, ElectrochemLLM achieves an F-1 score of 0.97, and has been applied to curate ElectroChemDB, a structured database spanning 15,000 electrochemical research articles. We demonstrate the utility of this resource by training machine learning models for electrolyte property prediction, illustrating a complete pathway from unstructured literature to predictive materials discovery.
45. 【2611.00530】WeSearch: A Unified Model-Centric Retrieval Framework for WeChat Search
链接：https://arxiv.org/abs/2611.00530
作者：Kepu Zhang,Yuzhe Cai,Yue Shu,Dawei Chen,Jinhai Zhu,Yuan Xu,Zehua Dai,Tongke Ni,Ziyao Chen,Chen Fu,Jie Shao,Chao Wang,Xiangmin Wang,Ruifeng Zhao,Rongchun Yao,Jie Yin,Weixin Qiu,Nan Song,Junyang Li,Fan Li,Quanchao Hui,Yulong Ou,Qiang Chen,Hao Cao,Sen Yang
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：continuously evolving content, evolving content search, model-centric retrieval framework, framework for large-scale, continuously evolving
备注：
点击查看摘要
Abstract:We present WeSearch, a unified, model-centric retrieval framework for large-scale, continuously evolving content search. Prevailing methods assign documents fixed hierarchical Semantic IDs, implicitly assuming each document follows a single coherent semantic path-an assumption that often breaks down for multi-topic documents. WeSearch instead retrieves query-relevant clusters and then ranks atomic documents within the resulting query-specific candidate space, decoupling candidate pruning from fine-grained relevance modeling. Combined with relevance-aware training, compact document representations, and incremental index updates, this design enables weekly-or daily when needed-model refreshes. Deployed as the primary semantic retrieval path in WeChat Search alongside a lexical syntax tree, WeSearch shows consistent one-week A/B gains on corpora from hundreds of millions to billions of documents, and a one-month full-traffic A/B test confirms stable improvements of +0.68% CTR and +2.27% per-user article clicks, together with a 41% reduction in retrieval resource cost and a 19 ms reduction in graphic-text retrieval latency. WeSearch is now fully deployed in WeChat Search, serving 100% of production traffic.
46. 【2611.00244】MEMENTO: Learning Context Management for Long Context Processing Agents
链接：https://arxiv.org/abs/2611.00244
作者：Yunfan Zhang,Taehoon Hwang,Kathleen McKeown,Smaranda Muresan
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：perform context management, LLM agents, operate over long, long inputs, inputs must perform
备注：
点击查看摘要
Abstract:LLM agents that operate over long inputs must perform context management: deciding what to retain in a fixed-size context window. A common approach is compaction, where the model replaces its history with a self-generated note. Yet off-the-shelf agentic models, including GPT-5.5 and GLM-5.3, often write ineffective notes, and reinforcement learning (RL) alone rarely discovers useful note-taking behavior. We present MEMENTO, a long-context agent built on Qwen3-8B and trained to manage its context through compaction. We first bootstrap note-taking by fine-tuning on synthetic trajectories annotated with notes generated in hindsight, then reinforce it with RL using a reward that combines answer correctness, note-quality heuristics, and confidence calibration. Although trained only to compact into a fresh window, MEMENTO extends at test time to strategies such as context folding and confidence-based backtracking. On book-level question answering across four benchmarks, with books of up to 2.5M tokens, MEMENTO raises Qwen3-8B's accuracy from 36.9% to 67.8% while never holding more than 20K tokens in context. It outperforms GPT-5.5 agent in the same harness (13.1%) and full book context (56.7%) at less than 1/50 the cost. It also nearly matches a ~100x larger GLM-5.3 agent (69.3%) at 1/9 the cost, and comes within 6.4 points of GLM-5.3 full context at 1/26 the cost.
47. 【2611.00169】PatchScout: Thematic Web Data Collection via Information Foraging
链接：https://arxiv.org/abs/2611.00169
作者：Michael West,Eduard Dragut
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：single query, decentralized sources, spanning many decentralized, documents spanning, Researchers
备注： 10 pages, 1 figure, to be published in Advances in Neural Information Processing Systems 2026
点击查看摘要
Abstract:Researchers often need web corpora that are not answers to a single query, but reusable collections of documents spanning many decentralized sources. We refer to this problem as thematic web data collection: assembling semantically relevant documents that share a common theme but are scattered across heterogeneous and structurally disconnected regions of the web. Existing approaches, including traversal-based methods and LLM-driven web agents, are limited by local exploration or short-horizon stopping, preventing comprehensive collection. We formulate this task as a long-horizon information foraging problem over query-induced semantic patches, where the central challenge is deciding when to continue local exploitation and when to switch to new regions. We propose PatchScout, a multi-agent framework that instantiates a class of patch-switching policies to balance local exploitation and adaptive patch switching under a fixed budget. Experiments on four live-web topics show that PatchScout substantially improves yield and domain coverage over traversal-based and search-augmented reasoning agent baselines. In an applied social science setting with an incomplete prior collection, PatchScout discovers 102 previously unidentified entities, illustrating its ability to expand existing thematic datasets.
48. 【2611.00111】SpatialVec: A Unified Representation Learning Framework for Geospatial Objects with Boundary-Aware Sampling
链接：https://arxiv.org/abs/2611.00111
作者：Samya Acharja,Kanchan Chowdhury
类目：Computer Vision and Pattern Recognition (cs.CV); Databases (cs.DB); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：Geospatial Artificial Intelligence, Artificial Intelligence, Geospatial Artificial, essential for Geospatial, enabling machine learning
备注： Accepted to 2026 IEEE International Conference on Big Data as a full research paper
点击查看摘要
Abstract:Spatial representation learning is essential for Geospatial Artificial Intelligence (GeoAI) applications, enabling machine learning models to capture the geometry, location, and spatial relationships of geographic entities such as points, polylines, and polygons. Existing spatial encoding methods often struggle to preserve fine-grained topological information, particularly for interactions involving complex geometries such as polylines and polygons. These approaches inadequately capture boundary structure and local spatial context, causing topology-sensitive relationships near geometry boundaries to be underrepresented in the learned embedding space. Consequently, accurately modeling complex spatial interactions remains a significant challenge for downstream spatial reasoning tasks. To fill the gap, we introduce SpatialVec, a boundary-aware spatial representation learning framework that adaptively samples geometry boundaries and their surrounding regions, capturing fine-grained geometric structures critical for topology-aware spatial reasoning. A transformer-based encoder-decoder trained through geometry reconstruction produces compact, geometry-aware, and unified representations for points, polylines, and polygons. Empirical evaluation on two real-world datasets shows that SpatialVec substantially improves the preservation of challenging topological relationships involving polygonal interactions and outperforms state-of-the-art baselines significantly on downstream prediction and classification tasks.
计算机视觉
1. 【2611.03648】Pixel: A Co-Designed Full-Stack Robot System for Learning General-Purpose Mobile Manipulation
链接：https://arxiv.org/abs/2611.03648
作者：Tony Tao,Jason Jingzhou Liu,Ruslan Salakhutdinov,Deepak Pathak
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Systems and Control (eess.SY)
关键词：General-purpose mobile manipulation, mobile manipulation requires, General-purpose mobile, learning general-purpose mobile, scalable demonstration collection
备注： More results at [this https URL](https://pixel-robot.com/pixel)
点击查看摘要
Abstract:General-purpose mobile manipulation requires a combination of capable robot hardware, scalable demonstration collection, expressive whole-body control, and effective policy learning. Yet these components are often developed independently, creating mismatches that limit the capabilities of the complete system. We present Pixel, a co-designed full-stack system for learning general-purpose mobile manipulation. Pixel combines a low-cost wheeled humanoid with human-aligned kinematics and compliant grippers, multiple teleoperation and robot-free human data-collection interfaces, a unified whole-body controller, and a common policy learning pipeline across human and robot demonstrations. A hierarchical learning stack further enables language-conditioned visuomotor control and long-horizon task execution. We evaluate the system across hardware, data collection, and policy learning, and demonstrate mobile-manipulation behaviors requiring dexterity, active perception, navigation, and whole-body coordination. We hope that Pixel provides an integrated and extensible foundation for studying how robot hardware, data, control, and learning can be designed together for robot learning. More results at this https URL
2. 【2611.03647】Pixel-UMI: Learning Environment-Aware Whole-Body Manipulation from Sensorized Human Demonstrations
链接：https://arxiv.org/abs/2611.03647
作者：Jason Jingzhou Liu,Tony Tao,Deepak Pathak,Ruslan Salakhutdinov
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Systems and Control (eess.SY)
关键词：offer scalable data, complicate policy learning, Sensorized human demonstrations, demonstrations offer scalable, embodiment differences complicate
备注： Video results are available at [this https URL](https://pixel-robot.com/pixel-umi)
点击查看摘要
Abstract:Sensorized human demonstrations offer scalable data for mobile manipulation, but embodiment differences complicate policy learning. We present Pixel-UMI, a pipeline for learning environment-aware whole-body policies from human data. We first introduce Environment-Aware Retargeting (EAR), which combines reconstructed scene geometry with demonstrated head and gripper trajectories to determine robot posture and generate collision-aware joint and base targets. Delay-calibrated action assignment converts these trajectories into actions. However, kinematic differences can leave residual pose errors, creating viewpoint mismatches between human demonstrations and robot observations. We therefore introduce Retargeting-Error-Aware Masking (REAM), which uses these errors during training to reduce reliance on mismatched views at deployment. Finally, because estimated actions cannot fully capture contact-rich interactions, we collect on-policy human corrections through DAgger to improve performance. We evaluate Pixel-UMI on five challenging tasks spanning articulated-object manipulation, deformable-object handling, constrained-space reaching, whole-body collision avoidance, and contact-rich bimanual coordination, achieving 87.0% average task progress. Video results are available at this https URL
3. 【2611.03646】EgoActionBench: Benchmarking Dense Action Captioning for Egocentric Human Videos
链接：https://arxiv.org/abs/2611.03646
作者：Yujiao Shen,Jiahe Song,Haitian Li,Jingkang Yang,Ziwei Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：accurately understand fine-grained, human data offers, understand fine-grained human, fine-grained human actions, egocentric observations
备注： 32 pages, 16 figures. Project page: [this https URL](https://egoaction-bench.github.io)
点击查看摘要
Abstract:Learning from human data offers a scalable path toward embodied intelligence, yet it requires models to accurately understand fine-grained human actions from egocentric observations. However, existing benchmarks remain limited in action atomicity, temporal precision, and hand-action association. We introduce EgoActionBench, a benchmark that represents continuous human manipulation as temporally localized atomic actions associated with the left hand, right hand, or both hands. EgoActionBench contains 1,407 episodes with 41,132 human-refined action annotations. To evaluate such dense predictions, we propose an evaluation protocol that retrieves temporally eligible candidates, selects a prediction by content agreement, and scores semantic fidelity and temporal overlap alongside action precision and recall, jointly capturing what happens, when it happens, and which hand performs it. We benchmark 20 baseline models and systems on EgoActionBench and further adapt two backbones, Qwen3-VL-4B and LLaVA-OneVision-2-8B, through supervised fine-tuning followed by reinforcement learning on automatically annotated training episodes. EgoAction improves EgoActionScore by 15.9 and 23.2 points on the two backbones, and both adapted models outperform all open-source baselines. Our experiments reveal substantial limitations of current models in action atomicity, temporal precision, and hand-action association, highlighting the gap between general video understanding and the action understanding required for embodied intelligence.
4. 【2611.03626】Isekai3D SDG: A Platform for Diverse Synthetic Gameplay Visual Data
链接：https://arxiv.org/abs/2611.03626
作者：Rafal Karp,Gene Liu,Shih-Hsin Li,Eric Courtemanche,Shengze Wang,Josef Spjut,David Pankratz,Mischa Kolbe,Michael Stengel,Sven Elflein,Adam Grygielski,Liwen Wu,Anjul Patney
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Synthetic Data Generation, neural graphics, Unreal Engine plugins, Data Generation, simulating and capturing
备注： [this https URL](https://research.nvidia.com/publication/2026-10_isekai3d-sdg-platform-diverse-synthetic-gameplay-visual-data)
点击查看摘要
Abstract:We present Isekai3D Synthetic Data Generation (SDG), a platform for simulating and capturing synthetic 3D gameplay for research in vision and world models, neural graphics, gameplay agents, and other applications. The platform combines reusable environment and character assets with Unreal Engine plugins in a two-stage workflow. First, world simulation generates gameplay while recording the world state, character movements, actions, and camera tracks needed for replay. Second, the recorded simulation is replayed to capture selected outputs, such as rendered video, images, and depth maps, at a specified resolution and frame rate under selected rendering and camera configurations. Separating simulation from capture allows the same recorded gameplay to produce multiple output variants without repeating the original simulation. Visual outputs are accompanied by frame-aligned camera, character, and action metadata. The platform uploads generated data directly in a training-friendly format, reducing intermediate storage, preparation time, and manual processing. This report describes the design of our overall system, including the platform's assets, plugins, and their functionality, explaining how they work together to generate diverse synthetic gameplay data.
5. 【2611.03602】Reviso: Not All Visual Evidence Deserves Equal Attention in Video Captioning
链接：https://arxiv.org/abs/2611.03602
作者：Tengfei Liu,Yang Shi,Yuran Wang,Yuqi Tang,Yizhuo Jia,Zhuoran Zhang,Qixun Wang,Shujie Li,Xuanyu Zhu,Xinyu Liu,Minghui Guo,Shixuan Liu,Haotian Wang,Yuanxing Zhang,Pengfei Wan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal large language, large language models, overemphasize minor details, Multimodal large, overlooking essential context
备注：
点击查看摘要
Abstract:Multimodal large language models (MLLMs) can generate detailed video captions, yet they may overemphasize minor details while overlooking essential context and key events. We argue that not all visual evidence deserves equal attention, as the importance of visual information depends on the content of each video. Motivated by this observation, we propose Reviso, an agentic video captioning framework that learns what to observe and how to gather relevant visual evidence. From a low-frame-rate global preview, Reviso constructs a hierarchical Context--Focus--Points (CFP) observation plan that identifies the video context, prioritizes key aspects, and defines concrete observation targets and corresponding tools. Guided by this plan, Reviso performs goal-directed active perception by selectively revisiting temporal segments and combining tools for fine-grained inspection. It interprets the acquired evidence, updates its plan as needed, and integrates global and local information to generate the final caption. To learn this observation strategy, we develop a verification-guided pipeline that constructs high-quality training trajectories through factual verification and teacher-guided refinement. We further train Reviso using Group Relative Policy Optimization (GRPO), incorporating a key-fact reward for caption quality, a Plan Alignment Reward (PAR) for identifying important observation targets, and an Unproductive Tool-Call Penalty (UTCP) that adjusts observation-cost penalties based on caption quality. Experiments across four video captioning benchmarks show that Reviso outperforms the evaluated open-source baselines, while its generated captions better support downstream video question answering. These findings highlight the effectiveness and potential of priority-guided active observation for video captioning.
6. 【2611.03597】Structured Visual Landscape: Generating Preferred Representations in Biological and Artificial Neural Networks
链接：https://arxiv.org/abs/2611.03597
作者：Yusong Zhao,Edgar Y. Walker,Hao Wang,Mi Lu
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)
关键词：learning and neuroscience, neurons respond, important question, deep learning, artificial neural networks
备注：
点击查看摘要
Abstract:Understanding how neurons respond to visual stimulus is an important question in both deep learning and neuroscience. It has significant implications for enhancing the interpretability of black-box artificial neural networks and for understanding the visual representation in the human brain. We propose a structured visual representations landscape and design an activation-based prior that allows us to effectively regularize the landscape with activations from brain regions or neural network units. Our model Vis-Lens integrates a variational autoencoder and a diffusion model into an image generation framework. It enables the generation of natural, realistic preferred images by directly modifying the activation-regularized latent codes without per-image iterative optimization. We demonstrate the effectiveness of our framework on both artificial neural networks and human visual cortex using functional magnetic resonance imaging (fMRI) data. Our framework improves activation modulation and image realism compared with a recent state-of-the-art method for generating preferred visual representations of these neural targets.
7. 【2611.03588】3D-BBDA: Backpropagation-Free Black-Box Domain Adaptation for Robust 3D Point Cloud Recognition
链接：https://arxiv.org/abs/2611.03588
作者：Shivangi Rai,Kunal Jangid,Vaibhav Kumar,Vinod K Kurmi
类目：Computer Vision and Pattern Recognition (cs.CV); Computational Engineering, Finance, and Science (cs.CE); Robotics (cs.RO)
关键词：suffer performance drops, domain shifts caused, environmental variation, critical for robotics, urban sensing
备注： Accepted at WACV 2027
点击查看摘要
Abstract:Robust 3D point-cloud recognition is critical for robotics, mapping, and urban sensing, yet point-cloud classifiers often suffer performance drops under domain shifts caused by sensor changes, environmental variation, and acquisition artifacts. Many existing adaptation methods are difficult to deploy in practice because they require access to source data or the internal parameters of the source model, which may be restricted by privacy, licensing, or security constraints. We present 3D-BBDA, a backpropagation-free black-box domain adaptation framework that adapts a source-trained predictor to unlabeled target data using only black-box outputs. Our method performs pseudo-label guided prototype-based alignment and employs a weighted prediction module to fuse source logits with alignment logits, reducing sensitivity to noisy pseudo-labels. To stabilize prototype memory when pseudo-label coverage is incomplete, we construct a Gaussian-perturbed prototype prior from unlabeled target predictions and use it as a fallback for missing or unreliable class prototypes during alignment. Experiments on four corrupted 3D benchmarks demonstrate consistent improvements over strong baselines. On ModelNet-40C, 3D-BBDA achieves mean errors of 32.08% (PointNet) and 29.62% (GDANet), outperforming Source-only (35.88% / 34.03%) and BFTT3D (33.78% / 32.36%). 3D-BBDA requires only a single forward pass with no gradient updates making it suitable for real-time, privacy-preserving deployment in transferable 3D recognition pipelines. Project page is available at this https URL
8. 【2611.03557】PlantVLM-Edge: Quantized Vision-Language Models for On-Device Crop Health Diagnosis
链接：https://arxiv.org/abs/2611.03557
作者：Gaurab Wagle,Bishal Adhikari,Jiajia Li,Xiaolei Huang,Dong Chen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：crop health diagnosis, sustainable agricultural production, accurate crop health, crop health, requires expert knowledge
备注：
点击查看摘要
Abstract:Timely and accurate crop health diagnosis is essential for sustainable agricultural production, yet accurate diagnosis often requires expert knowledge that is not readily available. Recent vision-language models (VLMs) have demonstrated remarkable capabilities in visual understanding, reasoning, and natural-language interaction, creating new opportunities for intelligent crop health assessment. However, deploying VLMs on resource-constrained devices remains challenging due to their substantial computational and memory requirements. This paper presents PlantVLM-Edge, a quantized vision-language framework for conversational crop health diagnosis that can run entirely on resource-constrained edge devices. PlantVLM-Edge combines agricultural domain adaptation, post-training quantization, and on-device serving with an offline chat interface, allowing growers to ask open-ended questions and receive diagnoses, symptom explanations, and management guidance without cloud connectivity. The framework is backbone-agnostic: we validate it with two different VLM types with varying scale and architecture (Qwen3-VL-2B and LLaVA-1.5-7B), four quantization schemes, and two diagnostic domains (plant diseases and insect pests), and we deploy all variants on an NVIDIA Jetson AGX Orin. Eight-bit quantization affects answer quality minimally relative to the full-precision model, and 4-bit activation-aware weight quantization (AWQ) retains 98.6% of full-precision answer quality on both domains while reducing the weight memory of the 2B backbone by 49%. In its most compact form, PlantVLM-Edge requires 2.01 GiB of weight memory, returns its first token in about 0.12 s, and completes a 64-token diagnostic response in 0.78 s. These results demonstrate that timely and accurate crop health diagnosis is practical on edge devices, providing a foundation for next-generation crop monitoring and decision support systems.
9. 【2611.03533】CoLa3D: Composable Latent 3D Decomposition
链接：https://arxiv.org/abs/2611.03533
作者：Xudong Cai,Yongcai Wang,Deying Li,Chuanxia Zheng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：consistent spatial layout, single whole-scene latent, existing scene mesh, single image, mesh as input
备注： Accepted at NeurIPS 2026. Project page: [this https URL](https://physicalvision.github.io/CoLa3D/)
点击查看摘要
Abstract:We introduce CoLa3D, a simple and effective model for composable 3D scene decomposition that, given a single whole-scene latent from either a single image or an existing scene mesh as input, directly outputs a set of object meshes with consistent spatial layout that can be assembled back into a coherent scene. CoLa3D introduces a novel paradigm for 3D scene decomposition within a shared whole-scene latent, unlike alternatives that perform per-object generation in canonical spaces and then glue the objects back together with fragile pose and scale estimation. The network is a lightweight, flexible, and scalable query-based transformer that accepts various types of queries, including 2D masks, 3D points, and learnable queries, and learns to decompose the scene into objects in a compact latent space. On both synthetic and real-world datasets, CoLa3D achieves state-of-the-art performance on composable 3D scene decomposition, substantially improving global scene-level consistency and object-level quality while running 2 times faster and using less than 1% of SAM 3D's training data. Visible depth on par with MoGe2 further confirms that latent decomposition preserves accurate visible scene geometry while producing physically complete, decomposable object meshes.
10. 【2611.03528】Contrastive Adapter Training and Consensus Knowledge Distillation for Multi-Source-Free Domain Adaptation in Skin Cancer Diagnosis
链接：https://arxiv.org/abs/2611.03528
作者：Ali Abedi,Q. M. Jonathan Wu,Ning Zhang,Farhad Pourpanah
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Skin cancer diagnosis, cancer diagnosis, benign nevi, differentiating melanoma, melanoma from benign
备注： Published in Artificial Intelligence in Medicine, Vol. 180, 103465 (2026). DOI: [this https URL](https://doi.org/10.1016/j.artmed.2026.103465) . Available at: [this https URL](https://www.sciencedirect.com/science/article/pii/S093336572600117X) and Code is available at: [this https URL](https://github.com/A-Abedi/CAT_CKD)
点击查看摘要
Abstract:Skin cancer diagnosis, particularly differentiating melanoma from benign nevi, is challenging due to the visual similarity between lesions. Although convolutional neural networks (CNNs) and vision transformers (ViTs) have shown promising performance, their effectiveness often deteriorates on data from heterogeneous clinical sources. Conventional domain adaptation methods address domain shift but require access to source data during adaptation, which is often infeasible due to privacy regulations. Multi-source-free unsupervised domain adaptation (MSFDA) addresses this limitation by leveraging multiple labeled source domains to generalize to an unlabeled target domain without requiring access to source data. However, existing MSFDA methods rely on full backbone fine-tuning, leading to catastrophic forgetting and overfitting on small clinical datasets, and address domain shift at the aggregation stage without establishing a shared domain-invariant feature space. Furthermore, their reliance on hard pseudo-labels or confidence-weighted aggregation introduces noisy supervision signals under domain shift. To address these limitations, we propose CAT-CKD, consisting of two components: (1) contrastive adapter training (CAT), which trains lightweight ConvPass adapters within a frozen ViT backbone using supervised contrastive learning (SCL) to establish a shared domain-invariant feature space before source-specific model training, and (2) consensus knowledge distillation (CKD), which aggregates logits from multiple source models into a consensus supervisory signal and adapts a student model on unlabeled target data using KL divergence. Experiments on five publicly available skin lesion datasets show that CAT-CKD achieves an average AUROC of 86.1%, outperforming existing MSFDA methods while requiring only 4.3M trainable parameters. The code is available at this https URL.
11. 【2611.03455】Bg-Mix: On Using Image Backgrounds for Data Augmentation in Electron Microscopy Images
链接：https://arxiv.org/abs/2611.03455
作者：Ankur Srivastava,Joana Sarah Grah,Katharina Ladewig,Nils Körber
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Electron microscopy, diagnostics and morphological, characterization of pathogens, cornerstone in virology, virology enabling
备注：
点击查看摘要
Abstract:Electron microscopy (EM) serves as a cornerstone in virology enabling the visualization of viral particles and is widely used in research, diagnostics and morphological characterization of pathogens. Computer-assisted image analysis can help facilitate and speed up this labor-intensive method, however, typical EM virus datasets are small and sparsely labeled, resulting in a lack of readily available deep learning models due to training limitations. To overcome data shortages and leverage content-rich, diverse sample backgrounds, we employed background-based data augmentation. To this end, we propose Bg-Mix, a form of data augmentation method, which decomposes training images into foreground objects and backgrounds and subsequently rearranges both into novel augmented images. This not only enhances the performance of object detection models but also increases the diversity of the training data. Using Bg-Mix provides an increase between +0.8 and +3.3 box mean average precision (mAP) points over the baseline when tested across two datasets using two architectures, thereby demonstrating its effectiveness.
12. 【2611.03449】Intent2CAD: How Semantic-Parametric Supervision Shapes Text-to-CAD Generation
链接：https://arxiv.org/abs/2611.03449
作者：Jinbo Yang,Mingyue Yuan,Shikai Jing
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：generating executable CAD, natural-language descriptions, modeling more accessible, accessible by generating, CAD
备注： NeurIPS 2026 Camera-ready version
点击查看摘要
Abstract:Text-to-CAD generation aims to make CAD modeling more accessible by generating executable CAD programs from natural-language descriptions. However, practical CAD workflows require more than executable geometry: generated programs should also expose reusable structure that supports later modification. We introduce intent-oriented text-to-CAD generation, where design intent is expressed as recoverable code-level signals: semantic features, reusable parameters, and lightweight parametric relations. Rather than changing the model architecture or decoding procedure, we investigate how supervision representation granularity affects both CAD generation and zero-shot intent-preserving editing. To enable this study, we construct IntentCAD-100K, a 100K paired text--code dataset built by converting low-level CAD construction traces into executable CadQuery programs. We further construct IntentCAD-Edit-1K to evaluate zero-shot intent-preserving editing from the same representation perspective. Intent2CAD uses a two-stage conservative lifting pipeline: semantic lifting rewrites reliable primitive groups into feature-level operations, while parametric lifting exposes lightweight parametric relations. Under controlled fine-tuning, semantic lifting mainly improves generation reliability and feature recovery, reducing IR from 2.39% to 0.22% and achieving 99.96% API Recovery, while parametric lifting makes reusable relation structure explicit and further improves relation-aware zero-shot editing. Datasets and code are available at this https URL.
13. 【2611.03438】Align Once to Explain: Feature Alignment for Scalable B-cosification of Foundational Vision Transformers
链接：https://arxiv.org/abs/2611.03438
作者：Raphael Maser,Siddhartha Gairola,Sukrut Rao,Bernt Schiele
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：vision tasks due, Foundational vision models, facto standard, tasks due, vision models
备注： CVPR 2026. 29 pages incl. appendix. R. Maser and S. Gairola contributed equally. This version's models are trained without the regularization term and differ slightly from the CVPR version. Code: [this https URL](https://github.com/rmaser/ALOE) ; Models: [this https URL](https://huggingface.co/collections/rmaser/aloe)
点击查看摘要
Abstract:Foundational vision models have become the de facto standard for many vision tasks due to their strong performance. However, they are notoriously opaque and remain hard to interpret. We present ALOE (ALign Once to Explain), a one-time, label-free feature alignment approach that efficiently converts foundational vision models into inherently interpretable B-cos variants. Once aligned, the B-cos backbone is used as a drop-in replacement across several downstream tasks-amortizing the cost of interpretability. ALOE is robust across pre-training paradigms (supervised, self-supervised, vision-language) and can preserve teacher-level generalization with orders of magnitude less data than training from scratch. On classification, it strongly outperforms vanilla B-cosification (e.g., +10.5 p.p. top-1 on ImageNet for DINOv3 ViT-B/16), retains strong linear probing, k-NN, and zero-shot transfer competitive with foundational backbones (DINOv3, SigLIP2) across diverse downstream datasets. It also preserves spatially structured features useful for dense prediction, while yielding well-localized and highly human-interpretable explanations by design.
14. 【2611.03430】Evaluating Depth-Augmented Visual Features for Cross-Dataset Lunar Traversability Estimation
链接：https://arxiv.org/abs/2611.03430
作者：Jan Baturo,Bartosz Ptak
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：occlusions limit continuous, limit continuous teleoperation, Autonomous mobility, continuous teleoperation, lunar surface operations
备注： Accepted for presentation at iSpaRo 2026
点击查看摘要
Abstract:Autonomous mobility is essential for sustained lunar surface operations, as communication delays and line-of-sight occlusions limit continuous teleoperation. Although recent traversability estimation methods increasingly rely on deep learning, the domain gap between terrestrial analogue environments and real lunar terrain can limit their generalisation, and real lunar traversability labels are scarce, making fully supervised training difficult. To address these challenges, we build a weakly supervised framework trained on sparse pairwise annotations and study whether augmenting visual features with depth-derived geometric information: depth, surface normals, and combined geometric descriptors. We evaluate the models in both in-domain and cross-domain settings using two terrestrial analogue datasets and the real lunar Chang'E PCAM dataset. Contrary to expectations, we find that naive geometric augmentation yields no consistent improvement over a strong visual-only baseline in either setting, with effects small relative to seed-to-seed variance. Instead, the choice of training source emerges as the dominant factor in transfer quality: models trained on domain-relevant sources transfer substantially better to real lunar imagery than the geometric fusion strategy improves any single model. Our evaluation runs onboard a resource-constrained edge device and provides a controlled baseline for designing more expressive multimodal fusion architectures in future lunar perception systems.
15. 【2611.03421】Circumventing Magnitude Collapse via Modular Two-Stage Open-Set Recognition
链接：https://arxiv.org/abs/2611.03421
作者：Laurin van den Bergh,Halil Bisgin,Andres Palechor,Mike Suter,Manuel Günther
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：requires neural networks, Open-set recognition, rejecting unknown samples, requires neural, real-world deployment
备注： Accepted for publication at the British Machine Vision Conference (BMVC) 2026
点击查看摘要
Abstract:Open-set recognition (OSR) requires neural networks to classify known classes while rejecting unknown samples, which is critical for real-world deployment. So far, OSR research studied and developed representation learning and postprocessing methods independently and their interactions remain unexplored. In this paper, we reconsider OSR as a modular two-stage pipeline and present the first systematic study of interactions between representation learning and postprocessing methods across dataset scales and usage of known unknown data. First, we discover a failure mode we term \emph{magnitude collapse}, where representation learning methods that utilize known unknown data can suffer performance degradation at large scale and irreversibly destroy discriminative information, despite excelling at small scale. Second, we study the modular interactions and reveal when they can be leveraged for modular performance gains via two-stage processing and where interaction effects amplify performance degradation due to magnitude collapse. Third, we show how these findings can be used to achieve state-of-the-art performance with a simple $K+1$ class classifier baseline and magnitude-aware postprocessing while circumventing magnitude collapse. Finally, our results demonstrate that small-scale evaluations with known unknown data are not predictive of large-scale performance, invalidating current best practices in OSR research. Code available at this https URL.
16. 【2611.03404】VidDub: Replacement-Aware Distillation for Two-Step Video Dubbing
链接：https://arxiv.org/abs/2611.03404
作者：Yexin Liu,Yunlong Lin,Zehan Wang,Guangxin He,Xinli Xu,Jiajun Zha,Yaofu Liu,Yueze Wang,Bowen Ping,Yuanming Li,Amie Wang,Bernard Ghanem,Bing Li,Harry Yang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：head pose, Video dubbing aims, match target speech, aims to synthesize, source video
备注： [this https URL](https://github.com/LAW1223/VidDub)
点击查看摘要
Abstract:Video dubbing aims to synthesize lip movements that match target speech while preserving the speaker identity, head pose, and background of a source video. Existing editors are predominantly trained via self-reconstruction under original paired audio, even though the source mouth becomes a conflicting target when driving speech is replaced. We introduce replacement-aware cross-audio supervision: paired-audio samples use full-frame reconstruction, whereas unpaired replacement-audio samples mask out source-mouth reconstruction losses and supervise the mouth solely through audio-visual synchronization while preserving unmasked facial regions and background. Because offline dubbing provides the complete source video and target speech beforehand, we present VidDub, a full-context diffusion editor distilled into two denoising steps (2 NFE). Our replacement-aware teacher first learns accurate lip synchronization without regressing toward conflicting source mouth movements. Matched trajectory regression then transfers the teacher's CFG-guided trajectories to a two-step student, and distribution matching distillation recovers visual quality after step compression. We will release the curated training dataset, VidDub-Bench, fixed paired- and cross-audio evaluation manifests, preprocessing outputs, and unified evaluation code. Across three training seeds, masking out conflicting source-mouth reconstruction improves cross-audio Sync-C by 0.833; the final two-step model combines strong lip synchronization with superior visual quality, identity preservation, and visual speech recognition across four benchmarks.
17. 【2611.03399】Image Guided Depth Upsampling using Anisotropic Total Generalized Variation
链接：https://arxiv.org/abs/2611.03399
作者：David Ferstl,Christian Reinbacher,Rene Ranftl,Matthias Rüther,Horst Bischof
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：work we present, Flight cameras deliver, depth, challenging problem, upsampling
备注：
点击查看摘要
Abstract:In this work we present a novel method for the challenging problem of depth image upsampling. Modern depth cameras such as Kinect or Time of Flight cameras deliver dense, high quality depth measurements but are limited in their lateral resolution. To overcome this limitation we formulate a convex optimization problem using higher order regularization for depth image upsampling. In this optimization an anisotropic diffusion tensor, calculated from a high resolution intensity image, is used to guide the upsampling. We derive a numerical algorithm based on a primaldual formulation that is efficiently parallelized and runs at multiple frames per second. We show that this novel upsampling clearly outperforms state of the art approaches in terms of speed and accuracy on the widely used Middlebury 2007 datasets. Furthermore, we introduce novel datasets with highly accurate groundtruth, which, for the first time, enable to benchmark depth upsampling methods using real sensor data.
18. 【2611.03394】aoMate-HD: Progressive-Resolution Autoregressive Audio-Video Generation
链接：https://arxiv.org/abs/2611.03394
作者：Qijun Gan,Chenwei Zhang,Xinyang Li,Meiguang Jin,Junfeng Ma,Shen Qiu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：digital humans produce, humans produce detailed, Streaming digital humans, produce detailed video, digital humans
备注：
点击查看摘要
Abstract:Streaming digital humans produce detailed video while continuing speech as new text arrives. High-resolution denoising is costly, and text updates can cause repeated or interrupted speech. We present TaoMate-HD, an autoregressive model for high-resolution audio-video streaming. For each short segment, or chunk, two denoising steps establish coarse video structure at low resolution. A final step refines the video to high resolution, with audio generated throughout the same trajectory. Each stage passes its audiovisual predictions to the same stage of the next chunk as history. Across text updates, the model retains this history to infer what has already been spoken. Continuation training utilizes asymmetric text conditioning, with separate text windows for generation and distillation. Experiments show a 1.6x speedup over direct high-resolution generation with the same model and hardware. Optimized stage-parallel deployment provides a further 1.9x overall speedup over serial progressive generation. Our continuation training reduces character error rate by 11.18 percentage points relative to the baseline. The model also supports hour-long audiovisual generation. Our project page is this https URL.
19. 【2611.03393】aoMate-FVSR:Audio-Guided Facial Video Restoration
链接：https://arxiv.org/abs/2611.03393
作者：Xinyang Li,Zeran Xu,Qijun Gan,Chenwei Zhang,Meiguang Jin,Junfeng Ma
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Low-quality facial videos, missing fine details, Low-quality facial, suffer from missing, missing fine
备注： 14 pages, 4 figures
点击查看摘要
Abstract:Low-quality facial videos suffer from missing fine details, while AI-generated videos may additionally contain implausible teeth and lip movements that do not match the speech. Restoring the mouth region is particularly challenging: enhancing existing details can preserve structural errors, whereas regenerating them risks changing facial identity and articulation. We propose an audio-guided facial video restoration framework that reconstructs unreliable mouth details and aligns lip movements with the speech while preserving facial identity and temporal consistency. Built on a video diffusion transformer, our framework mixes input video latents with noise to retain useful source information while allowing corrupted details to be regenerated. Audio guides lip movements, reference images constrain facial appearance, and previously generated frames promote temporal consistency. We train the model in two stages, first learning visual restoration from degraded images and videos, then learning audio-guided lip correction from degraded dubbed videos. The resulting model supports both restoration with the original audio and visual dubbing with replacement audio. On talking-head restoration benchmarks, our method achieves the lowest LPIPS and DISTS and the best lip synchronization scores among the evaluated restoration baselines. Qualitative results on AI-generated videos further show improvements in facial detail and mouth-region appearance, including clearer tooth boundaries and lip contours.
20. 【2611.03390】Progressive Multi-Scale Super-Resolution via Cascaded Bicubic Anchors and Inter-Scale Mutual Refinement
链接：https://arxiv.org/abs/2611.03390
作者：Chun-An Lin,Yu-Chia Chang,Chi-Mao Fan,Yen-Chieh Ouyang,Tsung-Jung Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Image and Video Processing (eess.IV)
关键词：output resolutions require, Super-resolution networks, magnification factor, resolutions require, single-input multiple-output network
备注： 14 pages, 7 figures, 7 tables. Submitted to an IEEE journal. Code and pretrained models will be released at [this https URL](https://github.com/julian135707/PMS-SR) upon acceptance
点击查看摘要
Abstract:Super-resolution networks are trained for one magnification factor, so several output resolutions require several models. We propose PMS-SR, a progressive single-input multiple-output network that produces x2, x4, and x8 results in one forward pass, with a Transformer backbone on the low-resolution grid. In Stage 1, each scale is predicted as a residual over the detached bicubic upsampling of the previous scale's prediction. With Dirac and zero initialization, training starts exactly from the bicubic cascade, and each head adds only the band the previous scale lacks. In Stage 2, inter-scale mutual refinement couples the scales in both directions through space-to-depth feedback, deformable alignment, and per-pixel fusion, so x8 features refine the x2 output. Trained on DF2K, the 7.95M-parameter model achieves a higher PSNR than every compared multi-scale method at x4 and x8 on all five standard benchmarks. At x8, it outperforms the x8-specific DRN-L on all of them, leads all compared methods on Urban100, and is within 0.13 dB of the best result elsewhere. Against three single-scale SwinIR-M models, PMS-SR uses 22% of the parameters, runs 2.9x faster on BSD100 inputs, and its outputs agree 6.7-12.4 dB more closely. Code and pretrained models will be released at this https URL upon acceptance.
21. 【2611.03382】ASCoR: Asymmetric Semantic-Spatial Learning for Remote Sensing Domain Generalization
链接：https://arxiv.org/abs/2611.03382
作者：Zitong Wang,Shuchang Lyu,Meng Li,Qiang Wang,Guangliang Cheng,Zhenwei Shi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Source-only domain generalization, segmentation seeks reliable, Source-only domain, remote sensing semantic, sensing semantic segmentation
备注： 15 pages
点击查看摘要
Abstract:Source-only domain generalization (DG) for remote sensing semantic segmentation seeks reliable predictions in unseen domains without target-domain data during training. Although vision foundation models offer transferable knowledge, category recognition remains sensitive to source-specific visual cues, while task-specific adaptation may weaken pretrained transferability. We propose ASCoR, an asymmetric semantic-spatial framework built on SAM3. Its text-conditioned semantic branch uses class-name prompts to provide explicit category guidance. Probe-Once Dynamic Adaptive LoRA distributes a fixed adaptation budget across encoder blocks to limit source-specific specialization. A complementary task-specific dense branch learns multi-scale spatial representations using a separate frozen SAM3 image encoder. A lightweight reliability router integrates the two branches through bounded spatial correction based on local prediction reliability. All components are trained using source-domain supervision only. Experiments on the ISPRS, LoveDA, and OpenEarthMap benchmarks cover nine cross-domain transfers. ASCoR achieves a state-of-the-art mean IoU of 68.61% across six ISPRS transfers, outperforming the previous best method by 2.69 percentage points. It also achieves the best results on all three LoveDA/OpenEarthMap transfers, with 59.07%, 47.95%, and 49.38% mIoU on Rural-to-Urban, Urban-to-Rural, and Urban-to-OpenEarthMap, respectively. Ablation studies, feature visualizations, and spatial reliability analyses support the effectiveness and complementarity of the proposed components. Code: this https URL.
22. 【2611.03377】Same Outputs, Different Scores: Auditing the Unchecked Graders of Multimodal LLM Benchmarks
链接：https://arxiv.org/abs/2611.03377
作者：Ahmad Jarjis Hasan,Jonathan Lwowski
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：multimodal-LLM multiple-choice benchmark, multiple-choice benchmark ends, wrong verdict, multimodal-LLM multiple-choice, free-form text
备注： Accepted at WACV 2027 (Evaluations and Datasets Track). Code and data: [this https URL](https://github.com/ahmadhasan2k8/grader-audit)
点击查看摘要
Abstract:Every multimodal-LLM multiple-choice benchmark ends with a scoring rule that converts a model's response, often free-form text rather than a clean option letter, into a right/wrong verdict, buried in its code. Unlike the dataset, this rule is chosen without justification and left unexamined, yet it sets the published number. We reproduce the official scorers of eight peer-reviewed benchmarks on five open vision-language models (VLMs) that fit a single 16 GB GPU, and introduce a blinded human-plus-LLM-judge adjudication (Cohen's kappa=0.956) that recovers what the model actually answered. The scoring rule alone moves accuracy by up to 22 points on identical outputs, yet exactly 0 wherever a model emits clean option letters, so it hides on strong-model leaderboards. It is the fallback and not the rambling that does the damage: the benchmark with the highest non-compliance we measure has an artifact of exactly zero, because its scorer abstains instead of guessing; a reasoning model with non-compliance 0.000 still swings 9.5 points with which regex match of its trace the parser keeps. No standard rule is reliable: snapping a non-answer to its closest option credits answers never given yet buries correct ones, abstention discards answers stated in words, and likelihood scoring follows answer-token priors, so a single grade conflates capability with luck rather than measuring either. We release all code, labels, and the protocol, and argue benchmarks should report a non-compliance rate and at least two rules, not one unexamined grade.
23. 【2611.03371】EO-Jev: Decision Model for Earth Observation
链接：https://arxiv.org/abs/2611.03371
作者：Mohamed Atef Abouelhadid,Diaa Addeen Abuhani,Muhammad Akhtar Munir,Fahad Shahbaz Khan,Salman Khan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：workflows require selecting, processing large volumes, Earth observation, workflows require, volumes of imagery
备注： 16 pages, 6 figures
点击查看摘要
Abstract:Earth observation (EO) workflows require selecting among known outcomes, estimating confidence, and processing large volumes of imagery. Generative vision-language models can address these tasks, but autoregressive decoding is computationally costly and their confidence estimates are unreliable. Decision models offer an alternative, returning probabilities over candidate answers in a single forward pass. However, their accuracy, calibration, and transfer across EO tasks remain insufficiently understood. We investigate these properties through a diagnostic study of d3-flash (8.4B parameters) across 30 settings from 23 public EO benchmarks. We find that compositional reasoning transfers well and calibration improves over its Qwen3.5-9B backbone on 24 settings, while counting, change quantification, damage grading, and absent-object recognition remain challenging. To address these limitations, we adapt d3-flash through low-rank fine-tuning on public EO training splits, producing EO-Jev. EO-Jev improves significantly over d3-flash on 26 of 30 settings and matches or exceeds specialist references on 20 of 28. It also achieves an average gain of 8.0 points across 12 held-out settings and lower expected calibration error than specialists on 21 of 28 settings. These improvements come at a modest cost of 1.8 points in general decision performance. Our results demonstrate the potential of adapting general decision models into competitive EO generalists while highlighting persistent challenges in quantitative perception, option-order consistency, and calibration under distribution shift.
24. 【2611.03370】Fuse To Align: Multimodal Representation Learning for Retrieval via Hypergraph Regularization
链接：https://arxiv.org/abs/2611.03370
作者：Anindya Nag,Ambuj Mehrish,Sebastiano Vascon
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal retrieval, integrate complementary evidence, unequally informative, Multimodal, integrate complementary
备注： 24 pages, 7 figures
点击查看摘要
Abstract:Multimodal retrieval must integrate complementary evidence from views that may be missing, noisy, or unequally informative. When a sample provides limited reliable evidence, learning from its views alone can hinder the acquisition of useful retrieval representations. Semantically related training samples may provide complementary observations, yet existing volume-based objectives jointly align modalities within each sample without explicitly enabling information exchange across samples. We therefore propose a training-time hypergraph fusion framework that connects observed modalities both within samples and across semantically related samples, allowing representation learning to draw on evidence beyond an individual sample while leaving the retrieval pipeline unchanged at inference. The framework includes HyVol as a special case and introduces two configurations: wHyVol learns view contribution weights and symmetric semantic affinities, whereas wRHG additionally models typed interactions and participant roles through relational propagation. Missing modalities are omitted rather than imputed, and the hypergraph is discarded after training, incurring no additional inference cost. Experiments on eleven zero-shot video-text and audio-text retrieval benchmarks demonstrate broad improvements with both GRAM and HyperGRAM. Across 17 video benchmark-modality settings evaluated in both retrieval directions, wRHG outperforms GRAM in all 34 comparisons and HyperGRAM in 33 of 34. Mean text-to-video R@1 increases from 63.4 to 68.2 with GRAM and from 64.8 to 68.4 with HyperGRAM, while the largest video-to-text gain reaches 13.3 percentage points on ActivityNet. Under missing-modality evaluation, both weighted configurations retain positive text-to-video gains over GRAM across seven benchmarks at every evaluated missingness rate, even when 90% of clips lack one modality.
25. 【2611.03360】Every Pixel Is an Option: A System One Model for Medical Ultrasound Biometry
链接：https://arxiv.org/abs/2611.03360
作者：Moein Heidari,Junbo Rao,Yudan Chen,Yasamin Medghalchi,River Jiang,Wenjin Chen,David J. Foran,Jasmine Grewal,Ilker Hacihaliloglu
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：obtain quantitative measurements, including prenatal, cardiac examinations, Purpose, prenatal and cardiac
备注：
点击查看摘要
Abstract:**Purpose:** Ultrasound biometry is widely used across various clinical applications, including prenatal and cardiac examinations, to obtain quantitative measurements by placing calipers at anatomical landmarks. However, these measurements remain subject to interoperator variability as they rely largely on manual caliper placement. Conventional methods often use specialized prediction heads for different ultrasound tasks, whereas vision-language models offer flexibility through text instructions. However, direct coordinate prediction does not explicitly model spatial likelihood distributions, limiting the representation of localization ambiguity. **Methods:** We propose Kev-Bio, a vision-language model that uses clinical measurement questions to guide ultrasound landmark detection. Inspired by System One decision models, Kev-Bio uses decision representations of the language model to generate queries for each caliper endpoint. These queries are matched against shared dense ultrasound features to produce spatial probability maps, from which landmark coordinates and clinical measurements are derived. The model is trained end-to-end using both landmark localization and clinical measurement losses. **Results:** On the nine-view FU/GU Biometry 2026 dataset, Kev-Bio achieves a mean radial error (MRE) of 22.50 pixels and a clinical measurement mean absolute error (MAE) of 15.38, outperforming the compared baselines in overall performance. **Conclusion:** These results demonstrate the effectiveness of Kev-Bio for ultrasound landmark detection and clinical measurement across different anatomical views. Our code and models are available at this https URL.
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
Cite as:
arXiv:2611.03360 [cs.CV]
(or
arXiv:2611.03360v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2611.03360
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Moein Heidari [view email] [v1]
Mon, 2 Nov 2026 16:09:34 UTC (822 KB)
26. 【2611.03339】ArabGeoText: Tool-Augmented Vision-Language Models for Arabic Geospatial Text Spotting
链接：https://arxiv.org/abs/2611.03339
作者：Yakoub Bazi,Sarah Alsaleh,Mohamad M. Al Rahhal,Mohamed A. Mekhtiche,Mansour Zuair
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：spotting involves locating, Geospatial text spotting, Arabic geospatial text, raster maps, involves locating
备注：
点击查看摘要
Abstract:Geospatial text spotting involves locating and transcribing geographic labels, such as road names, district names, and landmarks, in raster maps. These labels are often small, densely arranged, and arbitrarily oriented. Although Arabic text recognition has been studied extensively in documents and natural scenes, Arabic geospatial text spotting remains underexplored. We introduce ARABGEOTEXT, an Arabic-centric benchmark covering 970 geographic locations in Riyadh and Jeddah, with 17,875 manually annotated text instances per view type. For each location, we pair an OpenStreetMap (OSM) rendering with a composite created by overlaying that rendering on the corresponding remote sensing (RS) imagery. The paired views preserve label content and pixel geometry, allowing evaluation across different backgrounds. Geographic partitions support in-city and city-disjoint evaluation of detection, recognition, and end-to-end spotting. Experiments with direct Qwen3.5-4B spotting show difficulties in recovering all labels within a tile. We therefore propose a tool-augmented vision-language framework that combines YOLO26 localization and crop rectification with Qwen3.5-4B recognition adapted through low-rank adaptation (LoRA). The framework outperforms direct LoRA-adapted Qwen3.5-4B spotting across both image views and test cities. With localization held fixed, reader adaptation further improves recognition over the pretrained zero-shot reader. The dataset and code will be made publicly available at this https URL.
27. 【2611.03285】Mesh-Agnostic Refinement Models for Latent Space Encoding of 3D Human Body Shapes
链接：https://arxiv.org/abs/2611.03285
作者：Chaima Zouaouid,Jonathan Cerqueirab,Sylvain Arguillere,Martin Bauer,Nicolas Charon,Mohamed Daoudi,Emmanuel Hartman
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Skinned Multi-Person Linear, human body models, decoder expressive capacity, model provide compact, Parametric human body
备注：
点击查看摘要
Abstract:Parametric human body models such as the Skinned Multi-Person Linear (SMPL) model provide compact representations of human shape and pose, but their reconstructions remain affected by both errors in estimated latent parameters and limitations in the decoder's expressive capacity. We propose a framework for refining these reconstructions by exploiting the geometric discrepancy between an initial decoded surface and a target mesh, without requiring vertex correspondences between them. The framework comprises three complementary approaches. Latent-VaRefine uses varifold-distance gradients to correct the estimated latent code while preserving the original parametric representation. Vertex-VaRefine processes multiscale varifold-gradient features with a DiffusionNet backbone to predict vertex displacements in a canonical pose, yielding an approximately pose-equivariant refinement pipeline. ElaOpt directly optimizes surface deformations under elastic regularization and normal-direction constraints.
28. 【2611.03283】ReVA-HPE: Relative 6DoF Head Pose Estimation with Synthetic Pose Supervision and Personalized Virtual Anchors
链接：https://arxiv.org/abs/2611.03283
作者：Vasiliki Vasileiou,Panagiotis P. Filntisis,Petros Maragos,Kostas Daniilidis
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Monocular head pose, head pose estimation, Monocular head, relative head pose, head pose
备注： Accepted at WACV 2027
点击查看摘要
Abstract:Monocular head pose estimation is usually formulated as absolute regression from a single face crop, yet many applications observe the same person over time and can supply an explicit anchor image. Recently, relative head pose estimation was proposed, which casts the problem as estimation of the relative geometric change between an anchor and a query image. However, existing methods still require the anchor image pose to be known at inference, significantly limiting their practical use. We first extend relative head pose estimation to full 6DoF by additionally predicting a depth-normalized relative translation, which composes with the anchor to recover metric query pose in the camera frame. To eliminate the need for a ground-truth anchor pose, we reconstruct a personalized avatar from a single unlabeled enrollment image and render a bank of virtual anchors with known poses. The bank provides robust rotation hypotheses through multi-anchor consensus, while the real enrollment image serves as the real anchor in the translation branch via landmark PnP. We also introduce an efficient variant that amortizes the bank cost once at enrollment, after which each query requires a single real-to-real relative prediction, with limited accuracy sacrifice. The relative pose estimator is trained exclusively on synthetic face renderings, without real pose supervision, pseudo-labels, domain adaptation, or fine-tuning on the evaluation sets. On real 6DoF benchmarks, ReVA-HPE achieves state-of-the-art rotation accuracy on BIWI and, given a near-frontal enrollment image, on FaMoS, while remaining competitive in metric translation despite relying solely on synthetic pose supervision. Project page and code: this https URL
29. 【2611.03247】R$^2$-Omni: Reducing Structural and Precision Redundancy in Omni-LLMs for Long-Form Generation
链接：https://arxiv.org/abs/2611.03247
作者：Bolong Feng,Pengfei Zhou,Zhenglin Wan,Wei Wang,Wangbo Zhao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Omni-modal large language, large language models, typically process large, process large numbers, Omni-modal large
备注： 32 pages, 9 figures
点击查看摘要
Abstract:Omni-modal large language models (Omni-LLMs) typically process large numbers of multimodal tokens from audio-visual inputs, incurring substantial computational costs and a large memory footprint for the key-value (KV) cache. Aggressive token pruning can alleviate this problem while maintaining competitive performance on multiple-choice tasks, which require only a single option as output. However, we observe substantial quality degradation when generating long-form, open-ended responses. We attribute this gap to query-guided selection, which can retain sufficient evidence for answer selection while discarding details needed for comprehensive generation. This motivates reducing overlapping information across tokens, termed structural redundancy, while preserving diverse content. However, the retained representations may still contain precision redundancy due to unnecessarily high numerical precision in their cached values. To address these two levels of redundancy in token representations, we introduce a training-free framework named R$^2$-Omni. First, Structure-Aware Token Consolidation (STC) consolidates redundant representations using spatiotemporal similarity in video and local continuity in audio. Then, Semantic-Sensitivity Guided Precision Allocation (SSPA) allocates value precision to the retained representations according to the estimated reduction in attention-output error under quantized keys, with query attention and audio-visual alignment providing a semantic prior. Extensive experiments on long-form generation benchmarks demonstrate an average 5.0$\times$ reduction in the memory footprint while preserving 97.98% of baseline generation quality and achieving a 1.48$\times$ end-to-end speedup, highlighting the benefits of jointly reducing structural and precision redundancy.
30. 【2611.03245】HyperFlow: Class-Incremental Semantic Change Detection via Hyperbolic Flow
链接：https://arxiv.org/abs/2611.03245
作者：Manon Béchaz,Léo Buecher,Emanuele Dalsasso,Ciprian Tomoiaga,Patrick Jayet,Marcin Detyniecki,Laetitia Chapel,Lucas Drumetz,Nicolas Courty,Devis Tuia
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Semantic change detection, change detection, Semantic change, characterize land-cover transitions, land-cover transitions observed
备注：
点击查看摘要
Abstract:Semantic change detection in remote sensing aims to identify and characterize land-cover transitions observed in pairs of satellite or aerial images. Existing methods assume a fixed set of change categories, limiting their applicability in real-world scenarios where changes of interest may vary, for example across geographies or over time. In this work, we tackle the problem of class-incremental semantic change detection, where a model progressively learns to detect new types of semantic change. To do so, we exploit the hierarchical structure of land-cover semantics, where newly introduced categories correspond to fine-grained refinements of existing ones, and represent said semantic categories in hyperbolic space, which is particularly well suited to represent such hierarchical relationships. To capture semantic changes, we introduce HyperFlow, a method relying on Busemann prototypes, modeling change as an anomaly in a learned semantic flow within the hyperbolic embedding space induced by segmentation. HyperFlow couples change detection to class-incremental semantic segmentation, enabling class-incremental semantic change detection. We also present HiChange, a new large-scale, high resolution remote sensing dataset with detailed, fine-grained hierarchical labels. Experimental results demonstrate that HyperFlow achieves both strong change detection and semantic segmentation performance across incremental steps. In particular, we show that progressively refining semantic categories, rather than considering them all directly, yields improved change detection, highlighting the benefits of incremental learning for semantic change detection.
31. 【2611.03232】Calibrating Multimodal Test-Time Adaptation under Reliability and Availability Modality Shifts
链接：https://arxiv.org/abs/2611.03232
作者：Jiangmeng Li,Jinglin Xu,Yi Li,Yumeng Liu,Jiahuan Zhou,Fanjiang Xu,Hui Xiong,Gang Hua
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：unlabeled test data, original training data, enables pretrained multimodal, test data, training data
备注：
点击查看摘要
Abstract:Multimodal test-time adaptation (TTA) enables pretrained multimodal models to accommodate distribution shifts during inference using only unlabeled test data, without recourse to the original training data. Compared with unimodal adaptation, multimodal adaptation is further complicated by the coexistence and interaction of multiple representation perspectives. This complexity is particularly pronounced under modality reliability shifts, which preserve modality availability but degrade information quality, and modality availability shifts, which render the corresponding modality entirely inaccessible. Category-conditional Gaussian modeling offers a natural starting point for handling such distributional variations, having proven effective in unimodal test-time adaptation for characterizing representation distributions, yet its extension to multimodal settings requires a more elaborate formulation. To this end, we propose Adaptive Probabilistic Gaussian Calibration (AdaPGC), which extends category-conditional Gaussian modeling across modality-specific and multimodal fusion representations for probabilistic calibration under multimodal distribution shifts. AdaPGC continuously updates category-conditional Gaussian models over modality-specific and fusion representations, using the resulting probabilistic predictions to calibrate source model predictions and guide reliability based rectification, while exploiting their joint distributions to recover unavailable fusion representations. Extensive experiments under diverse modality corruption and missingness conditions demonstrate that AdaPGC effectively improves robustness under both modality reliability and availability shifts. Our source code will be released at this https URL.
32. 【2611.03229】CL3DOD: Understanding the Stability-Plasticity Dilemma in Outdoor Class-Incremental 3D Object Detection
链接：https://arxiv.org/abs/2611.03229
作者：Muhammad Ahmed Ullah Khan,Khalil Ahmed,Didier Stricker,Muhammad Zeshan Afzal
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：remains largely underexplored, detection remains largely, largely underexplored, object detection remains, remains largely
备注：
点击查看摘要
Abstract:Class-incremental learning (CIL) for outdoor 3D object detection remains largely underexplored. Existing outdoor studies are limited to single-benchmark evaluations, with SDCoT++ considering KITTI and CL2OD considering nuScenes under different incremental settings. This makes it difficult to assess whether observed continual-learning behavior generalizes across autonomous-driving benchmarks. To the best of our knowledge, we provide the first unified cross-benchmark analysis of outdoor class-incremental 3D object detection across multiple autonomous-driving benchmarks, covering both two-task and multi-stage settings. We investigate: (1) how severely existing 3D detectors forget previously learned classes, (2) how incremental training exposes the stability-plasticity dilemma between knowledge retention and new-class acquisition, and (3) which forms of supervision are most effective for balancing these objectives. We introduce CL3DOD, a class-incremental 3D detection framework that restores missing supervision for previous classes using predictions from the previous-stage detector, preserves old-class responses through query-wise knowledge distillation, and employs EMA-based temporal consistency regularization. Experiments on KITTI and nuScenes reveal a consistent stability-plasticity dilemma across both benchmarks. CL3DOD generally achieves a more favorable stability-plasticity balance than controlled incremental baselines and improves upon published prior methods in the reported benchmark comparisons. This advantage persists across multiple incremental stages, demonstrating strong retention of previously learned knowledge while maintaining effective new-class acquisition. Our code, evaluation setup, and incremental task splits will be publicly released.
33. 【2611.03228】AnchorComplete: Recovering Complete Scene Meshes from Partial Point Clouds
链接：https://arxiv.org/abs/2611.03228
作者：Weirong Chen,Ismail El-Yamany,Ganlin Zhang,Chuanxia Zheng,Andrea Vedaldi,Daniel Cremers
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：reconstructors primarily recover, recover visible surfaces, primarily recover visible, producing partial point, partial point clouds
备注： Project page: [this https URL](https://wrchen530.github.io/anchor-complete)
点击查看摘要
Abstract:Most image-based 3D reconstructors primarily recover visible surfaces, producing partial point clouds with large holes and leaving unobserved geometry unresolved. To address this limitation, we introduce AnchorComplete, a framework that reconstructs complete scene meshes from partial point clouds while preserving observed geometry and supporting scenes of varying scales. Building on TRELLIS.2, our method combines partial-point conditioning, which integrates global scene tokens with local spatial evidence to anchor generation to the input, and metric-scale coarse-to-fine generation, which progressively refines scene geometry within fixed-size windows while maintaining global structural consistency. Experiments on Replica and SCRREAM demonstrate that AnchorComplete consistently outperforms strong baselines in complete-scene reconstruction, particularly under sparse-view settings.
34. 【2611.03189】MoSoLoco: Monocular 3D Human Localization through Visual Latent Features and Social Context
链接：https://arxiv.org/abs/2611.03189
作者：Yasamin Borhani,Javad Khoramdel,Yang Gao,Po-Chien Luan,Alexandre Alahi
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：Estimating the metric, motion prediction, camera is important, important for robot, robot navigation
备注：
点击查看摘要
Abstract:Estimating the metric 3D position of people from a monocular camera is important for robot navigation and motion prediction. Lightweight pose-based localizers are attractive for robotic hardware with limited computational resources because they operate on compact 2D keypoints. However, they typically discard the richer visual representations computed by the pose estimator. We introduce MoSoLoco, a per-frame monocular 3D human localizer that combines the pose detector's internal visual features with the detected 2D skeleton, without requiring an additional RGB or depth encoder. MoSoLoco can further incorporate sparse same-frame multi-person context to refine individual position estimates. Experiments on JRDB and NuScenes show that reusing pose-detector representations improves localization, reducing the best JRDB error by approximately 23 percent relative to the strongest evaluated keypoint-based baseline. A sparse social-interaction module incorporates nearby detections from the same image for further refinement. Controlled trajectory-forecasting experiments show downstream benefits, while the complete pipeline remains suitable for efficient Jetson AGX Xavier inference.
35. 【2611.03143】Visual-to-Executable Procedural Reconstruction of Buildings
链接：https://arxiv.org/abs/2611.03143
作者：Zichong Zhu,Zhihao Liu,Andrei Sharf,Zhanglin Cheng
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：modeling offers compact, manually authored grammars, Procedural modeling offers, offers compact, authored grammars
备注： 27 pages, 15 figures
点击查看摘要
Abstract:Procedural modeling offers compact, editable, and reusable representations for architectural content, but building such models still depends heavily on manually authored grammars. We study image-based procedural building reconstruction from in-the-wild images, with the goal of recovering an executable procedural description that can be instantiated as an editable 3D building asset. Because a single image provides only partial and view-dependent evidence, we focus on recovering the dominant visible facade(s) and attach the recovered facade program to a simple mass model for building-level instantiation. Our method decomposes this task into two structured prediction stages. First, a Global Structure Layout Tree recovers facade-scale split-and-repeat organization through a fine-tuned layout model with render-guided visual-symbolic reflection. Second, a Component Parameterization schema maps representative facade tiles to structured procedural attributes for local architectural component synthesis. These two representations are then deterministically compiled into executable Computer Generated Architecture (CGA) programs, avoiding the brittleness of direct low-level program generation. Experiments show that the proposed framework handles both regular facades and challenging in-the-wild images, while maintaining high structural consistency, procedural executability, and fine-grained architectural detail. The recovered programs further enable controllable and reusable 3D building asset generation.
36. 【2611.03140】When Optimization Meets Human Intent: Human-Centered Diffusion Model Optimization
链接：https://arxiv.org/abs/2611.03140
作者：Renye Yan,Jikang Cheng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：fine-tuning and guidance, evolving from general, general tools, human, diffusion optimization
备注：
点击查看摘要
Abstract:Diffusion models are evolving from general tools into personalized systems that adapt to user needs through fine-tuning and guidance. However, diffusion optimization mainly targets measurable objectives such as aesthetics, rarely examining whether they align with human intent. Human needs are multidimensional, contextual, and dynamic, whereas existing methods approximate them with fixed metrics. Because these metrics capture human needs only partially and may amplify deviations from true intent during optimization, higher scores need not yield results better matching human expectations. To understand how human needs enter and influence optimization, we systematically analyze how human intent is expressed, translated into optimizable objectives, applied to model behavior or generation, and evaluated through outputs. We further discuss trade-offs affecting human-intent alignment in personalized image generation and gaps between automated metrics and real user judgments. This human-centered synthesis reorganizes diffusion optimization and provides a systematic reference for personalized generation systems designed for human preferences.
37. 【2611.03136】Znaki: A Russian Fingerspelling Recognition Dataset
链接：https://arxiv.org/abs/2611.03136
作者：Petr Surovtsev,Pavel Korotaev,Alexander Nagaev,Alexander Kapitanov
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Russian Sign Language, American Sign Language, Sign Language fingerspelling, sign language, technical terms
备注： Proceedings of the Second Workshop on Sign Language Processing, [this https URL](https://aclanthology.org/2026.wslp-1.20/)
点击查看摘要
Abstract:Fingerspelling - the sequential signing of letters that compose proper names, technical terms, and out-of-vocabulary words - is an integral component of any sign language. Despite Russian Sign Language (RSL) being used by more than 150,000 native signers, no public fingerspelling dataset for RSL exists, in contrast to American, British, German, and several other sign languages. We introduce Znaki the first open RSL fingerspelling dataset: 37,252 video recordings (35.4 hours) of 1,593 unique sequences - proper names sampled from 16 domain categories - recorded by 68 native RSL signers (37 Deaf, 29 hard-of-hearing, and 2 certified interpreters) through a crowdsourcing pipeline with a two-stage signer qualification procedure and expert validation. The dataset covers all 33 Cyrillic handshapes, and its letter-frequency distribution matches the Russian National Corpus. As reference points for future research, we establish two baselines adapted from American Sign Language fingerspelling recognition: a Squeezeformer-based encoder-decoder, reaching a character-level accuracy ($1-\mathrm{CER}$) of 0.932 and a sequence accuracy of 0.596, and Fingerspelling-PoseNet, reaching 0.886 and 0.545, respectively.
38. 【2611.03132】Behavioral Affinity Transduction for Zero-Shot Vision-Language Classification
链接：https://arxiv.org/abs/2611.03132
作者：Junxi Huang,Wenshuo Chen,Xiucheng Wang,Meitong Shen,Shaofeng Liang,Yuehan Kou,Yutao Yue,Nan Cheng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：unlabeled batch, Behavioral Affinity Transduction, BAT, Abstract, Zero-shot vision-language models
备注：
点击查看摘要
Abstract:An image that is hard to classify on its own may have a helpful neighbor in the same unlabeled batch. Zero-shot vision-language models (VLMs) score images independently and leave this evidence unused. We study small unlabeled query batches with no labeled examples. Visual similarity can reflect pose or background, so it may connect images from different classes. Each image's scores over the class vocabulary offer another way to choose neighbors. We introduce Behavioral Affinity Transduction (BAT), which builds a sparse graph from these class-response profiles. The graph supplies neighbor evidence during prediction. For EM-Dirichlet, it also screens candidate classes and initializes assignments. BAT plugs into direct and iterative readouts of a frozen VLM. Across diverse datasets, BAT improves the mean accuracy of every tested readout. In the main RN50 comparison, soft and hard EM-Dirichlet gain $4.22$ and $2.72$ percentage points.
39. 【2611.03125】SurgPace: Complexity-Aware Progressive Distillation for Surgical Multimodal Large Language Models
链接：https://arxiv.org/abs/2611.03125
作者：Zhicheng He,Xiaohan Xing,Hongqiu Wang,Kun Yuan,Guankun Wang,Yanheng Li,Haoxuan Che,Nassir Navab,Hongliang Ren,Long Bai
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：high computational cost, computational cost limits, cost limits real, real clinical deployment, Multimodal large language
备注： 21 pages, 4 figures, Accepted by Medical Image Analysis
点击查看摘要
Abstract:Multimodal large language models (MLLMs) have shown strong potential in robotic surgery for question answering, scene understanding, and grounded assistance, but their high computational cost limits real clinical deployment. Knowledge distillation provides a practical way to build compact surgical MLLMs, yet direct distillation is not well suited to surgical data because surgical samples vary greatly in difficulty, visual ambiguity, and required clinical context, making uniform teacher-student transfer unstable. In addition, the role of supervision changes during training: early stages require stronger teacher guidance for multimodal alignment, while later stages rely more on task supervision for effective optimization. To address these challenges, we propose SurgPace, a complexity-aware continuous curriculum framework for progressive distillation of surgical vision-language models. SurgPace estimates sample complexity using predictive confidence and Lorentz geometric consistency, and uses the fused score to guide a continuous easy-to-hard training process. We further introduce hierarchical representation alignment, which aligns the student with the teacher at the feature, logit, and probability levels, while gradually shifting the training focus from teacher imitation to task supervision. This design separates sample-level curriculum from objective-level scheduling, leading to more stable and effective distillation. We evaluate SurgPace on Surg-396K, a benchmark built from four public surgical datasets and covering five dialogue paradigms. SurgPace consistently outperforms strong MLLM distillation baselines, demonstrating its effectiveness for building compact, memory-efficient surgical MLLMs with faster decoding under controlled benchmarks. Code is available at this https URL.
40. 【2611.03120】KAUSTics-Net: Diffusion-Based Through-Water UAV Restoration with a Semi-Synthetic Dataset
链接：https://arxiv.org/abs/2611.03120
作者：Dario Scilla,Omar A. Lopez,Kasper Johansen,Brian O. Nieuwenhuis,Matthew F. McCabe
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：unmanned aerial vehicle, Accurate mapping, including refraction, aerial vehicle, wavelength-dependent attenuation
备注：
点击查看摘要
Abstract:Accurate mapping of shallow-water environments using unmanned aerial vehicle (UAV) imagery is challenged by water-induced distortions, including refraction, caustics, and wavelength-dependent attenuation. The scarcity of paired distorted and reference imagery further limits the development of supervised restoration methods. To address this challenge, we introduce KAUSTics, a semi-synthetic dataset combining 1,280 reference patches derived from 32 high-resolution UAV images with 12,800 degraded observations generated through Blender-based water-surface rendering and empirical color and blur augmentations. We further propose KAUSTics-Net, a pixel-space conditional diffusion framework integrating a multi-scale conditional encoder, feature-wise linear modulation (FiLM), cross-attention, and a composite reconstruction objective to restore shallow-water imagery. We evaluated the framework against eight image-restoration methods, complemented by architectural ablations and cross-dataset experiments. On KAUSTics, KAUSTics-Net achieved a mean peak signal-to-noise ratio (PSNR) of 31.715 +/- 0.439 dB, structural similarity index (SSIM) of 0.849 +/- 0.002, and learned perceptual image patch similarity (LPIPS) of 0.145 +/- 0.007 across three training seeds. On the independent Sea-Undistort dataset, sampler-aware fine-tuning improved restoration fidelity, reaching 19.469 +/- 0.332 dB PSNR and 0.554 +/- 0.005 SSIM under combined water-surface distortions, although perceptual trade-offs remained. Additional experiments on real UAV imagery examined feature preservation and segmentation behavior. These findings demonstrate the potential of semi-synthetic training and conditional diffusion for shallow-water image restoration while highlighting the importance of evaluating both reconstruction fidelity and downstream remote-sensing utility.
41. 【2611.03114】3D Gaussian Splatting within Self-Learned Neural View-Dependent Color Fields
链接：https://arxiv.org/abs/2611.03114
作者：Yixiao Yang,Yu-Shen Liu,Zhizhong Han
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Gaussian Splatting, view synthesis, vital tool, color, Splatting
备注：
点击查看摘要
Abstract:3D Gaussian Splatting (3DGS) has become a vital tool in novel view synthesis. 3D Gaussian functions with attributes like color, opacity, and scale are stacked together to explicitly model a radiance field. However, discrete 3D Gaussians usually produce poor depth with few geometry details but lots of floaters, which hinders the effective modeling of smooth radiance fields. To address this issue, we propose to learn a radiance field within a continuous view-dependent color field parameterized by neural networks. With continuous constraints in color, the bias on low-frequency signals of neural networks can highly encourage the geometry modeling to contribute to high-frequency color variations on images, getting rid of solely relying on the color attribute itself. Moreover, we impose a constraint to improve the Lipschitz continuity of the neural color field, making large changes of each Gaussian's color also match with large changes of its position in terms of a ratio. To this end, we additionally introduce novel self-learning strategies to improve the learning of the neural view-dependent color field without any external knowledge or priors, aiming for better generalization on unseen scenes. Our numerical and visual comparisons on widely used benchmarks justify our idea and show better ability of high fidelity geometry recovery in 3DGS. Project page: this https URL.
42. 【2611.03109】Multimodal Prompt Learning with Dual-Granularity Contrastive Alignment for Preoperative Prediction of Lung Adenocarcinoma Invasiveness Using 3D CT
链接：https://arxiv.org/abs/2611.03109
作者：Qing Huang,Xiaotong Tan,Lintong Yao,Wufeng Xue,Ruobing Huang,Dong Ni,Hao Wu,Tian Xiao,Jun Cheng
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Accurate preoperative prediction, Accurate preoperative, individualized treatment, important for surgical, surgical planning
备注：
点击查看摘要
Abstract:Accurate preoperative prediction of lung adenocarcinoma invasiveness is important for surgical planning and individualized treatment. However, overlapping CT appearances make it challenging to distinguish invasive adenocarcinoma (IAD) from Pre-IAD lesions. We propose a multimodal prompt-learning framework with dual-granularity image-text alignment for 3D CT-based IAD classification. A 3D ResNet-CBAM encoder extracts global and spatial visual features. A frozen RadBERT backbone is adapted with separate learnable prompts for report-level and keyword-level text encoding. These prompts are initialized using semantic representations derived from real-world clinical reports. Global contrastive alignment connects whole-volume CT representations with reports generated from clinician-annotated radiological attributes to provide overall semantic supervision. A multiple instance learning-based local alignment module associates spatial CT features with vascular-focused radiological keywords, to capture local imaging characteristics potentially associated with tumor invasion. The framework jointly optimizes classification and alignment objectives, while inference requires only CT images. Experiments included 1,593 pathologically confirmed nodules. On the test set, the proposed method achieved an accuracy of 87.92%, F1-score of 87.78%, and AUC of 0.9499. Its AUC significantly exceeded that of the image-only Res-CBAM baseline with the same visual backbone (0.9297; DeLong test, p = 0.0078). Ablation analyses supported the complementary contributions of global and local alignment and the benefit of report-based prompt initialization. Qualitative visualizations showed activation within nodules and adjacent vascular structures. These findings suggest that dual-granularity radiological supervision can enhance CT-based invasiveness prediction while preserving a CT-only inference workflow.
43. 【2611.03098】Ray-SCR: Generalizing Scene Coordinate Regression Across Camera Models
链接：https://arxiv.org/abs/2611.03098
作者：Jaemin Cho,Oleksii Nasypanyi,Francois Rameau
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：scene coordinate regression, coordinate regression, attractive approach, visual localization strategies, SCR
备注： WACV 2027
点击查看摘要
Abstract:Among visual localization strategies, scene coordinate regression (SCR) has emerged as an attractive approach for its compactness, accuracy, and speed. Despite these advantages, SCR models generalize poorly across substantially different camera models, such as omnidirectional or strongly rectified imagery. This limitation arises because, changes in field of view, lens distortion, or rectification-induced resampling can make the same scene content appear differently depending on its pixel position, degrading localization accuracy. To cope with this limitation, we introduce Ray-SCR, a lightweight extension to existing SCR architectures that conditions local visual features on their calibrated viewing rays and refines neighboring ray-conditioned features with a shallow local Transformer. We further formulate supervision directly in ray space and use sparse SfM points as metric anchors that link observations across views and camera models. Taken together, these components enable a single scene representation built from a panoramic mapping sequence to accurately localize query images captured with very different cameras, including pinhole, fisheye, and omnidirectional cameras. We evaluate Ray-SCR across multiple SCR architectures and on datasets with pinhole, fisheye, and omnidirectional cameras. The proposed ray conditioning substantially improves generalization across cameras and leads to state-of-the-art localization performance in these challenging cross-camera settings. The project page is available at this https URL.
Comments:
WACV 2027
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2611.03098 [cs.CV]
(or
arXiv:2611.03098v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2611.03098
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
44. 【2611.03097】DR Pixel: Page-Native Deep Research with Vision-Language Models
链接：https://arxiv.org/abs/2611.03097
作者：Tiansheng Hu,Yichuan Wang,James V. Talwar,Nicholas Tomlin,Chen Zhao,Sewon Min
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：agents typically reduce, typically reduce papers, deep research, page-native deep research, existing deep research
备注：
点击查看摘要
Abstract:Complex documents such as scientific papers contain rich information in tables, figures, and equations; however, existing deep research (DR) agents typically reduce papers to OCR-extracted text. We instead ask whether vision-language models (VLMs) can enable page-native deep research: directly retrieving and reasoning over rendered document page images. We introduce DR Pixel, the first open-source end-to-end multimodal DR agent that uses rendered page images as its sole retrieval and reasoning unit, operating over a corpus of 1.06M pages. To evaluate this setting, we construct DRPixelBench, a benchmark on scientific papers requiring reasoning over text, figures, tables, and equations. Surprisingly, page-native DR already works well without training, outperforming OCR-based baselines across state-of-the-art models like GPT-5.4, Gemini-3.5-Flash, and Qwen3.6-27B, while requiring fewer tool calls. We next turn to DR training. A key challenge is that teacher trajectories for agentic supervised finetuning are noisy, mixing critical reasoning and action steps with redundant or failed attempts. To address this, we introduce counterfactual credit reweighting, a fine-grained credit assignment method that weights individual reasoning and action steps by their counterfactual contribution to the final answer. Our training improves retrieval recall by about 15 points and final accuracy by over 10 points on DRPixelBench, and likewise outperforms the untrained baseline on four existing benchmarks. On out-of-distribution ViDoRe-V3, DR Pixel comes within 1.8 points of an oracle that is given the gold pages directly. Our results suggest that the conventional OCR-then-retrieve pipeline is not only unnecessary but suboptimal: directly retrieving and reasoning over visual document pages makes complex DR both more effective and more efficient.
45. 【2611.03087】MIRA: Reinforcing Multimodal Reasoning via Deceptive Contextual Augmentation
链接：https://arxiv.org/abs/2611.03087
作者：Zhihan Yin,Jianxin Liang,Yifeng Yao,Nonghai Zhang,and Bingyue Peng,Chunguang Qie,Huishuai Zhang,Dongyan Zhao
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Verifiable Rewards, Reinforcement Learning, Learning with Verifiable, existing frameworks suffer, significantly advanced multimodal
备注： Accepted at NeurIPS 2026. 23 pages. Code: [this https URL](https://github.com/Hans-M-Yin/mira-neurips26)
点击查看摘要
Abstract:While Reinforcement Learning with Verifiable Rewards (RLVR) has significantly advanced multimodal reasoning, existing frameworks suffer from a critical "perception-reasoning gap." Due to an over-reliance on seemingly relevant visual tokens, even minor perceptual perturbations can propagate through the reasoning process, leading to compounding hallucinations. To address this issue, we propose MIRA, a training framework that improves robustness to erroneous visual contexts while enhancing logical reasoning ability. By injecting filtered, deceptive visual contexts during training, we construct challenging "hard traps" that stress-test the model's robustness to misleading information. Furthermore, we introduce a group-wise reflection-triggering mechanism that enables the model to autonomously detect and rectify inconsistencies between visual cues and logical constraints, which is ultimately internalized as an intrinsic policy behavior. Importantly, MIRA does not rely on human annotations. Experimental results across multiple reasoning and perception benchmarks show that MIRA yields an average 7% improvement on in-domain benchmarks, with consistent improvements on vision-centric benchmarks. These findings highlight that active error recovery is essential for robust multimodal reasoning. Comprehensive ablation studies and analyses further provide insights into why MIRA is effective.
46. 【2611.03080】VL-Dedup: Graded Multimodal Entity Resolution for Image-Text Data Deduplication
链接：https://arxiv.org/abs/2611.03080
作者：Zhenxi Liu,Guanze Chen,Dehui Yu,Xingyu Wang,Bingxu Hou,Chengwei Li,Tao Ma,Ke Wang,Gongsheng Yuan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：corpora contain copies, image, images, pairs, describe one image
备注： 14 pages, 6 figures
点击查看摘要
Abstract:Image-text corpora contain copies of one image, captions that describe one image in different ways, captions reused for different images, and captions that do not match their images. Each case calls for a different curation action. Deduplication and multimodal entity resolution (ER) only decide whether records are the same, and they are evaluated on labeled pairs. Yet pair scores do not tell which records end up in the same cluster or which useful captions get deleted. We therefore formulate image-text deduplication as graded multimodal ER, which decides visual identity, caption handling, and mismatches for each pair, and we evaluate it at three levels: pairs, clusters, and the retained set. Our method, VL-Dedup, groups records of the same visual entity into clusters and caps the size of each cluster. Within each cluster, a vision-language model (VLM) and CLIPScore decide which captions to keep and which to flag. We also build VL-DedupBench, with 50,000 COCO and SOP records and 66,788 labeled pairs. On it, a classifier that selects no false edge among the labeled pairs still joins millions of record pairs from different entities. Spending VLM calls on the pairs inside clusters, rather than on pairs with uncertain scores, gives better caption decisions from the same model. Even when almost all clusters are correct, keeping one record per cluster loses facts in many deletions, while the deletions of VL-Dedup lose much less information.
47. 【2611.03067】PlanContext: Benchmarking In-Context Driving Decision-Making
链接：https://arxiv.org/abs/2611.03067
作者：Ruikai Li,Naiyu Gao,Hao Shan,Yizhe Fan,Yanhao Wu,Han Jiang,Yilong Ren,Zhenning Li,Haiyang Yu,Yanhu Shan,Rui Wu,Hao Zhao,Hongyang Li,Zhiyong Cui
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Real-world driving requires, requires context-aware decision-making, driving requires context-aware, Real-world driving, driving
备注：
点击查看摘要
Abstract:Real-world driving requires context-aware decision-making. Existing end-to-end driving benchmarks primarily assess trajectory quality through safety, compliance, comfort, and driving progress, leaving context-dependent decision-making insufficiently characterized. To fill this gap, we present PlanContext, a benchmark for evaluating in-context driving decision-making. PlanContext constructs paired evaluations by varying high-level driving intentions while keeping the observed scene fixed, enabling a natural and controllable assessment of context-dependent decision-making. We further define six representative driving contexts and jointly evaluate contextual decision correctness, road compliance, and dynamic safety with class-balanced metrics. Experiments on 9,561 scene-condition instances from NAVSIM and 23 public end-to-end driving models show that high conventional driving-quality scores do not consistently correspond to strong route-level in-context driving decision-making. Further analysis shows that model behavior varies with decision timing, road structure, and traffic interaction depending on the decision required by the current context. Our results highlight in-context driving decision-making as an important complementary dimension for evaluating end-to-end driving systems.
48. 【2611.03062】MuCHMDPoser: Multiview RGB-Camera Full-Body Pose Tracking for Virtual Reality
链接：https://arxiv.org/abs/2611.03062
作者：Antoine Maiorca,George Fletcher,Thierry Ravet,Thierry Dutoit
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Virtual Reality, consumer-grade sparse sensors, Head-Mounted Displays, Accurate full-body tracking, Accurate full-body
备注：
点击查看摘要
Abstract:Accurate full-body tracking in Virtual Reality (VR) is heavily underconstrained when relying solely on consumer-grade sparse sensors, such as Head-Mounted Displays (HMDs) and handheld controllers. Indeed, the self-avatar full-body pose must be inferred based on the 3 available upper-body joints tracked by these devices. This leads to significant tracking error, especially in lower-body pose. To overcome this issue, we propose to extend the tracking setup with external multiview RGB cameras. We show that integrating RGB-based pose estimation this framework is able to significantly decrease lower-body tracking errors, even under common artifacts in RGB-based estimates. Additionally, we evaluate a only-once HMD-camera calibration procedure that does not require any physical markers. We finally propose an implementation of the overall framework, achieving an end-to-end animation at 60 FPS on a Nvidia RTX3080 GPU. Codes are available at this https URL.
49. 【2611.03043】VideoEditor-MoE: Scaling Complex Video Editing with Mixture of Experts
链接：https://arxiv.org/abs/2611.03043
作者：Xiao Cao,Fuchen Long,Yansong Qu,Wen Xiao,Xin Zhang,Xinlong Sun,Xi Chen,Zhiyong Huang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：requires understanding complex, understanding complex instructions, jointly fulfilling multiple, multiple editing requests, understanding complex
备注：
点击查看摘要
Abstract:Complex video editing requires understanding complex instructions while jointly fulfilling multiple editing requests. Meeting these demands through dense model scaling substantially increases computational cost. We introduce VideoEditor-MoE, the first open-source mixture-of-experts framework for video editing. Beyond sparse MLP-MoE layers, MoE-Attention expands attention capacity through routed key--value experts while preserving global interactions among video tokens. Initialized from a 5B video editing model, VideoEditor-MoE scales to 14B and 56B parameters, with approximately 8B parameters activated per token in both variants. Comparisons with existing methods and two complementary baselines, Explicit-MoE and MLP-MoE, assess its benefits over explicit expert guidance and MLP-only expert architectures. Further analyses demonstrate that all experts remain active and reveal that learned routing responds more strongly to sample content and diffusion noise levels than to human-defined editing categories. Spatial analysis further indicates sensitivity to object-level semantic features. We also identify decoupled weight decay as a strategy for stabilizing expert scaling.
50. 【2611.03042】Bayesian Sequential Optimal Experimental Design for Single-Pixel Imaging using Reinforcement Learning
链接：https://arxiv.org/abs/2611.03042
作者：Marcos Antonio Obando,Tianyuan Wang,Tanja Tarvainen,Tristan van Leeuwen,Felix Lucka
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Adaptive compressed sensing, modern imaging systems, Adaptive compressed, informative measurements sequentially, compressed sensing
备注： 39 pages, 10 figures
点击查看摘要
Abstract:Adaptive compressed sensing (CS) aims to select the most informative measurements sequentially, which is crucial for many modern imaging systems. This task can be formulated as a Bayesian sequential optimal experimental design (sOED) problem, where each new acquisition is chosen to maximally reduce uncertainty about the unknown image given prior information and subsequent data provided by acquisitions. However, in single-pixel imaging (SPI), the large design space consists of all possible binary illumination patterns. Directly optimizing the Bayesian sOED objective over this space using conventional methods is generally challenging. In this work, we reformulate sOED for SPI as a reinforcement learning (RL) problem. In RL, an agent learns a policy through repeated experimental trials to maximize a reward, here given as the expected information gain, the most complete measure of uncertainty reduction in Bayesian OED. This avoids the need to directly optimize complex information-theoretic objectives during a measurement to obtain the next design. Instead, the result is a learned policy function that directly maps the current posterior belief about the image to the next optimal binary measurement pattern, in a computationally efficient way. Using a simple yet representative SPI imaging scenario, this work evaluates the scalability of the learned policy under two different policy parameterizations. Furthermore, we investigate how performance deteriorates when only approximate posterior information is available or the measurements are impaired by noise, and propose several strategies to introduce additional design constraints motivated by biomedical applications. The numerical experiments demonstrate that the proposed Bayesian sOED-RL framework remains robust and can be extended to more complex, large-scale SPI scenarios.
Comments:
39 pages, 10 figures
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
Cite as:
arXiv:2611.03042 [cs.CV]
(or
arXiv:2611.03042v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2611.03042
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
51. 【2611.03033】GPU-Native Real-Time Textured Mesh Reconstruction with Seam-Aware Multi-View Radiometric Correction
链接：https://arxiv.org/abs/2611.03033
作者：Hiroyuki Sato
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：multiple RGB-D sensors, GPU-native volumetric-video system, graphics-compatible textured triangle, textured triangle meshes, multiple RGB-D
备注： Accepted to WACV 2027. 20 pages including appendix
点击查看摘要
Abstract:We present a GPU-native volumetric-video system for real-time reconstruction of graphics-compatible textured triangle meshes from multiple RGB-D sensors. Existing TSDF systems accelerate fusion and mesh extraction, but extending them to per-frame textured meshing adds CPU mesh processing, CPU-side texturing work, or extra CPU-GPU transfers between stages. After input staging, our method keeps the reconstruction and texturing stages (TSDF fusion, Marching Cubes, connected-component noise removal, view-based texture mapping, inpainting, and radiometric seam correction) resident on the GPU; no intermediate mesh or image data returns to the host between these stages. A fixed-size-array representation of mesh topology gives constant-time neighbor access on the GPU and makes the downstream mesh-level operations data-parallel. Because we texture each face from a single camera, exposure seams that vary smoothly across each image remain; we estimate a per-camera low-frequency gain field and bake it into the atlas on the GPU. On the CMU Panoptic dataset, our method is faster than the baselines at every tested voxel resolution and number of sensors, achieves peak speedups of more than an order of magnitude over CUDA-accelerated nvblox and CPU-based Open3D, and approaches an offline textured-meshing baseline in perceptual re-rendering quality.
52. 【2611.03027】VLM-as-a-Judge for Person Re-Identification
链接：https://arxiv.org/abs/2611.03027
作者：Bessie Dominguez-Dager,Miguel Cazorla,Vincent Lepetit
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Cloth-changing person re-identification, Cloth-changing person, person re-identification, method clearly dominates, methods that lead
备注： Accepted at the NeurIPS 2026 Workshop on Grounded and Faithful Vision-Language Models for Real-World Deployment (VLM4RWD)
点击查看摘要
Abstract:Cloth-changing person re-identification (CC-ReID) is still very challenging, and no method clearly dominates: methods that lead on one benchmark collapse on the others, because they rest on different identity cues. We show that a general-purpose vision-language model (VLM), used zero-shot as a judge for reranking a short candidate list, beats the expert retrieval models it reranks by a wide and consistent margin. On the four scenarios of CHIRLA, a long-term CC-ReID benchmark that no publicly released Re-ID model is trained on, reranking the candidates of two frozen experts raises rank-1 on every scenario, by 12.9 points on average over the best expert and 9.4 over the best naive ensemble of the two, with no component fine-tuned on the target data. Merging both experts' shortlists matches or beats reranking the stronger expert's shortlist alone, at lower cost. Introducing a VLM does, however, come at a cost: almost all of the pipeline's FLOPs are spent on it. We therefore borrow a criterion from ensembling and invoke the VLM judge only where the two experts disagree at rank 1. This threshold-free gate removes 40% of the calls, and a comparable share of total compute, with no significant drop in rank-1, trading 1.8 to 3.8 points of mAP. Judging remains the dominant cost, but on a benchmark where dedicated experts stall, we find a frozen general-purpose model to be the strongest judge of identity. The code is available at this https URL.
53. 【2611.03023】VizDAGuide: Misleading Chart Question Answering in Compact Vision Language Models via DAG-Structured Supervision
链接：https://arxiv.org/abs/2611.03023
作者：Haiyang Zhang,Sicheng Song,Zixin Chen,Jie Gu,Huiya Ou,Chenhui Li,Changbo Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)
关键词：Misleading charts, lead vision-language models, underlying data, charts can lead, lead vision-language
备注： 21 pages, 16 figures
点击查看摘要
Abstract:Misleading charts can lead vision-language models to conclusions that conflict with underlying data. Existing work focuses on inference-time strategies, while training-time supervision remains less explored. We present VizDAGuide, a DAG-structured supervision method for misleading-chart question answering. The method represents intermediate reasoning states and their dependencies as a directed acyclic graph, assigns supervision weights according to their roles, and serializes the graph into a unified training target for open-ended and multiple-choice QA with single-pass inference. Experiments on two benchmarks across Qwen3-VL and InternVL3.5 models show improvements over a content- and weight-matched Linear CoT-SFT baseline on both answer formats. Process-level evaluation shows gains in grounding and operation execution, while ablations indicate that dependency structure and weighted supervision are most effective when combined. These results support DAG-structured weighted supervision for misleading-chart question answering.
54. 【2611.03017】Efficient Hybrid Distillation: Synergizing Score and Adversarial Objectives for One-Step Diffusion
链接：https://arxiv.org/abs/2611.03017
作者：Fei Peng,Junqiang Wu,Haoxian Tan,Jun Zhou,Jie Hu,Xiaoming Wei,Jie Guo,Xiu Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Numerous distillation methods, Numerous distillation, Score Distillation, accelerate diffusion models, Adversarial Score Distillation
备注： This paper is accepted by NeurIPS 2026
点击查看摘要
Abstract:Numerous distillation methods have been developed to accelerate diffusion models. Recent research indicates that hybrid strategies---blending different paradigms---yield superior results compared to single-method approaches. However, current works predominantly rely on a simple combination of objectives, leaving the question of how to effectively synergize them largely underexplored. In this paper, we specifically investigate the synergy between Score Distillation and Adversarial Distillation. We reveal that their operating zones are distinct and complementary: Score Distillation is effective in high-noise regimes for capturing the global distribution yet lacks fine-grained supervision in low-noise regions. Conversely, Adversarial Distillation is effective in low-noise regions but is prone to instability and suffers from discriminator failure when applied to high-noise intervals. Leveraging this insight, we propose Efficient Adversarial Score Distillation (EASD), a framework that synergizes these objectives via a regime-adaptive sampling strategy, directing each objective to focus on its effective interval. We further apply this paradigm to DiT-based Flow Matching models. Empirically, our method achieves a promising one-step FID of 1.39 on ImageNet 256$\times$256 using the SiT-XL/2+REPA model. This work provides a concrete guideline for maximizing the potential of hybrid distillation. Our code and model are available at this https URL .
55. 【2611.03007】Q-CamTuning: A Multimodal Large Language Model for Fine-Grained Quality Reasoning in Livestreaming Camera Tuning
链接：https://arxiv.org/abs/2611.03007
作者：Yanchao Bi,Pengfei Chen,Yulong Yan,Qian Zhang,Biao Wang,Leida Li
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：enjoy high Quality, camera tuning, Image Quality Assessment, automatic camera tuning, indispensable for ordinary
备注：
点击查看摘要
Abstract:With the popularization of livestreaming applications, automatic camera tuning has become indispensable for ordinary users to enjoy high Quality of Experience (QoE). However, the existing Image Quality Assessment (IQA) methods face two challenges in camera tuning. First, they struggle to identify subtle quality difference between images, which is common in camera tuning. Second, the ability to explain fine-grained differences and to provide suggestions for camera tuning are even more lacking. To address these challenges, we first construct FGLive-Comments, an instruction tuning dataset with rich annotations of both preferences for fine-grained image pairs and quality reasoning from global and local visual evidence, which supports selective adjustment recommendations of camera parameters. Based on FGLive-Comments, we develop Q-CamTuning, a multimodal large language model for livestreaming camera tuning. Its progressive perception-evidence-guidance framework learns quality-aware visual representations, enhances fine-grained reasoning with global-local evidence, and maps quality issues to camera-parameter adjustment directions. Extensive experimental results demonstrate that Q-CamTuning outperforms existing IQA models in both quality scoring and fine-grained image pair ranking. User study also validates its ability to recommend camera tuning suggestions.
56. 【2611.02995】ILLRAW: Illumination-Aware RAW Object Detection
链接：https://arxiv.org/abs/2611.02995
作者：Xinzhe Wang,Xiao Liang,Xiaoli Zhang,Kang Ma
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：introduce learnable ISP, learnable ISP modules, learnable ISP, formats to fit, RAW-based detectors typically
备注： Accepted to ACCV 2026
点击查看摘要
Abstract:Existing RAW-based detectors typically introduce learnable ISP modules to convert RAW inputs into sRGB-like formats to fit off-the-shelf detectors. However, this RAW-to-sRGB paradigm decouples representation learning from the downstream detection task. Crucially, it forces the network to inherit human-centric visual priors while discarding intrinsic RAW advantages, such as linear sensor responses and high-bit-depth, minimally processed scene cues. In this paper, we propose \textbf{ILLRAW}, an \textbf{ILL}umination-aware end-to-end \textbf{RAW} object detection framework. Instead of reconstructing visually plausible sRGB images, ILLRAW directly learns detection-oriented RAW features through a lightweight feature adapter inserted at the input stage of existing detectors. ILLRAW estimates an illumination mask and introduces channel-sensitive embeddings to model Bayer-channel responses. These features are fused by an illumination attention fusion module. Experiments show clear improvements on the diverse AODRaw benchmark and competitive performance on LOD and PascalRAW, with particularly strong results under dark exposure.
57. 【2611.02964】One Image Is Enough: Self-Generated Supervision for Personalizing Human Video Diffusion at Test Time
链接：https://arxiv.org/abs/2611.02964
作者：Sadman Rakib Pinon,Adamo Orsini,Yanis Falaki,Linlian Jiang,Jacob Kingi,Yang Wang,Xinxin Zuo
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Machine Learning (cs.LG)
关键词：Pose-driven human video, target pose sequence, human video diffusion, video diffusion animates, Pose-driven human
备注： Accepted to WACV 2027. 23 pages (8 main + 3 references + 12 supplementary), 11 figures, 19 tables. Code: [this https URL](https://github.com/SadmanPinon/one-image-is-enough)
点击查看摘要
Abstract:Pose-driven human video diffusion animates a person from a single reference image and a target pose sequence, yet it struggles to preserve identity, rendering the face and garments unfaithfully as the pose departs from it. Personalization is the standard remedy, but its supervision is missing: one image fixes identity at a single pose, while a multi-pose subject video cannot be assumed in practice. Instead, we synthesize the missing supervision. A domain-tuned, pose-conditioned generator produces pseudo-ground-truth frames at selected key poses. An inference-time reference-only sampler steers these candidates toward the subject and keeps the most identity-consistent. A per-subject low-rank adapter then trains on static clips of them, configured from the reference alone, with no subject video, ground truth, or labels. Although lower in fidelity, these synthetic frames supervise more effectively than real ones. Real frames as captured carry motion that erodes the temporal prior, while a static clip conveys appearance alone. On TikTok and UBC Fashion, the adapted model improves the base on every metric, inverts the identity-versus-motion trade-off, and matches or surpasses adaptation on five real frames despite using none. Code and weights are available at this https URL.
58. 【2611.02952】Balancing Representations by Identifying and Generating Under-represented Data
链接：https://arxiv.org/abs/2611.02952
作者：Filipe Laitenberger,Hirokatsu Kataoka,Yuki Asano,Cees Snoek,Mohammadreza Salehi
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Self-supervised learning inherits, Self-supervised learning, Generating Under-represented Data, learning inherits, Self-supervised
备注：
点击查看摘要
Abstract:Self-supervised learning inherits the coverage of its source data. When an unlabeled corpus is long-tailed, the representation becomes dense around frequent modes and thin where coverage is weak. Objectives for long-tailed SSL reweight the images already in the corpus and add no new ones. We introduce BRIDGE (Balancing Representations by Identifying and Generating Under-represented Data), a label-free feedback loop around the source set. The current encoder scores every source image by its mean kNN distance, and a budgeted acquisition rule selects images from a band of that score distribution where support is thin and the generator still produces faithful variants. A frozen image-to-image diffusion model then adds local variants of the selected anchors, and pretraining continues on the enlarged source set. We formulate acquisition as recoverability-weighted allocation of local support and derive when a finite budget should favor a sparse band that excludes the extreme tail and when reallocation after each repair is optimal under a fixed objective. Across five long-tailed, web-scraped and synthetic source regimes, BRIDGE has the highest seven-task linear-probe and kNN average of the compared methods, and paired experiments extend the gain to ViT-S under contrastive and self-distillation objectives, to low-label fine-tuning and to semantic segmentation. The linear-probe gain is smaller under masked reconstruction. Generated repair matches an oracle that restores the withheld real images, and under a frozen encoder the inserted images shrink the neighborhoods of the selected anchors about twice as much as those of matched unselected images. BRIDGE needs no labels and leaves the pretraining objective unchanged, so it can be added to pretraining on uncurated web data, where the encoder decides which images to generate.
59. 【2611.02941】RouteREPA: Routed Representation Alignment for Just Image Transformers
链接：https://arxiv.org/abs/2611.02941
作者：Yi Tan,Beier Zhu,Sirui Chen,Cheng Chen,Xingyu Zhu,Yuan Zhou,Zhenshan Tan,Tianrun Chen,Hanwang Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：latent-space diffusion transformers, diffusion transformers, Image Transformers, latent-space diffusion, alignment
备注： 23 pages
点击查看摘要
Abstract:Representation alignment (REPA) is widely used to accelerate the training of latent-space diffusion transformers (DiTs). However, applying it to pixel-space models such as Just Image Transformers (JiT) is challenging. Our analysis reveals a pronounced representation conflict between discriminative alignment and pixel-space generation. Compared with its latent counterpart, JiT learns representations that are substantially less aligned with DINOv2. Applying REPA to JiT consistently reduces the reconstructability of its intermediate representations, whereas this effect is not observed in Latent JiT. We attribute this conflict to JiT directly reconstructing pixels, which requires its representations to hierarchically encode discriminative semantics and reconstruction-relevant visual information across network depths. To address these challenges, we propose Routed Representation Alignment (RouteREPA), which uses lightweight, representation-dependent routers to adaptively route task-oriented representations for alignment and generation. We further apply routing across multiple network depths to accommodate their depth-dependent representation requirements. Extensive experiments on ImageNet-1K at 256x256 resolution show that RouteREPA consistently improves JiT across model scales and training budgets, outperforming standard REPA. On JiT-H/16, RouteREPA further surpasses PixelREPA using only one-third of its training epochs without classifier-free guidance.
60. 【2611.02931】raining-Time Domain Transfer for Generator-Free Diagnostics on Novel Modalities in Computational Pathology
链接：https://arxiv.org/abs/2611.02931
作者：Julia A. Mielcarz,Andrea Camilloni,Nita Mulliqi,Jessica A. Frank,Anders Blilie,Emilius A.M. Janssen,Martin Eklund,Kimmo Kartasalo
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：imaging modalities promise, modalities promise improved, promise improved diagnostics, promise improved, development is constrained
备注： 4 pages, 2 figures. Submitted to IEEE ISBI 2027
点击查看摘要
Abstract:Novel imaging modalities promise improved diagnostics, but AI development is constrained by scarce training data. Inference-time domain transfer can address this by mapping novel modalities to established ones, enabling reuse of existing diagnostic models. However, this introduces hallucination risks, computational overhead, and regulatory complexity. Inspired by sim-to-real transfer, we propose training-time domain transfer, generating synthetic target-domain training data from archived routine samples to enable direct diagnosis on real inputs without inference-time generation. Using unstained prostate histopathology as a proof-of-concept, we compare this approach with inference-time virtual staining and conventional HE-based cancer detection. Training-time transfer achieved higher concordance with the conventional benchmark than virtual staining for both raw (Cohen's $\kappa$=0.59 vs. 0.37; Gwet's AC1=0.73 vs. 0.29) and deparaffinized tissue ($\kappa$=0.66 vs. 0.61; AC1=0.73 vs. 0.64), supporting its potential for emerging diagnostic modalities.
61. 【2611.02929】Comprehensive Evaluation of Monocular and Multi-view 3D Human Pose Estimation Models for Fitness Exercise Analysis
链接：https://arxiv.org/abs/2611.02929
作者：Néstor Ortega,Agustín Salgado,Javier Sánchez
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Three-dimensional human pose, computer vision systems, Three-dimensional human, fundamental component, component of computer
备注： 24 pages, 11 figures, 7 tables
点击查看摘要
Abstract:Three-dimensional human pose estimation has become a fundamental component of computer vision systems for sports analytics, rehabilitation, and motion understanding. Although recent deep learning approaches have achieved remarkable accuracy on standard benchmarks, their performance under realistic sports scenarios remains insufficiently studied. Furthermore, the trade-offs between recent monocular and multi-view approaches, as well as the benefits of post-processing techniques for improving temporal consistency, have not been systematically evaluated on fitness-oriented datasets. This paper evaluates recent state-of-the-art 3D human pose estimation methods on Fit3D, a dataset of synchronized multi-view recordings of a wide variety of fitness exercises with accurate ground-truth annotations. We study two recent monocular lifting approaches, TCPFormer and PoseMamba-L, and a multi-view model, MVGFormer, under a unified evaluation protocol. To investigate the influence of the input data, monocular methods are evaluated using ground-truth keypoints and detections generated by recent 2D pose estimators, RTMPose and YOLO-Pose. Additionally, we analyze the effectiveness of three temporal filters for reducing prediction jitter while preserving motion dynamics. Experimental results provide a detailed comparison of accuracy, temporal consistency, and robustness to imperfect 2D detections across the evaluated methods. Our analysis highlights the impact of detector quality on lifting-based approaches, compares transformer- and state-space-based temporal architectures, and discusses the practical trade-offs between monocular and multi-view systems for fitness motion analysis. Our results show that 2D detection quality, temporal modeling, and post-processing must be considered jointly in pose estimation pipelines for exercise analysis.
62. 【2611.02921】Unlocking the Potential of Contrastive Regularization for Diffusion Transformer Training
链接：https://arxiv.org/abs/2611.02921
作者：Yi Tan,Beier Zhu,Sirui Chen,Yunzhe Lin,Yuan Zhou,Cheng Chen,Xingyu Zhu,Tianrun Chen,Yanbin Hao,Hanwang Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：contrastive, diffusion, effective regularizer, contrastive learning, regularization
备注： 29 pages
点击查看摘要
Abstract:Representation regularization has emerged as an effective way to improve diffusion transformer training. Yet one of the most canonical regularizers--InfoNCE-style contrastive learning--remains largely underexplored in this setting. We naturally ask a question: can standard contrastive learning serve as an effective regularizer for diffusion transformers? Surprisingly, we find that naive InfoNCE regularization brings only marginal gains. Our analysis reveals that the objective is easily dominated by a shortcut: near-orthogonal noise components in diffusion inputs provide a bypass for enlarging negative-pair distances while weakening positive-pair alignment, especially at high noise levels. To unlock the benefit of contrastive regularization, we propose Clean Representation-ANchored Contrastive (CRAN) regularization. Specifically, CRAN anchors contrastive dispersion with clean-sample representation distances, transferring clean relational semantic structure to noisy diffusion representations to suppress the noise shortcut. Extensive experiments on ImageNet show that CRAN consistently improves diffusion transformer training across model scales and training budgets, outperforming internal feature-alignment and dispersive regularization baselines while matching external DINO-guided REPA. These results re-establish InfoNCE-based contrastive learning as an effective regularizer for diffusion training, once its noise-driven over-dispersion is properly constrained.
63. 【2611.02902】ailorRig: Controllable and Structured Auxiliary Skeleton Generation for Garment-Aware Rigging
链接：https://arxiv.org/abs/2611.02902
作者：Yajing Chen,Xin Chen,Saidan Lu,Yeqi Yuan,Weikai Chen,Changyu Hu,Cheng Zeng,Xin Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：remains challenging due, complex garments remains, garments remains challenging, remains challenging, challenging due
备注： Accepted to SIGGRAPH Asia 2026 Conference Papers
点击查看摘要
Abstract:Humanoid rigging for modern characters with complex garments remains challenging due to the need for dense auxiliary skeletons and precise skinning control. Existing automatic methods primarily recover rigs from geometry, providing limited artist control over auxiliary articulation and often lacking explicit semantic or kinematic-chain structure for dense garment bones, leading to instability and weight bleeding. We present TailorRig, a framework that reformulates garment-aware humanoid rigging as a structured, controllable full-rig generation problem. This formulation shifts the goal from automatic rig recovery to artist-driven rig authoring, where both body-template compatibility and auxiliary articulation are explicit design choices. TailorRig exposes two explicit axes of artist control within a unified framework: a user-specified body skeleton template that preserves body-rig compatibility, and artist-provided semantic labels that drive an autoregressive generator to synthesize requested category-specific auxiliary bone chains. To robustly assign skinning weights under dense skeletal configurations, we further introduce a hierarchical chain-to-bone formulation: vertices are first associated to a kinematic chain, and bone weights are then refined within that chain, reducing weight bleeding between spatially adjacent but semantically unrelated structures. We evaluate TailorRig on a diverse set of characters and introduce Human-Mix, a large-scale dataset of over 38,000 humanoid models curated for garment-aware rigging. Experiments show that TailorRig improves skeleton accuracy, deformation stability, controllability, and practical usability over existing methods.
64. 【2611.02897】PhotoGuider: Composition-Aware Cropping and 360$^{\circ}$ View Framing with Explainable Photographic Assessments
链接：https://arxiv.org/abs/2611.02897
作者：Yuan-Kang Lee,Kuan-Lin Chen,Chia-Che Chang,Yu-Lun Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：composition worth keeping, Traditional image cropping, worth keeping, Traditional image, assumes the photograph
备注： 25 pages, 8 figures. Project page: [this https URL](https://ntuneillee.github.io/research/photoguider/)
点击查看摘要
Abstract:Traditional image cropping assumes the photograph already contains the composition worth keeping, and asks only where to crop. A full 360$^{\circ}$ scene offers no such guarantee: the viewing direction in a scene has to be discovered before anything can be framed. We present PhotoGuider, a measure-then-frame method that answers both questions with compact learned scorers over one shared set of composition-aware features. The designed features are extracted using foundation and task-specific vision models and structured into four photographic tokens: Subject, Composition, Aesthetics, and Integrity. Our MLLM explainer is fine-tuned to generate composition-related explanations conditioned on images and measured token assessments. To our knowledge, PhotoGuider is the first method to combine explicit composition-based direction selection in 360$^{\circ}$ panoramas with refined framing, camera-parameter output for native re-rendering, and measurement-conditioned explanations. On two standard 2D cropping benchmarks, PhotoGuider achieves the highest average mIoU performance against ground-truth crops. In a blind ranking study, 120 participants ranked three cropping methods over 100 panoramic scenes from the public Poly Haven HDRI library, placing our framings first in 53.2% of cases, against 27.3% and 19.5% for two strong alternatives. Project page: this https URL
65. 【2611.02877】ProtoFusion: Protocol-Guided Prompt Refinement for Generative Infrared and Visible Image Fusion
链接：https://arxiv.org/abs/2611.02877
作者：Pengwei Liang,Junjun Jiang,Junhui Hou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：integrates complementary information, visible image fusion, Infrared and visible, fusion integrates complementary, image fusion integrates
备注：
点击查看摘要
Abstract:Infrared and visible image fusion integrates complementary information from both modalities to provide a more comprehensive representation of the scene. We propose ProtoFusion, a protocol-guided generative framework for infrared and visible image fusion. Instead of relying on fixed fusion operators, hand-crafted objectives, or manually specified one-shot prompts, ProtoFusion formulates fusion as protocol-constrained generation. It represents fusion intent with a structured protocol, consisting of environment state cards, grounding principles, and a style profile, which explicitly specifies which evidence should be preserved or suppressed and which properties the fused result should satisfy. To optimize this protocol, we introduce protocol-guided prompt refinement, a closed-loop learning framework that iteratively performs generation, evaluation, and revision under multimodal evidence. Once learned, the optimized protocol is fixed at inference time and directly guides fusion generation. To address residual source inconsistencies, we further incorporate structured belief construction, which organizes modality reliability, scene evidence, and cross-modal conflicts into a structured representation for conservative correction after generation. Extensive experiments on standard benchmarks show that ProtoFusion improves quantitative performance, achieves favorable results in aesthetic evaluation, and produces visually coherent fusion outputs. Project Page: {this https URL}.
66. 【2611.02862】Performance evaluation of super-resolution techniques for characterization and phenotyping of commodity crops using multispectral imagery
链接：https://arxiv.org/abs/2611.02862
作者：Abhiram Karukayil,João F. C. Mota,Mateo Vásquez-Guevara,Tito Arevalo-Ramirez,Fernando Auat Cheein
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：limited spatial resolution, preserving spectral fidelity, obscure fine crop, fine crop structures, spatial resolution
备注： Published in Advanced Intelligent Systems
点击查看摘要
Abstract:Multispectral imagery provides spectral information beyond the visible range for vegetation monitoring, but it typically suffers from limited spatial resolution, which can obscure fine crop structures and affect vegetation-index (VI) estimates.} This study evaluates whether single-image super-resolution (SISR) methods developed for red, green, and blue (RGB) imagery can enhance the spatial resolution of red, green, and near-infrared (RGN) crop images while preserving spectral fidelity. Eight pretrained methods are applied directly to RGN images without fine-tuning: bicubic and nearest-neighbor interpolation, Real-ESRGAN, HAT, HiT-SR, SRFormer, ResShift, and StableSR. Reconstruction at $4\times$ and $16\times$ is evaluated for whole images and manually segmented leaf regions. Reconstruction quality is assessed using mean absolute error (MAE), peak signal-to-noise ratio (PSNR), structural similarity index (SSIM), spectral angle mapper (SAM), and erreur relative globale adimensionnelle de synthèse (ERGAS). Eight VIs, computed from reference and super-resolved images, are evaluated using MAE, PSNR, and SSIM. Transformer-based methods \modification{significantly} outperform GAN- and diffusion-based approaches in both evaluation settings \modification{($p 0.001$)}, with \modification{HAT, HiT-SR, and SRFormer forming the highest-performing statistical tier}. These findings indicate that RGB-trained SISR can enhance spatial detail in RGN crop imagery while maintaining spectral consistency and VI reliability for high-resolution crop phenotyping.
67. 【2611.02857】Solv3R: 3D Looped Transformer as a Multi-view Solver
链接：https://arxiv.org/abs/2611.02857
作者：Jeong-gi Kwak,Andrea Tagliasacchi,Sho Kagami,Yuki Ono,Kwang Moo Yi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：refining camera poses, reconstruction proceeds iteratively, proceeds iteratively, refining camera, camera poses
备注： preprint; project page: [this https URL](https://ubc-vision.github.io/solv3r/)
点击查看摘要
Abstract:Classical structure-from-motion reconstruction proceeds iteratively, refining camera poses and scene geometry from a current estimate. This allows maps to easily expand without recomputing already computed views, or geometry estimates to improve as more observations are provided. Most geometric foundation models, however, predict entire geometry in a single forward pass or update a recurrent state as frames arrive sequentially, making this expansion and refinement non-trivial. We introduce Solv3R, a looped transformer that learns to continue solving multi-view geometry from its current state. Importantly, its update operator is independent of the iteration count, allowing previously refined and newly introduced views to be jointly updated regardless of how ``solved'' they are. We train the operator to preserve accurate reconstructions under continued iteration and correct inaccurate states, enabling refinement of fixed image collections and integration of new observations. Representations of solved views can also be cached once and reused as geometric context across iterations, enabling compact and efficient key-value caching. We analyze the solver dynamics and compare it with the state-of-the-art, demonstrating that a single learned solver supports offline reconstruction, incremental reconstruction, relocalization, and streaming without task-specific training or modules. The code and models will be made publicly available at this https URL.
68. 【2611.02854】ask Adaptation Through Guidance in Frozen Feature Upsampling
链接：https://arxiv.org/abs/2611.02854
作者：Pingan Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Visual Object Classes, PASCAL Visual Object, spatial aggregation, frozen, spatial
备注：
点击查看摘要
Abstract:Adapting features before upsampling can improve dense prediction, but the gains may arise from changes in feature values, spatial aggregation, or both. We investigate this ambiguity by comparing matched residual adapters before and after a frozen JAFAR upsampler under a shared parent. We construct a readout-null intervention that preserves a frozen linear classifier's coarse logits while allowing spatial attention weights to adapt. Guidance/value exchanges on trained models and retrained fixed-guidance controls test the utility of this adaptation route. In three-seed experiments on PASCAL Visual Object Classes (VOC) and Cityscapes, adaptation before upsampling improves mean intersection over union (mIoU) by 0.807 and 1.413 percentage points, respectively, over adaptation after upsampling. Across both datasets and the JAFAR and AnyUp upsamplers, readout-null adaptation produces mean gains of 1.379-1.987 points over the corresponding frozen linear baselines. Retrained controls further support the benefit of adaptive spatial guidance. These findings explain how dense predictions can improve despite unchanged coarse classifier outputs and identify spatial guidance as a useful target when adapting frozen feature upsampling systems.
69. 【2611.02853】Scaling Action-Free Video Latent Prediction for Transferable Representations in End-to-End Autonomous Driving
链接：https://arxiv.org/abs/2611.02853
作者：Xingtai Gui,Xubin Zhou,Yucheng Zhou,Dongqian Guo,Jiahao Gong,Feiyang Tan,Jianbing Shen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：spatial scene structure, Video latent prediction, require effective visual, action-free video latent, policies require effective
备注： 23 pages, 7 figures
点击查看摘要
Abstract:End-to-end autonomous driving policies require effective visual representations that capture both spatial scene structure and temporal dynamics. Video latent prediction has emerged as an effective paradigm for learning spatiotemporal visual representations, yet it remains unclear whether scaling this objective with action-free driving videos can yield representations that benefit end-to-end planning. We study action-free video latent prediction as a scalable pretraining objective and introduce ScaleDrive, a driving-oriented framework pretrained exclusively on large-scale internet open-world driving videos, without action annotations or benchmark-specific data. We keep the pretrained video encoder frozen during downstream end-to-end planning training to isolate the transferability of representations learned from internet driving videos. Ego-motion and depth probes show that scaling action-free video pretraining progressively strengthens the temporal and geometric information encoded in the frozen representation. We systematically study the visual representation transfer across different end-to-end driving policies and closed-loop benchmarks, where ScaleDrive consistently improves downstream performance and demonstrates that scaling action-free video latent prediction yields representations that generalize across both planning policy architectures and evaluation scenarios and protocols.
70. 【2611.02844】Aerial Content-Aware Sample-Adaptive Classifier for Urban Photogrammetric Point Cloud Segmentation
链接：https://arxiv.org/abs/2611.02844
作者：Chong Liu,Yonghua Lu,Zhanglin Cheng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：geometrically similar categories, Urban photogrammetric point, distinguishing geometrically similar, Urban photogrammetric, photogrammetric point clouds
备注：
点击查看摘要
Abstract:Urban photogrammetric point clouds are commonly processed as local 3D patches, limiting the context available for distinguishing geometrically similar categories. Orthographic projection of the same data yields a co-registered digital orthophoto map (DOM)/RGB-D representation that supports efficient large-context modeling but compresses vertical geometry. Existing projection--point methods mainly fuse these two representations at the feature level while retaining a classifier shared across all samples. We present the Aerial Content-Aware Sample-Adaptive Classifier (ACASAC), which complements feature fusion with decision-level adaptation. A point-aligned aerial region bridges the full aerial crop and local 3D patch. ACASAC models scene-to-local variation within the projection and the representation discrepancy between aligned 2D and 3D supports, then transfers both relations to refine the local point class representation. The refined representation, scene-level aerial context, and fixed fused-head prior jointly form a classifier for the current sample. ACASAC improves the fixed dual-representation head by 2.1 and 2.7 mIoU points on SensatUrban and UrbanBIS, respectively, and by 2.1--2.3 points across four tested encoder combinations.
71. 【2611.02822】Disen-Forcing: Disentangling Semantic Anchoring from Motion for Autoregressive Video Diffusion
链接：https://arxiv.org/abs/2611.02822
作者：Zhengyang Yu,Akio Hayakawa,Masato Ishii,Qingtao Yu,Xuesong Li,Takashi Shibuya,Yuki Mitsufuji,Jing Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Autoregressive video diffusion, compounding exposure bias, inference horizon outruns, enable real-time, Autoregressive video
备注： NeurIPS 2026. Project page: [this https URL](https://disen-forcing.github.io/)
点击查看摘要
Abstract:Autoregressive video diffusion models (AR-VDMs) enable real-time, long-horizon video generation but degrade rapidly once the inference horizon outruns the training horizon, due to compounding exposure bias. To stabilize long rollouts, recent methods heuristically adopt frame sink, keeping initial frames as a persistent model context, inspired by attention sinks in LLMs. We revisit this design and find that the mechanism by which initial frames stabilize long-range consistency in AR-VDMs is not an LLM-style attention sink; instead, long-range consistency is anchored through a sparse subset of attention heads, while the majority of heads predominantly capture local temporal dynamics. This observation reveals an over-conditioning pathology in existing frame-sink strategies: by universally exposing every head to the pinned initial-frame context, the model becomes prone to collapsing motion toward the low-dynamic modes of the teacher during model distillation. We propose Disen-Forcing, a distillation-time plug-in for AR-VDMs that disentangles and reinforces this head specialization through disentangled context routing and motion-disentangling regularization. On long-horizon video generation benchmarks, Disen-Forcing simultaneously improves long-range consistency and motion dynamics of base AR-VDMs, a trade-off that sink-based methods fail to balance.
72. 【2611.02803】OmniOPD: Stable On-Policy Distillation for Joint Audio-Video Generation
链接：https://arxiv.org/abs/2611.02803
作者：Zihao Fan,Xin Lu,Jie Huang,Hexin Zhang,Xueyang Fu,Zheng-Jun Zha
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Sound (cs.SD)
关键词：Reinforcement learning, optimizing heterogeneous, audio, introduces cross-modal interference, elevates joint audio-video
备注： 17 pages, 7 figures
点击查看摘要
Abstract:Reinforcement learning (RL) elevates joint audio-video generation, but optimizing heterogeneous, modality-specific audio and video rewards often introduces cross-modal interference. On-policy distillation (OPD) alleviates this issue by transferring the capabilities of specialized audio and video RL teachers into a single student model. However, a significant imbalance in cross-modal token counts leaves audio with sparse supervision, causing unstable distillation. We observe that naively increasing the audio loss weight fails to solve this problem since audio learning relies heavily on visual context, indicating richer visual cues are crucial to offset sparse audio signals. To address this, we propose OmniOPD, a modality-wise on-policy distillation framework designed for balanced and stable audio-video generation. First, we construct privileged visual information using asymmetric noise scheduling, allowing the audio teacher to generate more informative targets from cleaner video context. Second, we introduce grouped multi-noise sampling to expand audio supervision coverage and stabilize training. Third, we introduce timestep-wise importance weighting based on teacher-student transition divergence, preserving reliable supervision while down-weighting unreliable learning signals, to stabilize fluctuations in audio learning. Evaluated on JavisBench and VBench demonstrate OmniOPD preserves audio quality while significantly enhancing video generation, achieving effective joint distillation.
73. 【2611.02786】Local-Global Joint Modeling for Point Cloud Super-Resolution Guided by Multi-Scale Spatial Priors
链接：https://arxiv.org/abs/2611.02786
作者：Wang Yang,Wenyi Ge
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：projecting low-resolution LiDAR, low-resolution LiDAR scans, reconstruct sparse outdoor, projecting low-resolution, low-resolution LiDAR
备注：
点击查看摘要
Abstract:Range-image-based point cloud super-resolution provides an effective way to reconstruct sparse outdoor point clouds by projecting low-resolution LiDAR scans into a regular 2D representation. However, current methods still face three challenges. First, range images exhibit pronounced vertical nonuniformity, with sparse observations in distant regions and denser observations in nearby regions. Some cross-scale fusion mechanisms do not account for the varying reliability of features at different vertical positions, allowing invalid values and noise from distant sparse regions to propagate into the decoder. Second, a single convolutional or sequence-modeling architecture often struggles to preserve both local high-frequency geometric details and global long-range dependencies, resulting in over-smoothed reconstructions. Third, smooth transition depths near foreground-background boundaries can produce spike artifacts when the 2D range image is back-projected into 3D. To address these issues, we propose a point cloud super-resolution method based on multi-scale spatial priors and joint local-global modeling. The design comprises a spatially gated fusion module, a multi-granularity local-global cooperative perception module, and 2D median-residual denoising. Experiments on KITTI-360 and nuScenes demonstrate effective reconstruction, with IoU scores of 0.4703 and 0.3593, respectively, supporting the feasibility of the proposed method for range-image super-resolution.
74. 【2611.02782】History Forcing: Distilling History-Dependent Continuations for Long-Horizon Video World Models
链接：https://arxiv.org/abs/2611.02782
作者：Hangyi Kuang,Chengzhi Wang,Yefei He,Weijie Wang,Yuke Zhao,Zhuokun Chen,Zisu Huang,Yifan Yang,Xiaoxuan He,Feng Chen,Bohan Zhuang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：diffusion enables efficient, rollouts remains challenging, long rollouts remains, video diffusion enables, Few-step autoregressive video
备注： Project Page: [this https URL](https://ziplab.co/History-Forcing-Project-Page/)
点击查看摘要
Abstract:Few-step autoregressive video diffusion enables efficient generation, yet maintaining consistency over long rollouts remains challenging, especially when subjects or scenes reappear after going out of sight. Despite progress in fidelity and rollout robustness, existing distillation methods do not fully exploit richer historical information to constrain the student's current prediction. To address this gap, we introduce \textbf{History Forcing}, a unified on-policy distillation framework that strengthens historical supervision for few-step autoregressive video generators. The framework uses the residual between teacher predictions with and without informative historical context to decouple this supervision. Such a historical context can be obtained using earlier generated chunks with less accumulated drift or a fixed-view teacher rollout that keeps the scene visible while the student looks away. The residual is then weighted and added to the score or velocity prediction used for distillation, forming a corrected target. By aligning the student with this corrected target through distillation, History Forcing incorporates long-range historical constraints into autoregressive generation. Our method achieves state-of-the-art performance among 1.3B models, with a VBench quality score of 85.07 for 15s video generation and a VBench-Long aggregate score of 79.82 for 60s generation. For out-of-sight world modeling, evaluations further demonstrate more plausible scene evolution and more consistent states when the camera returns, with Evolution Quality improving from 2.35 to 2.70 on PlayWorld and Object Consistency from 58.43 to 62.18 on MemoBench.
75. 【2611.02780】Lookahead Prediction-Guided Adaptive Visual Refocusing for Interleaved Multimodal Reasoning
链接：https://arxiv.org/abs/2611.02780
作者：Mengzhao Wang,Yanli Ji,Peng Ye
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：dynamically incorporating visual, evidence, incorporating visual evidence, large language models, Interleaved multimodal
备注：
点击查看摘要
Abstract:Interleaved multimodal chain-of-thought reasoning improves the visual reasoning capabilities of multimodal large language models by dynamically incorporating visual evidence during reasoning. However, existing methods primarily select evidence from historical context. When the reasoning focus shifts, history-guided evidence may remain focused on prior regions and fail to cover the visual information required by the next step. We refer to this lag between visual evidence and subsequent reasoning demands as Temporal Evidence Myopia. To address this issue, we propose Lookahead Prediction-guided Adaptive Visual Refocusing (LPAVR), a training-free test-time framework. LPAVR transforms Multi-Token Prediction (MTP) from a decoding acceleration mechanism into a lookahead signal for anticipating upcoming reasoning intent. During MTP decoding, the draft head generates multiple future tokens, while the target model verifies them in parallel and retains the longest prefix consistent with its decoding trajectory. This target-verified prefix contains near-future semantics, which LPAVR uses to construct lookahead-guided visual evidence and assess whether history-guided evidence covers the indicated regions. If the coverage is sufficient, the history-guided evidence is retained; otherwise, LPAVR switches to the lookahead-guided evidence. This better aligns the visual context with upcoming reasoning and improves consistency between draft predictions and target-model decoding. Experiments on multiple multimodal reasoning benchmarks show that LPAVR improves both reasoning accuracy and the acceptance rates of MTP speculative tokens, jointly enhancing visual reasoning and speculative decoding efficiency.
76. 【2611.02776】LipLingo: CNN Model for Lip Reading
链接：https://arxiv.org/abs/2611.02776
作者：Mahmoud S. Mayaleh,Liban Ali Achkir,Nijat Mehdiyev,Ahmet Ozdil
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Lip reading plays, Lip reading, assistive technologies, biometric authentication, reading plays
备注：
点击查看摘要
Abstract:Lip reading plays a crucial role in applications such as speech recognition, assistive technologies for the hearing-impaired, and biometric authentication. However, performance often degrades when the speaker varies and when certain speech sounds are visually similar. To address these challenges, we propose LipLingo, a robust lip-reading system based on the LipNet architecture, enhanced with a standardized preprocessing pipeline for consistent mouth-region representation, a rotational validation strategy for improved generalization to unseen speakers, and a flexible similarity evaluation for more reliable sentence-level assessment. The model architecture combines 3D convolutional layers for spatio-temporal feature extraction and bidirectional recurrent layers for sequence modeling, optimized using the Adam optimizer and Connectionist Temporal Classification (CTC) loss. On the GRID dataset, LipLingo achieved 95.0\% character-level accuracy (CER 4.99\%) and 87.2\% sentence-level accuracy. At the corpus level, the system obtained a (WER 13.1\%), outperforming the baseline LipNet and demonstrating competitive performance relative to recent 3D-ResNet + Bi-GRU + MixUp approaches. These results provide insights into strategies that enhance lip-reading robustness and highlight directions for future work toward real-world deployment.
77. 【2611.02775】Risk-Constrained Evaluation of Financial Document Recognition: A Formal Framework for Evidence, Critical Errors, and Selective Automation
链接：https://arxiv.org/abs/2611.02775
作者：Subodh Lonkar
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Financial document recognition, word error rates, document recognition, Financial document, commonly evaluated
备注：
点击查看摘要
Abstract:Financial document recognition is commonly evaluated using character and word error rates, which do not adequately represent the consequences of errors in financial workflows. This paper formalizes financial document recognition as a risk-constrained evidence-recovery problem. It defines typed, evidence-linked financial facts and a multi-layer quality model spanning text, layout, tables, fields, semantic relations, calibration, robustness, and operational performance. It introduces non-compensatory acceptance gates based on upper confidence bounds for critical-field errors, and formulates selective automation as a constrained risk-coverage problem with review-capacity limits. The paper also specifies annotation requirements, leakage-resistant benchmark splits, statistical estimands, and a reproducibility card. Formal propositions establish why aggregate scores cannot certify critical-field reliability and why zero observed errors do not imply zero risk. A synthetic example illustrates the decision rule. The work is theoretical; no empirical benchmark or model performance claim is presented.
78. 【2611.02769】Unlocking the Potential of Vision Foundation Models for Multi-Task Dense Prediction via Mixture of Task Adapters
链接：https://arxiv.org/abs/2611.02769
作者：Yunzhi Zhuge,Xinzhuo Yu,Sitong Gong,Lu Zhang,Pingping Zhang,Huchuan Lu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：supports simultaneously discriminative, simultaneously discriminative semantic, discriminative semantic recognition, dense prediction seeks, Multi-task dense prediction
备注： Accepted to IEEE TPAMI
点击查看摘要
Abstract:Multi-task dense prediction seeks a single, coherent representation that supports simultaneously discriminative semantic recognition and regularized geometric/structural inference. For vision foundation models, pretrained semantic invariances conflict with the frequency and smoothness biases of dense objectives; joint fine-tuning and single-route adapters therefore compress competing gradients into one update channel, causing negative transfer and unstable cross-task agreement. We frame this as two-level adaptation: task-generic alignment that preserves priors, and task-aware specialization that resolves late-stage conflicts. Based on this principle, we propose D2MoE , a Mixture of Task Adapters that explicitly factorizes these roles within a frozen DINOv3 backbone. D2MoE introduces Task-Generic Low-Rank Adaptation (TG-LoRA) in attention projections throughout the network to provide a stable, shared adaptation channel, and a Task-Adaptive Mixture of Experts (TA-MoE) injected only at the final attention block of each stage to enact sparse, task-conditioned perturbations of token mixing in a single forward pass. A Semantic Prior Injector further couples multi-level task features with frozen foundation priors to reinforce semantic coherence while preserving boundary and structural fidelity. Experiments across diverse benchmarks substantiate that this structured factorization yields robust multi-task improvements with a small trainable footprint, establishing a principled and scalable route to prior-preserving, foundation-centric multi-task dense perception.
79. 【2611.02767】GaussFlaw: Fine-Grained Perceptual Diagnosis for 3D Gaussian Splatting
链接：https://arxiv.org/abs/2611.02767
作者：Shaocheng Shen,Zihan Zheng,Kejin Li,Lu Liu,Xiaoyun Zhang,Qiang Hu,Wenjun Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：rendering artifacts remains, artifacts remains challenging, Gaussian Splatting, real-time rendering, enables photorealistic
备注：
点击查看摘要
Abstract:3D Gaussian Splatting (3DGS) enables photorealistic novel- view synthesis with real-time rendering, yet fine-grained di- agnosis of its rendering artifacts remains challenging. These artifacts are typically spatially localized and exhibit diverse degradation patterns, making them difficult to character- ize using global quality metrics and image-level assessment benchmarks, which provide no explicit indication of where they occur or what types of artifacts they represent. To ad- dress this limitation, we introduce GaussFlaw-80K, the first large-scale dataset for fine-grained perceptual diagnosis in 3DGS. Constructed through a model-assisted human-in-the- loop pipeline, GaussFlaw-80K contains 80,049 artifact re- gions across 14,289 rendered images, each annotated with a pixel-level mask and one of eight flaw labels spanning ge- ometric, blending, and photometric degradations. These an- notations turn 3DGS artifact diagnosis into an explicit and measurable task. Building on this dataset, we propose Ge- oCritic, a geometry-guided multi-task model that integrates RGB appearance with depth-derived cues to jointly localize artifacts and classify their flaw types. Beyond evaluation, we further demonstrate the downstream benefits of fine-grained diagnosis through three complementary targeted operations: Gaussian densification, attribute correction, and outlier prun- ing. Experiments show that GeoCritic achieves an AUC-J of 0.9507 and an Acc@1 of 80.08%, while diagnosis-guided re- finement improves all reported global and crop-level metrics across diverse datasets and 3DGS backbones.
80. 【2611.02759】race4D: Grounded Spatiotemporal Reasoning via 4D State Sequences
链接：https://arxiv.org/abs/2611.02759
作者：Wooseok Jang,Seungryong Kim,Yan Lu,Lei Ji
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：spatial relationships evolve, time remains challenging, Understanding how objects, space over time, changing viewpoints
备注： Project page: [this https URL](https://cvlab-kaist.github.io/Trace4D)
点击查看摘要
Abstract:Understanding how objects and their spatial relationships evolve in 3D space over time remains challenging for vision-language models (VLMs), particularly under changing viewpoints. Recent approaches incorporate geometric information into reasoning, but explicit supervision for temporally ordered 4D state evolution and its use as intermediate evidence remains limited. We introduce \textbf{Trace4D}, which trains VLMs to predict 4D state sequences and reason over their inter-timestep changes alongside temporal visual observations. Its 4D-grounded chain-of-thought (CoT) explicitly represents 4D states, analyzes temporal visual context, and connects both as evidence for the answer. We construct Trace4D-Train from in-the-wild videos with 600K 4D perception examples and approximately 70K grounded QA examples, and train with joint supervised fine-tuning followed by geometry-aware GRPO. At inference, Trace4D predicts 4D states and reasoning directly from video without reference annotations or an external geometric model. Experiments on Trace4D-Bench and VLM4D show improved QA accuracy over the base VLMs and benefits from reasoning over 4D state changes and temporal visual observations.
81. 【2611.02756】DINOFAS: Bonafide-Centric Representation Learning for Face Anti-Spoofing
链接：https://arxiv.org/abs/2611.02756
作者：Shakeel Muhammad Ibrahim,Muhammad Sohail Ibrahim,Muhammad Shahid Jabbar,Shujaat Khan
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Image and Video Processing (eess.IV)
关键词：Face anti-spoofing, dataset-specific cues, cues that degrade, degrade performance, learn attack
备注： 11 pages, 5 figures
点击查看摘要
Abstract:Face anti-spoofing (FAS) models often learn attack- and dataset-specific cues that degrade performance under unseen acquisition conditions and presentation attacks. We present DINOFAS, a DINOv3-based framework that formulates FAS as bonafide-centric representation learning. The proposed framework combines parameter-efficient DINOv3 adaptation using low-rank adaptation (LoRA), an attention style-content disentanglement (ASCD) module for reducing domain-specific appearance variations, and a dual-branch architecture that separates prototype-based liveness learning from attack-semantic supervision. The model is jointly optimized using a bonafide-centric prototype objective, an attack-semantic classification loss applied to detached features, and orthogonality regularization. DINOFAS achieves an average HTER of 9.09\% under the standard OCIM leave-one-domain-out protocol, where training is performed on three source datasets and evaluation is conducted on the held-out unseen domain. We further evaluate synthetic-to-real generalization by training exclusively on SynthASpoof and testing on four unseen real-world datasets, where DINOFAS achieves the lowest average HTER of 21.41\% and the highest average AUC of 86.14\% among the compared methods. Evaluations on OULU-NPU and SiW-Mv2 additionally demonstrate robustness to variations in acquisition conditions, devices, and unseen presentation attacks.
82. 【2611.02751】Pair-Relative Partial Equivariance for Rotation-Robust Keypoint Descriptor Matching
链接：https://arxiv.org/abs/2611.02751
作者：Jongmin Lee
类目：Computer Vision and Pattern Recognition (cs.CV); Computational Geometry (cs.CG)
关键词：Learned keypoint descriptors, Learned keypoint, keypoint descriptors trained, imagery often fail, large in-plane rotation
备注： Accepted to WACV 2027 (Round 1). 16 pages, 9 figures
点击查看摘要
Abstract:Learned keypoint descriptors trained on upright imagery often fail under large in-plane rotation. Steerers address this by applying a single exact SO(2) representation to the descriptor space, but this global group constraint can be too rigid for keypoint descriptors, whose angular responses need not follow a single group representation. We propose pair-relative partial equivariance, which measures equivariance under the empirical distribution of relative rotations in image pairs, and PaSteer, a relaxed descriptor-steering framework that allows the steering map to leave the exact representation manifold while retaining the lightweight, backbone-free design of steering. PaSteer instantiates this relaxation with two variants: an identity-preserving residual steerer (PaSteer-soft) and a free-form Fourier steerer (PaSteer-free). We show that the per-angle optimal linear steerer for a fixed non-equivariant descriptor generally does not obey the group composition law, explaining why exact representations can be suboptimal in the frozen-descriptor regime. On Roto-360, MegaDepth-1500, AIMS, and IMC-PT, PaSteer consistently improves rotation-robust matching over an exact steerer on frozen DeDoDe descriptors, especially under large relative rotations, with minimal upright degradation.
83. 【2611.02744】Subspace Representations for Synthetic-to-Real Transfer in 3-D Surface Inspection
链接：https://arxiv.org/abs/2611.02744
作者：Abdulla Nasir Chowdhury,Naish Ibrahim,Gulpi Qorik Oktagalu Pratamasunu,Kazuhiro Fukui
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：subspace representations contribute, paper studies, representations contribute, models learn, learn from synthetic
备注： 16 pages, 2 figures, 2 tables. Accepted to the ACCV 2026 Workshop on Subspaces in the Era of Foundation Models. Website: [this https URL](https://abdullah-nasir-chowdhury.github.io/projects/accv2026/)
点击查看摘要
Abstract:This paper studies what subspace representations contribute to synthetic-to-real transfer in 3-D surface inspection, where models learn from synthetic defects and the only real data before deployment are scans of good parts. We use three classical constructions as instruments: the nearest-subspace classifier, one-class template subspaces and the generalized difference subspace (GDS). On 1,197 MVTec 3D-AD scans without target annotation we find that every decision rule ranks real defects at a similar window AUC, that image-level detection stays at chance, and that no rule keeps its in-domain threshold. We show that the margin of a nearest-subspace rule moves by at most the part of the feature shift outside its class subspaces, and that this leakage, measured from unlabeled good scans, bounds the displacement observed on unseen scans. On 597 Real3D-AD objects, a one-class subspace of registered templates evaluated at every location on frozen features reaches point AUROC 0.957 on pre-registered scans and a category-mean object AUROC of 78 to 81 with no training on the benchmark. Our results suggest that a subspace helps under shift in proportion to the shift it spans, and that in reference-based inspection the reference and its registration matter more than the subspace.
84. 【2611.02737】MoviEdit: Long-form Multi-Shot Video Editing Made Easy
链接：https://arxiv.org/abs/2611.02737
作者：Suhyeon Lee,Zhengang Li,Soo Ye Kim,Peihao Zhu,Jong Chul Ye,Chun-Hao Paul Huang,Duygu Ceylan,Yan Kang,Hyeonho Jeong
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：conventional single-shot editors, Long-form multi-shot video, longer visual context, multi-shot video editing, Long-form multi-shot
备注： 26 pages, 15 figures
点击查看摘要
Abstract:Long-form multi-shot video editing requires an intended edit to remain coherent across abrupt changes in scene, viewpoint, and subject appearance, while processing substantially longer visual context than conventional single-shot editors. We introduce MoviEdit, an end-to-end framework for scalable long-form multi-shot video editing that jointly addresses the challenges of data, modeling, and evaluation. To provide cross-shot supervision data at scale, we develop automatic data-generation pipelines spanning synchronized multi-view footage, real-world multi-shot videos, and generated multi-shot content, yielding 87K paired editing videos without manual annotation. Architecturally, MoviEdit employs a cascaded bidirectional-autoregressive design: a lightweight bidirectional stage first establishes a globally coherent editing draft over a spatiotemporally compressed representation, which is then autoregressively propagated and refined over the full video. We further introduce MoviEdit-Bench, a dedicated benchmark for systematic evaluation of long-form multi-shot video editing. Extensive experiments show that MoviEdit substantially outperforms existing open-source models and performs on par with industry frontier models across text-guided and image-guided editing. Visit our project page for complete results and to access the benchmark: this https URL
85. 【2611.02726】Attention Residual U-Net for Enhanced Cross-Dataset Polyp Localization in Endoscopy
链接：https://arxiv.org/abs/2611.02726
作者：Romil Imtiaz,Dimitris K. Iakovidis
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：automated lesion detection, Precise localization, pathologies in endoscopy, critical task, task in medical
备注：
点击查看摘要
Abstract:Precise localization of pathologies in endoscopy is a critical task in medical imaging, with deep learning (DL) frameworks now serving as the primary methodology for automated lesion detection. Today, generic object detection methods, such as YOLO, provide state-of-the-art performance in this context. However, their robustness often decreases under real-world clinical conditions due to variations across endoscopic devices, intestinal content, dataset bias, and the presence of small or low-contrast lesions. Motivated by these challenges, we propose a novel polyp detection framework based on a Attention Residual U-Net offering enhanced polyp localization. Instead of directly regressing bounding boxes from global feature representations, the proposed method learns lesion-focused spatial representations and converts them into bounding-box predictions during inference. Unlike conventional encoder-decoder localization frameworks that directly propagate all encoder activations into the decoding pathway, the proposed method selectively suppresses irrelevant background responses before feature reconstruction. This encourages the network to focus on lesion-relevant spatial evidence under heterogeneous imaging conditions. To achieve this, the framework integrates residual feature propagation, attention-guided encoder filtering, and multi-scale contextual learning. The proposed framework was evaluated on multiple public endoscopic datasets acquired using different devices. The comparative experimental results validate its effectiveness over the relevant state-of-the-art methods, with an improvement up to 22.0% in terms of the area under the receiving operating characteristic (AUC).
86. 【2611.02695】3L-D: A Low-Light Level Dataset from a Sensor-Agnostic, Alignment-Preserving Acquisition Framework
链接：https://arxiv.org/abs/2611.02695
作者：Léo Rueff,Maurgène Ghezal,Valentin Gorse,Astrid Dufaure,Esteban Monsalvo,François Atteia,Ludovic Escoubas
类目：Computer Vision and Pattern Recognition (cs.CV); Databases (cs.DB)
关键词：achieved remarkable progress, Supervised low-light image, remain fundamentally constrained, Supervised low-light, remarkable progress
备注：
点击查看摘要
Abstract:Supervised low-light image and video enhancement has achieved remarkable progress, yet current models remain fundamentally constrained by the limitations of existing datasets. Prevailing methods typically rely on uncontrolled ambient captures, camera parameter manipulation (e.g., exposure or ISO adjustments), or neutral density filters, failing to replicate authentic night-sky near-infrared spectral content and genuine low-photon noise distributions. Furthermore, capturing dynamic paired sequences without introducing warping artifacts or sensor-specific biases remains an open challenge. In this paper, we introduce 3L-Dataset, a physically calibrated low-light image and video dataset generated using a modular, sensor-agnostic acquisition framework. Our test bench faithfully reproduces the standardized Midavaine night level scale from Level 1 (full moon, approximately 1000 mlx) down to Level 5 (overcast moonless night, approximately 0.1 mlx), spanning the visible to near-infrared spectrum across diverse realistic environments, including countryside, forest, urban, and desert scale models. Using high-precision programmable mechanical actuation, our acquisition framework guarantees sub-pixel spatial alignment across synchronized sextuplets, each composed of one reference image and five corresponding images acquired at the five standardized night levels, without post-processing image warping. We evaluate multiple representative deep learning baselines across varying night levels, revealing critical trade-offs between reconstruction fidelity, perceptual quality, and inference latency under severe photon starvation. The modular acquisition framework can be adapted to different cameras, optical systems, sensor technologies, and resolutions, enabling the dataset to be continuously expanded.
87. 【2611.02690】Human-Oriented World Model
链接：https://arxiv.org/abs/2611.02690
作者：Saihui Hou,Zengyun Mou,Chunshui Cao,Yongzhen Huang
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：repeated interactions requires, interactions requires interpreting, requires interpreting, Human-Oriented World Model, HOWM connects current
备注： 19 pages
点击查看摘要
Abstract:Supporting a person over repeated interactions requires interpreting their current state in context and anticipating its subsequent evolution. We formulate the \emph{Human-Oriented World Model} (HOWM) as a conceptual framework centered on task-relevant human states and their evolution. HOWM connects current observations and individual history with environmental and social context to organize continuing state estimation, personalized dynamics prediction, and action support. Dynamic expectations and new observations jointly inform the current estimate, which in turn anchors personalized forecasts based on shared knowledge and individual experience. An external policy relates forecasts under alternative conditions to the person's goals, preferences, and constraints when considering support. Actual responses and outcomes provide evidence for revising the state estimate and personal dynamic patterns, thereby informing subsequent estimation, prediction, and support. We illustrate the framework through hypothetical training and learning scenarios. Our research agenda asks whether accumulated interaction experience improves subsequent estimation and prediction, and whether using the model helps the person pursue their goals over time.
88. 【2611.02686】Discovering Semantic Granularity in Images through Clustering of Pretrained Visual Representations
链接：https://arxiv.org/abs/2611.02686
作者：Ying Dai
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：pretrained visual representations, organize image content, pretrained visual, visual representations, visual representations organize
备注：
点击查看摘要
Abstract:Semantic granularity, which refers to the levels at which visual representations organize image content into meaningful entities, is fundamental to image understanding. However, whether pretrained visual representations inherently encode semantic structures at multiple granularities remains poorly understood. This paper presents a representation-driven approach for discovering semantically meaningful image regions at different granularities through clustering of pretrained visual representations without semantic supervision. Specifically, we concatenate selected feature maps extracted from a pretrained visual model and apply a singular value decomposition (SVD)-based projection to derive pixel-wise principal representation maps (PRMs). The resulting PRMs capture implicit semantic structures embedded in pretrained visual representations, making them accessible to subsequent semantic clustering. We then introduce the semantic continuity rate (SCR), based on the silhouette principle, to quantify the coherence of pixel-wise representations within and between clusters at different candidate granularities. Furthermore, we analyze the signal-to-noise ratio (SNR) of SCR profiles to assess representation suitability for discovering semantic regions at multiple granularities. Our results indicate that PRMs exhibiting higher SNR values over an initial range of cluster numbers tend to yield more semantically meaningful regions across multiple granularities. We evaluate the proposed approach on the COCO-2017 and VOC-2012 validation datasets using Hungarian-matched intersection over union (HIoU). The results demonstrate competitive segmentation performance among the compared methods, supporting the feasibility of discovering useful semantic granularities through clustering PRMs without semantic supervision.
89. 【2611.02685】Geometry-Constrained Dynamic Hypergraph Convolutional Network with Contrastive Score Refinement for Skeleton-Based Action Recognition
链接：https://arxiv.org/abs/2611.02685
作者：Minh Ta Tran Nhat,Yuning Ye,Yuseok Ban
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：conventional Graph Convolutional, Graph Convolutional Networks, intricate high-order interactions, high-order interactions inherent, Dynamic Hypergraph Construction
备注： 19 pages, 4 figures, BMVC 2026
点击查看摘要
Abstract:Skeleton-based action recognition is a pivotal task in computer vision; however, conventional Graph Convolutional Networks (GCNs) are often constrained by pairwise joint modeling, which fails to capture the intricate high-order interactions inherent in human movement. While recent hypergraph-based methods attempt to address this limitation, they typically rely on static structures derived from anatomical priors, lacking the flexibility to capture dynamic, action-specific joint correlations. To this end, we propose DyGCN, a Geometry-Constrained Dynamic Hypergraph Convolutional Network for skeleton-based action recognition. At the core of DyGCN is the Dynamic Hypergraph Construction Network with Contrastive Score Refinement (DyGCT) block, which comprises two novel components: the Geometry-Constrained Dynamic Hypergraph Construction (GeoHC) module and the Contrastive Score Refinement (CSR) module. Specifically, GeoHC dynamically constructs action-specific hyperedges by leveraging geometry-constrained second-order compatibility, transcending the limitations of static hyperedge structures. Furthermore, CSR explicitly refines the pairwise compatibility scores during hypergraph construction through prototype-based contrastive learning, fostering more discriminative action-specific hyperedges, with zero inference-time overhead as CSR operates only during training. Extensive experiments on NTU RGB+D, NTU RGB+D 120, and Northwestern-UCLA validate the effectiveness of DyGCN, achieving state-of-the-art performance on widely used benchmarks. The source code is available at this https URL.
90. 【2611.02671】ME-ContextNet: Class-Conditioned Spatial Supervision and Grouped Decoding for Joint Nuclei Instance Segmentation and Classification
链接：https://arxiv.org/abs/2611.02671
作者：Rukang Ma,Bingxue Wang,Liwen Zou,Yingying Cao,Zhenghua Cai,Yu Li,Dong Wang,Huiyu Zhou,Luying Gui
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：similar cell types, classification requires precise, requires precise boundaries, distinguish morphologically similar, morphologically similar cell
备注：
点击查看摘要
Abstract:Joint nuclei instance segmentation and classification requires precise boundaries and neighborhood information that helps distinguish morphologically similar cell types. We present TME-ContextNet, a multi-task framework that learns class-conditioned spatial context from existing nuclear annotations and organizes decoding into geometry-related and semantic task groups. Class-conditioned spatial supervision extends nuclear labels into a dense target using Euclidean distance transforms, requiring no additional tissue-region annotation. We derive its nearest-region interpretation and characterize its stability to small annotation perturbations. A local--global context module combines dilated convolution and self-attention, while a grouped task decoder reduces redundant computation. The spatial head supplies training supervision and is omitted during inference. Experiments on PanMix, CoNSeP, and PanNuke yield Dice scores of 80.23%, 65.32%, and 79.13%, and mean multi-class panoptic quality (mPQ+) scores of 58.67%, 35.50%, and 43.74%, respectively. PanNuke results are averaged across three test folds. Target and decoder controls support the combination of distance-based supervision and grouped decoding while identifying their dependence on task configuration. The framework uses 36.40 million parameters, compared with 54.74 million for HoVer-Net. These findings support a compact, context-aware formulation for joint nuclei analysis in computational pathology.
91. 【2611.02661】PriCBMs: Multi-granular Concept Bottleneck Vision-Language Models for Visual Privacy Recognition
链接：https://arxiv.org/abs/2611.02661
作者：Shenglei Pei,Haotian Sun,Pengfei Li,Bingxu Lu,Wenlong Yu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Widespread image sharing, inadvertently exposed privacy, visual privacy recognition, identify inadvertently exposed, privacy
备注： 33 pages
点击查看摘要
Abstract:Widespread image sharing on social media has increased the need for visual privacy recognition to identify inadvertently exposed privacy information. However, multi-label visual privacy recognition presents two challenges. First, privacy categories represent high-level semantic attributes and do not have a one-to-one correspondence with visual objects. Different visual objects may involve the same privacy category, while the same type of object may contain different types of privacy-sensitive information. In this setting, direct prediction methods generally lack explicit guidance for identifying category-relevant privacy cues, leaving this process implicit in the learned image-to-label mapping and potentially limiting classification performance. Second, privacy cues are often distributed across image regions and may not be adequately represented by whole-image features. To address these challenges, we propose Privacy Concept Bottleneck Models (PriCBMs). By introducing privacy-related concepts as intermediate semantic representations, PriCBMs first identify category-relevant privacy cues through visual-concept matching and then predict privacy categories based on concept responses. This process makes privacy predictions more interpretable. To improve the quality of these concepts, we design a concept selection strategy based on target-category relevance, cross-category discriminability, and semantic diversity. Meanwhile, we introduce a global-region modeling module to capture localized privacy evidence while retaining global context. Experiments on VISPR and FineViP show that PriCBMs outperform evaluated competitors across all four multi-label metrics. Ablation studies and concept-quality analyses support the effectiveness of the proposed design. Code is available at this https URL.
92. 【2611.02659】Parametric CAD Bench v3: Evaluating Agentic Parametric CAD Authoring from Text and Engineering Drawings
链接：https://arxiv.org/abs/2611.02659
作者：Mei Chen,Yu Xia,Haipeng Mao
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Machine Learning (cs.LG)
关键词：executable CAD script, Producing an executable, engineering design request, Parametric CAD Bench, design request
备注： 31 pages, 12 figures, 11 tables. Benchmark: [this https URL](https://cadbench.ai/) ; tasks and leaderboard: [this https URL](https://hub.harborframework.com/datasets/gnucleus-ai/cad-bench/v3) ; scoring code: [this https URL](https://github.com/gNucleus-AI/freecad-validator)
点击查看摘要
Abstract:Producing an executable CAD script is not sufficient to establish that an agent has satisfied an engineering design request. Evaluation must also consider the resulting geometry, specified dimensions, and native CAD modeling history. We present Parametric CAD Bench v3, a 100-task benchmark comprising 30 text-to-CAD creation tasks, 30 text-to-CAD create-and-edit tasks, and 40 tasks that reconstruct mechanical parts from engineering drawings. Agents operate in a pinned FreeCAD environment and submit native CAD artifacts to a separate programmatic verifier. The primary metric is mean continuous task reward, combining geometry similarity and specification consistency rather than binary task success. A September 24, 2026 snapshot covers 13 model-agent systems; Claude Code with Claude Opus 5.5 achieves the highest overall point estimate, 61.03%, and an image-to-CAD mean reward of 84.66%. These measurements describe complete systems, not isolated model capabilities. We release versioned tasks, evaluation configurations, and inspectable result artifacts.
93. 【2611.02658】OctreeSplat: Hierarchical Octree-Guided Feed-Forward Gaussian Splatting
链接：https://arxiv.org/abs/2611.02658
作者：Yibin Zhao,Yihan Pan,Wenli Yang,Jun Nan,Jianjun Yi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：shown considerable potential, feed-forward Gaussian splatting, Gaussian Splatting, shown considerable, considerable potential
备注：
点击查看摘要
Abstract:3D Gaussian Splatting (3DGS) has shown considerable potential for novel view synthesis (NVS) and 3D reconstruction. Feed-forward methods avoid costly per-scene optimization, but fixed image or spatial resolutions limit their ability to allocate primitives according to local complexity. We present OctreeSplat, a hierarchical octree-guided feed-forward Gaussian splatting. OctreeSplat extracts multi-view features and geometric priors from a frozen visual foundation model (VFM), constructs a hierarchical octree, and predicts densification scores. The resulting representation allocates Gaussian primitives at spatially varying densities according to local complexity. Stochastic solids volume rendering improves depth rendering, strengthens geometric supervision, and supports surface reconstruction. When camera parameters are available, an optional test-time optimization (TTO) module improves agreement between predicted and ground-truth parameters. Training updates only 76 million additional parameters and requires 35 GPU-hours. Experiments on Replica, TUM, Tanks and Temples, and DTU demonstrate competitive RGB view synthesis, depth synthesis, and surface reconstruction. OctreeSplat reduces the number of Gaussian primitives while maintaining high reconstruction quality.
94. 【2611.02654】VerdictAD: Few-Shot Anomaly Detection via Decision-Guided Refinement
链接：https://arxiv.org/abs/2611.02654
作者：Shangquan Sun,Wenjun Luo,Yuanzhi Wang,Ruiqi Li,Ruoyu Chen,Jiachen Liu,Shijian Lu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：real-world industrial inspection, Detecting defects, real-world industrial, industrial inspection, inspection often requires
备注： Preprint with 5 tables and 7 figures. Code and experimental logs available at [this https URL](https://github.com/sgstq0811/VerdictAD-Jev-AD)
点击查看摘要
Abstract:Detecting defects in real-world industrial inspection often requires learning from only a few normal images per category. Recent few-shot anomaly detection methods have achieved strong performance by measuring feature differences between query images and normal references. However, visual differences do not always indicate genuine defects, as normal appearance variations can also produce high anomaly scores. Conversely, structural or logical anomalies may not produce strong local feature differences, making them difficult to detect. To address this limitation, we introduce VerdictAD, a training-free framework that refines existing anomaly detectors through visual decisions. Rather than replacing existing detectors, VerdictAD adopts a typed decision model to assess the query image and its local regions against a few normal references. By directly producing structured decision probabilities without text generation, the model provides complementary evidence for refining anomaly responses at different spatial scales. Building on this capability, we introduce two modules: Global Verdict Refinement (GVR) uses image-level decisions to refine the overall anomaly score, while Local Verdict Refinement (LVR) aggregates regional decisions to refine the anomaly map. Combined with a simple DINOv2-based detector, VerdictAD achieves competitive performance in one-shot and few-shot anomaly detection. More importantly, as a plug-and-play framework, it consistently improves existing anomaly detectors across MVTec AD, VisA, and MVTec LOCO AD, achieving strong results across one-shot and few-shot settings. Our code and experimental logs are publicly available at this https URL.
95. 【2611.02651】Probe-Guided Gradient Balancing for Multimodal Learning
链接：https://arxiv.org/abs/2611.02651
作者：Vu Vo,Haytham M. Fayek,Thuy Nguyen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Jointly trained multimodal, networks frequently underutilize, Jointly trained, frequently underutilize weaker, suppress gradients reaching
备注：
点击查看摘要
Abstract:Jointly trained multimodal networks frequently underutilize weaker modalities, as faster-learning modalities dominate the shared fusion objective and suppress gradients reaching slower ones. Most existing approaches throttle dominant modalities, whereas directly boosting weaker modalities often fails because monitoring signals derived from the joint loss remain dominated by stronger modalities. We propose Probe-Guided Gradient Boosting (PGGB), a gradient modulation approach that boosts weaker modalities while preserving the strength of dominant ones. PGGB attaches lightweight linear classifiers to stop-gradient features from each modality to estimate representation quality independently. The gap between these scores, termed the utilization gap, provides an imbalance signal used to adaptively scale weaker-modality gradients through bounded and smoothed modulation. PGGB is composable with throttling methods, as it leaves the loss function and fusion architecture unchanged. Experiments across eight benchmarks spanning four domains and 2-4 modalities demonstrate that PGGB outperforms state-of-the-art methods on highly imbalanced multimodal datasets while remaining competitive under low or negligible imbalance. We further establish bounded scaling, self-attenuation, and a descent bound for standard SGD under smoothness and bounded-variance assumptions. Code is available at this https URL.
96. 【2611.02649】Computer Vision Applications for Art History: Reflections and paradigms for future research
链接：https://arxiv.org/abs/2611.02649
作者：Amalia Foka
类目：Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY); Digital Libraries (cs.DL)
关键词：art history research, art history, today art history, history research questions, contributing factors
备注： 8 pages. Published in the Proceedings of EVA London 2021 (Electronic Visualisation and the Arts), BCS Electronic Workshops in Computing (eWiC), under CC BY 4.0
点击查看摘要
Abstract:One of the contributing factors to the continuing debate among art historians over the use of computational methods in art history research is that they do not consider the core of today's art history research questions. The lack of close collaboration between the two involved research communities makes the definition of contemporary art-historical methods as well-defined computer vision problems extremely difficult. For that purpose, it is devised as a methodology to study articles in art history journals from a computer science perspective. The objective is to identify which image features art historians utilise within their research and describe them in immediate and meaningful terms to the computer vision research community. Finally, some paradigms that could serve as a new starting point for exploring how computer vision applications for art history can address the core of today's art history research are given.
97. 【2611.02648】ReinSeg: Retrieval-Guided Bounded Multimodal Refinement for 3-D Road Anomaly Segmentation
链接：https://arxiv.org/abs/2611.02648
作者：Haifa Zhang,Yijing Wang,Zhiqiang Zuo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：road anomaly segmentation, autonomous driving, road anomaly, normal road structures, point-wise road anomaly
备注：
点击查看摘要
Abstract:3-D road anomaly segmentation is essential for risk-aware perception in autonomous driving. Its central challenge is to rank sparsely observed hazards ahead of abundant normal road structures while preserving point-wise metric localization. LiDAR provides accurate 3-D point support, whereas surround-view imagery offers complementary semantic context for separating unexpected hazards from challenging normal structures. We propose ReinSeg, a retrieval-guided bounded multimodal refinement framework for point-wise road anomaly segmentation. Occupied LiDAR bird's-eye-view cells retrieve scene-specific context from a shared memory of eight surround-view images without supplying calibration variables to the retrieval module. A relative-norm-bounded residual returns this context to the LiDAR point features, so the frozen LIDO anomaly-scoring interface is preserved, and the refinement is optimized with in-distribution semantic labels only. On the Spotting the Unexpected (STU) benchmark, ReinSeg improves validation average precision from 27.54\% to 35.67\% and reduces the false-positive rate at 95\% anomaly recall from 34.85\% to 10.61\%, shrinking the high-recall screening set from 67.54 to 20.55 million points. Relative to REL, AP is 24.99 percentage points higher and FPR95 is 0.99 points lower. Matched interfaces and component isolation show that retrieved scene imagery and the relative-norm bound are both essential, and ReinSeg stays above LiDAR-only performance under missing, corrupted, or misaligned camera inputs while running at 21.8 frames per second. These results establish bounded retrieval of scene-specific visual evidence as an effective route to reliable 3-D road-hazard perception.
98. 【2611.02631】UniCross3D: Unified Cross-View and Cross-Domain Diffusion for Consistent Single-Image 3D Generation
链接：https://arxiv.org/abs/2611.02631
作者：U-Chae Jun,Jaeeun Ko,Jiwoo Kang
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：Reconstructing detailed geometry, single RGB image, Reconstructing detailed, single RGB, fundamentally challenging due
备注：
点击查看摘要
Abstract:Reconstructing detailed geometry and realistic appearance from a single RGB image is essential yet fundamentally challenging due to inherent ambiguities such as occlusion, lighting variations, and texture-geometry entanglement. While recent diffusion-based generative models have significantly improved novel view synthesis, existing approaches suffer from two critical limitations: lack of cross-view geometric consistency and insufficient cross-domain semantic alignment. To address these issues, we introduce UniCross3D, a unified cross-view and cross-domain diffusion framework designed explicitly for consistent and physically coherent 3D generation. UniCross3D features two novel contributions: (1) a cross-view latent regularization that enforces cross-view geometric consistency across synthesized viewpoints by penalizing latent variance, and (2) a cross-domain mutual information objective grounded in the physics of image formation, explicitly aligning synthesized color and normal maps. Extensive experiments demonstrate that UniCross3D achieves significantly improved view consistency and semantic alignment over state-of-the-art methods and yields higher-fidelity reconstructions, particularly under challenging textures and ambiguous viewpoints.
99. 【2611.02625】Latent Diffusion-GAN: Adversarial Learning in the Autoencoded Latent Space
链接：https://arxiv.org/abs/2611.02625
作者：U-Chae Jun,Jaeeun Ko,Jiwoo Kang
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：producing high-quality images, random noise, powerful generative frameworks, denoising latent variables, producing high-quality
备注：
点击查看摘要
Abstract:Diffusion models are powerful generative frameworks for producing high-quality images by denoising latent variables from random noise. However, training with likelihood-based objectives, such as denoising score matching, can lead to locally over-smoothed high-frequency details, including fine textures and sharp edges, thereby limiting perceptual fidelity and structural detail. Adversarial training with GANs enhances sharpness but typically requires additional discriminator networks, increasing computational costs and destabilizing training. To this end, we propose Latent Diffusion Generative Adversarial Networks (LD-GAN), a novel framework that seamlessly integrates adversarial learning into diffusion models without modifying their original pipeline. LD-GAN leverages the pretrained variational autoencoder (VAE) in latent diffusion models as an energy-based discriminator, enabling adversarial training without extra parameters and preserving the structured latent priors learned from large datasets. We also introduce a structural consistency energy that aligns encoder and decoder feature representations, thereby enhancing perceptual quality and compatibility with the pretrained latent space. Extensive experiments demonstrate that LD-GAN significantly improves sample fidelity, perceptual sharpness, and diversity over state-of-the-art baseline methods across various generation tasks while ensuring efficient training dynamics.
100. 【2611.02603】BGD-SF PolySegNet: boundary-guided dynamic selective fusion network for robust polyp segmentation in colonoscopy images
链接：https://arxiv.org/abs/2611.02603
作者：Nishi Kanta Paul,Shamia Maherin,Morsheda Akter,Moinul Hossain,Md Kishor Morol
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：cancer-related death worldwide, Effective polyp segmentation, colorectal cancer, death worldwide, multi-scale context aggregation
备注： 26 pages, 9 figures, 8 tables, Submitted to PLOS ONE
点击查看摘要
Abstract:Effective polyp segmentation in colonoscopy images is crucial for early detection of colorectal cancer, a leading cause of cancer-related death worldwide. While current deep learning models perform well on traditional Dice benchmarks, border segmentation remains difficult. Most methods use boundary information only as an additional loss signal during training, which prevents the network from explicitly learning border-guided feature selection or mask refinement. This paper introduces BGD-SF PolySegNet, a boundary-guided encoder-decoder architecture that controls three phases of the segmentation pipeline: dynamic multi-scale context aggregation, selective skip-feature fusion, and final mask refinement. The architecture comprises a pretrained EfficientNet-B4 backbone and three proposed modules: Boundary-Guided Dynamic Cascaded Multi-Scale Context Aggregation (BGD-CMSCA), Boundary-Guided Selective Attention Fusion (BG-SAGF), and a Multi-Level Boundary Guidance Head (MBGH). The model is trained on 3,535 annotated images from Kvasir-SEG, BKAI-IGH NeoPolyp-Small, and PolypGen, and evaluated on four held-out benchmark datasets. On the internal test set, BGD-SF achieves a Dice of 0.887, IoU of 0.839, mask-derived Boundary F1 of 0.531, HD95 of 30.32, and ASSD of 18.10, improving Boundary F1, HD95, and ASSD by 15.7%, 27.5%, and 34.6% over the strongest CNN baselines. External validation on CVC-ClinicDB, CVC-ColonDB, ETIS-Larib, and CVC-300 yielded Dice scores of 0.891, 0.776, 0.863, and 0.885, respectively. The model runs at 35 FPS with 22.51M parameters. Wilcoxon signed-rank tests confirm statistically significant mask-derived Boundary F1 improvements over six of seven ablation variants (p 0.001; small-to-moderate effect sizes, r = 0.215-0.434), demonstrating that integrating boundary guidance as an active architectural component measurably advances polyp boundary delineation.
101. 【2611.02599】Camera-Free Object Discovery and Interaction with GazeTags
链接：https://arxiv.org/abs/2611.02599
作者：Vimal Mollyn,Chris Harrison
类目：Human-Computer Interaction (cs.HC); Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Multimedia (cs.MM)
关键词：head-gaze object awareness, worn head-gaze object, worn head-gaze, object awareness, head-gaze object
备注： Published at UIST 2026
点击查看摘要
Abstract:We present GazeTags, a camera- and computer-vision-free approach for worn head-gaze object awareness. Our small electronic tags cost roughly \$2 each and can operate for more than a year on a coin cell battery. They work in concert with a user-worn device (smartglasses, hearables, etc.) that periodically emits a focused infrared signal aligned with the user's head direction. Only GazeTags within that narrow head-oriented beam wake and respond, providing their identity and optional payloads such as object state or live sensor readings. By avoiding cameras and computer vision pipelines, our approach is very energy efficient, able to operate continuously even in battery-constrained wearables, and sidesteps non-trivial privacy issues. We describe our hardware design, characterize our system performance and operating tradeoffs, and demonstrate how GazeTags can enable practical gaze-aware environments.
102. 【2611.02593】AVID: A 5T fMRI Dataset for Benchmarking Auditory-induced Visual Mental Imagery Decoding
链接：https://arxiv.org/abs/2611.02593
作者：Shiqi Shen,Shurui Li,Xilin Zhang,Yuanning Li
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Neurons and Cognition (q-bio.NC)
关键词：neuroprosthetic communication interfaces, reconstruct internally generated, externalizing internal experiences, developing neuroprosthetic communication, internally generated visual
备注： This is the camera-ready version accepted at NeurIPS 2026. Abstract shortened to respect the arXiv limit of 1920 characters. Please see the PDF for the full abstract
点击查看摘要
Abstract:Visual mental imagery (VMI) decoding uses brain activity to reconstruct internally generated visual scenes, providing a potential pathway for externalizing internal experiences and developing neuroprosthetic communication interfaces. However, progress is limited by the lack of dedicated, training-scale VMI datasets. Current VMI paradigms often rely on visual prompts or short-term memory images, introducing visual and mnemonic confounds that make it difficult to disentangle neural activity associated with endogenous image construction from signals driven by prior or concurrent visual input. Furthermore, existing VMI datasets offer limited descriptive control over individual visual attributes, making it difficult to systematically assess fine grained visual details. To address these gaps, we introduce AVID, the first dedicated training-scale 5.0 Tesla functional magnetic resonance imaging (fMRI) resource for auditory-induced VMI decoding. AVID comprises approximately 67 hours of dense recordings from nine participants. The dataset is structured into two complementary splits: a scene-level complex split using naturalistic Mandarin descriptions and a controlled simple split with explicitly specified visual attributes. We further formalize a standardized evaluation protocol that decouples source-image consistency from semantic alignment, allowing for a more nuanced assessment of imagery reconstruction. Baseline qualitative and quantitative results show that current reconstruction pipelines remain limited on AVID, although the most successful reconstructions preserve recognizable scene level semantics from spoken descriptions. By combining dedicated training-scale neural recordings and standardized evaluation resources, AVID provides both a data foundation for imagery-specific model development and a benchmark for evaluating VMI decoding with substantially reduced sensory contamination.
103. 【2611.02581】SMILE: A Structured Multi-Agent Clinical Reasoning for Liver Ultrasound Understanding
链接：https://arxiv.org/abs/2611.02581
作者：Haris Ghafoor,Minjee Seo,Seonaeng cho,Keungmo Yang,Jaejun Lee,Kyungho Yoon
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：report generation improves, Automated liver ultrasound, ultrasound report generation, Automated liver, liver ultrasound report
备注： Accepted at Winter Conference on Applications of Computer Vision (WACV) 2027
点击查看摘要
Abstract:Automated liver ultrasound report generation improves the diagnosis of liver diseases by producing clinically structured descriptions of anatomical and disease-related findings. However, current generative vision-language models (VLMs) often rely on a single reasoning pathway that maps ultrasound appearance directly to textual descriptions. In addition to the inherent vision-language modality gap, this design is limited for liver ultrasound because disease interpretation is constrained by subtle visual evidence, heterogeneous disease patterns, and limited paired supervision. To address these limitations, we propose SMILE, a Structured Multi-agent clInicaL rEasoning framework that uses multiple complementary specialist agents to interpret ultrasound images and consolidates their outputs through a judge-guided consensus mechanism. Our approach employs three specialized agents: an image interpretation agent for morphological descriptions, a clinical-stage reasoning agent, and a visual question answering (VQA) agent for targeted queries. These agent responses are then aggregated and scrutinized by a judge VLM using a consensus filtering prompt to produce a unified, clinically coherent output. Across a public liver ultrasound dataset and an internal clinical dataset, SMILE consistently outperforms state-of-the-art VLMs, achieving up to 19.0\% improvement in ROUGE-1 and 18.8\% improvement in clinical F1-score, while reaching VQA F1-scores of 0.82 and 0.65 on public and internal datasets, respectively. These results demonstrate the potential of SMILE for data-scarce and limited-supervision clinical settings. Our models, datasets, and code are available \href{this https URL}{here}.
104. 【2611.02578】Probing Local Conditional Fit for Diffusion Model Membership Inference
链接：https://arxiv.org/abs/2611.02578
作者：ByungHee Cha,Naoki Murata,Yuhta Takida,Jong Chul Ye,Yuki Mitsufuji
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Membership inference determines, inference determines, important tool, tool for auditing, auditing training-data
备注：
点击查看摘要
Abstract:Membership inference determines whether a candidate example was used to train a text-to-image diffusion model and is an important tool for auditing training-data use. We identify a directional membership signal in \emph{conditional prediction shifts}, the changes in predicted noise under alternative text conditions at a fixed noisy input: whether movement toward the alternative prediction initially lowers or raises the denoising loss from its value under the original caption. Members exhibit less room for such local improvement. To quantify this response, we propose \emph{LoFIT} (Local Conditional Fit), which measures the initial response of the denoising loss along normalized prediction shifts and aggregates it across multiple text conditions and diffusion states. LoFIT requires no target-model gradients and can be computed using only forward queries to the denoiser. Evaluations on four datasets show improved membership discrimination across fine-tuned and pretrained models. LoFIT distinguishes members early in fine-tuning, while the naive denoising-loss baseline remains near chance. Controlled comparisons show that the membership signal is concentrated in the first-order response, with little discrimination from prediction-shift magnitude alone.
105. 【2611.02568】SeMo3D: Unifying 3D Generation, Editing, and Completion via Selective Modeling
链接：https://arxiv.org/abs/2611.02568
作者：Xiaokun Sun,Jian Yang,Zhenyu Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：regenerating the complete, typically treated, treated as regenerating, task-specific constraints, task-specific paired data
备注： Project page: [this https URL](https://xiaokunsun.github.io/SeMo3D.github.io/)
点击查看摘要
Abstract:3D generation, editing, and completion are typically treated as regenerating the complete 3D asset under task-specific constraints, even when only a local region needs modification. This leads to task isolation, inconsistency in content that should remain unchanged, and dependence on task-specific paired data. We address these issues with a key observation: the three tasks all synthesize a designated region while keeping the rest intact---the full region for generation, the target region for editing, and the missing region for completion. We term this paradigm Selective Modeling and build SeMo3D upon it; it naturally unifies the three tasks, preserves unchanged content by construction, and enables training without paired editing or completion data, since any 3D asset can be partitioned into a selected region and its context. For training, we propose region-selective denoising, which randomly selects regions of varying sizes on standard 3D assets and applies noise and loss only to them, jointly learning all three tasks. For architecture, we propose Omni3DiT, a multi-condition 3D diffusion transformer that distinguishes regions to create from those to retain and fuses image, text, and point guidance for fine-grained control. Experiments across three benchmarks show SeMo3D surpasses state-of-the-art methods on all tasks, delivering multimodal controllability in generation and strong consistency and accuracy in editing and completion. SeMo3D further serves as a unified modeling tool for agents, enabling efficient 3D creation through natural-language interaction. Project page: this https URL.
106. 【2611.02551】Flat Features, Detailed Images? Simple Detail Control for Diffusion Transformers
链接：https://arxiv.org/abs/2611.02551
作者：Qingtao Yu,Zhen Wang,Jiyang Zheng,Minghao Sun,Hongdong Li,Dylan Campbell
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：models to generate, engineering is commonly, generate more detailed, Prompt engineering, detailed images
备注：
点击查看摘要
Abstract:Prompt engineering is commonly used to encourage text-to-image models to generate more detailed images. However, it does not provide reliable, continuous, or disentangled control. We analyze feature tokens produced with and without detail-enhancing prompts across six diffusion transformers and observe a common pattern: these prompts tend to increase the entropy of each token's energy distribution while largely preserving its ordering. That is, flattening the distribution increases the level of detail. Motivated by this counter-intuitive finding, we introduce a simple training-free approach that continuously adjusts the level of detail according to a scalar. Specifically, it shifts the squared channel magnitudes of each token toward a higher entropy distribution with a time-aware scheduler to concentrate the intervention at intermediate sampling steps. Across extensive experiments on different types of diffusion transformers, we show that our approach provides continuous control over detail metrics while largely preserving image quality and semantic structure. It requires only a few lines of code and adds negligible inference time overhead.
107. 【2611.02540】PixelBench: Can LLMs Understand and Generate Images Pixel by Pixel?
链接：https://arxiv.org/abs/2611.02540
作者：Haoquan Zhang,Feiyang Liu,Juanxi Tian,Wanhua Li,Haodong Duan,Weiyang Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：SVG and CAD, Large language models, symbolic representations describe, Large language, representations describe images
备注： Technical report, 38 pages, 7 figures. Project page: [this https URL](https://haoquanzhang.github.io/pixel-bench)
点击查看摘要
Abstract:Large language models (LLMs) can generate visual assets through text-based formats such as SVG and CAD, but these symbolic representations describe images using high-level primitives rather than explicit raster values. We ask whether LLMs can instead generate pixel images directly through their existing vocabulary, without a learned image tokenizer or decoder. We introduce PixelBench, a benchmark for text-to-pixel (T2P) and image-to-pixel (I2P) generation across multiple resolutions, together with a complementary pixel-understanding evaluation. Models generate an RGB color palette followed by a grid of indices specifying the palette color of each output pixel. In T2P, the strongest models produce recognizable images directly from text. In I2P, the strongest models outperform palette-matched downsampling and specialized pixelization algorithms at low resolutions. Pixel-understanding performance correlates strongly with generation performance. A resolution-scaling study shows that pixel-generation performance often improves initially before declining at high resolutions. Finally, we introduce Pixel Reconstruction Tuning (PRT), which augments visual instruction tuning with caption-palette-grid trajectories. We post-train Molmo2-4B from its pretraining checkpoint by mixing general instruction data with our curated PRT data, improving performance across 16 visual-centric benchmarks, indicating that explicit pixel reconstruction can provide useful auxiliary supervision.
108. 【2611.02526】INTERACT: Learning Interaction-Aware World Dynamics from Driving Videos for Autonomous Driving
链接：https://arxiv.org/abs/2611.02526
作者：Zhan Chen,Songyan Zhang,Wenhui Huang,Zirui Li,Zhidong Wang,Qihang Huang,Shiyu Fang,Chen Lv
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Safe autonomous driving, Safe autonomous, autonomous driving requires, surrounding traffic participants, recognizing the current
备注：
点击查看摘要
Abstract:Safe autonomous driving requires more than recognizing the current scene: the ego vehicle must anticipate how surrounding traffic participants will evolve under its own motion. However, existing end-to-end driving models typically encode scenes into dense visual or BEV features, leaving object-level interactions implicit. We propose (INTERACT INTERaction-aware Action-Conditioned Trajectory learning), a three-stage framework that learns a slot-based object-centric world model from unlabeled driving videos and transfers it to trajectory planning. INTERACT first learns recurrent slots that group dense visual features into temporally structured scene-entity representations without object annotations. It then infers latent ego actions from slot context and video transitions, and uses them to condition future slot prediction, capturing how ego motion and surrounding entities co-evolve. Finally, the learned slots, latent actions, and future slot predictions are distilled into a trajectory planner to guide trajectory generation and selection. Extensive experiments on NAVSIM and nuScenes validate the effectiveness of INTERACT. In particular, it achieves state-of-the-art performance on NAVSIM, with improvements in safety-critical collision metrics.
109. 【2611.02519】MedHEB: Benchmarking Medical Embeddings Across Heterogeneous Clinical Evidence
链接：https://arxiv.org/abs/2611.02519
作者：Yingshu Li,Shaoyang Zhou,Zhanyu Wang,Yunyi Liu,Xinyu Liang,Xi Zhang,Lingqiao Liu,Lei Wang,Luping Zhou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：retrieving relevant evidence, cross-modal examinations, inherently relational, prior studies, localized findings
备注：
点击查看摘要
Abstract:Clinical evidence is inherently relational: medical images are interpreted with prior studies, cross-modal examinations, reports, and localized findings, and retrieving relevant evidence is therefore central to clinical interpretation. Recent foundation models increasingly encode these heterogeneous sources into shared embedding spaces, yet existing embedding evaluation often focuses on isolated matches, leaving unclear whether current models retrieve relevant evidence across changes in modality, appearance, and granularity. We introduce MedHEB, a unified benchmark with 107 retrieval tasks from 54 datasets, including both in-distribution and held-out-source evaluation, across three axes: evidence form (2D images, 3D volumes, text), pairing type (image--image, image--text, text--text, and modality-bridging visual matching), and relevance granularity (global, question-conditioned, region-level). Under a single ranking protocol, MedHEB varies clinically relevant evidence definitions to test whether embedding proximity remains meaningful across heterogeneous evidence, including modality-bridging visual retrieval and region-level text-to-region retrieval. Across representative models, performance is uneven across retrieval families: models strong on conventional image--text or text--text retrieval are less reliable on modality-bridging and region-level tasks. Current embedding spaces capture some clinical relationships well but do not yet provide balanced retrieval across heterogeneous evidence. We further provide MedEmb, an MLLM-based reference embedding model trained on the MedHEB ID split, as a reproducible baseline for unified 2D--3D--text medical retrieval. We release MedHEB with preprocessing scripts, evaluation code, access manifests, and MedEmb to support research on clinically meaningful medical embeddings.
110. 【2611.02512】Latent Spectral Prompting for Multimodal Hyperspectral Object Tracking
链接：https://arxiv.org/abs/2611.02512
作者：Wangshu Cai,Jun Zhou,Lei Wang,Mohammad Aminul Islam,Xu Han,Kuldip Paliwal
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：videos provide rich, pretrained RGB trackers, Hyperspectral videos provide, pretrained RGB, provide rich spectral
备注： Accepted at the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV 2027)
点击查看摘要
Abstract:Hyperspectral videos provide rich spectral signatures for robust tracking under challenging conditions such as camouflage and low illumination. However, limited hyperspectral annotations and the large RGB-hyperspectral domain gap hinder the direct use of modern temporally pretrained RGB trackers. We propose SProTrack, a multimodal framework that transfers temporal knowledge from pretrained RGB trackers to the hyperspectral domain through latent spectral prompting. The key idea is to decouple temporal modeling from spectral adaptation, allowing temporal dynamics to be inherited from RGB foundation models while hyperspectral information is learned from unlabeled data in a self-supervised manner. Unlike band-selection methods that discard most spectral information or prompt-based approaches that rely on local-search crops, SProTrack learns a global, scene-level spectral representation from the full hyperspectral frame using an autoencoder. This latent representation is used to guide spectral prompt extraction while a pretrained RGB tracker preserves strong temporal modeling on RGB-compatible inputs. By encoding spectral-spatial structure into compact latent prompts, SProTrack bridges the RGB-hyperspectral modality gap without extensive retraining or dense supervision. Experiments on HOT2020 and HOT2023 demonstrate that SProTrack achieves the best overall performance, with strong results across all spectral domains.
111. 【2611.02506】CellPlex: Benchmarking Single-Cell Spatial Proteomics Prediction from HE
链接：https://arxiv.org/abs/2611.02506
作者：Zijun Gao,Yijiang Chen,Xiangde Luo,Pheng-Ann Heng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：proteomics measures tens, Spatial proteomics measures, small research cohorts, Spatial proteomics, single-cell spatial proteomics
备注：
点击查看摘要
Abstract:Spatial proteomics measures tens of proteins in every cell of a tissue section, but its cost confines it to small research cohorts, whereas hematoxylin and eosin (H\E) slides exist for nearly every patient. Inferring single-cell spatial proteomics from H\E would bring its analyses to routine pathology, and a growing number of virtual staining models pursue this goal. Each is evaluated on its own cohort, panel and pixel-level metric, and released models transfer poorly to new cohorts, leaving open which approach to build on and which proteins H\E can reveal. We introduce CellPlex, a benchmark that poses the task at the level of the cell: seven cohorts with same-section H\E and multiplexed immunofluorescence, from colorectal and breast cancer to lymph-node metastases, bone marrow and glioma, with 717 samples, 44.8 million cells and 149 proteins, processed by one pipeline into per-cell targets. Pathology foundation models (PFMs) are adapted with one cell-level protocol, specialist models are fine-tuned under a matched budget, and all are scored on the same cells. Adapted PFMs are the most accurate models on every cohort, ahead of the specialists even after fine-tuning, but keep less than half of their accuracy on cohorts they were not trained on. Which proteins can be predicted depends on the tissue, not on how many cells were measured for them. By fixing the cells, targets and splits on which predictions are judged, CellPlex sets a common standard for inferring costly molecular measurements from routine H\E and shows how far H\E can stand in for spatial proteomics. We will release the data, splits, evaluation code and baselines as a testbed for developing and comparing future pathology foundation models and virtual staining methods.
112. 【2611.02505】QFacePlacement: From Arbitrary Tensorization to Semantic Spatial Correspondence in Modern Face Verification
链接：https://arxiv.org/abs/2611.02505
作者：Krishna Bhatia,Kavita Choudhary,Pruthwik Mishra,Praveen Kumar Chandaliya
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：reshapes high-dimensional features, applies tensor-network models, Quantum-inspired computer vision, computer vision, vision often reshapes
备注： Accepted at 11th International Conference on Computer Vision Image Processing (CVIP)
点击查看摘要
Abstract:Quantum-inspired computer vision often reshapes high-dimensional features into tensors and applies tensor-network models. In face verification, this can be misleading: modern embeddings are optimized for cosine similarity, and tensorization alone does not establish the low-rank structure needed for tensor trains or matrix-product operators (MPOs). We study model placement through two controlled interfaces. First, cross-model embedding alignment requires a 512 x 512 operator to map AdaFace embeddings into ArcFace space. Dense Ridge and Procrustes mappings remain strong, while deterministic TT-SVD and MPO compression underperform even with basis changes and low-rank residuals. At a 64K-parameter storage budget, mean directional AUC is 0.9297 for dense Ridge, 0.8952 for rank-64 SVD, 0.8685 for the best low-rank-MPO hybrid, and approximately 0.649 for raw MPO. Second, before global pooling, we construct a 7 x 7 x 7 x 7 probe-gallery correspondence tensor from local AdaFace descriptors. A geometry-aware symmetric tensor train with bond dimension 2 uses 122 trainable parameters, compared with 2,403 for a dense linear matcher, while attaining an LFW AUC of 0.9802. Yet compression does not translate into better low-false-acceptance performance: on CFP-FP, TAR at FAR = 0.001 is 0.0102 versus 0.1734 for global cosine matching, and on CPLFW it is 0.7805 versus 0.8737. These results suggest that quantum-inspired factorization is most credible when the chosen interface provides task-aligned axes and compressible structure. They also show why aggregate AUC must be assessed alongside operational low-FAR metrics.
113. 【2611.02499】Fast-Slow Evolutionary Occupancy Prediction via Controlled Dynamics
链接：https://arxiv.org/abs/2611.02499
作者：Runhe Yang,Zhiyuan Zhou,Yuxiang Yan,Xuetong Yang,Yikai Pan,Jiacheng Tang,Zhuolin He,Jianhua Han,Hang Xu,Jian Pu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：safe downstream forecasting, autonomous driving, forecasting and planning, semantic scene representations, representations for autonomous
备注： Accepted by NeurIPS 2026
点击查看摘要
Abstract:3D semantic occupancy prediction provides dense geometric and semantic scene representations for autonomous driving, where both high accuracy and low response latency are crucial for safe downstream forecasting and planning. Existing methods usually exhibit different accuracy-latency characteristics. Performance-oriented models provide stronger geometric and semantic predictions, while deployment-friendly models provide faster responses. This motivates EvoOcc, a fast-slow evolutionary occupancy prediction framework that jointly exploits their complementary strengths to improve the accuracy-latency balance without changing the upstream architectures. EvoOcc models evolutionary occupancy prediction as a continuous time controlled dynamical system, enabling flexible adaptation to variable slow system delays and irregular fast system arrivals. The framework further decomposes the evolution process into dual state evolution where ego state evolution compensates for the deterministic coordinate shifts and scene state evolution models the genuine geometric and semantic scene changes. Extensive experiments on three different fast-slow system pairs and irregular prediction arrivals show that EvoOcc consistently improves over fast system baselines while maintaining much lower latency than the slow system, indicating a favorable accuracy-latency balance and stable behavior under practical inference situations.
114. 【2611.02488】End-to-End Stability of Online Active Learning in Large-Scale Neural Systems
链接：https://arxiv.org/abs/2611.02488
作者：Shuiwen Shen,Jinhua Zhang,Chenlei Hou,Peng Shi,Yong Han,Bo Gao,Xiaoxiao Na,Zhihui Lin,Pengtao Du
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：changing physical environment, aims to extend, physical environment, static inference, inference after offline
备注： 21 pages, 4 figures
点击查看摘要
Abstract:Online Active Learning (OAL) aims to extend deep learning from static inference after offline training to continuous adaptation during real-time interaction with a changing physical environment. This transition is essential for safety-critical applications, but it raises a central theoretical question: whether the online parameter update process remains stable when scaled to multilayer neural architectures. This paper develops a stability-focused OAL framework. The framework uses prediction error as a feedback signal to update a structured deep model, thereby linking online learning with Lyapunov-based energy minimization. We show that prediction error convergence alone is insufficient for global parameter convergence because multilayer networks may admit high-dimensional manifolds of equivalent output solutions. The analysis therefore separates output error regulation, internal zero dynamics, interlayer coupling, and parameter convergence. Persistency of excitation and active damping are then used to remove the residual null-space modes that remain after output error convergence. A cascaded Lyapunov analysis establishes asymptotic stability of the overall OAL learning process, while monotonic activation functions and diffeomorphic layer mappings provide the uniqueness condition for the target parameter trajectory. The resulting proof provides a theoretical basis for applying online adaptive learning to large-scale neural systems in nonstationary and safety-critical settings.
115. 【2611.02474】Gnomon4D: Learning Where and When to Focus for Geometric Motion-Grounded World-Action Modeling
链接：https://arxiv.org/abs/2611.02474
作者：Lingwei Dang,Yan Zhou,Juntong Li,Zhenhao Zhang,Yiteng Chen,Xiaoqiang Liu,Liang An,Hongwen Zhang,Wei Min,Guoxin Zhang,Pengfei Wan,Yebin Liu,Qingyao Wu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：World-action models, predict future observations, jointly predict future, video-generation priors, RGB futures entangle
备注：
点击查看摘要
Abstract:World-action models (WAMs) use video-generation priors to jointly predict future observations and robot actions. Yet RGB futures entangle physical state changes with appearance, while frame-wise depth and point maps lack temporal correspondence. Existing 4D approaches either keep motion implicit in visual features or translate predicted traces into actions through a separate interface. We present Gnomon4D, a WAM that jointly generates future video, robot actions, and GeoDelta, a video-aligned 4D geometric motion field encoding the cross-frame image-plane displacement and depth change of embodiment and object points. By placing embodiment motion and object responses in a shared space, GeoDelta exposes their motion relations to the action expert at inference. Interaction-Salient Attention (InSAttn) uses these relations to focus spatial readout on task-relevant interaction regions, while Transition-Anchored Aggregation (TransAgg) aggregates evidence around changes in their relative motion, such as grasp and release. GeoDelta describes surface motion independently of embodiment-specific controls, providing a shared human--robot quasi-action for action-free pretraining on EgoManip-5000H followed by robot mid-training on Robot-30H. Gnomon4D leads on RoboTwin~2.0, VLABench, and RoboDojo, and outperforms the strongest real-robot baseline by 7.0 and 16.0 percentage points under in-distribution and out-of-distribution settings, respectively.
116. 【2611.02437】Evaluating Synthetic Skin Lesion Images for Classifier Training: A Safety-Aware Algorithm
链接：https://arxiv.org/abs/2611.02437
作者：Amindu Kumarasinghe(Southern Cross University),Vinh Bui(Southern Cross University),Reza Ghanbarzadeh(Southern Cross University)
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Skin cancer classifiers, Skin cancer, Fréchet Inception Distance, rare lesion types, images
备注： 57 pages, 12 figures. Code to reproduce all experiments, along with links to the full Zenodo dataset and the synth-curator package, can be found at [this https URL](https://github.com/Amixdu/synth-curator-paper)
点击查看摘要
Abstract:Skin cancer classifiers need large sets of annotated images, which are scarce, especially for rare lesion types. AI-generated images can fill the gap, but a generator produces images of widely varying quality, so selecting which images to retain is important. That choice usually rests on a single quality score, most often the Fréchet Inception Distance (FID), which has not been tested against what a classifier needs and cannot tell whether the generator memorizes its training photographs. We test that practice with a tournament of 16 quality metrics. Each metric alone selects a training subset from a pool of 275,472 images generated by a diffusion model (EDM2), and a classifier trained on each subset scores the metric per class. The tournament shows that no single metric serves every class: FID computed on Inception features gives the best classifier for one lesion type and no measurable advantage over random sampling for another, and the generation setting it prefers is also the one closest to the training images. We turn these per-class measurements into a safety-aware evaluation algorithm that weights each metric by its measured value in each class and removes images too close to a real training image. On the held-out ISIC-2018 test set, the algorithm improves Macro-$F_2$, a recall-weighted measure of classification performance, over the FID baseline for a Swin-B classifier by +0.0136 to +0.0164 across four safety thresholds (Bonferroni-corrected $p 0.02$) and over random sampling by about +0.03, though not for ResNet-50. Tightening the threshold improves a memorization-safety score with no measurable change in utility, but every curated set remains less safe than random sampling. The results show a modest but statistically significant gain on the primary classifier, and offer a practical, safety-aware procedure for evaluating and using synthetic data.
117. 【2611.02433】Blueprint2CAD: Benchmarking Foundation Models on Engineering Drawing-to-CAD Render Correspondence
链接：https://arxiv.org/abs/2611.02433
作者：Alexander Valverde,Danny Xie-Li,Zhichao Wang,Marcos V. Conde
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Engineering drawings, Engineering, orthographic projections, mechanical parts, part
备注： Accepted at WACV 2027 (LVR)
点击查看摘要
Abstract:Engineering drawings specify mechanical parts through orthographic projections. Recognizing which part a drawing depicts underlies part search, design reuse, and digitization, yet no public benchmark measures whether vision models can do it. We introduce Blueprint2CAD, a benchmark for drawing-to-render correspondence: given an orthographic line drawing and a shaded render, usually from another viewpoint, decide whether they show the same part. Its data layer, BlueCAD-30K, applies an open drafting pipeline to 29,925 Zero-to-CAD models, adding view-aligned renders, clean and dimensioned drawings from six viewpoints, and surface-type metadata. Frozen encoders retrieve the matching part from a 10,000-model gallery with up to 65% Recall@1 when viewpoints are known but 43% when they are not, and the four encoders we test lie within six points of each other: viewpoint, not backbone, is the bottleneck. Six zero-shot vision-language models reach only 0.52-0.67 verification accuracy, with model-specific Yes/No biases that chain-of-thought shifts but does not remove; a quick LoRA fine-tuning on in-domain pairs improves verification accuracy by a few points but sharpens these biases and leaves the viewpoint failure intact.
118. 【2611.02419】ERA: Task-Evidence Restoration for Underwater Object Detection under Bandwidth-Constrained Transmission
链接：https://arxiv.org/abs/2611.02419
作者：Heejin Kim,Joon-Seok Song,Eunil Park
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：overlooking additional degradation, pre-transmission images, overlooking additional, downscaling and compression, typically evaluated
备注： Accepted to WACV 2027
点击查看摘要
Abstract:Underwater object detectors are typically evaluated on pre-transmission images, overlooking additional degradation from bandwidth-constrained downscaling and compression. We introduce AquaTX, a controlled benchmark built from real underwater detection datasets with seen and held-out codecs. We also propose TERA, a metadata-blind receiver-side framework combining task-guided pixel restoration and dual-state feature correction while keeping the detector frozen. Under seen compound degradation, TERA improves mean average precision (mAP50:95, averaged over IoU thresholds from 0.50 to 0.95) from 37.7 to 50.0 on DUO-TX and from 31.5 to 41.3 on RUOD-TX relative to the frozen detector without restoration. TERA also preserves clean-input performance and remains competitive with detector fine-tuning under the held-out AVIF codec. These findings support transmission-aware evaluation and task-guided restoration for underwater object detection. Code is available at this https URL.
119. 【2611.02393】IMUdrape: Generating Garment-Mounted Virtual IMU Data from Text through Physics-Based Cloth Simulation
链接：https://arxiv.org/abs/2611.02393
作者：Zikang Leng,Thomas Plötz
类目：Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)
关键词：Inertial sensors, data, Virtual IMU data, garment, sensorized sportswear
备注： 34 pages, 7 figures, 15 tables. Under review. Project page: [this https URL](https://zikangleng.github.io/imudrape/)
点击查看摘要
Abstract:Inertial sensors are moving into clothing, from sensorized sportswear to garments instrumented with hundreds of IMUs. Sewn into clothing, a sensor no longer moves rigidly with the body: loose fabric slides, twists and swings, so a garment-mounted sensor records the motion of the fabric as well as that of the body, and this extra motion differs from one garment to the next. Models for such sensors need training data recorded with the deployed garment, yet labeled data are scarce. Virtual IMU data generated from videos or text have eased this scarcity for body-attached sensors, but existing generators attach their virtual sensors rigidly to the body. We present IMUdrape, which generates garment-mounted virtual IMU data from text through physics-based cloth simulation. IMUdrape synthesizes motion from activity descriptions, reconstructs the target garment as a sewing pattern from photographs, places virtual IMUs at the deployment's real sensor positions, and simulates the garment with an intersection-free contact solver, so that every simulation yields paired garment and body signals. On four real datasets with clothing-mounted sensors, IMUdrape improves on existing virtual-data approaches for both activity recognition and full-body pose estimation. With one real subject, its data improve recognition macro-F1 by 7% to 46% over real data alone and by 2% to 11% over body-mounted virtual data from the same motion. When the garment is simulated on recorded motion, the pose error without any real training data falls by 30% to 33% relative to generated motion, and garment data remain 12% more accurate than body data. IMUdrape thus reduces the amount of real data that garment-mounted sensing requires.
120. 【2611.02366】Do Visual RL Gains Scale at Test Time? A Quantile View of Post-Training
链接：https://arxiv.org/abs/2611.02366
作者：Austin Wang,Lexing Ying
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：Reinforcement learning, additional inference compute, Reinforcement, visual generative models, Utility Policy Optimization
备注：
点击查看摘要
Abstract:Reinforcement learning (RL) post-training improves the single-sample quality of visual generative models, but deployment often provides additional inference compute through Best-of-N sampling. Whether RL gains transfer under such test-time scaling, particularly on difficult held-out tasks, remains poorly understood in the visual domain. Our central contribution is to systematically identify and characterize a failure mode of scaling transfer in visual RL: across multiple RL methods, model backbones, and evaluations spanning compositional generation, text rendering, and preference alignment, higher single-sample reward does not necessarily imply a better quality-compute frontier. RL gains may attenuate, saturate, or even reverse at large sampling budgets, with the base model eventually outperforming its post-trained counterpart. We explain these regimes through a quantile-transfer framework, showing that Best-of-N places increasing weight on the upper tail of the reward distribution as N grows. Consequently, RL can improve typical samples while compressing or degrading the rare high-quality outcomes that test-time scaling exploits. As a simple intervention motivated by this analysis, we introduce Quantile Utility Policy Optimization (QUPO), which optimizes a controllable mixture of quantile utilities corresponding to different inference budgets. Experiments on SD3.5-M and BAGEL show that QUPO better preserves upper-tail quality and substantially improves scaling on challenging held-out prompts relative to standard RL post-training. Our results suggest that visual generative models should be evaluated and optimized not only for single-sample quality, but for how post-training reshapes the full reward distribution that inference-time scaling exploits.
121. 【2611.02363】GEAR: Generative Editing for Scene-Conditioned Outfit Retrieval for VR Travel
链接：https://arxiv.org/abs/2611.02363
作者：Gia-Huy Dinh,Thinh-Phuc Nguyen,Thanh-Hai Nguyen,Lam-Huy Nguyen-Ngoc,Hoang-Bach Nguyen-Phan,Nam-Quan Nguyen,Minh-Triet Tran,Trung-Nghia Le
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：assets remains challenging, catalog garment assets, garment assets remains, requires contextual harmony, remains challenging
备注：
点击查看摘要
Abstract:In virtual environments, choosing appropriate outfits requires contextual harmony with surrounding scenes, yet bridging the visual gap between 3D ambient views and catalog garment assets remains challenging. This paper investigates scene-conditioned outfit retrieval for interactive 3D environments, where a user's egocentric view serves as the retrieval signal. We present GEAR (Generative Editing for Asset Retrieval), a framework that bridges the cross-domain gap by synthesizing intermediate visual queries rather than predicting direct compatibility. GEAR uses a vision-language model to describe suitable clothing from a captured scene, employs an instruction-guided diffusion model to render the concept onto a standardized reference character, and utilizes the cropped clothing region to retrieve existing 2D outfit assets via embedding similarity. An interactive Unity prototype demonstrates real-time scene capture, asset retrieval, and in-engine 3D avatar fitting. We benchmark GEAR against direct visual similarity, aesthetic scoring, and VLM-based reranking on a controlled dataset using automated Swiss-system pairwise judgments, where GEAR achieves competitive top-ranked performance (mean Elo@5 of 1012.75 and top-10 overlap of 0.180) alongside 0.539 pairwise agreement. Furthermore, a user study across 20 virtual travel scenes demonstrates that GEAR achieves the highest overall participant preference in both visual appeal (34.5%) and contextual suitability (34.5%).
122. 【2611.02356】Exploiting Textual Semantics for Robust Cross-View Object Correspondence
链接：https://arxiv.org/abs/2611.02356
作者：Bing Fan,Yunhe Feng,Yan Huang,Heng Fan
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Cross-view object correspondence, search videos captured, aims to establish, Textual, establish associations
备注： Accepted to NeurIPS 2026. 12 figures, 12 tables. Code: [this https URL](https://github.com/VAIL-Fan/TeSCo)
点击查看摘要
Abstract:Cross-view object correspondence (CVOC) aims to establish associations of the same target between query and search videos captured from different viewpoints. Existing methods often rely on visual cues for CVOC. Despite recent progress, these methods struggle in complicated scenarios with substantial viewpoint changes and appearance variations, due to lacking sufficient target information. Addressing this, we introduce TeSCo, a framework that exploits rich Textual Semantics of an object, in addition to its visual cues, for cross-view object Correspondence. Our key insight is, textual description of a target, by capturing diverse attributes such as category, texture, and color, provides viewpoint- and appearance-invariant semantics, which are complementary to visual cues and can hence enhance correspondence robustness in complicated scenes. Inspired by this, TeSCo first generates a textual expression of the target from the given query view using a vision-language model, and then extracts textual feature to enhance visual features for localization in the search view. To realize this, we introduce a text-conditioned cross-modal fusion (TCF) module that incorporates the textual feature into visual features with text-guided modulation, producing more robust multimodal target representation for object correspondence. Since not all textual cues are equally compatible with the target in current search-view frame, we propose an iterative textual feature refinement (ITFR) module that progressively adjusts textual feature using search-view information before the TCF module, enabling search-view-aware textual semantics to be fused into visual features and leading to better performance. In extensive experiments on Ego-Exo4D and HANDAL-X, TeSCo demonstrates state-of-the-art results and largely outperforms other models, validating its efficacy. Our code is released at this https URL.
123. 【2611.02341】AgiWorld: An Agentic Video World Model for Building Persistent Worlds
链接：https://arxiv.org/abs/2611.02341
作者：Shaoheng Fang,Yiqun Mei,Hanwen Jiang,Xin Sun,Haitian Zheng,Hao Tan,Kalyan Sunkavalli,Georgios Pavlakos,Qixing Huang,Yiwei Hu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Recent interactive video, Recent interactive, visually compelling videos, generate visually compelling, world
备注：
点击查看摘要
Abstract:Recent interactive video world models generate visually compelling videos from a single image, following user-provided camera motion and text prompts. However, such low-level control demands substantial user effort to realize a high-level intent, and the generated world struggles to remain persistent as the exploration proceeds. In this work, we present AgiWorld, an agentic video world model that explores and builds a persistent world from a single image and a free-form instruction. For high-level planning, our agent AgiWorld-Agent designs the world and the journey through it in a world state and directs the exploration. For low-level realization, our video world model AgiWorld-WM generates the video chunk by chunk and stores it with its geometry in a spatial memory, from which the agent updates its world state. This closed loop keeps the world faithful to the user's intent and keeps the agent's world state consistent with the generated content throughout the exploration. We co-design the two levels around the shared spatial memory and an interface of metric camera trajectories and structured prompts. In AgiWorld-WM, to handle occlusion and accumulated geometric errors in the spatial memory over long rollouts, we propose occlusion-aware history selection, which retrieves past views by surface visibility, and reliability-based memory maintenance, which prefers reliable geometry and earlier observations. AgiWorld-WM achieves state-of-the-art overall performance on world revisiting and exploration benchmarks, and qualitative results and ablations show that AgiWorld builds persistent worlds from free-form instructions over minute-long journeys. Persistence thus arises not from the video model alone but from its closed loop with the agent.
124. 【2611.02327】Findings-aware Language-Image Pretraining for CT Volume Interpretation
链接：https://arxiv.org/abs/2611.02327
作者：Takuro Shimaya,Junya Inoh,Masahiro Saiko
类目：Computer Vision and Pattern Recognition (cs.CV); Medical Physics (physics.med-ph)
关键词：diverse patient information, Computed tomography, numerous deep learning, diverse patient, patient information
备注： 10+2 pages, accepted to WACV2027
点击查看摘要
Abstract:Computed tomography (CT) provides diverse patient information and various clinical tasks, for which numerous deep learning models have been investigated. Recent years have seen the development of vision-language foundation models that can comprehensively extract clinical features, driven by representation learning that combines CT volumes with radiology reports. Existing approaches typically adopt Contrastive Language-Image Pre-training (CLIP)-based representation learning, where pairs from different cases are, in principle, treated as negative pairs such that the volume and report embeddings are pushed apart. In the biomedical imaging, however, treating different cases as negative pairs is not always appropriate, particularly when clinical similarity exists. In this study, we propose a supervised representation learning framework grounded in clinical knowledge from language foundation models, rather than the weak supervision used in CLIP. Specifically, we utilized a large language model to extract abnormal finding phrases from reports. We then explicitly constructed the target features that the image encoder should output, as the semantic representation of the extracted findings using a biomedical text embedding model. Our Findings-aware Language-Image Pre-training (FiLIP) outperformed weakly supervised approaches in multi-label zero-shot finding classification in both in-domain and external-domain evaluations, and also proved effective when fine-tuned for the downstream task of radiology report generation.
125. 【2611.02324】he DynaCell Evaluation Suite for Dynamic 3D Virtual Staining of Live Cells
链接：https://arxiv.org/abs/2611.02324
作者：Alexandr A. Kalinin,Dihan Zheng,Taylla Milena Theodoro,Ivan Ivanov,Eduardo Hirata-Miyasaki,See-Chi Lee,Aofei Liu,Sricharan Reddy Varra,Talon Chandler,Soorya Pradeep,Chad Liu,Manuel D. Leonetti,Carolina Arias,Bo Huang,Shalin B. Mehta
类目：Computer Vision and Pattern Recognition (cs.CV); Quantitative Methods (q-bio.QM)
关键词：drug discovery, time is central, biology and drug, Virtual staining, Understanding
备注： 64 pages: 10-page main text with 4 figures and 1 table, plus references and a 49-page appendix with 15 figures and 25 tables. Accepted at NeurIPS 2026, Track on Evaluations and Datasets
点击查看摘要
Abstract:Understanding how cells respond to perturbations over time is central to cell biology and drug discovery. Live-cell imaging captures the dynamics of perturbation-induced phenotypes in individual cells. While fluorescence imaging can visualize specific molecular phenotypes, labeling and repeated illumination often affect cell health. Virtual staining offers an alternative by predicting these fluorescence images from images acquired without fluorescent labels. Although many virtual staining models have been developed, their performance on volumetric time-lapse data remains poorly characterized. We address this gap with an evaluation suite for 3D time-lapse virtual staining of live cells. The suite combines paired 3D time-lapse images acquired with and without fluorescent labels, a set of baseline models, and three metric tiers measuring pixel-level fidelity, organelle segmentation performance, and single-cell phenotype similarity. Using this evaluation suite, we study metric and model behavior across 3 cell types, 2 microscopes, 4 organelles, and 3 perturbation states. We find that regression baselines better predict the spatial localization of target organelles, whereas the generative baseline better captures the distribution of phenotypes across cells. These differences expose trade-offs between structural and phenotypic fidelity that are obscured by single-metric evaluation and suggest how virtual staining models can be developed for diverse downstream tasks such as localization, segmentation, tracking, and phenotypic profiling. We release the curated datasets, baseline checkpoints, and evaluation code as part of DynaCell, a broader framework for image-based profiling of cell-state dynamics.
126. 【2611.02306】Lie Routing Vision Language Models for View-Robust 3D Understanding
链接：https://arxiv.org/abs/2611.02306
作者：Jingjun Yi,Chen Hu,Qi Bi,Hao Zheng,Huimin Huang,Yongkang,Wei Ji,Yawen Huang,Xian Wu,Yefeng Zheng
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Multimodal Large Language, Large Language Models, multi-view RGB observations, Multimodal Large, Language Models
备注： NeurIPS 2026 Accepted Paper
点击查看摘要
Abstract:Multimodal Large Language Models (MLLMs) have made substantial progress in 3D scene understanding from multi-view RGB observations. Yet a fixed object and query can elicit inconsistent target-related responses across camera viewpoints, a phenomenon we characterize as viewpoint-induced semantic drift. We introduce LieVLM, a Lie routing framework for view-robust 3D understanding. Motivated by the rotational component of viewpoint change, Lie routing adapts visual representations by applying local $\mathrm{SO}(3)$ transformations to projected features within learned three-dimensional subspaces. Geometry tokens extracted by VGGT predict local rotation parameters and channel-wise routing coefficients. A closed-form Padé--Cayley map transforms projected visual features, whose identity-relative corrections are projected back and gated into the original visual and geometry features. This design retains the pretrained semantic and direct spatial context while learning view-dependent feature adjustments. Experiments on 3D captioning, grounding, detection, and spatial reasoning show consistent improvements over additive fusion across training scales and backbones. Controlled ablations examine the roles of geometric conditioning and transformation structure. Viewpoint analyses further reveal systematic variation in the predicted routing states alongside more localized target responses and stronger task performance across viewpoint changes.
127. 【2611.02305】Peripheral prototypical contrastive loss for supervised medical image segmentation
链接：https://arxiv.org/abs/2611.02305
作者：Takuro Shimaya,Ryosaku Shino,Masahiro Saiko
类目：Computer Vision and Pattern Recognition (cs.CV); Medical Physics (physics.med-ph)
关键词：challenging primarily due, ill-defined object boundaries, PPC loss, remains challenging primarily, Robust segmentation
备注： 5pages, accepted to ISBI2026
点击查看摘要
Abstract:Robust segmentation of biomedical images remains challenging primarily due to ill-defined object boundaries. Although several loss functions have recently been proposed to enhance object boundary recognition, concerns remain about the susceptibility to unstable annotations resulting from boundary ambiguities. Here, we introduce the Peripheral Prototypical Contrastive (PPC) loss, which leverages prototypical contrastive learning to improve boundary recognition and enable stable training even under noisy annotation conditions. The PPC loss utilizes prototype features obtained from local regions near object boundaries, focusing specifically on ambiguous areas that have been challenging for existing approaches. Extensive experiments across multiple datasets demonstrated that the PPC loss consistently improve segmentation performance even under conditions with noisy labels. A newly proposed strategy, which adaptively determines the local region for prototype calculation, enhanced robustness and outperformed existing methods. Our findings indicate the potential of the PPC loss in facilitating scalable and reliable medical image segmentation, including the development of foundation models with imperfect annotations.
128. 【2611.02284】SVD-Prune: Spectral Vision Token Pruning under Extreme Compression
链接：https://arxiv.org/abs/2611.02284
作者：Yvon Apedo,Martyna Poreba,Michal Szczepanski,Samia Bouchafa
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：models process hundreds, major computational bottleneck, Vision-Language Models, making visual representations, models process
备注： Accepted at WACV 2027. Code available at [this https URL](https://github.com/anoncvlab/svdPrune)
点击查看摘要
Abstract:Vision-Language Models (VLMs) and Vision-Language-Action (VLA) models process hundreds of visual tokens, making visual representations a major computational bottleneck. We argue that visual token pruning should be formulated not as identifying individually important tokens, but as preserving the dominant low-rank spectral structure of the visual representation. Based on this formulation, we introduce SVD-Prune, a training-free framework that leverages Singular Value Decomposition (SVD) and statistical leverage scores for globally informed token selection. SVD-Prune is architecture-agnostic and can be applied at different stages of the multimodal pipeline, including encoder-side, decoder-side, and hybrid configurations Extensive experiments across VLM and VLA benchmarks demonstrate strong robustness under extreme compression. SVD-Prune reduces the visual token. SVD-Prune cuts the visual token budget by up to 99.3%, while, at a 16-token budget, encoder-side pruning lowers inference FLOPs by 82.4% and achieves a 4.18x end-to-end speedup, including pruning overhead.
129. 【2611.02211】Forecasting Earth Surface Change in Embedding Space
链接：https://arxiv.org/abs/2611.02211
作者：Jingtao Li,Sadiq Jaffer,Anil Madhavapeddy,Pedro Sousa,Anthony Ortiz,Kyle Gao,Zhengpeng Feng,Yanfei Zhong,Kevin White,Srinivasan Keshav
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Repeated satellite imagery, plan mitigating actions, imagery permits understanding, satellite imagery permits, Repeated satellite
备注： 22 pages, Code: [this https URL](https://github.com/ucam-eo/e2forecast)
点击查看摘要
Abstract:Repeated satellite imagery permits understanding of how our planet changes over time, letting us predict its future and plan mitigating actions. Most existing studies that rely on a time series of satellite observations forecast the spectral values at each pixel for a future target date. However, clouds, shadows, and sensor noise often corrupt these observations, so that spectral forecasters waste much of their capacity on low-level features or noise rather than real change. With the advent of Earth foundation models, we argue that forecasting in embedding space is a feasible and more effective alternative. To this end, we design a token space that handles irregular histories from different sensors and foundation models and supports forecasts at any query date. Tokens from this space are inputs to our proposed forecaster, E$^2$Forecast, which is a transformer with two branches: a Gaussian branch that directly predicts a mean point forecast and per-dimension standard deviations, and a rectified-flow branch that generates forecast ensembles. On Sentinel-1 and Sentinel-2 benchmarks, forecasting embeddings instead of spectral values halves the cosine distance (from 0.20 to 0.10) and greatly reduces overconfidence, lowering the z-score standard deviation from 2.63 to 1.22. By comparing new observations with its forecasts, E$^2$Forecast can also detect anomalous changes without labels or retraining, raising F$_1$ from 41.58 to 48.70 on a global benchmark. This consistent superiority is validated on nine remote sensing foundation models. Beyond change detection, we believe our approach advances the field by permitting effective reuse of diverse pretrained task heads. Our code is publicly available at this https URL.
130. 【2611.02204】Learning from high-resolution 2D images to reconstruct 3D microstructures
链接：https://arxiv.org/abs/2611.02204
作者：Wenbo Sui,Lars P. Mikkelsen,Jens W. Andreasen,Daniel Lichau,Harold Phelippeau,Philip J. Withers
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：microstructure characterization remains, characterization remains difficult, required spatial resolution, time-consuming or destructive, Cross-modal Relational Distillation
备注：
点击查看摘要
Abstract:High-resolution three-dimensional (3D) microstructure characterization remains difficult to undertake at scale because volumetric imaging at the required spatial resolution is expensive, time-consuming or destructive. In many settings, however, fine-resolution two-dimensional (2D) imaging and lower-resolution volumetric measurements are both readily available. We introduce a Privileged Cross-modal Relational Distillation (PCRD) framework that leverages fine-resolution 2D observations during training to improve specimen-specific 3D reconstruction from lower-resolution volumetric imaging alone. We demonstrate PCRD on pultruded carbon fiber-reinforced polymer composites, using scanning electron microscopy as the privileged modality and micro-CT as the inference input. The framework transfers spatial organization by matching similarity distributions defined around corresponding spatial anchors in the teacher and student representations, avoiding direct alignment of heterogeneous feature vectors. In 2D cross-sectional reconstruction, PCRD improves mAP by 1.66 percentage points over direct micro-CT training. Independent 3D validation against high-resolution synchrotron X-ray CT data shows close agreement in fiber volume fraction, diameter and local spacing. The PCRD reconstruction matches 89.97% of the reference fiber centerline length, compared with 75.08% for the interpolated low-resolution volume.
131. 【2611.02203】Depth Anyviewpoint? Evaluating Monocular Depth Over Viewpoint Sequences
链接：https://arxiv.org/abs/2611.02203
作者：Theo Rode,Rui Zhang,Ryan Aubrey,Olivia Li,Jessica Huang,Liv Chu,Healani Dowd,Calden Wloka
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：single RGB images, Monocular depth, single RGB, RGB images, stereo camera pairs
备注：
点击查看摘要
Abstract:Monocular depth estimation aims to predict depth maps from single RGB images (forgoing the need for stereo camera pairs) and has seen impressive leaps in performance in recent work due to the introduction of affine-invariant losses and the use of foundation model features. These monocular depth models predict affine-invariant depth, which describes the relative positions of objects in the scene instead of absolute depth. While these models demonstrate strong performance on single image benchmarks and qualitatively consistent predictions in video, their effectiveness at preserving consistent spatial structure has been less thoroughly explored. Many potential real-world applications, such as handling video streams as input, rely on coherent three dimensional consistency in scenes. Further, anchoring relative depth predictions to a metric reference for a given scene is a key challenge for applying monocular depth models to real-world situations. We develop a novel evaluation protocol for monocular depth models using video sequences with moving camera positions to test the consistency of prediction across variation in viewpoint. We demonstrate this methodology over diverse, real-world video sequences where we are able to anchor depth model output to metric depth values using structure from motion. Our work demonstrates open challenges in the development of broadly applicable monocular depth foundation models, particularly with their ability to provide temporal consistency over long time frames. We also identify challenges in the straightforward adoption of structure-from-motion as a metric grounding tool for monocular depth estimation models.
132. 【2611.02197】A conditional generative model for T2-weighted prostate MRI with downstream evaluation in clinically significant cancer classificatio
链接：https://arxiv.org/abs/2611.02197
作者：Xavier Rafael-Palou(1),Alejandro Vergara-Richart(1,2),Ignacio Iborra Roncales(1),Carmen Prieto-de-la-Lastra(1),Andreu Antolin-Redondo(3,4),Juan Morote(4),Ana Jimenez-Pastor(1) ((1) Quantitative Imaging Biomarkers in Medicine (Quibim S.L.), Valencia, Spain, (2) Universitat Politècnica de València, València, Spain, (3) Department of Radiology, Institut de Diagnòstic per la Imatge (IDI), Hospital Universitari Vall d'Hebron, Barcelona, Spain, (4) Department of Surgery, Universitat Autònoma de Barcelona, Bellaterra, Spain)
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Scarce and unrepresentative, prostate MRI prediction, unrepresentative training data, training data limit, MRI prediction models
备注：
点击查看摘要
Abstract:Scarce and unrepresentative training data limit the performance of prostate MRI prediction models. Synthetic T2-weighted (T2W) MRI may augment training data containing clinically significant prostate cancer (csPCa) and transition zone (TZ) lesions. In this retrospective, single-center, ethics-committee-approved study, we developed a conditional generative model for T2W prostate MRI extending MAISI-v2 with csPCa class, zonal, and lesion-mask-guided conditioning, incorporating a relative advantage weighted loss fine-tuned on 1,303 patients (1,654 lesions). Fidelity was assessed by incremental ablation, and downstream utility was evaluated with T2W-based csPCa classifiers across five simulated training-data scenarios, each testing 18 synthetic-data configurations. The proposed model reduced Fréchet inception distance (FID) from 13.28 (pretrained MAISI-v2) to $2.04 \pm 0.06$ internally (PI-CAI: $3.83 \pm 0.51$). Synthetic augmentation significantly increased AUC in all five scenarios (+0.027 to +0.088; adjusted $p = 0.016$--$0.043$), though cross-institutional augmentation of PI-CAI yielded a non-significant gain (+0.013; $p = 0.397$). Overall, our model improved T2W MRI fidelity, and synthetic images improved csPCa classification under simulated data constraints, although benefit did not transfer significantly across institutions.
133. 【2611.02147】Refining Roadside 4D Radar Vehicle Classification Using Point-Cloud Dispersion
链接：https://arxiv.org/abs/2611.02147
作者：Mohammed Alsakabi,Andreia Figueiredo,António Almeida,John Dolan,Miguel Luís,Pedro Rito,Ozan Tonguz,Susana Sargento
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Intelligent Transportation Systems, Transportation Systems, Intelligent Transportation, Roadside sensing infrastructure, essential for Intelligent
备注：
点击查看摘要
Abstract:Roadside sensing infrastructure is essential for Intelligent Transportation Systems (ITS), but cameras and legacy sensors are limited in range, weather robustness, and depth accuracy. 4D radar complements these modalities by resolving range, azimuth, elevation, and radial velocity under adverse conditions, though its sparse, noisy point clouds make reliable classification difficult. We present a roadside multi-sensor platform combining a 4D radar and stereo depth camera under synchronized acquisition, used to collect a real-world dataset. Our analysis reveals a substantial class-distribution discrepancy between modalities, most notably a strong radar confusion between passenger cars and motorcycles (49.01% and\ 48.60% of the dataset). To address this, we propose a Neyman-Pearson-based binary classifier on the temporally-smoothed 2D positional standard deviation of radar point cloud clusters, reducing classification error from 52.1% to 42.7%. This lightweight and edge-deployable approach improves radar-only classification reliability and lays the foundation for future camera-radar fusion.
134. 【2611.02119】sting concept-level audits of melanoma classifiers with diffusion counterfactuals and matched positive controls
链接：https://arxiv.org/abs/2611.02119
作者：Md. Shohanoor Rahman,Md. Hasibul Islam,Md Kishor Morol,Moinul Hossain,Dip Nandi,Liew Tze Hui
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Concept-based explanations, Concept-based, controls, rarely tested, classifiers
备注： 25 pages, 7 figures, 9 tables. Under review at Scientific Reports. Code and data at [this https URL](https://github.com/srahman7900/melanoma-concept-audit)
点击查看摘要
Abstract:Concept-based explanations of melanoma classifiers are rarely tested against controls with known targets. We built a counterfactual audit from a diffusion model conditioned on seven 7-point checklist concepts and tested it with such controls. Colour-calibrated start noise reduced colour outliers from 78.5-84.8\% to 6.6-13.3\%. Four of seven knobs were target-dominant but also changed other concepts. Quartile-based positive controls were confounded, and the audit failed its pre-specified rule. It recovered the targets of all 16 controls matched on the generator's pseudo-labels and of 12 of 12 controls labelled by a second evaluator, for three concepts; concept activation vectors recovered fewer (11 of 16). In 18 permuted-label classifiers, significant sweep responses and target rankings also arose, whereas standardised effect margins separated the controls from these null classifiers. The pigmentation sweep raised the melanoma logit in 15 of 15 ISIC 2020 classifiers (+3.12 on average) and 6 of 6 HAM10000 classifiers (+4.01), about four times the null response in scale-free units; the regression effect did not transfer. An exploratory decomposition, evaluated against the controls, suggested that knob cross-talk partly hides vascular responses. Matched controls and null classifiers are practical checks of concept audits.
135. 【2611.02114】CNN-Based Retinal OCT Classification: Research Gap Analysis and a From-Scratch Baseline, ED126-A
链接：https://arxiv.org/abs/2611.02114
作者：Shkelqim Sherifi
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Optical Coherence Tomography, Coherence Tomography, images remains challenging, substantial inter-class similarity, Optical Coherence
备注： 18 pages, 26 figures
点击查看摘要
Abstract:Automated classification of retinal pathologies from Optical Coherence Tomography (OCT) images remains challenging because diagnostically relevant morphological patterns may exhibit substantial inter-class similarity. Although high classification accuracies have been reported on benchmark OCT datasets, cross-study comparison is limited by heterogeneous evaluation protocols and by the limited characterization of compact convolutional neural network (CNN) baselines trained from random initialization. This study addresses this gap through two contributions. First, it provides a focused review of CNN-based retinal OCT classification and identifies methodological considerations relevant to controlled benchmarking. Second, it presents ED126-A, a purpose-built four-class CNN baseline trained from scratch under a documented experimental protocol on the Kermany labeled OCT dataset. The model contains 1,241,380 total parameters, including 1,239,460 trainable parameters, and is evaluated using training-dynamics analysis, class-wise performance metrics, confusion-matrix analysis, confidence analysis, t-SNE representation-space visualization, Grad-CAM, hierarchical feature-map analysis, and one-vs-rest ROC/Precision-Recall analysis. On the image-level held-out test set, ED126-A achieved 95.03% accuracy, with a macro-F1 of 0.9205 and a weighted-F1 of 0.9521. The principal class-conditional limitation occurred for Drusen, which attained a recall of 0.9605 but a precision of 0.7493 and an F1-score of 0.8419. The confusion matrix identified Normal to Drusen and CNV to Drusen as major error channels. These results support the use of ED126-A as a documented from-scratch reference baseline and provide an empirical basis for controlled evaluation of transfer learning, increased depth, attention, multi-scale feature fusion, and calibration in subsequent studies.
136. 【2611.02101】When Delay Meets Drift: Physical Safety of Robot Foundation Models Is a Cross-Layer Problem
链接：https://arxiv.org/abs/2611.02101
作者：Liangkai Liu,Bimal Thapa Magar
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Emerging Technologies (cs.ET)
关键词：Robot foundation models, robustness benchmarks perturb, real-time execution methods, execution methods study, assuming instantaneous inference
备注： 11 pages, 3 figures
点击查看摘要
Abstract:Robot foundation models now act in a closed loop, yet their safety is evaluated one variation at a time: robustness benchmarks perturb the scene while assuming instantaneous inference, and real-time execution methods study inference delay in nominal scenes. We argue that physical safety is not a property of the model alone, but emerges from how variations in the physical environment, the model, the computing platform, and execution interact in closed loop. We formalize this as cross-layer variation propagation across these system layers and use an interaction contrast to measure when joint variation creates more risk than the sum of its parts. In 4,000 paired closed-loop episodes of the pi0.5 vision-language-action model on LIBERO, a 400 ms inference delay raises the safety-violation rate by 3.5 percentage points under the training viewpoint but by 37 percentage points under a 60-degree camera shift: 33.5 percentage points (95% CI: 25-43) more than the two effects combined. We close with a research agenda toward predictable physical intelligence: predicting when variation becomes risk, and adapting compute, power, and control accordingly.
137. 【2611.02096】EarthJev: Calibrated, Non-Generative Answers to Natural-Language Questions about Sentinel-2 Land Cover
链接：https://arxiv.org/abs/2611.02096
作者：Domenico Benfenati,Antonio Maria Rinaldi,Cristian Tommasino
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：remote sensing answer, sensing answer questions, Vision-language models, decoding loop, usable probability
备注： 16 pages, 1 figure, 5 tables. Code and model: [this https URL](https://github.com/CosmoIknosLab/EarthJev)
点击查看摘要
Abstract:Vision-language models for remote sensing answer questions about satellite images by generating text: every answer costs a decoding loop, has to be parsed back to an option, and comes without a usable probability. We present EarthJev, a 0.8B-parameter model that answers typed questions about multispectral Sentinel-2 patches without generating any token. All 12 bands enter the vision encoder of Qwen3.5-0.8B through a widened input layer initialised from the RGB kernels, and, following the open OneJev recipe, the answer is read from the logits of the option letters at a single position and trained with cross-entropy plus Brier score. Under a pre-specified analysis plan, we compare it with the same backbone fine-tuned to generate the answer and with three multimodal language models fine-tuned with LoRA, all trained on the same 70,890 questions from 5% of BigEarthNet v2.0 and timed in one job on the same GPU; VQA models that classify over a fixed answer vocabulary are reported as a reference for the cost of answering only the questions seen in training. EarthJev answers a question in 19.9 ms, 4.3 to 8.7 times faster than the multimodal language models and 6.8 times faster than its own backbone used generatively; when all the questions about an image are asked together, it answers them in 42.8 ms, 3.7 to 10.1 times faster than the batched generative models. On 36,028 test questions it reaches 86.0% accuracy (three seeds), 0.6 and 1.2 points below the two 2B multimodal models and 3.5 points below the remote-sensing EarthDial-4B, with answers that are valid by construction and calibrated probabilities (ECE 0.006). Replacing the nine non-RGB bands with their mean costs 4.5 points, so the model uses the multispectral input, and in an ablation training the whole vision encoder raises accuracy to 88.4% at the same cost. Code and model: this https URL
138. 【2611.02076】Scene-Adaptive Readout and Decoding in Diffusion Driving VLAs
链接：https://arxiv.org/abs/2611.02076
作者：Seungjun Yu,Jiho Choi,Inha Kang,Hojun Choi,Seungwook Kim,Hyunjung Shim
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Robotics (cs.RO)
关键词：models repeatedly execute, incurring substantial inference, substantial inference cost, models repeatedly, denoising stage
备注：
点击查看摘要
Abstract:Diffusion driving vision-language-action models repeatedly execute the backbone at every denoising stage, incurring substantial inference cost, while it remains unclear whether all scenes require the same decoding computation. To distinguish when a trajectory becomes readable from how much further refinement it requires, we analyze trajectory readout across network depth and decoding progress. We identify a depth-decoding dissociation in which late-layer representations already support useful trajectory readout after the first forward sweep, whereas early-layer representations benefit more from continued decoding. We further find that both the preferred readout layer and decoding depth vary across scenes. Based on these observations, we propose a scene-adaptive readout and decoding framework. A scene-conditioned readout MoE adaptively weights and combines trajectory predictions from layer-specific late-layer representations after a single backbone sweep, while an adaptive decoding policy applies additional native refinement only when required by the scene. We evaluate our framework on two diffusion driving VLAs across the Waymo E2E and nuScenes benchmarks. Our method improves validation RFS by up to 0.56 while also improving test performance, and achieves an end-to-end speedup of up to $6.0\times$ on Waymo E2E, while consistently reducing trajectory error on nuScenes. These results demonstrate that scene-level readout and decoding allocation improves planning quality while avoiding unnecessary decoding. Our code is available at this https URL
139. 【2611.02056】Do Embodied VLMs Actually Use Their Scene-Graph Memory?
链接：https://arxiv.org/abs/2611.02056
作者：Shubh Garg,Divyansh Pandey,Vedant Khandelwal,Niyati Rawal,Amit Sheth
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：natural form, graph, Embodied agents, VLM, memory
备注：
点击查看摘要
Abstract:Embodied agents that answer questions about their route need a memory of what they saw, and scene graphs are a natural form for it. A vision-language model (VLM) can receive such a graph as text or through a graph encoder, but accuracy alone cannot show whether the graph holds the episode's facts, reaches the model, or is actually relied on. In this diagnostic study, we introduce a graph-swap test for the last of these: each episode is given another episode's graph, and we count how many answers change. On an embodied question-answering benchmark with routes through two to seven rooms, we use it to compare ways of delivering scene-graph memory to a fine-tuned VLM. As text, the memory is used strongly, adding 30 points on route questions. As a graph, it is not, and we trace why: the encoder preserves the information, but standard pooled and late fusion discard it. Giving each node its own input token recovers part of it, a gain of 8.3 points on route questions that the swap test confirms comes from the graph. The test also exposes a shortcut that accuracy hides: when the same facts appear in the text, the model ignores its graph. The test thus offers a cheap check of whether a VLM uses its scene-graph memory, and our analysis points to how that memory should be delivered.
140. 【2611.02053】Learning to Look: A Foundation for Visual Understanding
链接：https://arxiv.org/abs/2611.02053
作者：Wenshuai Zhao,Yihao Wang,Benjamin Robson,Juho Kannala,Arno Solin
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Vision-language models, Vision-language, visual hallucination, image, visual input
备注： 15 pages, 7 figures
点击查看摘要
Abstract:Vision-language models (VLMs) suffer from visual hallucination, such as saying an object that is not present in an image. We ask a more fundamental question: whether a VLM is even aware of where it is looking before understanding the semantic meaning in the image. We formulate this question as a LOOK task: identifying which parts of its visual input were available to the model. We construct the task in a self-supervised way without manually labeling the available region to the model. Our experiments show that existing VLMs fail to localize the visible region. We further show that fine-tuning VLMs on the proposed LOOK task improves a model's awareness of visual input.
141. 【2611.02051】UniGS-SLAM: Monocular Gaussian SLAM with Enhanced Geometry and Open-Vocabulary Semantics
链接：https://arxiv.org/abs/2611.02051
作者：Xingyuan Ding,Sicheng Yu,Kaiyong Zhao,Hao Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：reconstruct scene geometry, RGB observations, semantic SLAM aims, aims to reconstruct, reconstruct scene
备注： 23 pages, 9 figures
点击查看摘要
Abstract:Monocular semantic SLAM aims to reconstruct scene geometry and build semantic maps from RGB observations. Existing Gaussian-based methods often attach semantic labels or features to evolving Gaussian primitives, making semantic fusion difficult to maintain and increasing reconstruction overhead. Hybrid Gaussian--voxel representations provide more stable semantic support, but often rely on RGB-D input or known poses and do not revise historical semantic evidence after geometry updates. We present UniGS-SLAM, an RGB-only framework that decouples open-vocabulary semantics from Gaussian reconstruction while preserving bidirectional interaction. Foundation priors enhance monocular depth and pose estimation, while semantic observations are fused into an independent sparse voxel map with observation provenance, enabling historical contributions to be revised as reconstruction evolves. The fused semantics further guide Gaussian filtering and local surface refinement. Experiments on Replica, ScanNet, and KITTI-360 show leading tracking, rendering, and geometric reconstruction performance among representative RGB-only methods, together with strong open-set semantic mapping on Replica and ScanNet. We also achieve a 2.37-fold reconstruction speedup over the fastest compared semantic SLAM baseline. Project page: this https URL.
142. 【2611.02044】Unified Loss-Aware Density Control for 3D Gaussian Splatting
链接：https://arxiv.org/abs/2611.02044
作者：Tae-Young Kim,Jiwoo Chung,Jae-Pil Heo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Splatting critically depend, Gaussian Splatting critically, Splatting critically, Gaussian Splatting, efficiency and fidelity
备注： Accepted to NeurIPS 2026
点击查看摘要
Abstract:The efficiency and fidelity of 3D Gaussian Splatting critically depend on adaptive density control, which grows and suppresses Gaussian primitives throughout optimization. However, the standard pipeline still relies on heuristic view-space gradients, scale thresholds, and global opacity resets, rather than explicitly assessing the loss-reducing effect of each split, clone, or opacity update. This mismatch can allocate primitives to already-sufficient regions, miss under-reconstructed structures, and destabilize training through blanket opacity changes. In this work, we recast adaptive density control as a collection of local loss-reduction decisions. We derive efficient Taylor-based per-Gaussian surrogates that predict the objective change caused by three primitive-level operations: splitting, cloning, and opacity decay. This yields a unified loss-aware framework with three components. First, we extend second-order splitting to a normalized joint position-scale space, enabling children to adapt not only their locations but also their anisotropic extents. Second, we formulate duplicate cloning as a surrogate minimization problem, selecting only Gaussians whose duplicated contribution is predicted to improve reconstruction and assigning each child a principled opacity. Third, we replace global opacity reset with selective soft opacity decay that weakens harmful primitives while preserving useful ones. Across standard 3DGS benchmarks, our method produces more targeted primitive allocation and achieves improved rendering quality with comparable or smaller Gaussian budgets compared to baselines.
143. 【2611.02037】Scalar Smoothness Is One Point on a Besov Spectrum
链接：https://arxiv.org/abs/2611.02037
作者：Bum Jun Kim,Anastasis Kratsios
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：neural network generalization, Studies of neural, Lipschitz constants summarize, Hessian statistics summarize, Hessian curvature statistic
备注： 83 pages, 10 figures
点击查看摘要
Abstract:Studies of neural network generalization and robustness often summarize smoothness with a single number, such as a Lipschitz constant or a Hessian curvature statistic. However, Lipschitz constants summarize global worst-case sensitivity and Hessian statistics summarize local curvature; neither captures how model responses vary with the size, direction, and location of perturbations encountered in real-world deployment. To measure smoothness under these perturbations, we introduce a finite-difference roughness spectrum that profiles model responses across these conditions. Our roughness spectrum generalizes scalar smoothness measures, bringing Lipschitz sensitivity and directional Hessian curvature into a common framework across perturbation scales. We connect this spectrum to classical Besov theory, which describes how a function's variation changes with scale. Our theoretical analysis also proves that a larger output shift can cause less task damage than a smaller one, and that local curvature alone can miss the blocks most vulnerable to finite perturbations. In image classification, Roughness Source Control (RSC) suppresses margin roughness along noise directions and improves noise robustness in a comparison of 80 checkpoints across four model--dataset combinations. In post-training quantization, we identify blocks that need higher precision by measuring task-loss increases from perturbations matched to the size and direction of each block's quantization error. Our mixed-precision allocation achieves lower perplexity than the Hessian-based HAWQ-V2 baseline under the same GPTQ weights and bit budgets in all 14 settings across seven held-out large language models.
144. 【2611.02034】4D Triangle Splatting Reconstruction of Dynamic Endoscopic Scenes from Monocular Videos
链接：https://arxiv.org/abs/2611.02034
作者：Laura Salort-Benejam,Stamatia Giannarou,Antonio Agudo
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：unknown camera trajectories, remains challenging due, non-rigid tissue deformation, due to non-rigid, non-rigid tissue
备注： Off-Grid; MICCAIW 2026
点击查看摘要
Abstract:Robust 4D reconstruction of deformable endoscopic scenes from monocular videos remains challenging due to non-rigid tissue deformation, illumination changes, occlusions, and unknown camera trajectories. Reliable dynamic reconstruction of endoscopies could significantly enhance visualization, diagnostic accuracy and intraoperative guidance of minimally invasive procedures. We propose SurgicalTS, a self-supervised triangle-splatting framework for dynamic endoscopic scene reconstruction from static monocular cameras. The scene is represented by a canonical set of triangles jointly optimized with a deformation network. We introduce a quaternion-based deformation model, an improved color parametrization, spatio-temporal priors, and a redefined initialization strategy that improves completeness under occlusions. Extensive evaluation on challenging in-vivo endoscopy videos from diverse procedures shows that SurgicalTS successfully models soft-tissue deformations and tool-tissue interactions over time, while consistently outperforming state-of-the-art methods. Our method also reduces training times while maintaining competitive geometric and photometric accuracy results, highlighting the effectiveness of quaternion-based deformation modelling with physical consistency for robust and efficient 4D reconstruction of endoscopic scenes.
145. 【2611.02026】Reconstruction as Spatial Evaluation: Diagnosing Cross-View Spatial Intelligence in Large Vision-Language Models
链接：https://arxiv.org/abs/2611.02026
作者：Junfei Wu,Qiuyue Wang,Xuhong Huang,Qihang Peng,Mingsheng Li,Jian Guan,Qiang Liu,Shu Wu,Liang Wang,Shuai Bai,Tieniu Tan
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：local visual observations, combine local visual, large vision-language models, geometrically consistent representation, requires the ability
备注： 36 pages, 12 figures, including appendices
点击查看摘要
Abstract:The spatial intelligence of large vision-language models (LVLMs) requires the ability to combine local visual observations into a geometrically consistent representation of the physical world. Many static benchmarks assess isolated spatial judgments, such as relative direction or distance, while interactive embodied evaluations combine perception with exploration, planning, control, and simulator-specific execution. To bridge this gap, we introduce RECONSPATIAL, a benchmark centered on multi-view 3D scene reconstruction across indoor, tabletop, and outdoor environments. Given real multi-view images and target-object queries, LVLMs are required to jointly predict oriented 3D bounding boxes in a shared, camera-anchored metric coordinate frame. Reconstructions are evaluated along two complementary axes: Structure for relative layout and Metric for physical scale and camera-anchored placement. Nine atomic spatial QA tasks, grouped into Geometric Perception and Spatial Relations, probe spatial capabilities involved in joint reconstruction. Offline navigation extends evaluation to path planning. Evaluation of 18 frontier LVLMs reveals a consistent gap between relative scene structure and metric reconstruction; even GPT-6-Astra scores 81.4% on Structure but only 58.7% on Metric. Tracing this gap, diagnostic analyses link atomic spatial capabilities to reconstruction quality and show that relational consistency alone does not ensure metric accuracy. Experiments with 3D map injection further separate scene construction from path planning, revealing how these geometric errors limit navigation success. Finally, spatial fine-tuning yields broad transfer across both spatial and general vision-language benchmarks.
146. 【2611.02008】NAS-PO: Native Attention-Strategy Policy Optimization for Vision-Language Models
链接：https://arxiv.org/abs/2611.02008
作者：Ke An,Shizhe Xiang,Yue Liu,Liang Chen,Pei Fu,Shaojie Zhang,Xiaoxing Hu,Yupei Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：effective post-training paradigm, Reinforcement learning, verifiable rewards, learning with verifiable, effective post-training
备注：
点击查看摘要
Abstract:Reinforcement learning with verifiable rewards (RLVR) has become an effective post-training paradigm for vision-language models (VLMs). Standard RLVR, however, assigns identical outcome-derived credit to all generated tokens regardless of their perceptual relevance. Recent perception-aware methods estimate visual reliance through image perturbation or masking. These indirect proxies require perturbation branches, while corruption sensitivity does not necessarily identify the visual evidence used for reasoning. We instead shape model perception through native attention, an intrinsic model signal. Rather than treating attention as a post-hoc explanation, we formulate it as a reward-anchored, token-aligned routing signal that encourages attention patterns supporting visually grounded reasoning. To this end, we propose NAS-PO, a Native Attention-Strategy Policy Optimization framework. NAS-PO analyzes native attention with a visual mass policy that quantifies visual allocation and a conditional visual policy that captures spatial routing over visual tokens, making the optimization well-posed. Based on this, Native Attention-Strategy Advantage Shaping (NAS-AS) draws on the visual-mass policy to redistribute signed policy-gradient credit for visually engaged rollouts. The Adaptive Attention-Coupled (AAC) loss then aligns the visual-mass policy on all response tokens and the conditional visual policy on visually active ones, consolidating the visual-routing patterns that drive successful trajectories. Experiments demonstrate that NAS-PO substantially surpasses leading RL-tuned VLMs across 7 out-of-domain reasoning and perception benchmarks, with its effectiveness consistently validated across 8B and 32B. Visual-Routing Sensitivity (VRS) analysis further indicates that the optimized attention prioritizes visually load-bearing regions.
147. 【2611.01990】Synthetic Realities: Evaluating Human Ability to Distinguish AIGenerated Videos from Real Footage
链接：https://arxiv.org/abs/2611.01990
作者：Danyal Sarfraz,Raja Mubashar Karim,KwanMyung Kim
类目：Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)
关键词：enabled multiple pathways, Recent advances, high-fidelity video synthesis, advances in generative, enabled multiple
备注： Published in Proceedings of IASDR 2025
点击查看摘要
Abstract:Recent advances in generative AI have enabled multiple pathways for high-fidelity video synthesis: text-to-video, image-to-video animation, and video outpainting. Empirical side-by-side evaluations of how untrained viewers perceive and distinguish these outputs from real footage remain scarce. In this study, we systematically compare human detection accuracy across these three AI generation techniques within three thematic contexts: historical footage, film and media content, and natural environments. We constructed a balanced stimulus set comprising equal amounts of real and AI-generated videos (18 each). The AI clips were evenly distributed across the three generation methods using Google's Veo 3, Lightricks LTX Video, and Wan VACE. All videos were produced and standardized within the ComfyUI framework to ensure consistent quality and duration. 87 participants judged every clip in a binary forced-choice task ("real" vs. "AI-generated"). Participants correctly identified videos 60% of the time on average. Image-to-video clips were recognized most accurately (79%), followed by real footage (64%), outpainting (49%), and text-to-video (43%). Accuracy also varied by theme: film and historical scenes yielded higher detection rates than environmental clips, which were frequently mistaken for AI. Logistic regression confirmed significant effects of both technique and theme as well as their interaction (p 0.001), indicating that detection success depends jointly on how the content was generated and what it depicts. Findings reveal a consistent bias toward assuming synthetic origins and highlight that perceptual realism in AI video is shaped more by context than by model type, underscoring the importance of media-literacy approaches and context-aware evaluation tools for navigating increasingly synthetic visual media.
148. 【2611.01982】SurgStream: A Workflow-Anchored Proactive Streaming Framework and Benchmark for Real-Time Surgical Video Understanding
链接：https://arxiv.org/abs/2611.01982
作者：Ruipeng Ma,Qing Xu,Jie Liang,Zhen Chen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Surgical video understanding, workflow monitoring, instrument preparation, essential for intraoperative, Surgical video
备注：
点击查看摘要
Abstract:Surgical video understanding is essential for intraoperative assistance such as workflow monitoring, instrument preparation and procedural documentation. Delivering such assistance in real time requires a model to jointly perceive the ongoing scene, remember past surgical events, and respond before clinically relevant moments pass. Existing approaches provide limited support for jointly retaining procedural evidence and deciding when to respond in streaming surgical video. In this work, we propose SurgStream, a workflow-anchored proactive streaming framework for real-time surgical video understanding. We first introduce Workflow-Anchored Memory (WAM) to record structured instrument-action-target observations and fold them into phase-level summaries, providing compact and queryable surgical memory. Deadline-aware Transition Learning (DTL) is then devised to supervise response states within clinical windows, enabling timely responses before procedural deadlines. We further introduce SurgStream-Bench, comprising 11.7K streaming interactions across various tasks covering real-time perception, backward memory queries, forward proactive QA, proactive alerts and caption memory. Experiments on SurgStream-Bench show gains over state-of-the-art methods, especially in memory and forward proactive QA. The source code will be available.
149. 【2611.01978】Multimodal BVP and Respiration for Automated Pain Recognition with Hankel-FCN
链接：https://arxiv.org/abs/2611.01978
作者：Valentina Becchetti,Muhammad Umar Khan,Stefanos Gkikas,Alessandro Giuseppi,Raul Fernandez Rojas
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Automated pain recognition, empathetic human-computer interaction, Automated pain, Blood Volume Pulse, human-computer interaction
备注：
点击查看摘要
Abstract:Automated pain recognition is a fundamental challenge for the advancement of clinical care and empathetic human-computer interaction, due to the subjective and dynamic nature of pain. In this study, we propose a deep learning framework for objective pain assessment based on multimodal physiological signals from the AI4Pain dataset. The approach focuses on Blood Volume Pulse (BVP) and Respiration (RESP), capturing complementary aspects of autonomic responses to nociceptive stimulation. To explicitly model their temporal dynamics, the signals are transformed into structured trajectory representations using Hankel matrix embeddings, enabling the learning of dynamical patterns beyond conventional time-series representations. These embeddings are processed by modality-specific Fully Convolutional Networks, and their outputs are integrated through a late fusion strategy for three-class classification (No Pain, Low Pain, High Pain). Experimental results demonstrate that the proposed method achieves an accuracy of 67.09% and an F1-score of 66.41%, providing competitive performance compared to existing approaches, while relying on no handcrafted feature engineering. Multimodal fusion significantly outperformed either modality alone, and the Hankel embedding showed a trend towards further improvement. Further validation is required to establish generalisability to broader populations and clinical settings.
150. 【2611.01974】MUPA${}^2$S: Multimodal Unified Perception with Asymmetric Attention for Stress Assessment
链接：https://arxiv.org/abs/2611.01974
作者：Stefanos Gkikas,Thomas Kassiotis,Yu Fang,Christian Arzate Cruz,Miao Cheng,Zongyi Jiang,Zacharias Kamarianakis,Houshyar Asadi,Randy Gomez,Raul Fernandez Rojas,Giorgos Giannakakis
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：mental health decline, health decline, leading contributor, contributor to long-term, long-term physical
备注：
点击查看摘要
Abstract:Stress is a leading contributor to long-term physical and mental health decline. The automatic assessment of stress is a promising approach for continuous monitoring and mitigating human biases. However, the development of automated systems remains challenging due to the heterogeneity of physiological and behavioral signals. This paper presents MUPA${}^2$S, a multimodal framework for automatic stress assessment that combines facial video and ECG signals within a unified perception architecture. Both modalities are mapped into a shared token representation without modality-specific components, and processed through asymmetric attention comprising segment-local cross-attention and global self-attention across segment states. Experiments on a newly collected 58-subject stress dataset, evaluated under a stratified subject-level protocol, show that facial video achieves 69.44% test accuracy, while ECG-only performance remains close to chance under the proposed representation. Unified Video-ECG fusion achieves a test accuracy of 69.58% at approximately half the number of parameters of feature-level fusion, with negligible additional computational cost. Feature-level fusion does not exceed the video-only baseline, while unified input-level integration provides a parameter-efficient mechanism for jointly processing the two modalities.
151. 【2611.01970】Knowledge-Guided Floodwater Level Reasoning for Cloud-Edge Collaborative Monitoring
链接：https://arxiv.org/abs/2611.01970
作者：Zhengshu Zhou,Shaoyu Wang,Ziyi Geng,Lu Tao,Qian Long
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Frequent urban floodwater, Frequent urban, urban floodwater poses, intelligent transportation systems, efficiency of intelligent
备注：
点击查看摘要
Abstract:Frequent urban floodwater poses a serious threat to the safety and efficiency of intelligent transportation systems. Existing vision-based methods for floodwater level detection face two main limitations. First, the lack of explicit reasoning leads to poor detection performance and little interpretability. Second, these methods struggle to generalize to the complex and varied real-world road scenes seen from different viewpoints. To address this, we reformulate the task as an explicit visual reasoning problem and propose HydroReasoner, a floodwater level reasoning framework designed for cloud-edge collaboration. HydroReasoner builds on Qwen2.5-VL and is trained with Group Relative Policy Optimization. To address the scarcity of reasoning process annotations, we build a floodwater domain knowledge graph HydroKG and design a novel KG path reward. Through deterministic graph traversal over HydroKG, this reward supervises the model's reasoning process at a fine granularity, which improves both reasoning and generalization. For edge deployment, we apply 4-bit quantization to the model, cutting GPU memory usage by 57% and inference latency by 43% while out-of-domain accuracy drops by only 0.2 percentage points. We also propose a confidence-based cloud-edge routing mechanism, which improves system safety and eases the computational load on the cloud. In addition, we build HydroLevel, a floodwater benchmark dataset of 3,000 images, for training and evaluating the model. Experimental results show that HydroReasoner achieves detection accuracy 4.0 and 13.6 percentage points higher than conventional vision baselines in the in-domain and out-of-domain evaluations respectively, with performance dropping by only 4.4 percentage points out of domain.
152. 【2611.01962】Object-Only Is Not Context-Free: A Counterfactual Diagnostic for Context Removal in Object Retrieval
链接：https://arxiv.org/abs/2611.01962
作者：Boaz Meivar,Shai Avidan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Object-centric retrieval pipelines, pooling backbone features, Keyhole Aperture Probe, Object-centric retrieval, background before pooling
备注： Accepted at WACV 2027. 8 pages plus references and supplementary material (15 pages total). Code and adapter checkpoints: [this https URL](https://github.com/bmeivar/kap)
点击查看摘要
Abstract:Object-centric retrieval pipelines often mask the background before pooling backbone features, aiming for a descriptor that reflects the object rather than its scene. Whether this truly yields an object-only descriptor, however, is rarely tested. We introduce the Keyhole Aperture Probe (KAP), a counterfactual diagnostic that repurposes the ground-truth masks of existing panoptic segmentation datasets (COCO, ADE20K) for retrieval: it holds the pooled object region fixed and varies only the pixels outside it, summarizing a backbone's context dependence in a single number. We find that the pooled object region has already integrated its surround. Replacing the context, with a neutral fill or even a different real scene, changes the descriptor, and when retrieval fails under a blank fill, the descriptor matches plain-background images rather than its own object. Object-only is not context-free. Across ten modern backbones, object-only descriptors retain only about a quarter to two-thirds of their full-image accuracy, and the effect is not unique to Transformer self-attention: a convolutional backbone shows it too. The dependence is also reducible: a lightweight adapter that encourages the descriptor to stay stable as context is removed lowers it and improves full-image instance retrieval on INSTRE, transferring to ILIAS with accuracy improved or preserved. A matched contrastive-fine-tuning control does not reproduce those gains. We release KAP as a simple, backbone-agnostic evaluation protocol to measure and reduce this dependence before deployment.
153. 【2611.01960】Event-Based Optical Flow Constraint via Time-Sliced Plane Fitting
链接：https://arxiv.org/abs/2611.01960
作者：Masaki Koike,Yusuke Kameda,Shunichi Sato,Takayuki Hamamoto
类目：Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)
关键词：assumes constant velocity, inherently assumes constant, approximation inherently assumes, Event-based optical flow, spatiotemporal planar approximation
备注： 5 pages, 5 figures, 1 table. Accepted for publication at IEEE VCIP 2026 (2026 IEEE International Conference on Visual Communications and Image Processing). (c) 2026 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses
点击查看摘要
Abstract:Event-based optical flow estimation using spatiotemporal planar approximation inherently assumes constant velocity and tends to average out temporal velocity variations. In this paper, we propose a flow estimation method that extends this planar approximation along the temporal axis. The resulting event-based optical flow constraint allows existing variational optical flow formulations to model temporal motion variation. Specifically, we partition the space-time volume into sub-intervals and apply a two-step planar approximation to track object edges consistently. Moreover, a spatial compensation mechanism and a temporal regularization term are incorporated to compensate for edge displacements and temporally stabilize the flow estimation, respectively. The experimental results show that modeling temporal motion variation improves flow estimation accuracy over conventional methods.
154. 【2611.01958】Answering Without Arriving: An Evidence Audit for Embodied Question Answering
链接：https://arxiv.org/abs/2611.01958
作者：Shubh Garg,Divyansh Pandey,Niyati Rawal,Vedant Khandelwal,Amit Sheth
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Embodied question answering, Embodied question, answer, question answering, questions
备注： 19 Pages, 3 figures, 11 tables
点击查看摘要
Abstract:Embodied question answering asks an agent to navigate, observe, and then answer questions about what it saw, yet answer accuracy alone cannot tell whether any of this happened. A plausible answer can come from the question, the room label, or the answer choices, and a correct answer does not show that the supporting observation was ever made. We present a multi-room benchmark whose 200 test episodes and 800 questions are stratified by route extent, with an evaluation ladder that holds the questions fixed while varying only the evidence supplied to the answerer, from text-only probes through closed-loop agents to replay of the reference trajectory. Questions are generated from symbolic records of rooms, visible objects, and frames, so every answer can be traced to the observations that support it. A closed-loop vision-language agent reaches no target in 200 episodes yet answers 45.5% of questions, within 0.1 points of the same model given no images; replaying the reference trajectory raises the same model to 57.4%, so the evidence exists along the route but is not gathered. A family-level audit then shows that access to evidence is not the same as use of it. Four of eight families are largely answerable from text, one cites frames that cannot establish its own answer, and the oracle conditions reach 59.5% on Rooms-visited by counting the supplied images. Evidence acquisition, answer coverage, and shortcut sensitivity must therefore be established before an accuracy gain can be credited to memory.
155. 【2611.01939】VLSplat: Vision-Language Guided Object-Centric 3D Gaussian Splatting via Scene Graph
链接：https://arxiv.org/abs/2611.01939
作者：Yuntae Jeon,Younho Jeon,Sujin Jin,Sungho Jo,Seunghee Park
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Learning semantic representations, Gaussian Splatting, Learning semantic, recently emerged, promising direction
备注： Accepted to NeurIPS 2026. Project page: [this https URL](https://vlsplat.github.io/)
点击查看摘要
Abstract:Learning semantic representations for 3D Gaussian Splatting has recently emerged as a promising direction for 3D scene understanding. However, existing 2D-to-3D semantic lifting approaches rely primarily on 2D segmentation supervision and lack object-level priors, causing the learned representation to be driven by local mask evidence rather than holistic object structure. In this paper, we present VLSplat, a vision-language guided approach for object-centric semantic lifting in 3D Gaussian Splatting. Our method augments mask-based lifting with object-level semantic priors derived from vision-language models and refines Gaussian representations using an object-group scene graph. The refinement is performed through two language-guided modules: intra-group refinement suppresses semantic noise within object groups, while inter-group acquisition expands object support regions by incorporating structurally relevant candidates from neighboring groups. Extensive experiments on indoor scene datasets demonstrate that VLSplat improves the semantic consistency and structural completeness of object-level categories. Our code and models are available at this https URL.
156. 【2611.01937】Spade-SLAM: Sparse Correspondence Anchors for Dense Self-Supervised Visual SLAM
链接：https://arxiv.org/abs/2611.01937
作者：Julian Philipp Schmitt,Weirong Chen,Ganlin Zhang,Felix Wimbauer,Daniel Cremers
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：long-standing performance gap, visual SLAM framework, dense visual SLAM, zero-shot setting, self-supervised dense visual
备注：
点击查看摘要
Abstract:We introduce Spade-SLAM, a self-supervised dense visual SLAM framework that substantially narrows the long-standing performance gap to supervised methods in a zero-shot setting. By demonstrating that high-fidelity tracking can be achieved without explicit ground-truth pose and depth labels, our approach offers a highly effective and label-efficient alternative to fully supervised pretraining. Our core contribution is a complementary sparse-to-dense training regime: While a warping-based photometric loss provides a dense training signal, we stabilize the optimization and suppress drift in ambiguous regions using a sparse correspondence loss derived from image feature matches. Extensive experiments demonstrate that Spade-SLAM significantly improves robustness and accuracy compared to existing self-supervised baselines, closely rivaling SLAM systems trained with explicit pose and depth supervision. The code will be made publicly available at this https URL.
157. 【2611.01934】riPhysBench: Evaluating Physical Intelligence for Embodied Agents
链接：https://arxiv.org/abs/2611.01934
作者：Zhongxiang Sun,Chenghao Yang,Haojie Ding,Boheng Zhang,Fan Yang,Qingsong Wen,Kun Wang
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：physical, intelligence to understand, understand their surroundings, physical perception, knowledge retrieval
备注：
点击查看摘要
Abstract:Embodied agents need physical intelligence to understand their surroundings through physical perception, physical knowledge retrieval, and physical reasoning. These capabilities must work together to interpret events and make quantitative judgments. Existing benchmarks advance physical understanding and general-purpose tool use, yet the coordination of these capabilities in physical scenarios remains insufficiently characterized. Inspired by Popper's Three Worlds, we introduce TriPhysBench, a benchmark of 410 questions from 200 videos that brings physical perception, physical knowledge retrieval, and physical reasoning into a shared evaluation setting. Its measurement-grounded and knowledge-grounded subtasks impose complementary demands on obtaining observations and acquiring external specifications, then applying them to quantitative problems. Among six representative vision-language models, the best achieves an answer accuracy of only 50.38%, revealing limited performance on tasks that require these capabilities to work together. We further introduce TriPhys, a framework that learns a unified policy for physical perception, knowledge retrieval, and quantitative reasoning from complete tool-integrated trajectories. The policy uses intermediate reasoning to guide retrieval and computation, then incorporates tool feedback into subsequent physical inference. On 110 questions from videos excluded from training, TriPhys improves answer and solution scores across three Qwen configurations, with a 17.7% relative gain in answer accuracy for TriPhys-27B over its Qwen3.6-27B backbone. This work provides a benchmark and a learning pathway toward embodied agents that move beyond recognizing events to understanding and reasoning about the physical processes behind them.
158. 【2611.01921】Vision-language classification of Torsades de Pointes risk from pseudo-coloured ECG images: do T-wave morphology and colour context help or hinder?
链接：https://arxiv.org/abs/2611.01921
作者：Dario Labrador Alonso,Alaa Alahmadi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Contextual prompting, prompting is widely, widely presented, cheap route, performance from vision
备注：
点击查看摘要
Abstract:Contextual prompting is widely presented as a cheap route to better performance from vision models, but the evidence comes largely from benchmarks in which an attribute named in a prompt is also present in the image, confounding the two channels. We investigate the significance of context for a semantically complex biomedical signal classification task using a domain-adapted vision-language model, BiomedCLIP. Building on our previous work that renders electrocardiogram (ECG) signals as colour-enhanced images to flag Torsades de Pointes risk using the QT-nomogram and pseudo-colouring technique, we cross four context strategies with four T-wave morphology label sets, evaluated zero-shot and with a class-balanced linear probe, under five-fold stratified cross-validation on 9,789 images. Zero-shot inference is unusable. Once trained, the colour-enhanced images outperform the colourless ones on every metric: balanced accuracy 0.903 versus 0.825, sensitivity 0.914 versus 0.827, specificity 0.892 versus 0.823, ROC-AUC 0.955 versus 0.888 and Matthews correlation coefficient (MCC) 0.437 versus 0.311. Crossing colour-in-image with colour-in-prompt separates the confounded channels: the image contributes +0.126 MCC (+0.078 balanced accuracy, +0.067 ROC-AUC) whether or not the prompt names colour, whereas naming it changes nothing under any metric. Context is two-sided: the best prompt set gains 0.008 MCC where colour is present and 0.016 where it is not, while the worst loses 0.017 and 0.013. For a signal rendered as an image, the leverage lies in how the signal is drawn rather than in how it is described - and where the endpoint is an interval measurement, prompts naming T-wave morphology describe the wrong quantity.
159. 【2611.01913】SurgQ-VLM: Question-Conditioned Dual-Stream Compression and Answer-Type-Aware Reinforcement for Surgical Video Question Answering
链接：https://arxiv.org/abs/2611.01913
作者：Dhruv Makwana,Ananya Mantravadi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：underpins operative documentation, workflow analysis, phase is underway, instruments act, events occur
备注： Accepted to WACV 2027 (Applications track). 16 pages: 8-page main paper, references, and supplementary material. Code: [this https URL](https://github.com/DhruvMakwana/SurgQ-VLM) ; Weights: [this https URL](https://huggingface.co/dhruvmakwana/SurgQ-VLM-7B)
点击查看摘要
Abstract:Reasoning about surgical video -- which phase is underway, which instruments act, and when events occur -- underpins operative documentation, workflow analysis, and skill assessment. Yet surgical visual question answering is still largely built on single frames and closed labels that cannot express a duration, an ordering, or a count, and the video models that lift the frame limit typically compress every clip the same way regardless of the question, discarding the temporal evidence the answer needs. Worse, the answers are structurally heterogeneous, spanning five incompatible structures -- binary, classification, multi-label, counting, and sentence-temporal -- that no single training signal scores uniformly well. We propose SurgQ-VLM, a two-stage model for surgical video question answering. Stage 1 trains a question-conditioned dual-stream (slow/fast) compressor for a LoRA-adapted Qwen2.5-VL-7B: cross-attention conditions both streams on the question, and each clip's visual tokens shrink 49x from the raw ViT patches (11x vs. post-merge backbone tokens). Stage 2 post-trains with GRPO under an answer-type-aware reward that scores each question on the metric matching its answer structure (micro-F1 for label sets, normalised error for counts, a content-timing blend for temporal windows). On a sealed 21,840-question test split over Cholec80 and CholecT50, SurgQ-VLM reaches 0.779 keyword accuracy and a 10x BLEU-4 gain over zero-shot; GRPO adds 2.5 pp K-Acc (2.0 pp attributable to the answer-type-aware reward), concentrated in the structurally hard types, with answer format unchanged (ROUGE-L). Code is available at this https URL.
160. 【2611.01907】Online Active Learning Architecture for Safety-Critical Control Systems
链接：https://arxiv.org/abs/2611.01907
作者：Shuiwen Shen,Jinhua Zhang,Yan Wang,Huanqiang Zeng,Yueyun Xu,Song Gao,Haifeng Xiang,Yifu Shen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：conventional offline-training paradigms, information-centric artificial intelligence, Online Active Learning, open-world environments, information-centric artificial
备注： 16 pages, 10 figures
点击查看摘要
Abstract:The transition of information-centric artificial intelligence to safety-critical applications is impeded by the limitations of conventional offline-training paradigms in open-world environments. This paper presents Control AI, an architecture for Online Active Learning (OAL) inspired by the continuous Prediction-Evaluation-Correction process of biological intelligence. The framework combines the hierarchical representation capacity of deep neural networks with the real-time error-feedback adaptation of adaptive control. A prediction model maps sensory input into a latent manifold, an optional latent model represents transitions in that space, and a reconstruction model maps the latent state back to observable signals. Residuals between predictions and measurements provide the internal learning signal. Spatial and temporal cross-reconstruction architectures prevent OAL from collapsing to a trivial identity mapping, while coupled, dual, and localized variants shorten error-transmission paths. Localized predictive coding style OAL is implemented through guidance-backpropagation and target-backpropagation architectures, and hybrid and scaled variants support high-dimensional deployment. The paper focuses on the architectural rationale and the progression from a conceptual feedback loop to practical large-scale configurations.
161. 【2611.01902】raining-Free Motion-Corrected 3D Brain MRI Reconstruction via Event-Guided References
链接：https://arxiv.org/abs/2611.01902
作者：Wei Jiang,Hongli Chen,Tianyi Ding,Feng Liu,Nan Ye,Hongfu Sun
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：bias structural measurements, brain MRI, Head motion, structural measurements, bias structural
备注：
点击查看摘要
Abstract:Head motion causes artefacts in 3D brain MRI and can bias structural measurements. Model-based correction alternates between image and motion estimation, but artefacts in the reconstructed reference can reinforce motion errors. Learned priors can reduce these artefacts but require pretraining and may add test-time computation. We propose EventMC (event-guided motion correction), a training-free method for interleaved Cartesian acquisitions. It iteratively detects motion events and estimates motion using reference images reconstructed from stable intervals. It then refines the image and motion from low to high spatial frequencies. In a fair comparison in simulation (same reconstruction), EventMC's motion estimates improve mean PSNR by up to 4.0 dB over those of the learning-based MotionTTT. A single run of EventMC is up to 7.5 times faster than MotionTTT with less than half the GPU memory. On in vivo motion-corrupted scans, EventMC achieves similar mean image quality to MotionTTT without any training. Code is available at this https URL.
162. 【2611.01900】Systematic Evaluation of Robustness in Fine-tuned Models
链接：https://arxiv.org/abs/2611.01900
作者：Angela John,Hamayoon Behmanush
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：pre-trained models, selecting pre-trained models, fine-tuned pre-trained models, image classification, models
备注：
点击查看摘要
Abstract:Our study systematically evaluates the robustness of fine-tuned pre-trained models across different datasets and attack types, aiming to provide insights for researchers in selecting pre-trained models for image classification tasks while prioritizing robustness against potential attacks. Our work explores the influence of fine-tuning pre-trained models with different datasets and attack types on their robustness and overview of the appropriate pre-trained model for image classification based on factors such as computation resources, memory usage, and accuracy on clean data. We fine-tune the models with weights. Evaluate the models on data before any attack and after different attack cases. The study utilizes publicly available image datasets such as MNIST, CIFAR10, CIFAR100, and SVHN to assess the robustness of pre-trained models. The results indicate that the robustness of fine-tuned models varies across different data distributions and sample sizes, emphasizing the need for tailored selection based on specific task requirements. The findings also highlight the varying performance of ResNet50, DenseNet, and MobileNet in defending against attacks on different datasets. Overall, this research provides valuable insights into the robustness of fine-tuned pre-trained models and their suitability for real-world applications in image classification.
163. 【2611.01888】Prior-Guided Physics-Informed Deep Learning for Fast 4D MRI Reconstruction
链接：https://arxiv.org/abs/2611.01888
作者：Mojtaba Safari,Parag J. Parikh,Shansong Wang,Mingzhe Hu,Philip Connell,Stanley L. Liauw,Ralph R. Weichselbaum,Zhen Tian,Xiaofeng Yang
类目：Computer Vision and Pattern Recognition (cs.CV); Medical Physics (physics.med-ph)
关键词：Background and purpose, deep learning method, respiratory phases, MRI, deep learning
备注：
点击查看摘要
Abstract:Background and purpose: We propose PGPI4MR (prior-guided, physics-informed 4D MRI reconstruction), a deep learning method that leverages information from other respiratory phases or a setup scan, the first 30 s of the same scan, to improve 4D MRI reconstruction without extra scan time. Materials and methods: PGPI4MR is an unrolled network that reconstructs 16 respiratory phases from 60, 30, or 15 s of data, and single 3D volumes, each from 0.29-0.49 s of data, using a setup-scan image. The networks were trained once, on other volunteers, and were not retrained for new volunteers. We evaluated PGPI4MR on measured k-space from three datasets: free-breathing MR-linac (1.5T) and abdominal (3T) scans, and thigh scans with cuff compression (1.5T). All methods, including comparative models, received identical samples and were scored similarly. Results: In vivo, PGPI4MR had the lowest held-out error for 4D MRI at every scan time, and its 16 phases were ready a median of 7.5-13 s after the scan on the 2 GPUs tested. Coupling the 16 respiratory phases reduced the error at 60 s by 9.1% compared with reconstructing each phase alone. For sub-second MRI, the error at 0.49 s was 15.5% lower than that of the best comparison method, classical reconstruction toward the same prior, and on the faster GPU, every 0.29 s window was acquired and reconstructed within 0.5 s. Without retraining, PGPI4MR matched the best methods on the 3T abdominal scans but not on the thigh scans; after retraining on thigh data, it reduced the held-out error by 6.6% relative to the best comparison method. Conclusion: Prior information allowed PGPI4MR to reconstruct 4D and sub-second MRI more accurately than compressed sensing and a published 4D network, within seconds and without extra scan time. This could support 4D MRI for treatment planning and 3D motion monitoring during MR-guided radiotherapy.
164. 【2611.01860】Advances in Agentic Computer Graphics
链接：https://arxiv.org/abs/2611.01860
作者：Hengyu Liu,Jihyeon Je,Ruiqi Wang,Mingxuan Wu,Haven Feng,Qixing Huang,Georgios Pavlakos,Hao Zhang,Jiajun Wu,Maneesh Agrawala,Leonidas Guibas,R. Kenny Jones,Shangzhe Wu,Guandao Yang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Computer graphics, graphics, tasks, computer graphics tasks, Computer
备注： 27 pages, 19 Figures
点击查看摘要
Abstract:Computer graphics is built on code. Large language model (LLM) agents can now generate graphics code and iteratively refine it through various feedback. This capability opens the door to a potentially new paradigm of computer graphics, with graphics algorithms increasingly built around agentic systems to automate progressively complex tasks. Over the past years, research on agentic graphics has expanded rapidly across a diverse range of tasks. This rapid growth makes it increasingly difficult for manual literature reviews to keep pace with new developments. At the same time, similar ideas are often described using different terminology across these tasks, further complicating efforts to develop a systematic understanding of the field. In this report, we address these challenges through two contributions. First, we introduce a unified taxonomy for characterizing agentic systems across diverse computer graphics tasks. Second, we develop an agentic literature system that can assist human researchers in analyzing existing and newly published papers at scale. Building on these contributions, we analyze emerging research trends and discuss open challenges in coordinating agents and tools across graphics tasks, designing interfaces and representations for human-agent collaboration, sustaining long-horizon planning and refinement, and reliably evaluating interactive graphics systems.
165. 【2611.01858】Learning-to-Memorize: Dynamic Context Management for Long-Horizon Autoregressive Video Generation
链接：https://arxiv.org/abs/2611.01858
作者：Haowei Zhu,Qijie Wang,Jia Li,Xing Wang,Tianyu Zhao,Jiexi Wang,Xurui Peng,Xinglong Wu,Junhai Yong,Bin Wan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：achieved impressive results, remains challenging due, potentially imperfect previous, videos remains challenging, imperfect previous frames
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:Autoregressive video generation has achieved impressive results on short clips, yet generating long videos remains challenging due to error accumulation over extended horizons, where each predicted frame depends on potentially imperfect previous frames. Existing approaches typically rely on static context management strategies, such as sliding-window caches that discard early frames or fixed sink frames that permanently preserve initial content. These designs either lose critical long-range context or anchor generation to outdated information, which can lead to degraded fidelity, motion stagnation, and reduced diversity. In this paper, we propose Learning to Memorize (L2M), a learned context memory management framework that dynamically retains, evicts, and evolves historical frames according to predicted importance. The framework consists of an importance prediction router that estimates the relevance of each historical frame, degradation-aware training that improves robustness to noisy or corrupted context, and a dynamic memory initialization and evolution mechanism that updates long-term memory using exponential moving average (EMA) importance scores. This allows high-quality frames to replace stale anchors and enables memory to adapt naturally to scene evolution. Trained with a teacher-student distillation objective and sparsity regularization, L2M makes efficient use of a fixed KV-cache budget while preserving the most informative contextual information. Extensive experiments demonstrate that L2M improves long-horizon video generation quality and temporal consistency over existing baselines, providing a learned strategy for context memory management in long autoregressive video generation.
166. 【2611.01850】Biological Congruence: Evaluating Microscopy Generation Across Representations
链接：https://arxiv.org/abs/2611.01850
作者：Duway Nicolas Lesmes-Leon,Shumpei Takezaki,Fabian Schmeisser,Ryoma Bise,Gillian Lovell,Bianca Migliori,Andreas Dengel,Sheraz Ahmed
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：conventional evaluation primarily, evaluation primarily characterizes, produce realistic microscopy, primarily characterizes visual, increasingly produce realistic
备注： Accepted at WACV2027
点击查看摘要
Abstract:Generative models increasingly produce realistic microscopy images, yet conventional evaluation primarily characterizes visual fidelity and distributional coverage rather than the biological information represented by synthetic data. We introduce biological congruence as an evaluation principle describing whether biologically relevant information forms a coherent description across representations and remains consistent with its empirical biological context. To study this principle, we develop a text-conditioned diffusion framework that jointly generates microscopy images and instance masks, exposing the same generated biological state through conditioning, visual appearance, and instance structure. Across prompt--mask, prompt--image, image--mask, and population-level analyses, we find strongly feature-dependent behavior: density and confluency are consistently preserved, morphology exhibits recurrent disagreement, while nearest-neighbor distance reveals that strong image--mask agreement can coexist with weaker conditioning and population fidelity. Stress testing increasingly unsupported phenotype combinations further shows that target controllability can increase while untargeted phenotypes reorganize and the complete generated state moves toward configurations better supported by real data. These findings demonstrate that generative quality, controllability, cross-representation agreement, and population fidelity capture complementary properties, motivating biological congruence as a relational perspective for evaluating scientific generative models.
167. 【2611.01846】Z-Cache: Accelerating Diffusion Transformers via Self-Reflection
链接：https://arxiv.org/abs/2611.01846
作者：Zegang Cheng,Zhikai Wang,Jiacheng Liu,Xiaobing Tu,Chang Zou,Junjie Chen,Yue Ma,Zhiyuan Ma,Jinkui Ren,Likai Zou,Linfeng Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：massive computation costs, suffer from massive, caching steps, feature caching, caching
备注： Accepted at NeurIPS 2026 (poster)
点击查看摘要
Abstract:Diffusion transformers have become the most powerful models for visual generation, but still suffer from massive computation costs. To solve this problem, feature caching has been proposed to cache the features of diffusion models in the previous computation steps and then reuse them in the following caching steps, which brings significant acceleration but also degradation in generation quality. To address this problem, this paper proposes Z-cache as a feature caching method that can maintain high-quality generation through self-reflection. Concretely, we observe that the error from feature caching tends to be sharply reduced after each full computation. Based on this observation, Z-Cache is designed to first predict the features in the future caching steps and then perform a full computation. After that, Z-Cache returns to the caching steps and re-predicts them based on the previous and the current computation steps, which brings correction in features. Experiments demonstrate that with Z-Cache, diffusion transformers achieve comparable generation quality to the original model but with faster inference speed, for instance, 6.22X acceleration on FLUX-dev for text-to-image generation. Our code is released on GitHub.
168. 【2611.01823】LUMEN: Geometry-Guided Diffusion Model for Spatially-Varying HDR Illumination Estimation
链接：https://arxiv.org/abs/2611.01823
作者：Hongze Chen,Fangyu Lin,Runze Zhang,Lingting Zhu,Weikai Chen,Zeyu Hu,Yingda Yin,Keyang Luo,Xin Wang,Zehong Lin,Jun Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Estimating scene illumination, inherently spatially varying, depending on geometry, environment maps, light sources
备注：
点击查看摘要
Abstract:Estimating scene illumination from images is challenging as lighting is inherently spatially varying, depending on geometry, occlusion, and light sources. Existing methods incorporate geometric cues by deriving local environment maps or probe-based representations, but largely rely on regression or parametric models, resulting in over-smoothed lighting and limited realism. We revisit spatially-varying illumination estimation from a generative perspective and introduce LUMEN, a geometry-conditioned diffusion framework for synthesizing high-dynamic-range (HDR) environment maps at arbitrary spatial locations from single or multi-view images. Specifically, we reconstruct a coarse 3D scene from input images and render partial environment maps at arbitrary locations to encode visibility and spatial structure. These signals are fused with multi-view image features and fed into a diffusion transformer to generate full HDR environment maps. To train the model, we build a synthetic dataset of 700 indoor scenes with dense spatial supervision, including multi-view RGB images, depth, and HDR illumination at multiple sampled locations. This dataset enables the model to learn spatially consistent lighting distributions across diverse scenes. Extensive experiments demonstrate that LUMEN significantly improves visual fidelity and spatial coherence compared to prior approaches.
169. 【2611.01822】RCFormer: Reliability-aware Context Transformer for Occlusion-Robust Facial Landmark Detection
链接：https://arxiv.org/abs/2611.01822
作者：Ashish Kumar,Prashant Kumar,Mallika Garg
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：regular imaging conditions, poor illumination, remain major sources, imaging conditions, incomplete or misleading
备注： Accepted at the British Machine Vision Conference (BMVC 2026)
点击查看摘要
Abstract:Facial landmark detection has advanced substantially under regular imaging conditions, yet occlusion, poor illumination, and large pose changes remain major sources of error because local facial evidence can become incomplete or misleading. Context-guided latent patch recovery offers a promising way to address this issue by inferring unreliable patch representations from surrounding facial context before heatmap prediction. However, the recovered context can itself be unreliable when it is weakly adapted to the input face, influenced by corrupted neighboring patches, or blended without preserving local spatial coherence. We propose RCFormer, a Reliability-aware Context Transformer for occlusion-robust facial landmark detection. RCFormer strengthens latent patch recovery with three reliability-oriented components: visible-context conditioning (VCC), which adapts the context representation using a visibility-weighted global facial summary; visibility-guided context aggregation (VGCA), which reduces the influence of unreliable source patches during attention; and spatial residual correction (SRC), which refines blended latent features using neighboring patch information. The recovered heatmaps are then used as reliability-aware structural cues for existing landmark detection networks. Experiments show that RCFormer improves heatmap recovery and achieves strong landmark localization results on the WFLW, COFW, and 300W datasets.
170. 【2611.01815】When Does Latent Prediction Error Support Physical Surprise Claims in Video World Models?
链接：https://arxiv.org/abs/2611.01815
作者：Anton Hristov,Aleksandar Slavov,Vasil Vasilev
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：ordinary prediction difficulty, static content, Prediction, prediction difficulty, error
备注： 28 pages, 12 figures, 25 tables. Accepted at the World Models in Physical AI Workshop, NeurIPS 2026
点击查看摘要
Abstract:Prediction errors from video world models are often treated as physical surprise, but they can also reflect appearance, static content, motion, or ordinary prediction difficulty. We present an evaluation framework that separates what frozen representations contain, how they organize appearance and physical differences, and what changes a model's own prediction error. On IntPhys2, a benchmark of physically possible and impossible events, we compare representations from latent prediction, masked pixel reconstruction, and simple visual statistics. Appearance remains easy to decode, while V-JEPA2 exposes modest information about whether events are possible or impossible. Looking at the latent geometry, appearance changes become smaller compared with differences between videos, their directions line up more consistently across scenes, and their overlap with physical changes decreases in deeper layers. Across action-conditioned models, incorrect actions raise prediction error, while appearance changes also produce substantial responses. In Physion++ video clips, repeating a single frame can produce higher error than the original clip, while changing color throughout the clip can lower it. Using Kubric, a simulation and rendering framework, we find that impossible events can produce lower error than possible events. A fixed error threshold also incorrectly flags many possible events as impossible. A model can therefore represent physical information and respond to incorrect actions without its native prediction error reliably measuring physical surprise.
171. 【2611.01791】RIFT: Residual-Informed Flow Transfer for One-Step Generative Video Compression
链接：https://arxiv.org/abs/2611.01791
作者：Qizhe Wang,Jiaye Fu,Feng Ye,Haocheng Tang,Zetian Song,Chuanmin Jia,Siwei Ma,Jiaqi Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：reconstruct details lost, Recent advances, pretrained spatiotemporal priors, spatiotemporal priors, generation have enabled
备注：
点击查看摘要
Abstract:Recent advances in video generation have enabled generative video compression to reconstruct details lost during coding using pretrained spatiotemporal priors. However, a substantial gap remains between codec-induced degradation and the perturbation trajectories learned by flow-matching models. In this paper, we identify a compression-dependent directional mismatch that degradation-strength-based timestep calibration alone cannot resolve. Compressed latents remain strongly aligned across codec operating points, while their reconstruction residuals vary substantially in magnitude and direction. To bridge this gap, we propose RIFT, a Residual-Informed Flow Transfer framework for one-step generative video compression. At its core, RIFT introduces a Residual Geometry Inducer (RGI) that converts the pretrained flow prediction into a content-adaptive restoration update using decoder-visible codec cues. RGI integrates flow-timestep conditioning with a learned full-band residual-strength estimate and content-conditioned direction and gain modulation, aligning the orientation and magnitude of the update with the compression-dependent residual geometry. Extensive experiments on three public video compression benchmarks show that RIFT outperforms competing generative video compression methods. The code is publicly available on RIFT.
172. 【2611.01790】Detection Instead of Inversion: T1-T2 Microstructure Quantification With Detection Transformers
链接：https://arxiv.org/abs/2611.01790
作者：Sebastian Endt,Fatih Özkan,Marion I. Menzel
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Medical Physics (physics.med-ph)
关键词：Inverse Laplace Transform, correlation MRI, MRI has strong, quantify microstructural compartments, time-consuming Inverse Laplace
备注： 4 pages, 3 figures, 1 table; For submission to IEEE ISBI 2027; Code: [this https URL](https://github.com/SebastianEndtTHI/t1t2-detr)
点击查看摘要
Abstract:T1-T2 correlation MRI has strong potential to quantify microstructural compartments without imposing a biological model. Traditionally, full T1-T2 spectra per voxel are reconstructed with an ill-conditioned and time-consuming Inverse Laplace Transform. We propose to view this challenge as an object detection task: A Detection Transformer (DETR) takes 64 TI/TE signals and directly predicts a set of compartments specified by T1, T2, and signal fraction. We achieve a mean average precision mAP@10 of 76.8% on simulated data, outperforming both our previous model design (53.8%) and regularized NNLS (66.1%). We show that our DETR approach outperforms NNLS in almost every setting across compartment count, compartmental signal fraction, and SNR. Reconstruction is orders of magnitude faster than NNLS. The results are fully reproducible from our public code: this http URL
173. 【2611.01783】OCBI: Order-Sensitive Cross-Branch Interaction for Image Manipulation Localization
链接：https://arxiv.org/abs/2611.01783
作者：Zhouli Yu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Image manipulation localization, identify modified pixels, Image manipulation, combines semantic structure, modified pixels
备注： 13 pages, 3 figures, 4 tables
点击查看摘要
Abstract:Image manipulation localization combines semantic structure with forensic traces to identify modified pixels. Within-branch spatial mixing and RGB-guided cross-branch mixing can produce different messages when composed in opposite orders. We propose OCBI, an extension of Co-Transformers that models the discrepancy between these two composition orders for localization. A local cross-branch fusion module uses the commutator of RGB-guided cross-attention and forensic self-attention to add a learnable signed correction to feature transfer. Pixelwise adaptive multiscale aggregation then combines spatial contexts before prediction. OCBI uses the Co-Transformers backbone and supervision. We compare OCBI with retrained Co-Transformers using CASIA-only task training, a 50-epoch budget, and final-epoch evaluation. Across five clean test datasets, OCBI achieves a macro PixelF1 of 0.5773, exceeding the baseline by 0.43 percentage points. Under JPEG compression, Gaussian blur, and resizing on three datasets, its average PixelF1 over 21 dataset-transformation conditions exceeds the baseline by 0.95 percentage points.
174. 【2611.01765】FinishStrong: Learning to End Well after Imperfect Start in Video Temporal Grounding
链接：https://arxiv.org/abs/2611.01765
作者：Yuda Zou,Boxiang Zhou,Xin Zhou,Yibo Chen,Dejia Song,Xu Tang,Yao Hu,Yongchao Xu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：lowers the ceiling, poor start lowers, start lowers, poor start, start
备注：
点击查看摘要
Abstract:A poor start lowers the ceiling, but does not negate the value of finishing well. In autoregressive video temporal grounding, models systematically exhibit an endpoint performance asymmetry, predicting ends significantly worse than starts. A committed flawed start acts as an immutable physical constraint, irreversibly capping the attainable overlap as a sunk loss. While models should minimize the remaining conditional regret, standard post-training paradigms fail to teach this adaptation. Specifically, teacher-forced SFT suffers from strict prefix exposure bias, and holistic trajectory evaluation in standard GRPO inadvertently penalizes conditionally optimal ends if they follow a poor start. To address this, we introduce FinishStrong, a novel two-stage post-training framework explicitly designed to teach optimal continuations. First, Online-start SFT exposes the end prediction to the model's own generated contexts. Second, Conditional-tree GRPO restructures the sampling topology, centering end rewards exclusively within the same-start branch to mathematically isolate the conditional end quality from the inherited start penalty. FinishStrong-9B achieves a state-of-the-art 61.7\% overall IoU on TimeLens-Bench, remarkably outperforming flagship closed-source models like Gemini-3.8-Flash and Qwen3.8-Max. Crucially, when forced to continue from imperfect starts, it reduces the subsequent end prediction error by 36.5\%, proving its exceptional ability to end well after flawed starts. Code will be open.
175. 【2611.01759】operation System for Service Robots using Virtual Reality Headset and Pose Estimation
链接：https://arxiv.org/abs/2611.01759
作者：Eduardo Fernandes,Tiago Ribeiro,Antonio Ribeiro,Carolina Lopes,Gil Lopes,Fernando Ribeiro
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：human pose estimation, integrates human pose, enable intuitive remote, pose estimation, human pose
备注： 17 pages, 16 figures
点击查看摘要
Abstract:This paper presents a teleoperation system for service robots that integrates human pose estimation with virtual reality (VR) to enable intuitive remote control. By using the Mediapipe framework for 2D pose detection and extending it with RGB-D data from the Intel RealSense D455 camera, a comprehensive 3D human pose estimation is achieved. This data is then mapped to the robot's kinematics, allowing the operator to control the robot's movements naturally. A VR interface was developed to provide an immersive perspective, enhancing the operator's situational awareness. Real-world experiments were conducted using the CHARMIE service robot to validate the system's effectiveness in tasks involving object manipulation. While the current system successfully demonstrates the potential of VR-based teleoperation, challenges remain in accurately capturing certain joint angles (e.g., wrist yaw) and ensuring precise mapping between human and robot movements. Future work includes the integration of inertial measurement units (IMUs) for improved rotational tracking and the implementation of more advanced control algorithms. Overall, this research contributes to the development of more intuitive and effective teleoperation systems for service robots, facilitating their deployment in complex and dynamic environments. This work further introduces a novel approach to teleoperation by combining RGB-D sensing with an innovative algorithm for real-time joint angle computation using Mediapipe, enhancing the precision of human-robot motion mapping and enabling immersive control through a VR interface. These contributions represent significant advancements in the field of human-robot interaction, particularly for service robot applications.
176. 【2611.01736】RSI-Env: An Open-Ended Environment for Recursive Self-Improvement of Agents
链接：https://arxiv.org/abs/2611.01736
作者：Wanying Qu,Zhiyuan Fan,Jiyao Liu,Jiang Zhou,Jianghan Shen,Yanwei Fu,Dongrui Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：envisions agent systems, updated system continuing, autonomously improve, envisions agent, models and harnesses
备注：
点击查看摘要
Abstract:Recursive self-improvement (RSI) envisions agent systems that autonomously improve their own models and harnesses, with each updated system continuing to improve itself. Existing approaches typically restrict optimization objectives, editable components, or evaluation procedures, limiting open-ended exploration and continuity across generations. We introduce RSI-Env, a persistent environment for coordinated model-harness improvement, supporting autonomous training, harness modification, and retention of research state. An independent Host Controller manages services, evaluation, and versioning. Under Self, each accepted model-harness version takes over the next improvement round. We define three settings that vary goal specificity and access to benchmark feedback: Open-General, Capability-Directed, and Benchmark-Guided. Across these three settings, we compare Self with two fixed external Teachers on seven tasks, starting from Qwen3.8-27B with a minimal harness. Without benchmark feedback, Open-General Self raises GPQA Diamond accuracy from 65.2% to 73.2% and AIME 2026 accuracy from 53.3% to 56.7%. All three Capability-Directed Self runs achieve target-aligned gains. Knowledge Self demonstrates continued improvement across system updates, with SimpleQA accuracy rising from 82.0% to 85.0% and then 88.0%. Benchmark guidance and Teacher benefits vary by task. These results demonstrate RSI-Env's support for open-ended exploration and sustained recursive improvement within the studied runs, while highlighting challenges in preserving gains across capabilities.
177. 【2611.01730】Deep Learning for Cervical Cytology Screening: Methods, Algorithms, Challenges and Prospects
链接：https://arxiv.org/abs/2611.01730
作者：Jiang Yangbo,Zheng Nenggan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Cervical cancer remains, cervical cytology screening, cancer death, cytology screening, deaths occurring
备注：
点击查看摘要
Abstract:Cervical cancer remains a leading cause of cancer death among women, with more than 90\% of deaths occurring in low- and middle-income countries, where cytology screening is constrained by a shortage of trained cytopathologists. Deep learning has made automated cytology screening increasingly feasible, but the literature is fragmented across cell, patch and whole-slide-image scales, task formulations and supervision regimes, hindering comparison and clinical translation. This Review synthesizes the deep learning literature for cervical cytology screening, organizing the field along three axes---data scale, functional task and supervision---and distinguishing two clinical roadmaps: whole-slide-image confidence aggregation and cell-level detection with Bethesda classification. We examine 16 publicly available or publicly documented cytology datasets alongside the CAISHI histopathology dataset, compare quantitative performance while exposing incomparable metrics and data leakage, and assess commercial systems, regulatory status, HPV-era screening pathways and low-resource deployment. Single-cell accuracy on Herlev and SIPaKMeD has plateaued, but this reflects benchmark saturation rather than clinical readiness; prospective and randomized evidence is emerging but remains limited. We consolidate the evidence into five challenge areas---data and benchmarks, architecture and label-efficient learning, trustworthy AI, clinical translation and health economics, and evaluation and reproducibility---and provide an evidence-to-agenda map and a deployment decision matrix. Progress now depends on multi-center benchmarks, externally validated label-efficient methods, calibrated and fair predictions, and pragmatic clinical trials rather than further gains on saturated single-cell benchmarks.
178. 【2611.01705】Fréchet Oral Distance: A Coordinate-Free Metric and Benchmark for Speech-Driven Oral Animation
链接：https://arxiv.org/abs/2611.01705
作者：Jaehong Myung,Seungho Eum,Hyunjung Chung,Unsang Park
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：oral animation technologies, speech therapy, Fréchet Oral Distance, Oral Motion Encoder, speech-driven facial
备注：
点击查看摘要
Abstract:Recently, speech-driven facial and oral animation technologies have been used in various fields such as education, speech therapy, and healthcare. But methods to objectively evaluate the quality of generated results are still limited. Accordingly, we propose the Fréchet Oral Distance (FOD), which uses embeddings from an Oral Motion Encoder (OME) and a TIMIT-Vis reference distribution. In experiments, FOD reproduced model rankings similar to the coordinate-based metric, Lip Vertex Error (LVE), and showed trends consistent with user preference. Our framework provides objective and reproducible benchmarking without relying on expensive equipment or subjective evaluation, and it can be extended to compare a variety of 2D/3D models.
179. 【2611.01696】Restoring Semantic Fidelity for Training-Free High-Resolution Image Generation in Diffusion Transformers
链接：https://arxiv.org/abs/2611.01696
作者：Junjie Li,Zengbin Wang,Gaoxiang Li,Muyi Sun,Yixin Zhang,Man Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Diffusion Transformer, recently achieved remarkable, achieved remarkable success, recently achieved, achieved remarkable
备注： accept by acm mm2026
点击查看摘要
Abstract:Diffusion Transformer (DiT)-based text-to-image models have recently achieved remarkable success in image synthesis. However, when directly applied beyond their training resolution, these models often suffer from severe semantic degradation, where meaningful semantic content disappears. Although existing training-free high-resolution generation methods can mitigate this issue, the inherent semantic degradation at high resolutions remains largely unresolved, leading to degraded fine-grained details. Furthermore, widely used structural guidance methods lack modeling of the structure and details in the intermediate trajectory, which degrades the quality of the generated results. In this paper, we propose a training-free framework for high-resolution image generation to address these challenges. First, we propose a text-visual scale-decoupled attention (TVSDA) module, which restores the model's ability to generate semantically meaningful content at high resolutions by preserving the global receptive field of text tokens while aligning the receptive field of image tokens with the training resolution. Second, we propose a structure-detail guidance (SDG) strategy that explicitly models structural information and fine details through scale-wise and temporal-wise guidance, overcoming the limitations of conventional low-resolution guidance. Extensive experiments demonstrate that our method significantly improves both structural coherence and detail fidelity over existing training-free DiT-based high-resolution generation approaches. The code is available at this https URL.
180. 【2611.01688】SEALECT: Scene-Conditioned Pose Priors for Plausible Maritime Vessel Retrieval
链接：https://arxiv.org/abs/2611.01688
作者：Faisal Mohammad,Mohamed Younis
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：produce physically implausible, implausible vessel insertions, physically implausible vessel, address scene-conditioned object, make appearance-only retrieval
备注： Accepted to WACV 2027 (Applications Track). 22 pages: 11-page main paper including references, plus 11 pages of supplementary material. Code: [this https URL](https://github.com/fossil-ai/SEALECT)
点击查看摘要
Abstract:We address scene-conditioned object retrieval for compositional augmentation in maritime imagery, where strong geometric constraints make appearance-only retrieval produce physically implausible vessel insertions. We propose SEALECT, a retrieval framework that jointly models visual compatibility, vessel pose, scale, and scene geometry through a unified score combining neural similarity, scene-conditioned pose priors, and observed-pose consistency. We construct a maritime scene-pose library and model the pose and scale priors nonparametrically, as a kernel that conditions each prior continuously on the scene with no learned parameters. Across seven maritime benchmarks, our trained scene-conditioned retriever exceeds the strongest appearance encoder (SigLIP 2) in recall (+0.14), and the training-free prior raises geometric plausibility further at negligible recall cost, more than halving the constraint violations of appearance retrieval and outperforming learned foreground-search baselines (GALA-style, DiscoFOS). In a blind study of end-to-end composites (BootPlace placement, DiffHarmony harmonization), SEALECT ranks first among six methods, ahead of random and GALA-style selection and statistically tied with CLIP, DiscoFOS, and DINO.
181. 【2611.01684】GaitFM: A Cross-Modal Foundation Model for Wearable Gait Assessment
链接：https://arxiv.org/abs/2611.01684
作者：Yize Cai,Zhiqing Hong
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Gait assessment, Gait assessment supports, supports the diagnosis, musculoskeletal disorders, neurological and musculoskeletal
备注： 18 pages, 4 figures
点击查看摘要
Abstract:Gait assessment supports the diagnosis, monitoring, and prognosis of diverse movement-related conditions, such as neurological and musculoskeletal disorders. Recent advances in deep learning using everyday wearable inertial measurement units (IMUs) offer an accessible and low-cost approach to automated gait assessment. However, IMU measurements vary substantially across individuals, body locations, and device configurations, while existing deep learning models are typically developed using small, homogeneous datasets for specific clinical tasks, limiting their robustness and generalizability in diverse real-world contexts. Here we present GaitFM, a cross-modal foundation model for gait assessment using IMU sensors. GaitFM improves the generalizability of gait assessment by transferring knowledge from large vision models and pretraining on unlabeled IMU sensor data. We pretrain GaitFM on a large curated dataset comprising about 4,000 participants and 1.23 million gait windows across diverse clinical and daily conditions, sensor modalities, and body locations. GaitFM demonstrates strong performance across 18 gait-related tasks, including 3 gait parameter estimation tasks, 14 disease and gait abnormality detection tasks, and 1 clinical outcome prediction task. Furthermore, GaitFM generalizes across different sensor configurations and body locations, including those commonly used in clinical settings and everyday wearable devices. These findings demonstrate the effectiveness of transferring visual knowledge in improving sensor-based gait assessment performance, offering a new promising pathway for addressing data scarcity in the sensor and medical domains.
182. 【2611.01682】Leveraging 2D Foundation Priors for Generalized Category Discovery under Test-Time Adaptation in 3D LiDAR Segmentation
链接：https://arxiv.org/abs/2611.01682
作者：Hanqi Chen,Chaoqi Chen,Tian Ji,Hui Huang
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：recognize previously unseen, LiDAR semantic segmentation, making generalized category, previously unseen categories, autonomous driving
备注： Accepted by ACMMM 2026
点击查看摘要
Abstract:In autonomous driving, 3D LiDAR semantic segmentation is expected to adapt to evolving environments and recognize previously unseen categories, making generalized category discovery under test-time adaptation (GCD-TTA) an important problem. However, existing works treat GCD and TTA separately, while the limited semantic information in 3D point clouds makes GCD-TTA under domain shift more prone to feature collapse when combining GCD with TTA. To address this issue, we propose a two-stage framework for GCD-TTA in 3D LiDAR semantic segmentation. Specifically, in the first stage, we adaptively aggregate local 3D features according to geometric density variations and obtain reliable pseudo labels under a global class-wise prototype consistency constraint. In the second stage, we cast category discovery as an optimal transport assignment process for globally consistent grouping of novel categories. Meanwhile, semantic features from 2D vision foundation models are fused with 3D point cloud features to enrich 3D semantic information and promote a more separable feature space. Extensive experiments on Synth4D to SemanticKITTI, SynLiDAR to SemanticKITTI, and Synth4D to nuScenes demonstrate the effectiveness of our framework. Under a unified evaluation protocol, our method achieves the best overall mIoU on 9 out of 10 benchmark splits and improves the overall mIoU by up to 12.21 points over the strongest re-implemented baseline.
183. 【2611.01676】MMCoT$^3$: Empowering 3D Scene Understanding with 3D-Text Interleaved Multi-Modal Chain-of-Thought Reasoning
链接：https://arxiv.org/abs/2611.01676
作者：Yongqi Shan,Yifan Wang,Yunzhi Zhuge,Lijun Wang,Huchuan Lu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：point clouds, clouds is essential, broad range, reasoning, evidence
备注： 10 pages, 5 figures, 4 tables. Accepted to ACM Multimedia 2026
点击查看摘要
Abstract:Understanding and reasoning over 3D scenes from point clouds is essential for a broad range of AI applications. Recent 3D large language models have shown promising results, yet they still face two fundamental limitations: (i) insufficient capability for grounded multi-step reasoning in complex 3D scenes, and (ii) a text-centric inference paradigm that lacks effective interaction between textual reasoning and visual evidence. As a result, these models often fail to verify intermediate inferences, disambiguate similar object instances, and avoid hallucinations. To address these limitations, we propose MMCoT$^3$, the first 3D-Text Interleaved Chain-of-Thought (CoT) framework for 3D scene understanding. The core idea is to explicitly interleave textual reasoning with task-relevant 3D evidence, enabling the model to consult scene observations throughout the reasoning process. In addition, since a textual mention in 3D scenes may correspond to multiple candidate objects, naive object-mention alignment can inject incorrect evidence and mislead subsequent reasoning. To mitigate this multi-instance ambiguity, we design an ambiguity-aware evidence aggregation mechanism that uses query-guided cross-attention to fuse candidate object tokens and inject both evidence and ambiguity cues into the reasoning process. To better equip the model with multi-step reasoning capability, we further develop PointCoT, a large-scale 3D-specific CoT instruction tuning dataset with approximately 176.2K instances spanning captioning, question answering, dialogue, and planning tasks. Extensive experiments on six benchmarks show that our method consistently improves performance and achieves state-of-the-art results, validating the effectiveness of our proposed ambiguity-aware 3D-text interleaved reasoning for 3D scene understanding.
184. 【2611.01663】GatedVLA with Camera-Based Emergency Braking: AlpaSim E2E Closed Loop Challenge Technical Report
链接：https://arxiv.org/abs/2611.01663
作者：Kaneyoshi Hiratsuka,Naoki Takada,Makoto Kawano
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：report presents GatedVLA, presents GatedVLA, report presents, PAI-AV, soft visual mask
备注：
点击查看摘要
Abstract:This report presents GatedVLA, our entry for the Physical AI AV (PAI-AV) track. Our learned vision-language-action (VLA) policy pairs the driving-pretrained Qwen-Drive-1.0-4B vision-language model with a layer-wise flow-matching action expert that outputs a 2.5 s horizon of acceleration and curvature controls, augmented with a soft visual mask applied to the expert's cross-attention. Compared to an identically trained baseline, the masked policy achieves comparable overall open-loop error while reducing error on left turns. In local closed-loop evaluation across the same 150 scenes (two rollouts per scene), the visual mask increases the mean scene score from 0.479 to 0.517 (paired difference +0.038, 95% bootstrap CI [-0.018, +0.093], wins/losses 37/26, sign test p = 0.21). Incorporating a rule-based automatic emergency braking (AEB) module at deployment further increases the mean score to 0.599 (+0.082, CI [+0.023, +0.143]) and reduces the mean number of scenes with at-fault collisions from 34.0 to 11.0.
185. 【2611.01648】dKV Forcing: Separating Generation and Memory Representations through a Differentiable KV Cache
链接：https://arxiv.org/abs/2611.01648
作者：Zhiqi Li,Bo Zhu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：causal video generator, video generator produces, produces two key, causal video, video generator
备注：
点击查看摘要
Abstract:A causal video generator produces two key--value (KV) states for every segment: the KV it uses while denoising that segment, and the KV it writes into the cache for later segments to read. In a pretrained generator the two already differ substantially, later segments attend to them differently, and replacing the written KV with the generation KV degrades the continuation. We propose dKV Forcing (dKV denotes differentiable KV) to learn a dedicated memory representation from its future use: a writer-specific low-rank residual on the shared backbone separates memory writing from generation and is trained through the future reads of what it writes. Learning a write from its future use needs gradients through the cache, which the mutable cache in common use cannot provide. dKV Forcing replaces the training-time cache by persistent differentiable pages with local rematerialization and, in one temporal traversal, computes exactly the gradient that a two-pass reconstruction of the same objective computes. One traversal computes the full memory gradient at $7\%$ generator-update overhead over detached-write training, with $28\%$ less resident memory and $20.8\%$ shorter training cycles than the two-pass reconstruction. Over Self Gradient Forcing (SGF), the same objective trained with the same traversal, writer adaptation raises VBench-Long aesthetic quality by $6.6$ points at 60\,s and $8.5$ points at 240\,s with the highest subject and background consistency, and rollout dropout of the residual keeps most of this gain while restoring the motion of training without write gradients.
186. 【2611.01645】UA-Depth: Uncertainty-Aware Depth Restoration for Material-Agnostic Object Manipulation
链接：https://arxiv.org/abs/2611.01645
作者：Rui Cao,Jia-Hui Pan,Yin Zhang,Qiwei Meng,Jiapeng Li,Gang Wang,Runsong Zhu,Wei Chen,Chi-Wing Fu,Jiangliu Wang,Yun-Hui Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：Robotic manipulation requires, commodity RGB-D cameras, manipulation requires accurate, Robotic manipulation, commodity RGB-D
备注： Under Review
点击查看摘要
Abstract:Robotic manipulation requires accurate metric depth, yet commodity RGB-D cameras often fail on non-Lambertian objects such as transparent, reflective, and translucent materials, producing holes, structured noise, and biased depth. Most restoration methods produce only a single depth map, treating noisy and reliable regions uniformly for downstream tasks while ignoring regional uncertainty. We present UA-Depth, an uncertainty-aware depth restoration framework that iteratively co-refines depth and pixel-wise uncertainty, and uses uncertainty-gated features to suppress unreliable cues for stable updates. To strengthen zero-shot behavior, UA-Depth leverages a frozen depth foundation model as a prior to initialize missing or unreliable depth, and applies two-stage MAD-weighted log-depth scale normalization to reduce outlier bias in relative-to-metric alignment. We introduce an eight-dataset zero-shot benchmark across diverse scenes, materials, and sensors. Across these benchmarks, UA-Depth achieves the best mean rank among representative baselines, with particularly strong gains on datasets dominated by transparent and reflective objects. Beyond depth metrics, we demonstrate downstream improvements in category-level 6D pose estimation and 6D grasp synthesis by exploiting the predicted uncertainty. \emph{Code, models, and data for training and evaluation will be released upon publication.}
187. 【2611.01635】Benchmarking Vision-Language Models for Urdu Nastaliq Handwriting Recognition
链接：https://arxiv.org/abs/2611.01635
作者：Haseeb Yaqoob,Fatima Azfar,Emaan Arif Khan
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Urdu Nastaliq Handwritten, Nastaliq Handwritten Dataset, cursive Nastaliq script, clear character boundaries, Handwritten Urdu
备注：
点击查看摘要
Abstract:Handwritten Urdu is hard to recognize because the cursive Nastaliq script has no fixed baseline and no clear character boundaries. We benchmark six systems on the Urdu Nastaliq Handwritten Dataset (UNHD): Tesseract (default configuration), a script-specific recognizer trained on printed Urdu (UTRNet-Large), two open-source vision-language models (VLMs), and two commercial VLMs. All six systems are evaluated without fine-tuning on 2,465 single-line images (Part A), and the four VLMs receive the same fixed prompt (decoding uses temperature 0 where configurable, except for Claude Sonnet 5, whose decoding cannot be configured). Both commercial VLMs reach lower error than the printed-Urdu recognizer and the open-source VLMs. We do not compare against handwriting-trained recognizers, which would likely do better in-domain; we characterize zero-shot behavior, not state of the art. We also describe three distinct failure modes among the ranked systems. In one of them, a commercial model explicitly declines to transcribe a few very hard-to-read images instead of guessing. In a second study (Part B), VLMs correct the output of a separate OCR system using both the source image and the noisy text. Once separated from each model's own reading ability, the benefit is small on Tesseract's output (0.7% to 7.4%) and larger (17.9% and 21.9%) only for the two commercial correctors given UTRNet's text. It appears to depend on how legible the supplied text already is, and a weaker corrector can make a more legible text worse.
188. 【2611.01631】Zero-shot evaluation of open vision-language models as System 1 decision models on radiology tasks
链接：https://arxiv.org/abs/2611.01631
作者：Bradley J Erickson,Sara Salehi
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Clef, Purpose, tasks, CT-RATE, models
备注： 22 pages, 3 tables, 2 figures
点击查看摘要
Abstract:Purpose: We compared two multimodal System 1 decision models, Clef 27B and d1 3B, with a traditional LLM (Qwen 3.8-27B) on seven radiology tasks covering text, radiographs, CT and MRI. Methods: Three models were compared: Clef, Qwen3.8-27B and d1. Three tasks were interpretation of text and 4 were detection of finding in images. The tasks were: 1. finding presence of finding in CT-RATE chest CT reports; 2. Presence of finding in PadChest chest radiograph reports; 3. the same 18 findings on CT-RATE chest CT but 3D volumes; 4. MR safety status of devices from AccessGUDID device records; 5. line and tube position on RANZCR CLiP chest radiographs; 6. motion-artifact severity on MR-ART T1-weighted brain MRI and 7. sequence identification on BraTS 2021 brain MRI. The primary endpoint was AUROC. There was no fine-tuning of the models on the tasks. Results: All models completed all tests without a failed request. All retrieved findings from reports almost perfectly (AUROC 0.95). Clef ranked higher than its Qwen backbone on CT-RATE volumes and RANZCR lower on MR-ART. The two did not differ on BraTS, GUDID or PadChest, and differed by 0.002 on CT-RATE reports. On BraTS, Clef correctly identified 90 of 100 FLAIR volumes while Qwen never chose it. d1 ranked lower than Clef on six of seven tasks. No model performed well on motion severity. Clef was faster per request than Qwen on tasks with many questions per input. d1 used 3 to 9 times less energy per request than Clef. Conclusions: System 1 models can perform important tasks in radiology with high accuracy, at lower compute cost than LLMs used in the usual way. When an LLM is constrained to a single answer token, its cost and performance is similar to System 1 models unless multiple questions are asked. A 3B System 1 model was close to the 27B models on report text but not on images. No model performed well on motion severity.
189. 【2611.01627】EgoMo3R: Joint Egocentric Motion and Scene Reconstruction
链接：https://arxiv.org/abs/2611.01627
作者：Chaitanya Patel,Yusuke Kato,Rin Takahira,Kazuki Kozuka,Juan Carlos Niebles,Ehsan Adeli
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Understanding holistic, surrounding environment, fundamental for applications, motion, egocentric video
备注： NeurIPS 2026. Project Page: [this https URL](https://chaitanya100100.github.io/EgoMo3R/)
点击查看摘要
Abstract:Understanding holistic 3D human motion and the surrounding environment from egocentric video is fundamental for applications in AR/VR and robotics. Although these tasks are inherently coupled, existing methods treat them separately. In particular, egocentric motion reconstruction methods typically assume access to metric, gravity-aligned camera trajectories from specialized inertial sensors. Recovering such trajectories from monocular egocentric video remains a significant challenge due to rapid head movements and motion blur. We present EgoMo3R, a joint optimization framework that simultaneously reconstructs 3D human motion and scene geometry from casual egocentric video. It leverages the robustness of low-level visuo-geometric primitives, including monocular depth, optical flow, and point tracks, integrated with a diffusion-based human motion prior via first-order optimization. We propose an alternating optimization scheme that establishes a synergistic feedback loop: scene reconstruction provides physical grounding and trajectory conditioning for the motion prior, while the motion prior regularizes the camera trajectory and anchors the scene in a metric, gravity-aligned world frame. We evaluate EgoMo3R on the highly dynamic sequences of the EgoExo4D and Nymeria datasets and show that it outperforms specialized baselines in both 3D scene reconstruction and egocentric motion estimation.
190. 【2611.01626】Special and General Computational Aesthetics
链接：https://arxiv.org/abs/2611.01626
作者：Ganqing Luo(1 and 2),Chuan Li(1),Liaoruxing Zhang(3 and 5),Xin Jin(4 and 5) ((1) Sichuan Fine Arts Institute, Chongqing, China, (2) Chongqing College of Artificial Intelligence, Chongqing, China, (3) Beihang University, Beijing, China, (4) Beijing Electronic Science and Technology Institute, Beijing, China, (5) State Key Laboratory of General Artificial Intelligence, Beijing Institute for General Artificial Intelligence (BIGAI), Beijing, China)
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：aesthetic, Computational aesthetics, Computational, computational aesthetic, computational aesthetic models
备注： 18 pages, 5 figures, 2 tables. Presented at the 2026 CCF Chinese Conference on Computational Art (CCAC 2026), Jinan, China, October 2026; to appear in the conference proceedings
点击查看摘要
Abstract:Computational aesthetics is a field at the intersection of computer science, artificial intelligence, aesthetics, and other disciplines. As AI has developed, the field has formed relations of inclusion, intersection, or support with computational art, AI art, AI aesthetics, AI-generated content (AIGC), computational creativity, affective computing, and neuroaesthetics. Without distinguishing scope, objectives, and methods, it may be narrowed to image aesthetic quality assessment or expanded into an umbrella term for AI's involvement in art. We analyze its internal structure and its relations with neighboring concepts, and propose a two-level scope: special computational aesthetics (SCA) and general computational aesthetics (GCA). SCA centers on aesthetic measurement and aesthetic process modeling. The former primarily corresponds to "Aesthetic Perception": computationally identifying and representing aesthetic attributes and predicting human aesthetic evaluations; the latter primarily to "Aesthetic Understanding": computationally describing, testing, and explaining how human aesthetic perception and judgment are formed. GCA extends this core to include "Aesthetic Generation," namely artistic generation guided by computational aesthetic models. Some computational aesthetic tasks can also use non-AI methods. Research in this scope using AI algorithms and models we define as AI aesthetics, which may involve the special core and the general extension. "Aesthetic Generation" intersects with AIGC, AI art, and computational creativity, but belongs to the general extension defined here only when computational aesthetic models substantively constrain, guide, or optimize artwork generation. We also draw on Feng Peng's discussion of the computability of beauty, aesthetic experience, and art as a theoretical reference for clarifying boundaries between computational aesthetics and related concepts.
Comments:
18 pages, 5 figures, 2 tables. Presented at the 2026 CCF Chinese Conference on Computational Art (CCAC 2026), Jinan, China, October 2026; to appear in the conference proceedings
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
ACMclasses:
J.5; I.2.1
Cite as:
arXiv:2611.01626 [cs.CV]
(or
arXiv:2611.01626v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2611.01626
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
191. 【2611.01617】Seeing What Matters, Verifying What Pays: Load-Adaptive Speculative Decoding for Vision-Language Models
链接：https://arxiv.org/abs/2611.01617
作者：Hong Nie,Zhangchi Gao,Yuqian Liang,Jun Yu,Bo Wang,Jianqing Sun,Shengping Liu
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：decoding accelerates vision-language, accelerates vision-language model, Speculative decoding accelerates, inference without altering, output distribution
备注：
点击查看摘要
Abstract:Speculative decoding accelerates vision-language model (VLM) inference without altering the output distribution, yet two factors limit its gains. Existing drafters either lack the image evidence required for visually grounded tokens or pay to condition on every visual token, although a short draft block typically depends on only a few image regions. Moreover, the value of verifying additional candidates varies with GPU load, so no fixed verification structure is efficient across serving conditions. We present Uni-LaSpec, a block-parallel speculative decoding framework that addresses both factors. To improve draft quality, Uni-LaSpec reuses the verifier's own attention: the query retained from the preceding verification ranks the cached, int8-quantized visual keys, and a cross-layer vote selects a few visual tokens that the drafter fuses through gated cross-attention. Acceptance-aware training further weights each draft position by its contribution to the accepted prefix. To allocate verification, a marginal-cost criterion selects the structure per request and per round: draft trees exploit idle verifier capacity under light load, whereas a dynamic head truncates linear drafts under heavy load. Across six VLMs from three model families and 17 text and multimodal benchmarks, selecting eight visual tokens retains at least 98.6% of the acceptance obtained from the full image at sub-millisecond selection cost. With greedy decoding at concurrency one, Uni-LaSpec achieves up to 5.11x text and 3.24x multimodal throughput over autoregressive decoding. Across six load levels and three GPU types, it outperforms autoregressive decoding in every setting and matches or exceeds the best fixed verification strategy in 123 of 144 settings; under bursty arrivals, it reduces mean end-to-end latency by 47.6% relative to linear verification.
192. 【2611.01615】LLM-Enhanced Multimodal House Price Prediction using Structured, Textual, and Visual Features
链接：https://arxiv.org/abs/2611.01615
作者：Khandokar Md. Rahat Hossain,Souvik Das,Tahsina Hashem,Mohammed Eunus Ali,Tanzima Hashem
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)
关键词：real estate buyers, estate buyers, financial institutions, house price prediction, essential for real
备注： 35 pages, 7 figures, 5 tables. Code: [this https URL](https://github.com/rh2975/LLM-VLM-HousePrice)
点击查看摘要
Abstract:Accurate house price prediction is essential for real estate buyers, sellers, agents, and financial institutions. Traditional methods rely primarily on structured data, e.g., number of bedrooms, bathrooms, parkings, but they overlook rich contextual information embedded in textual descriptions and property photos. Previous deep learning approaches for house price prediction have fused multimodal data but they fall short to extract structured spatio-temporal and contextual features from texts and semantic visual information from images. In this paper, we introduce a novel multimodal framework that addresses these limitations by systematically integrating structured attributes, textual descriptions, and visual images of properties to achieve higher prediction accuracy while maintaining interpretability. We use a large language model to derive domain-specific spatio-temporal and contextual features from text, and an unsupervised vision-language approach to automatically group photos into meaningful classes like indoor, outdoor, mixed, or floorplan, that are commonly present in real-world house listings. These categories are created without manual labeling by aligning image clusters with carefully designed pseudo text prompts. We fuse all features into a unified representation and use an optimized regressor to predict prices. Experiments on a large real-world property dataset demonstrate that our method outperforms traditional methods and existing multimodal baselines. Ablation studies confirm that the novel textual feature extraction and categorized visual embeddings substantially contribute to more accurate and reliable price predictions.
193. 【2611.01607】NatureFusion: Rethinking Infrared and Visible Image Fusion as Natural Complementary Enhancement
链接：https://arxiv.org/abs/2611.01607
作者：Jianfeng Ding,Linfeng Tang,Hao Zhang,Han Xu,Xunpeng Yi,Yibing Zhang,Meiqi Gong,Zhongyuan Wang,Jiayi Ma
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：physically distinct modalities, visible image fusion, distinct modalities, superimpose two physically, physically distinct
备注： 17 pages, 13 figures, 12 tables
点击查看摘要
Abstract:In the absence of ground truth, most existing infrared and visible image fusion methods pursue fidelity to the source images and directly superimpose two physically distinct modalities. As a result, salient infrared targets appear as bright patches of thermal radiation pasted onto the scene. These patches obscure the original color and texture of the targets, so the fused images look unnatural to human observers and deviate from the data distribution learned by vision models pretrained on visible images. Therefore, we redefine infrared and visible image fusion as natural complementary enhancement rather than source fidelity, and propose NatureFusion, which exploits cross-modal complementary cues to infer a clear and natural visible-style image from low-quality visible and infrared image pairs. Specifically, to address the lack of ground truth, we employ a generative foundation model as the teacher to directly generate visually natural fused images for supervision. Furthermore, to fully distill the teacher's generative capability while reducing computational cost, we fine-tune a pretrained generative model with conditional flow matching through a light-weight fusion adapter. Last but not least, to further improve downstream performance without sacrificing natural appearance, we freeze the fusion adapter and introduce a detector-supervised task adapter that strengthens the complementary contribution of infrared. Extensive comparisons with seven multi-modal fusion and seven single-modality enhancement methods demonstrate that NatureFusion generates visually natural fused images with the best perceptual quality. Detection and segmentation models pretrained on visible images achieve substantially higher accuracy on our fused images than on those of any competing method.
194. 【2611.01605】MedNet and U$^2$-ViT: A Nested Vision Transformer Diffusion Framework for Diverse Medical Images Generation
链接：https://arxiv.org/abs/2611.01605
作者：Lakshmikar R. Polamreddy,Jialu Li,Youshan Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：advancing AI-driven medical, AI-driven medical diagnostics, treatment planning, remains a significant, significant bottleneck
备注：
点击查看摘要
Abstract:The scarcity of diverse, high-quality medical images remains a significant bottleneck in advancing AI-driven medical diagnostics and treatment planning. Traditional datasets often suffer from class imbalances, limited disease coverage, and insufficient variations in imaging conditions - challenges that hinder the development of robust, generalizable models. To address this, we introduce MedNet, a large-scale, multi-modal text-to-image dataset spanning 61 disease categories with 160 classes, covering both humans and animals. We built this with images from trusted public repositories, ensuring data diversity, quality, and ethical compliance. Additionally, we propose U$^2$-ViT, a novel diffusion-based text-to-image generation architecture arranging Vision Transformers (ViTs) in a nested U-Net structure to enhance the generation of diverse, and high-fidelity medical images. Through extensive experiments, we demonstrate that our model achieves the best Fr'echet Inception Distance (FID) score compared to state-of-the-art models. The source code is available at this https URL.
195. 【2611.01601】Accurate automated photo-identification of Near Eastern and European fire salamanders
链接：https://arxiv.org/abs/2611.01601
作者：Maayan Yesharim,Hava Goldstein,Gabi Kolodny,Assaf Ben-Levy,Tamar Kis-Papo,Dor Gavish,Rotem Vidan,Nirit Lavie-Alon,Olga Rybak,Yoav Ram
类目：Computer Vision and Pattern Recognition (cs.CV); Quantitative Methods (q-bio.QM)
关键词：Photo-identification underpins non-invasive, reference libraries grow, Photo-identification underpins, underpins non-invasive capture-recapture, libraries grow
备注：
点击查看摘要
Abstract:Photo-identification underpins non-invasive capture-recapture monitoring of amphibians, but manual identification becomes slow and error-prone as reference libraries grow. Focusing on the Near Eastern fire salamander (Salamandra infraimmaculata), we developed a pipeline based on zero-shot local-feature matching (SuperPoint and LightGlue) without species-specific training and evaluated it on $2{,}440$ field photographs from Haifa and Tel Dan in northern Israel. We isolated the yellow spot pattern, scored image similarity by the number of high-confidence keypoint matches, which reduced a confound whereby many-spotted individuals accumulate spurious matches, and assigned identities across the database by two-tier clustering. Pipeline-assisted expert review corrected misidentifications, reducing the number of identities by almost a quarter. On held-out individuals, the pipeline ranked the correct individual first for $95.2\%$ of queries and recovered identities with an ARI of $0.958$. Without modification, it reached $95.1\%$ and $91.7\%$ top-1 accuracy on two datasets of the European fire salamander (Salamandra salamandra) and recognised $93.7\%$ of recaptures in one of them, compared with $38$-$77\%$ for five established programs and $93.9\%$ for visual inspection. Zero-shot local-feature matching thus offers amphibian monitoring a re-identification tool that needs no training data, transfers between related species, scales to databases of over a thousand individuals, and can audit existing databases before capture-recapture analysis.
196. 【2611.01600】SCOUT: Planning under Occlusion via Object-Centric World Model Rollouts
链接：https://arxiv.org/abs/2611.01600
作者：Amir Hossain Raj,Xuesu Xiao
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：foreground objects occlude, Robots manipulating, usable free space, occlude the target, plan from partial
备注：
点击查看摘要
Abstract:Robots manipulating in cluttered spaces must often plan from partial views where foreground objects occlude the target, surrounding geometry, and usable free space. Reactive policies often miss these hidden constraints, while exhaustive search becomes computationally prohibitive in dense clutter. We present SCOUT, an occlusion-aware planning framework that bridges high-level deliberation with grounded physical rollouts. SCOUT leverages an object-centric scene representation to reconstruct hidden geometry and derive a relational planning state capturing blocker hierarchies and accessibility corridors. To navigate the vast action space in clutter, an LLM proposes structured action candidates which are then rigorously evaluated via Monte Carlo Tree Search (MCTS) using a learned action-conditioned world model. Evaluations on 'Reveal' and 'Placement' tasks show that SCOUT outperforms Vision-Language-Action (VLA) policies, embodied agents, and 3D world models, with significant gains in long-horizon tasks requiring reasoning over occluded geometry. We further validate the framework's robustness through real-world robotic manipulation in a cluttered shelf environment.
197. 【2611.01578】Recoverability-Aware Evaluation of Diffusion Video Inpainting and Object Removal
链接：https://arxiv.org/abs/2611.01578
作者：Yanliang Qi,Jiacheng Ding,Cong Guo,Peihua Mai
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：object removal, removal is scored, Video inpainting, video diffusion remover, inpainting for object
备注： 10 pages, 6 figures, 7 tables
点击查看摘要
Abstract:Video inpainting for object removal is scored over the whole hole, although the background behind the object is visible in other frames of the shot for some hole pixels and in no frame for others. A whole-hole score therefore mixes copying with generation and cannot show which of the two a remover does well. To separate the two, we propose recoverability-stratified evaluation, in which a point tracker run on the clean video labels each hole pixel by whether and how far away it is observed, so that fidelity and temporal stability can be reported per stratum against a copy reference. To reuse the observed content, we also propose evidence-guided sampling (EGS), which blends tracked colors into the clean-latent prediction of a video diffusion remover without training. On DAVIS, the perceptual advantage of three diffusion removers over flow propagation shrinks where the content is visible a few frames away (LPIPS difference-in-differences +0.046 to +0.056 against E2FGVI-HQ), and real paired captures show the same pattern for two of them. Their DAVIS hole warping error is two to four times that of ProPainter, and copying along clean-video tracks lowers their recoverable LPIPS by a quarter to two fifths. EGS closes 43% and 56% of the gap to this copy reference on held-out DAVIS when its colors come from clean-video tracks. With colors tracked on the masked input, a pre-registered confirmation finds no gain on MiniMax-Remover and a loss on ROSE. Diffusion removers thus leave observed content unused on DAVIS, and training-free reuse does not yet hold with tracked evidence.
198. 【2611.01573】Spend the Bits Where the Tiny Objects Are: Rate-Utility Region Coding for Aerial Detection
链接：https://arxiv.org/abs/2611.01573
作者：Yanliang Qi,Jiacheng Ding,Cong Guo,Peihua Mai
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Bandwidth-limited aerial cameras, Bandwidth-limited aerial, aerial cameras, cameras must compress, Bandwidth-limited
备注： 17 pages, including supplementary material
点击查看摘要
Abstract:Bandwidth-limited aerial cameras must compress their images before a remote detector can find the many tiny objects in them. Threshold-based region-of-interest (ROI) coding sends only confidently detected regions, and because tiny objects provide limited visual evidence and often score low, it can discard the regions that contain them. We propose rate-utility region coding (RUO), which sends a region when its expected detection utility justifies its measured byte cost, choosing to drop it or to send it at low or high quality with one multiplier shared across images. RUO trains no model, uses a standard image codec and decodes in a few milliseconds. On all 1,610 VisDrone-DET test-dev images, RUO uses 42.4% fewer bits than a tuned threshold-based ROI coder, averaged over their shared tiny-object average precision (AP) range. RUO also needs fewer bits for tiny objects than the AV1 Image File Format (AVIF), High Efficiency Video Coding (HEVC) and three published learned codecs, and its advantage over threshold-based ROI coding persists when the sender and receiver use different detectors. For AP over all object sizes RUO needs 25.4% more bits than the tuned ROI coder, because its allocation drops large regions first at low rates, so it suits tasks that target tiny objects. We plan to release the code.
199. 【2611.01558】xt-Assisted Event Stream Visual Place Recognition via Multi-Scale Spatiotemporal Optimal Transport
链接：https://arxiv.org/abs/2611.01558
作者：Lan Chen,Xingxing Xiong,Xiao Wang,Ziyan Zhang,Zikang Yan,Yuanhao Zheng,Bo Jiang,Yonghong Tian
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：high dynamic range, low-altitude economic research, low energy consumption, economic research leveraging, research leveraging event
备注： 17 pages including appendix, 4 figures. Submitted to ICLR 2027
点击查看摘要
Abstract:Benefiting from the high dynamic range, high temporal resolution, and low energy consumption of event cameras, low-altitude economic research leveraging event cameras has become a popular topic. Several existing attempts introduce natural-language descriptions into visual place recognition (VPR) to mitigate the sparsity of structural spatial information inherent to event cameras. Nevertheless, these methods still fail to fully address two core challenges: effectively encoding event streams and semantically aligning event streams with text. In this paper, we propose a multi-scale spatial-temporal optimal transport approach, MSTOT-EPR, to address these challenges. Specifically, given event streams and scene text information, we first adopt a visual encoder and a text encoder to extract respective feature representations. We then apply optimal-transport constraints to achieve cross-modal alignment. We then design a cross-modal bottleneck fusion module to further fuse bimodal features. Furthermore, we develop multi-scale spatial optimal transport and inter-frame temporal optimal transport modules to mine high-quality spatial-temporal event features for scene recognition. Extensive experiments on the NYC-Event-VPR and EPRBench datasets fully validate the effectiveness of our proposed framework for event-based VPR. The source code of this paper will be released upon acceptance.
200. 【2611.01551】opoDPO: Dense Preference Alignment for Structure-Sensitive Aerial Referring Segmentation
链接：https://arxiv.org/abs/2611.01551
作者：Huaiyuan Peng,Jisheng Dang,Wencan Zhang,Jingwen Zhao,Hong Peng,Wenjun Ma,Bin Hu,Qi Tian,Tat-Seng Chua
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：shared nonlinear weight, multimodal segmentation faces, heterogeneous preference signals, spatially heterogeneous preference, granularity mismatch
备注： 10 pages, 5 figures
点击查看摘要
Abstract:Preference optimization for multimodal segmentation faces a granularity mismatch: dense masks contain spatially heterogeneous preference signals, whereas image-level objectives assign one shared nonlinear weight to all spatial margins. We introduce TopoDPO, a topology-aware dense preference alignment framework for structure-sensitive aerial referring segmentation. Topo-Prior mines informative preference pairs using connected-component discrepancy and macro-corner recall, while the dense objective applies the preference penalty to each local margin before spatial aggregation against a frozen supervised reference. On Topo-RS-Hard, a 4590-instance structural stress set, TopoDPO improves intersection over union (IoU) from 50.91% to 51.24% over image-level direct preference optimization (DPO) and reduces Betti-0 error from 1.34 to 0.90; paired image-cluster bootstrap intervals against image-level DPO exclude zero for all five reported metrics. Matched supervised controls and a complete factorial analysis separate the effects of topology-aware pair mining, localized correction, and dense reference-relative preference weighting. An unfiltered stratification over all 39,244 validation records further shows the clearest structural gains on samples with moderate or severe pre-alignment component-count errors. The code is publicly available at: this https URL.
201. 【2611.01550】Detecting Generated-Depth Injection Attacks on RGB-D Place Authentication
链接：https://arxiv.org/abs/2611.01550
作者：Seigo Kawachi,Satoshi Matsuura
类目：Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV)
关键词：forged RGB-D queries, submit forged RGB-D, monocular depth estimation, Advances in monocular, publicly available RGB
备注： 6 pages, 1 figure, 1 table. Accepted to IEEE WIFS 2026. (c) 2026 IEEE
点击查看摘要
Abstract:Advances in monocular depth estimation (MDE) now let an attacker generate depth from publicly available RGB images and submit forged RGB-D queries. Such attacks break a core assumption of RGB-D place authentication: that depth comes from a sensor. We study a presentation attack detection (PAD) classifier that uses geometric consistency between the enrollment and query views, as a software-layer defense. A three-stage evaluation shows how far this classifier detects software-injected depth, depending on how accurately the attacker knows the camera intrinsics. In the first stage, the attacker has only an estimate of the intrinsics, and the PAD classifier separates forgeries generated by all three MDE models with a validation area under the receiver operating characteristic curve (AUC) of 0.997-0.999. In the second stage, the attacker obtains the exact intrinsics, and the original PAD classifier falls to near chance (AUC 0.54-0.61); a retrained PAD classifier, however, still has the registration residual between enrollment and query as a cue. In the third stage, an oracle evaluation, in which the evaluator fits warps using the ground-truth 3D geometry, shows that detection falls to near chance only in its strongest case, where every valid query keypoint is given its ground-truth 3D coordinate. Of the detection cues, the reprojection error captures the attacker's misestimate of the intrinsics, whereas the registration residual remains even when the attacker knows the exact intrinsics.
202. 【2611.01548】Band2Net: Frequency-to-Network Transport Distillation for fMRI-Privileged, EEG-Only Session-Condition Decoding
链接：https://arxiv.org/abs/2611.01548
作者：Nishi Kanta Paul,Md Shihabul Islam Shovo,Dwarikanath Mahapatra
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Functional MRI resolves, MRI resolves large-scale, Functional MRI, resolves large-scale brain, MRI resolves
备注： 5 pages, 2 figures, 1 table
点击查看摘要
Abstract:Functional MRI resolves large-scale brain networks but is expensive and stationary, whereas EEG is portable but poorly localised. We treat fMRI as privileged information, available during training and absent at deployment, with EEG and fMRI acquired from the same participants under matched conditions but not simultaneously. Band2Net encodes EEG into five frequency-specific connectivity graphs and fMRI into seven canonical network tokens from a frozen teacher, and solves a balanced entropic transport problem between the two token sets that gives each EEG band its own fMRI target. In subject-grouped cross-validation on the PsiConnect psilocybin data set, Band2Net reaches 0.801 ROC-AUC for EEG-only session-condition decoding, 5.0 AUC points (95% CI 1.8-8.2) above an EEG-only student. Although its margins over a single shared plan, a KL-relaxed plan and label-free network descriptors remain unresolved, secondary comparisons favour band-specific transported targets over logit, global-feature, contrastive and pooled-target distillation, though not after Holm correction.
203. 【2611.01543】GSExplorer: Interactive World Generation with a Persistent 3D Gaussian World State
链接：https://arxiv.org/abs/2611.01543
作者：Sicheng Yu,Liu Liu,Xinjie Wang,Xinjiang Wang,Taojun Ding,Wenhao Hu,Beizhen Zhao,Puxin Yan,Zhizhong Su,Hao Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Interactive world generation, accurate local control, Interactive world, requires both accurate, world generation requires
备注： 17 pages
点击查看摘要
Abstract:Interactive world generation requires both accurate local control and stable scene consistency over long rollouts. Existing methods improve local generation through camera or geometry conditioning and extend historical context with memory mechanisms. However, long-horizon exploration remains challenging as target-view guidance becomes incomplete and inconsistencies accumulate across repeated scene updates. We present \textbf{GSExplorer}, a generation--reconstruction framework built around a persistent 3D Gaussian world state. At each step, the current 3DGS scene provides multimodal rendering conditions for a condition-driven video generator, while camera geometry is injected through a separate Relative Ray Encoding branch. Generated videos are then fed back to a SLAM-based reconstruction backend, where inconsistency filtering prevents conflicting content from corrupting the scene and cross-chunk bundle adjustment improves spatial alignment across generation steps. We further design a data-construction pipeline that reproduces realistic 3DGS degradation during scene extrapolation, yielding 293K training pairs of degraded multimodal renderings and real target videos. GSExplorer achieves the best overall performance among the compared methods on both single-step and three-step WorldScore evaluation, with strong camera control and consistency across both settings, including a Camera Control score of 99.07 in single-step extrapolation. On 481-frame leave-and-return rollouts, it also shows strong revisit consistency, demonstrating the value of maintaining a reliable 3D world state for continued exploration.
204. 【2611.01541】MoPort: A View-Aware 2D Interface for Motion Language Models
链接：https://arxiv.org/abs/2611.01541
作者：Lixing Tan,Qing Xia,Yuting Guo,Shuai Li,Aimin Hao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Motion language models, language models, language-based understanding, discrete tokens, tokens for language-based
备注：
点击查看摘要
Abstract:Motion language models (MoLMs) encode 3D human motion as discrete tokens for language-based understanding. Deploying them on monocular video raises two problems. Pose detection yields 2D joint sequences, leaving a dimensional gap from the 3D motion used in training. Moreover, the 2D observation changes with the camera viewpoint, while the depth lost in projection makes the 2D pose ambiguous across viewpoints. We propose MoPort, a view-aware 2D interface that enables MoLMs to take 2D observations as input. We introduce Paired View Alignment (PVA), which gives two views of the same motion a shared 3D teacher target and directly constrains the consistency of their latents, so that 2D observations from different viewpoints are mapped to a consistent semantic representation. Camera-Modulated Encoding (CME) estimates the camera extrinsics from the 2D sequence and uses them to modulate encoding, providing the 2D latents with geometric information about the viewpoint. MoPort achieves R@1 of 0.5674 on HumanML3D and 0.3286 on KIT-ML, outperforming all evaluated baselines. On HumanML3D, its R@1 decreases only from 0.5763 on in-distribution viewpoints to 0.5585 on out-of-distribution viewpoints. We validate portability on three downstream MoLMs. Furthermore, on the real-world RGB video dataset Fit3D, MoPort achieves 80.36\% accuracy. Code will be released upon acceptance.
205. 【2611.01536】CUFormer: Modality-Aware CT-Ultrasound Point Cloud Registration for Orthopedic Navigation
链接：https://arxiv.org/abs/2611.01536
作者：Lixing Tan,Qing Xia,Yuting Guo,Shuai Li,Aimin Hao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：preoperative Computed Tomography, Registering intraoperative Ultrasound, Computed Tomography, radiation-free orthopedic navigation, support radiation-free orthopedic
备注：
点击查看摘要
Abstract:Registering intraoperative Ultrasound (US) bone-surface point clouds to preoperative Computed Tomography (CT) models can support radiation-free orthopedic navigation. Differences in imaging physics produce distinct surface sampling patterns, complicating cross-modal feature matching. Bone strongly reflects ultrasound and casts an acoustic shadow, so US captures only the probe-facing bone surface and leaves most CT points unmatched. This partial coverage makes correspondences ambiguous on near-symmetric bones. We propose CUFormer, a modality-aware registration framework. We introduce a Modality-Aware Transformer (MAT) that encodes input modality through identity embeddings and updates features through modality-specific adapters within a shared geometric matcher. We model imaging visibility and use predicted reference-side visibility to weight coarse and fine correspondences. CUFormer achieves the lowest mean registration errors among evaluated methods on two CT-US datasets, UltraBones100k and UltraBonesHip, and the CT-RGB-D dataset SpineDepth. On UltraBones100k, it reaches mean rotation error 4.53$^\circ$, translation error 3.19\,mm, and Root Mean Squared Error (RMSE) 2.54\,mm, reducing RMSE by 65.8\% relative to the best-performing baseline by this metric. These results demonstrate CUFormer's effectiveness in aligning partial bone surfaces with preoperative CT across anatomical sites.
206. 【2611.01534】AbacusGS: Gaussian Splatting without Per-Splat Sorting
链接：https://arxiv.org/abs/2611.01534
作者：Jiacheng Ding,Yanliang Qi,Cong Guo,Peihua Mai
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：Gaussian Splatting sorts, Gaussian Splatting, Splatting sorts, Gaussian, Splatting
备注： 10 pages, 5 figures, 6 tables
点击查看摘要
Abstract:3D Gaussian Splatting sorts every splat by depth in every frame. Viewers that draw splats with the hardware rasterizer and sort them on the CPU, as most web and mobile viewers do, spend most of the frame time in this sort. We present AbacusGS, which stores the blending order of a 3DGS scene in the scene layout. AbacusGS groups the splats into octree boxes of at most 128 splats and stores each box in order along an axis chosen at write time. In each frame, AbacusGS sorts only the visible boxes, and one dot product per box decides whether the box is read forward or backward. A short order-aware fine-tuning converts an existing 3DGS model, and the over operator of 3DGS stays unchanged. On 13 standard scenes, AbacusGS loses 0.13 dB PSNR on average against an equally fine-tuned 3DGS model. In an OpenGL viewer that orders splats on the CPU, AbacusGS renders frames 4.5 times faster than per-splat sorting. We also present a compact format of 17 bytes per splat and a CUDA tile renderer that use the same order. The code will be released.
207. 【2611.01529】AR-RRG: Anatomy-Guided Retrieval-Driven Radiology Report Generation
链接：https://arxiv.org/abs/2611.01529
作者：Xiang Zhang,Shijie Song,Wanqing Zhao,Wei Zhou,Rui Cao,Dekui Wang,Qiyao Hu,Xianlin Peng,Hangzai Luo,Sheng Zhong,Jianping Fan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：streamlines clinical workflows, Radiology report generation, radiologists' documentation, workflows and alleviates, alleviates the burden
备注：
点击查看摘要
Abstract:Radiology report generation (RRG) streamlines clinical workflows and alleviates the burden of radiologists' documentation. Standard vision-language models capture global visual cues and lack fine-grained alignment between anatomical regions and diagnostic text. Most retrieval-augmented methods retrieve complete historical reports, introducing redundant noise and severe vision-text mismatches that trigger clinically risky hallucinations and missed lesions. In this paper, we introduce AR-RRG, an anatomy-guided retrieval-driven method for the generation of radiology reports. AR-RRG consists of two core modules: the anatomy-aware self-training lesion detection network (ASLDNet) and the retrieval-driven radiology report generation (RRRG). ASLDNet leverages anatomy-aware spatial verification (ASV) and class-adaptive dynamic thresholding (CDT) via self-training, delivering accurate lesion localization to support subsequent generation. As the generative branch of AR-RRG, RRRG eliminates clinical hallucinations through dual-granularity retrieval (DR) and complements missing lesions with a neighborhood consensus (NC) mechanism. A parallel continuous visual perception (PCVP) stream converts radiographs into visual tokens through fixed medical encoding and resampling. Multi-scale text and visual features are fused, followed by LoRA-efficient large language model tuning to generate clinically consistent, visually grounded radiology reports. Extensive evaluations on MS-CXR, MIMIC-CXR, and IU X-Ray demonstrate that AR-RRG consistently outperforms state-of-the-art methods across mainstream metrics. Our code will be made publicly available.
208. 【2611.01517】VLMs Read Aloud: The Gap Between Recognizing and Using Visual Text
链接：https://arxiv.org/abs/2611.01517
作者：Zhiyun Shi
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：original text, text, Visual-text compression renders, original, compression renders long
备注： 23 pages, 7 figures, 21 tables
点击查看摘要
Abstract:Visual-text compression renders long contexts as images and is engineered around how much of the text a vision-language model (VLM) can recover. Yet recovered text is not usable text. VLMs can transcribe the text in an image word for word and still fail to answer from it; given back their own transcript, they answer nearly as well as from the original text. We call this difference the read-use gap. Recognizing and using visual text have different resolution requirements: Qwen3-VL-8B's recognition saturates at 15-pixel characters while use catches up only at 24 pixels, and scaling from 2B to 32B raises recognition without narrowing the gap. Putting the evidence into words closes it: thinking VLMs recite the evidence in their thinking, and their own transcript, written without seeing the question, recovers most of what thinking adds. In a preregistered held-out test, the gap ranks how much eight VLMs gain from their own words over pixels (Spearman $\rho$ = 0.86), which recognition rates do not. We propose ALOUD, which spends visual resolution on finding and recognizing evidence and language tokens on using it. Without keeping the source text, it doubles the accuracy of a frozen Qwen3-VL-8B on long documents compressed 5x and 10x: at 5x, from 27.7% to 54.8%, near the original text's 58.5%, with a context smaller than the compressed pages themselves. For less than the cost of reading the original text, it leads at equal budget every method that does without it, at every level, and beats AGAR and VERA, which paste the original text back; at 5x it also beats LensVLM-9B, which is trained and keeps the original text. Visual-text compression is limited not by how much text a model can recover, but by how much it can use.
209. 【2611.01513】Label-Free Localization and Test-Time Suppression of CLIP's Typographic Circuits
链接：https://arxiv.org/abs/2611.01513
作者：Bohan Liu,Wenqian Ye,Guangzhi Xiong,Zhenghao He,Sanchit Sinha,Aidong Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：CLIP-based Vision-Language Models, modern multimodal systems, Vision-Language Models, CLIP-based Vision-Language, multimodal systems
备注：
点击查看摘要
Abstract:CLIP-based Vision-Language Models have become cornerstones of modern multimodal systems. The cross-modal contrastive objective equips the CLIP vision encoder to both see objects and read text. These two abilities induce an entanglement between the encoding of lexical and semantic shapes, creating a distinctive vulnerability to typographic attacks, in which rendered text overrides an image's semantic content with its literal meaning. The black-box nature of these encoders has prevented a mechanistic interpretation of such entanglement. We introduce a head-decomposed Sparse Dictionary Learning (SDL) architecture that, by design, decomposes individual attention heads into interpretable, head-specific latents. Based on this inductive disentanglement, we re-purpose Clarity Score and propose normalized Text Attribution Score, which are both label-free, to identify attention heads that carry typographic information. As a causal validation of successful circuit separation, we perform a mechanistic intervention that reweighs attention away from the patch tokens in the identified lexical heads at test-time. Experiments show that the intervention effectively recovers object classification under typographic attack and, across five CLIP variants and four typographic benchmarks, achieves up to 46.9% improvement while incurring up to 1% accuracy loss in general image perception, outperforming prior supervised and training-free methods. Expanding on the mechanistic intervention, we propose a test-time adaptive attention head routing to further reduce the impact on performance at matched robustness, pushing beyond the Pareto frontier of current robustness-perception tradeoff.
210. 【2611.01467】See, Think, Use: Diagnosing Perception and Reasoning Failures in VLMs
链接：https://arxiv.org/abs/2611.01467
作者：Jiacheng Ding,Yanliang Qi,Cong Guo,Peihua Mai
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：model, vision-language model, answer, perception, protocol
备注： 10 pages, 4 figures, 8 tables
点击查看摘要
Abstract:We present See, Think, Use, a protocol that traces each answer of a vision-language model to perception, reasoning or the use of perception. The diagnosis shows a developer which stage to improve and directs test-time compute to the stage that fails. Benchmarks score the final answer, and an answer that rests on the image earns the same credit as a guess or a memorized prior. The protocol asks the model two extra questions per item and needs no access to its weights. A localization probe asks for a box around every instance and measures seeing, and a text-replacement probe answers from a description and measures thinking. Use is the rate at which the answer follows the model's own perception across counterfactual image pairs. The rate needs no answer labels, because the question and its prior are the same on both images. On two model families and six datasets the protocol shows that the knob that helps follows the task family. Answers follow the model's perception except on images that contradict a common prior, and asking the model to localize first repairs this failure when its boxes are right. Allocating compute by the measured stages comes close to the best uniform policy at lower cost and beats a random allocation of the same compute wherever a knob raises the short stage. We will release the code, the prompts and the per-question outputs.
211. 【2611.01466】Resolve, Clear, or Defer: Training-Free Active Prototype Triage for Ecological Detection Pipelines
链接：https://arxiv.org/abs/2611.01466
作者：Anirudh Potlapally,Brijesh Nanda Brunda Yogananda,Jianyang Gu,Maanav Jajodia,Luke Meyers,Wei-Lun Chao,Hari Subramoni
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Ecological monitoring increasingly, large image collections, monitoring increasingly relies, generate large image, Ecological monitoring
备注： Accepted to the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV 2027), Main Conference. 27 pages including supplementary material
点击查看摘要
Abstract:Ecological monitoring increasingly relies on camera traps and aerial surveys that generate large image collections. High-recall animal detectors can localize candidate animals at scale. However, they also produce many detections that still require expert review, including false positives, ambiguous cases, and animals difficult to identify at the species level. Since exhaustive review requires substantial effort, we propose training-free active prototype triage, where reviewed detections become reusable evidence to (1) Resolve supported foreground classes, (2) Clear likely background false positives, or (3) Defer insufficiently supported cases for expert review. Across camera-trap and aerial datasets, foreground recognition and false-positive rejection benefit from different pretrained representations: BioCLIP2 provides foreground evidence while DINOv3 provides background evidence, reducing erroneous foreground clearing while improving automatic foreground recovery. Deferring unsupported cases avoids the higher error rates caused by forced decisions. Compared with confidence-thresholded multiclass k-NN and uncertainty-sampling logistic regression, prototype triage improves foreground recovery while maintaining competitive or lower review burden. Acquisition goes beyond class discovery: even after classes are represented, prototype choice determines how reliably evidence propagates through the remaining detections. Our results suggest that once animal localization reaches high recall, the challenge shifts from finding animals to deciding which examples to review, how to reuse them, and when evidence does not support an automatic decision.
212. 【2611.01463】DIMWIT: Directly Invoking Models Without Intensive Tuning
链接：https://arxiv.org/abs/2611.01463
作者：Saarth Deshpande,Neeraja J. Yadwadkar,Venkat Arun
类目：Performance (cs.PF); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC); Operating Systems (cs.OS)
关键词：Resource managers typically, Resource managers, managers typically encode, optimization procedure, frontier LLM
备注：
点击查看摘要
Abstract:Resource managers typically encode what to do in a task-specific policy---a heuristic, an optimization procedure, or a model trained for the task---that must be developed before use and may need revision as the workload or system changes. We propose bypassing policy development and instead asking pretrained models to make resource-management decisions directly, given the current system state, desired outcome, and available choices. We evaluate this approach on microservice autoscaling, DRAM sizing, and video encoding, using a frontier LLM and two small decision models. On two microservice applications, a small decision model meets latency targets while using within 10% of the replicas allocated by policy-based autoscalers and within 13% of the frontier LLM. In DRAM sizing, a small decision model reduces DRAM usage by up to 27.5% relative to static provisioning while maintaining at least 95% of baseline performance. In video encoding, it completes encodes up to 4.3$\times$ faster than the frontier LLM, with an imperceptible 1.1-point decrease in Video Multi-Method Assessment Fusion (VMAF), a metric of perceptual video quality. Making individual resource-management decisions may be considerably simpler than developing a general strategy for making them.
213. 【2611.01460】Can Large Language Model Agents Learn by Watching Tutorial Videos?
链接：https://arxiv.org/abs/2611.01460
作者：Haoyu Zhao,Zafeirios Fountas,Jun Wang
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：Humans continuously acquire, continuously acquire knowledge, carefully crafted materials, carrying that understanding, future tasks
备注：
点击查看摘要
Abstract:Humans continuously acquire knowledge from carefully crafted materials such as books and tutorial videos, carrying that understanding into future tasks. Millions of such instructional videos are uploaded online every day, yet LLM agents remain unable to exploit this ever-expanding wealth of human teaching. Their capabilities are frozen after training, while parameter updates at scale remain prohibitively expensive. This raises the central question: can LLM agents learn from this vast instructional resource without parameter updates? We introduce Tutorial Agentic Learning (TAL), a nonparametric continual-learning paradigm that consolidates tutorial videos into a persistent, structured tutorialbook memory through a two-stage adversarial process that harvests hard, video-grounded questions and uses them to refine the memory. At inference time, TAL retrieves through a Table-of-Contents (TOC) tree, tying retrieval directly to the model's reasoning rather than to embedding similarity. To study this setting, we introduce VidLearn, a multimodal QA benchmark built from 72 chess tutorial videos spanning 12 openings. On VidLearn, TAL outperforms all evaluated baselines and improves monotonically as more videos are consumed, achieving up to 113% and 91% relative gains over the corresponding vanilla MLLMs on the training and test splits, respectively. In actual gameplay, TAL reaches a stronger opening-phase position than its vanilla counterpart in 69% of head-to-head games. Evaluation in a second domain further demonstrates the generality of TAL. Together, these results highlight instructional videos as a scalable resource for parameter-update-free agent continual learning.
214. 【2611.01457】ContactCut: A Partition-Aware Contact Selection Framework for False-Merge Correction in Connectomics
链接：https://arxiv.org/abs/2611.01457
作者：Byunghyun Ko,Won-Ki Jeong,Chaoli Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：connectomics requires converting, Localized false-merge correction, Localized false-merge, connectomics requires, requires converting
备注： 5 pages, 3 figures. Submitted to the IEEE International Symposium on Biomedical Imaging (ISBI) 2027
点击查看摘要
Abstract:Localized false-merge correction in connectomics requires converting an identified error into an executable native 3D partition. Still, neither intermediate correction predictions nor seeded graph solvers alone determine which native source-sink constraints should define that partition. We formulate this problem as a 3D-native partition-aware contact selection problem: selecting candidate contacts based on the complete partitions they induce. Our solution comprises two components: ContactCut (CC)-Auto, which uses learned single-contact selection, and ContactCut (CC)-Search, which enables bounded paired-contact search, generates compact alternatives, and applies learned panel ranking. On historical two-way false-merge corrections from MICrONS and FlyWire, CC-Auto improves failure-aware 3D partition (FA-3D Part.) mIoU by 5.9 and 3.4 points over the strongest graph-based controls and by 12.5 and 10.0 points over the best learned baselines. A MICrONS-trained ranker transfers to FlyWire with negligible degradation. CC-Search expands oracle reachability and prioritizes near-oracle alternatives. The code is available at this https URL.
215. 【2611.01438】FOCUS: Closed-Loop Attention Feedback for Efficient Vision-Language Understanding
链接：https://arxiv.org/abs/2611.01438
作者：Akul Santhosh,Aastha Jhunjhunwala
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：adds significant inference, significant inference cost, comprehend real-time video, adds significant, Vision-Language Models
备注：
点击查看摘要
Abstract:Processing every video frame through Vision-Language Models (VLMs) adds significant inference cost and limits their ability to comprehend real-time video. Existing approaches either sub-sample frames uniformly, ignoring content and missing important events, or prune visual tokens inside the VLM to cut per-call cost while still invoking the model on every sampled frame. We introduce FOCUS, a training-free three-layer framework that reduces the number of invocations and steers each one towards what matters. Temporal gating measures inter-frame dissimilarity in the patch-embedding space of a smaller VLM from the same family, triggering burst captures only when the scene changes in a semantically meaningful way. Patch-level dissimilarity is then accumulated across the burst and fused with a top-down attention prior into a spatial focus map that encodes where motion and semantic relevance coincide. That map calibrates the VLM's value cache during generation, progressively amplifying vision tokens in task-relevant regions and attenuating off-target ones, without removing any token from the context. The loop closes after each response: text-to-vision cross-attention is extracted from the decoder and fed back as the prior for the next burst, letting the system converge on semantically important regions over successive observations. We evaluate FOCUS on the 500-video EgoSchema subset in streaming mode, with a single Qwen3-VL-8B backbone shared by every method. It reaches 74.8% accuracy using 25.4 VLM calls per clip, against 74.6% with 55 calls for uniform sampling and 74.2% with 55 calls for BOLT. On egocentric video captioning across four domains, it matches the best baseline's quality while issuing 57% fewer VLM invocations than uniform sampling.
216. 【2611.01400】RadPose: ISAC-based RF 3D Human Pose Estimation
链接：https://arxiv.org/abs/2611.01400
作者：Geo Jie Zhou,Kunzhe Song,Ruxin Lin,Huacheng Zeng
类目：Computer Vision and Pattern Recognition (cs.CV); Networking and Internet Architecture (cs.NI)
关键词：conditions remains challenging, occlusion conditions remains, Human pose estimation, challenging for camera, LiDAR-based systems
备注： Accepted to WACV 2027
点击查看摘要
Abstract:Human pose estimation under adverse lighting and occlusion conditions remains challenging for camera- and LiDAR-based systems. Although mmWave radars provide robustness to illumination and occlusion, they rely on dedicated hardware and licensed spectrum, limiting scalability. In this paper, we present RadPose, a learning-based monostatic integrated sensing and communication (ISAC) framework that enables mmWave communication devices to perform 3D human pose estimation. Unlike specialized radars, RadPose leverages monostatic full-duplex operation to extract channel impulse responses (CIRs) directly from standard OFDM communication signals, generating 3D radio point clouds without additional sensing hardware. To address the sparsity and noise of RF observations, RadPose employs a cross-frame transformer-based pose inference network with semantic-guided spatial attention and target-driven temporal attention for robust spatio-temporal aggregation. It further adopts a joint-aware inverse kinematics refinement module based on graph convolution to enforce skeletal topology, bone-length consistency, and anatomical plausibility. Extensive experiments demonstrate RadPose achieves competitive accuracy compared to state-of-the-art radar-based approaches while maintaining robust performance in unseen and occluded scenarios. The dataset and source code are available at this https URL.
217. 【2611.01396】SpecUltra: A Unified Foundation Model for Heterogeneous Spectral Images
链接：https://arxiv.org/abs/2611.01396
作者：Weili Kong,Baisen Liu,Xiaojun Bi,Jiaming Pei
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：exhibits substantial heterogeneity, including hyperspectral image, hindering unified modeling, including hyperspectral, exhibits substantial
备注：
点击查看摘要
Abstract:Spectral imagery, including hyperspectral image (HSI) and multispectral image (MSI), exhibits substantial heterogeneity in band numbers, wavelengths, spectral resolutions, hindering unified modeling and cross-sensor transfer. From the perspective of imaging physics, these heterogeneous observations can be regarded as discrete measurements of an underlying continuous spectrum acquired through different sampling processes. Motivated by this perspective, we propose SpecUltra, a unified foundation model for heterogeneous spectral images. Specifically, SpecUltra employs 3D convolutional tokenization and wavelength-aware 3D RoPE to encode relative wavelength and spatial relationships, enabling fine-grained spatial-spectral modeling within a shared coordinate system. We further construct MultiHyper-200K, a large-scale multi-sensor HSI dataset, and pretrain SpecUltra using auxiliary-token-assisted mask image modeling (MIM), where a level token indicates the radiometric product type and register tokens absorb sensor- and acquisition-dependent variations. To bridge the spectral-granularity gap between HSI and MSI, we introduce Spectral Kernel Transformation (SKT), which transfers pretrained knowledge in parameter space by constructing MSI embedding kernels from fine-grained HSI-pretrained kernel slices. This design preserves pretrained spectral priors while maintaining compatibility with the pretrained backbone. Experiments on HSI and MSI classification and segmentation benchmarks demonstrate state-of-the-art or competitive performance across disparate sensors and downstream tasks.
218. 【2611.01391】Vocabulary Aligned Explanations for Computer Vision Models
链接：https://arxiv.org/abs/2611.01391
作者：Erfan Mirhaji,Nikhil Krishnaswamy,Jill Zarestky,Lisa Mason,Nathaniel Blanchard,Sarath Sreedharan
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Optimizing vision models, Optimizing vision, learn and utilize, utilize human-understandable, Optimizing
备注：
点击查看摘要
Abstract:Optimizing vision models for accuracy does not force the model to learn and utilize human-understandable and domain-specific concepts and rules. We propose explaining image classifications through domain-specific concepts, visual evidence, and expert knowledge expressed as logical rules. We introduce FLUENT (Framework for Localized, Uncertainty-Aware Explanations in Normative Terminology), a post-hoc framework that ranks expert-authored rules combining jointly required, alternative, and absent concepts. To account for prediction errors, FLUENT combines predicted labels and concept states with empirically estimated likelihoods and concept priors. It scores each rule by calculating support over satisfying assignments to the concepts mentioned in that rule, then normalizes these scores to express relative confidence among candidate explanations. The selected rule is illustrated through occlusion-based highlights for positive concept mentions in the query image and localized examples in retrieved reference images for negative mentions. These illustrations are intended to show end users unfamiliar with the domain what the concepts named in an explanation look like. FLUENT combines domain knowledge and model accuracy, and delivers visual concept highlights and explicit rule confidence to explain an image in the vocabulary of an application domain.
219. 【2611.01372】IMPACT: Image-Conditioned Motion with Physics-Aware Collision and Trajectory Guidance for Video Generation
链接：https://arxiv.org/abs/2611.01372
作者：Shiwei Yang,Yunlong Yu,Zhao Wang,Jungong Han
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Visually realistic video, Visually realistic, guarantee physically consistent, realistic video generation, realistic video
备注：
点击查看摘要
Abstract:Visually realistic video generation does not guarantee physically consistent motion. Generated objects may exhibit implausible collision responses or rebounds without energy dissipation, while even physically valid motion predictions may not be faithfully realized during synthesis. We propose \textbf{IMPACT}, a physics-state-driven image-to-video framework that addresses these challenges by coupling explicit dynamics prediction with complementary sparse--dense physical guidance. A learnably calibrated Physics State Generator unifies continuous free-flight dynamics with discrete collision responses, linking impact timing, post-impact velocity, rebound attenuation, and eventual settling within a coherent physical-state sequence. To translate this evolution into effective generative constraints, IMPACT derives sparse trajectories and dense region-level motion priors from the same physical rollout. Sparse trajectories constrain global object displacement, while dense priors guide diffusion sampling to encourage coherent object-region motion and suppress unwanted background changes. Their shared physical basis coordinates global and local motion guidance to reduce prediction--generation mismatch. Experiments on 100 controlled sphere--plane collision scenes spanning different material combinations and visual environments demonstrate improved physical plausibility over representative general-purpose, physics-grounded, and motion-controllable baselines. The project repository is available at this https URL
220. 【2611.01295】[Re] Pure Noise to the Rescue of Insufficient Data
链接：https://arxiv.org/abs/2611.01295
作者：Seungjae Ryan Lee,Seungmin Brian Lee
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：pure noise images, pure noise, noise images, imbalanced training data, noise
备注： Reproducibility study of Zada et al. ( [arXiv:2112.08810](https://arxiv.org/abs/2112.08810) ). Published in ReScience C 9(2), #45 (2023), ML Reproducibility Challenge 2022. 15 pages. Code: [this https URL](https://github.com/seungjaeryanlee/pure-noise)
点击查看摘要
Abstract:We examine the main claims of Zada, Benou, and Irani (2021), which states that in an image classification task with imbalanced training data, (i) using pure noise to augment minority-class images encourages generalization by improving minority-class accuracy. This method is paired with (ii) a new batch normalization layer that normalizes noise images using affine parameters learned from natural images, which improves the model's performance. Moreover, (iii) this improvement is robust to varying levels of data augmentation. Finally, the authors propose that (iv) adding pure noise images can improve classification even on balanced training data. We implemented the training pipeline from the description of the paper using PyTorch and integrated authors' code snippets for sampling pure noise images and batch normalizing noise and natural images separately. We reproduced the main claims that (i) oversampling with pure noise improves generalization by improving the minority-class accuracy, (ii) the proposed batch normalization (BN) method outperforms baselines, (iii) and this improvement is robust across data augmentations. Our results also support that (iv) adding pure noise images can improve classification on balanced training data. However, additional experiments suggest that the performance improvement from OPeN may be more orthogonal to the improvement caused by a bigger network or more complex data augmentation.
221. 【2611.01283】DriftingPlanner: Drifting Generative Models for One-Step Trajectory Planning in End-to-End Autonomous Driving
链接：https://arxiv.org/abs/2611.01283
作者：Ziming Liu,Yizhan Qu,Leichen Wang,Hao Sun
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：blends plausible maneuvers, fast but blends, blends plausible, plausible maneuvers, Drifting models move
备注：
点击查看摘要
Abstract:End-to-end planners decode the ego trajectory either by coordinate regression, which is fast but blends plausible maneuvers into one trajectory that may follow none of them, or by diffusion and flow matching, which model the trajectory distribution but need several inference steps. Drifting models move this iteration into training: a one-step generator learns to follow an attraction--repulsion field between generated and ground-truth samples. Drifting was developed for class-conditional image generation, where every class supplies many positive samples. In planning, every scene is its own condition. Pooling scenes would attract the generated trajectories of one scene to the ground truth of unrelated scenes, whereas computing the field per scene leaves a single positive, the expert trajectory. Mutual repulsion then holds the generated trajectories on a shell around it, so any single generated trajectory deviates from the ground truth. We present DriftingPlanner, a trajectory planner trained with the drifting loss alone, without any coordinate regression term. It computes the field per scene and removes the shell at inference: it decodes every noise vector together with its negation in one batched pass, and averaging each antithetic pair cancels the linear part of the displacement from the shell center. On NAVSIM navtest, DriftingPlanner reaches a state-of-the-art 93.75 PDMS, and with single-step inference its drifting decoder comes within 0.13 PDMS of the best diffusion or flow matching setting, which needs ten inference steps.
222. 【2611.01263】StreamClarify: Proactive Clarification for Grounded Streaming Video Question Answering
链接：https://arxiv.org/abs/2611.01263
作者：Zhuchen Shao,Bo Chen,Klara Nahrstedt
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：continuous video streams, requires real-time reasoning, video question answering, Streaming video question, continuous video
备注： Accepted to WACV 2027
点击查看摘要
Abstract:Streaming video question answering (QA) requires real-time reasoning over continuous video streams under strict latency and active-context budgets. Current streaming vision-language models (VLMs) often give confident yet ungrounded answers when queries are ambiguous or have false premises, or when relevant visual evidence is no longer in the active context. Proactive clarification can help, but must satisfy the same latency and memory constraints. We present StreamClarify, a training-free framework for grounded streaming QA that combines a pre-answer uncertainty check with hierarchical memory. The check uses the entropy of a binary pre-answer judgment as a lightweight uncertainty score to decide whether to answer directly or request clarification. To support re-answering, a temporal-pyramid KV cache maintains a bounded active visual context, while a CPU-side semantic retrieval archive provides access to historical frames. We further construct StreamClarify-QA, a diagnostic benchmark of 1,837 QA pairs from StreamBench and OVO-Bench, spanning standard, referential ambiguity, and unanswerable scenarios. Across three VLM backbones, StreamClarify improves Macro accuracy by up to 8.2 points over backbone-matched baselines. At comparable trigger rates, entropy-based selection achieves more than 18 points higher precision than random selection in identifying initially incorrect answers. Under oracle user guidance, clarification improves Macro accuracy by up to 3.5 points. We also report a controlled, oracle-assisted Qwen3-VL simulation on Ambiguous QA with generated questions and referent-only user replies, where the entropy-gated condition improves accuracy by 8.3 points.
223. 【2611.01252】Context-Shielded Backdoor Attack against Large Vision-Language Models
链接：https://arxiv.org/abs/2611.01252
作者：Zhifang Zhang,Qiang Huang,Chenpeng Wang,Weitong Chen,Olaf Maennel,Wei Emma Zhang,Lei Feng,Lei Zhang,Miao Xu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Large vision-language models, Large vision-language, inference-time visual-token compression, routinely use inference-time, compact budget
备注：
点击查看摘要
Abstract:Large vision-language models (LVLMs) routinely use inference-time visual-token compression to prune hundreds of patch tokens down to a compact budget. Existing LVLM backdoors fire whenever a triggered image appears, whereas prior deployment-triggered attacks activate only when model weights are quantized or pruned. However, conventional LVLM backdoors exhibit nearly 100% attack success rate (ASR) under full-token inference, immediately exposing compromised checkpoints during pre-deployment auditing. We reveal context stripping: surrounding clean visual tokens suppress an embedded trigger at full length, whereas token pruning strips this context away and activates the backdoor. Motivated by this finding, we propose StripWake, a projector-only backdoor that remains dormant under full-token auditing yet activates across unseen compressors. Specifically, StripWake pairs clean-supervised full-token views with target-supervised randomized compressed views, and aligns early visual attention with a frozen benign teacher to preserve clean utility. On LLaVA-1.5-7B across nine unseen compressors, StripWake stays dormant at 0.4% full-token ASR yet achieves 94.0%-99.7% compressed ASR across five primary compressors without CIDEr loss.
224. 【2611.01230】Reproducing INP-Former: Reconstructing Intrinsic Normal Prototypes for Industrial Anomaly Detection
链接：https://arxiv.org/abs/2611.01230
作者：Yunfei Liang,Juan Pablo Osorio Rivera
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：industrial anomaly detection, multi-class industrial anomaly, Intrinsic Normal Prototypes, extracts Intrinsic Normal, INP-Former extracts Intrinsic
备注： Reproducibility study. 12 pages of main text (excluding references and appendix), 14 tables. Code available at [this https URL](https://github.com/garasnote/Repro-INPFormer)
点击查看摘要
Abstract:We reproduce the central claims of INP-Former, a reconstruction-based method for multi-class industrial anomaly detection. INP-Former extracts Intrinsic Normal Prototypes (INPs) from each test image and uses them to guide a decoder that reconstructs normal features, without a stored memory bank. Using the authors' released code, we reproduce the reported performance on MVTec AD and VisA and extend the evaluation to MVTec AD 2, where image AUROC with the default settings is 63.4, compared with 99.7 on MVTec AD. On MVTec AD, a five-seed ablation shows that most of the performance comes from the INP mechanism, while the two auxiliary losses add small changes whose direction depends on the metric. A paired comparison with both losses disabled confirms the benefit of INP on MVTec AD 2. The default of six prototypes transfers less well: the plateau beyond four prototypes reproduces on MVTec AD and VisA, but on MVTec AD 2 a single prototype outperforms six in AU-PRO on the public split and on both hidden test splits. We also measure practical trade-offs in resolution, backbone size, training length, and LoRA adaptation, and examine performance by defect size, lighting condition, and a stricter AU-PRO limit. Several conclusions from the original benchmarks, including the default prototype count, do not carry over to harder data. Code: this https URL
225. 【2611.01222】Modeling Fat-shift for Improved Head Segmentation from MRI Scans using a Probabilistic Model
链接：https://arxiv.org/abs/2611.01222
作者：Merle Diedrichsen,Koen Van Leemput,Douglas N. Greve,Oula Puonti,Axel Thielscher
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Personalized computational head, magnetic resonance imaging, Personalized computational, accurate whole-head segmentations, computational head models
备注：
点击查看摘要
Abstract:Personalized computational head models for biophysical simulations rely on accurate whole-head segmentations from T1-weighted (T1w) magnetic resonance imaging (MRI) scans. While T1w scans provide excellent contrast for intracranial anatomy, extracerebral tissues have partly almost no signal (compact bone) and also suffer from the so-called chemical shift artifact, which affects the fatty tissues in MRI and causes them to spatially shift in the frequency encoding direction of the scan. This artifact occurs primarily in two structures of the head: the spongy bone, a fatty compartment inside the compact bone, and the subcutaneous fat, located directly underneath the skin. The frequency-encoding direction is often set in the superior-inferior direction, causing the fatty tissues to shift down and, as a result, making the skull appear thinner than it actually is. Existing segmentation methods do not model this artifact, consequently leading to inaccurate labeling of the skull and scalp, which introduces a bias in biophysical simulations. The direction and magnitude of the fat-shift can be determined from the scan parameters, thus making it possible to explicitly model the shift and to recover the correct anatomy. This study introduces a probabilistic model that uses variational inference to segment head and brain structures from a T1w scan while accounting for the fat-shift artifact. The proposed Fat-shift-informed Label Optimization of the Whole head (FLOW) method reconstructs extracerebral anatomy more accurately than a fat-shift-agnostic segmentation approach while maintaining high segmentation accuracy in all other structures. FLOW-based fat-shift corrected segmentations significantly reduce bias in electric field simulations compared to a segmentation method that does not model the shift.
226. 【2611.01215】Vision-Language Models Are Joint Denoisers in Robotic Action Generation
链接：https://arxiv.org/abs/2611.01215
作者：Xicheng Gong,Wenxuan Song,Chengze Liu,Qiwei Li,Qize Yu,Jiaolong Yang,Haoang Li,Yadong Mu
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：providing static conditioning, cascade pretrained vision-language, VLM, action, diffusion action experts
备注： 19 pages, 6 figures, 6 tables
点击查看摘要
Abstract:Diffusion-based vision-language-action (VLA) models cascade pretrained vision-language models (VLMs) with diffusion action experts, but typically restrict the VLM to providing static conditioning. This separation limits how much pretrained perception and reasoning can guide action generation, especially in out-of-distribution settings. We introduce JADE, a Joint Action DEnoiser that enables the VLM and action expert to jointly refine actions. Our key insight is that structured action latents allow the VLM to read the current noisy action together with visual observations and language instructions. At every denoising step, the VLM contextualizes the noisy action and guides the action expert through gated cross-attention, so that its guidance evolves with the action being generated. We further supervise the VLM to recover clean action latents from noisy ones, which gives it a direct action-learning signal and couples perception with control. Additionally, joint denoising enables JADE to generate actions with fewer sampling steps, helping offset the additional cost of VLM participation. An adaptive step-size schedule further balances task performance and inference latency. On RoboDojo, JADE achieves an average success rate of 12.67%, the highest among the evaluated $\pi_{0.5}$-based methods, and is competitive with recent VLA and WAM foundation models pretrained at scale. It also improves performance on RoboTwin 2.0 and raises the average success rate across four real-world bimanual tasks by 20.8 percentage points compared with $\pi_{0.5}$.
227. 【2611.01162】SHield: Watermarking 4D Gaussian Splatting via Spherical Harmonic Coefficient Perturbation
链接：https://arxiv.org/abs/2611.01162
作者：Kunal Bhosikar,Prajas Wadekar,Venkata Sai Pranav Bachina,Ankit Gangwal,Charu Sharma,Nicole Meng,Yingjie Lao
类目：Computer Vision and Pattern Recognition (cs.CV); Cryptography and Security (cs.CR); Graphics (cs.GR); Multimedia (cs.MM)
关键词：easily copied parameter, copied parameter files, Gaussian Splatting, computationally expensive, expensive to train
备注： 35 pages, 9 figures, 21 tables, 2 algorithms
点击查看摘要
Abstract:4D Gaussian Splatting (4DGS) models are computationally expensive to train but distributed as easily copied parameter files. Existing watermarks protect these assets by fine-tuning the scene against a neural decoder to extract bit strings from rendered video, a heavy process vulnerable to the temporal dynamics of dynamic scenes. However, if the threat model targets the redistributed file itself, verification can be vastly simplified. Because the canonical Spherical-Harmonic (SH) coefficients of 4DGS are time- and view-invariant, parameter-space perturbations can be recovered via deterministic arithmetic. We propose **SHield**, the first non-blind, decoder-free watermarking approach that natively embeds full-resolution RGB images into 4DGS files. SHield tiles a zero-mean payload across the SH coefficients of a key-selected Gaussian subset, applying a brief anchored optimization to preserve visual fidelity. To verify ownership, it geometrically re-associates the key using canonical Gaussian centres to survive file tampering and recovers the payload in closed form. Across 30 scenes (D-NeRF, HyperNeRF, DyNeRF), SHield guarantees near-perfect payload recovery (Pearson $r \geq 0.991$) on all 150 tested models with a mean rendering penalty of $\leq 0.13$~dB. Held-out evaluation yields perfect detection on 400 true trials and zero false positives across $1{,}600$ wrong-subset null trials. We also strictly bound the method's robustness: SHield survives INT8 quantization and $30\%$ opacity pruning for the image payload, and on aggressive SH-degree-1 truncation bit payloads are still decodable.
228. 【2611.01141】GESTALT: Fast, Generalizable Histopathology Image Synthesis from Gene Expression with Pretrained Pathology Foundation Models
链接：https://arxiv.org/abs/2611.01141
作者：Felix Ho,Alexandros Graikos,Dimitris Samaras
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Spatial transcriptomics measures, transcriptomics measures gene, measures gene expression, spatial assay molecular, transcriptomics measures
备注： Accepted at WACV 2027. 10 pages (8 main paper + 2 references), 4 figures. 8 pages of supplementary material
点击查看摘要
Abstract:Spatial transcriptomics measures gene expression while preserving where each cell sits in the tissue. The inverse, what a given transcriptomic state looks like, is less explored but equally useful: it lets researchers visualize the morphological consequence of a molecular state and interpret a spatial assay's molecular calls against real tissue structure. GeneFlow, the current state of the art on the Xenium gene expression-to-image benchmark, trains a model from scratch, incurring a high cost on every new target dataset it is applied to. We instead propose GESTALT, which reformulates gene expression-to-image synthesis as predicting a pathology foundation model's image embedding. A lightweight gene-token transformer predicts this embedding from multi-cell gene expression, and a frozen or LoRA-adapted diffusion decoder (PixCell) renders it as an image. Because this visual knowledge is reused rather than relearned, GESTALT trains in a fraction of the time. In both multi-cell and single-cell settings, our method outperforms the SoTA on perceptual metrics across all three Xenium datasets. Beyond improved image quality, GESTALT natively synthesizes at 1024 x 1024, and is evaluated in three generalization settings: zero-shot transfer across gene panels and datasets, held-out patients and disease states, and transfer across studies and tissue sources. Coupled with a statistical model of spatial expression, GESTALT also provides, to our knowledge, the first paired synthesis of cell-resolved transcriptomic fields and tissue images with explicit control over cell type, density, and composition. Code is available at this https URL.
229. 【2611.01125】What Does a Safety Label Measure? Auditing Situational-Safety Benchmarks for Multimodal LLMs
链接：https://arxiv.org/abs/2611.01125
作者：Wayner Barrios,Kenneth Barrios
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multiagent Systems (cs.MA)
关键词：Situational-safety benchmarks label, multimodal large language, scores guide deployment, Situational-safety benchmarks, large language model
备注：
点击查看摘要
Abstract:Situational-safety benchmarks label each scene SAFE or UNSAFE and score a multimodal large language model (MLLM) against that label, usually by judging its free-form answer, and these scores guide deployment. We ask what such a label measures. A label score can come from the scene, the request or the benchmark's own files. We propose the Benchmark Card, seven measured fields that tell them apart, and fill it for six benchmarks. Only MSSBench chat leaks the label through its image files: image size alone reaches 82.3% accuracy, matching or beating six of seven commercial models. Elsewhere the signal outside the scene comes from design. In MOSSBench the item partition fixes the label, and on HoliSafe the request alone ranks pairs about as well as the scene. On our corrected chat split, the size rule falls to chance. We then introduce the Spot-Stop decomposition, which compares ranking with labelling on pairs of a safe and an unsafe scene. It splits the gap above a label-swap null into three parts: a threshold part, overlap between safe and unsafe scores, and order that holds only within a pair. Most of fourteen open MLLMs rank better than they label, beyond what their AUROC predicts. On chat, one shared threshold repairs a third to a half of the excess, and label-free recentering recovers it on balanced batches. Recentering on unlabelled scenes of the same situation improves ranking on VSCBench for 13 of 14 models.
230. 【2611.01120】StreamDuo: A Live Commentator and a Research Agent for Unseen Games
链接：https://arxiv.org/abs/2611.01120
作者：Zixian Gao,Penghao Luo,Xiangcheng Cao,Lixin Xiu,Ziqi Cai,Zhen Li,Erwin Wu,Kaipeng Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Streaming video LLMs, commentate live gameplay, live gameplay, game commentates games, video LLMs
备注： 18 pages, 7 figures
点击查看摘要
Abstract:Streaming video LLMs can now commentate live gameplay, but they are trained and tested on the same games. We study cross-game streaming commentary, in which a model trained on one game commentates games it has never seen, and find that current commentators transfer their timing but not their knowledge of the game world. We propose StreamDuo, which pairs a trainable commentator with a frozen research agent that reads the wiki of the game being played. When the commentator sees something it cannot name, it sends the current frames, and the research agent returns a few wiki entries two seconds later while the stream continues. We train only the commentator, on a single game, in two stages. Information-gain labels teach it to ask only where an answer would help it say what the human caster said, and on-policy self-distillation from a copy of itself that sees the ideal answer teaches it to use noisy answers. Trained on Baldur's Gate 3 and tested on ten unseen games, StreamDuo raises entity recall from 0.082 to 0.116 over Proact-VL trained on the same data, cuts source-game leakage from 9.9% to 1.0%, and achieves the best timing and the highest judged liveliness and overall quality among streaming models.
231. 【2611.01095】Pop Goes the Verifier: Phoneme-Targeted Data Poisoning of Voice Liveness Detection
链接：https://arxiv.org/abs/2611.01095
作者：Eshaq Jamdar,Amith Kamath Belman
类目：Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)
关键词：Automated Speaker Verification, Frequency Cepstral Coefficients, Gammatone Frequency Cepstral, Speaker Verification Systems, Cepstral Coefficients
备注： Accepted at IEEE International Joint Conference on Biometrics (IJCB) 2026
点击查看摘要
Abstract:Many Automated Speaker Verification Systems (ASVs) commonly employ liveliness detection techniques, such as VoicePop, which identify genuine speech by analyzing low- frequency pop bursts from plosive phonemes using Gammatone Frequency Cepstral Coefficients (GFCC) and an SVM classifier. While effective against traditional replay attacks, such systems are vulnerable to data poisoning techniques. Prior work shows that broadly applied SyntheticPop attacks can collapse model to accuracy to as low as 14.01% using only 20% poisoned samples, but the resulting artifacts are easily detectable when visualizing the waveform energies. This paper introduces Pop Goes the Verifier, a stealthier phoneme injection poisoning attack. By leveraging FastSpeech 2 (FS2) with a modified HiFi-GAN vocoder, we inject localized pop bursts at plosive phoneme locations and overlay subtle Gaussian noise to reduce the visibility of injected artifacts in waveform and spectrogram analysis. Using the ASVSpoof 2019 as the dataset, we observe that the approach achieves a moderate poisoning attack while providing greater resistance to signal-level inspection than the original SyntheticPop attack.
232. 【2611.01084】QVR3D: Query-Guided Visual Reasoning for Training-Free 3D Grounding
链接：https://arxiv.org/abs/2611.01084
作者：Jung-Hao Kao,Jing-En Huang,Jia-Wei Liao,Tzuhsuan Huang,Yu-Lun Liu,Cheng-Fu Chou,Jun-Cheng Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：natural language descriptions, grounding localizes objects, language descriptions, localizes objects, natural language
备注：
点击查看摘要
Abstract:3D visual grounding localizes objects in 3D scenes from natural language descriptions, requiring reasoning over semantics, spatial relationships, and multi-view observations. Training-free approaches avoid costly annotations but often rely on explicit scene transformation or scene-level frame selection, which may waste limited visual capacity on query-irrelevant regions. We observe that effective grounding should prioritize observations that provide evidence for the query rather than uniformly represent the entire scene. Based on this insight, we introduce QVR3D, a query-guided visual reasoning framework that operates on RGB-D observations using off-the-shelf foundation models. QVR3D combines Query-Guided Maximum Coverage (QGMC) for selecting complementary query-relevant views with Grounding Probability Estimation (GPE) that integrates instance confidence, attribute consistency, and relationship consistency. The framework supports both single- and multi-object grounding without task-specific adaptation. Experiments on ScanRefer and Nr3D achieve state-of-the-art zero-shot performance, while QGMC also improves frame efficiency across multiple 3D vision-language tasks. Our code is available at this https URL.
233. 【2611.01078】CuPH: Parallel Cubical Persistent Homology via Level-Synchronous Component Tracking
链接：https://arxiv.org/abs/2611.01078
作者：Guangyu Meng,Pengfei Gu,Erin Wolf Chambers,Danny Z. Chen
类目：Computer Vision and Pattern Recognition (cs.CV); Computational Geometry (cs.CG); Distributed, Parallel, and Cluster Computing (cs.DC)
关键词：mathematically principled multi-scale, principled multi-scale topological, multi-scale topological descriptor, Persistent homology, connectivity in data
备注：
点击查看摘要
Abstract:Persistent homology (PH) is a mathematically principled multi-scale topological descriptor of shape and connectivity in data. It is widely applied in image classification, segmentation, and shape analysis across medical and aerial imaging, providing structural information that pixel-wise deep learning may overlook. Standard cubical PH decomposes an image into cubical cells (vertices, edges, and squares) and reduces them sequentially in filtration order. This sequential reduction has $\Theta(n)$ parallel depth for an $n$-pixel image, limiting within-image GPU parallelism and constraining its use in topology-aware deep learning. We introduce CuPH, a GPU-based parallel algorithm for computing cubical PH on 2D images that operates directly on pixels rather than cubical cells. CuPH buckets pixels by filtration values, activates them with a level-synchronous sweep, and tracks connected components with a lock-free union-find method. We prove that CuPH produces persistence diagrams identical to standard cubical PH on integer inputs, with a stability bound for floating-point inputs. CuPH reduces parallel depth from $\Theta(n)$ to $O(L\log n)$ for an image with $L$ intensity levels. We implement the level sweep as a single CUDA kernel, eliminating cross-level kernel-launch overhead. Empirically, CuPH is $18.6$--$99.6\times$ faster than the existing GPU baseline (CMP). As a drop-in PH backend, CuPH accelerates topology-aware classification ($4.2$--$16.7\times$) and segmentation ($8.3$--$44\times$) while preserving accuracy. It also enables computing full-image PH losses on high-resolution images, improving segmentation Dice by $2.2$--$4.6$ points over patch-local PH baselines and accelerating training by $25$--$31\times$.
234. 【2611.01074】Grounding Across Views: Cross-View Referring Reasoning for Visual Grounding
链接：https://arxiv.org/abs/2611.01074
作者：Hao Gan,Liuqian Wang,Shuang Li,Yufei Gao,Wentao Chao,Chong Fu,Chengming Liu,Lei Shi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Cross-view object geo-localization, object geo-localization, aims to localize, observation captured, Cross-view object
备注：
点击查看摘要
Abstract:Cross-view object geo-localization (CVOGL) aims to localize a target in a satellite image from an observation captured under another viewpoint. Existing methods typically specify the query with a click point or bounding box, marking the target region but underusing the semantic attributes and relations conveyed by natural language. Moreover, referring expressions are often viewpoint-dependent, making query-view descriptions difficult to ground directly in the satellite image. In this paper, we formulate cross-view visual grounding (CVVG), extending conventional point- or box-prompted CVOGL to instance grounding jointly guided by a referring expression and a visual exemplar. We present GAV (Grounding Across Views), a view-aware framework for selectively transferring visual and linguistic evidence across views. Its core is view-aware referring reasoning: target-centered descriptions are derived from the marked query image, checked for target-category consistency, and augmented with a direction-free role cue. Exemplar prompting, cross-view alignment, and scene-level discrimination ground this semantic evidence in a satellite instance. GAV achieves a new state of the art on MoP-UAV with 62.55% Acc@0.5. We also introduce CVOGL-Text, a benchmark for text-guided grounding from street- and drone-view queries to satellite images. GAV outperforms the click-point baseline by 7.09 and 6.79 Acc@0.25 points on the street- and drone-view splits, respectively, demonstrating robustness to larger viewpoint gaps. The code and annotations will be publicly released.
235. 【2611.01018】Robust Pixel-wise Digital Image Correlation under Large Motions and Illumination Variations via a Global-to-Local Hybrid Neural Field
链接：https://arxiv.org/abs/2611.01018
作者：Xianglong Guo,Jianyang Li
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Digital image correlation, Digital image, full-field displacement measurement, widely used non-contact, non-contact technique
备注： 28 pages, 12 figures, 4 tables
点击查看摘要
Abstract:Digital image correlation (DIC) is a widely used non-contact technique for full-field displacement measurement. Data-driven deep-learning DIC offers rapid inference but may generalize poorly to unseen speckle patterns, deformation modes, noise levels, and illumination conditions. Classical optimization-based DIC and recent image-constrained neural formulations avoid labeled displacement data, yet their convergence and accuracy remain vulnerable to initialization, large rigid-body motion, fine non-uniform deformation, and gray-value disturbances. This paper presents a global-to-local hybrid neural DIC framework for robust pixelwise measurement. Stage 1 estimates a dominant in-plane rigid transformation through coarse rotation search, phase correlation, and masked refinement, providing a reliable initialization under large translation and rotation. Stage 2 represents the residual displacement with a hybrid Kolmogorov-Arnold network (KAN) and multilayer perceptron (MLP), and optimizes it using a valid-overlap, illumination-robust structural loss. The local gray-value model explicitly accommodates multiplicative and additive intensity changes. Simulated and real experiments demonstrate accurate and stable displacement recovery under noise, non-uniform deformation, large rotation, illumination variation, and degraded imaging conditions.
236. 【2611.00974】Efficient Image Denoising on Smartphone GPUs: Mobile AI 2026 Challenge Report
链接：https://arxiv.org/abs/2611.00974
作者：Andrey Ignatov,Georgy Perevozchikov,Radu Timofte,HaoDong Wu,Desheng Cai,Nikolay Falaleev,Faraz Kayani,Sarmad Kayani,Asad Ahmed,Dmitry Ignatov,Kihwan Yoon,Ganzorig Gankhuyag,Yoonsuk Kang, TheVan Le,Jin Young Lee,Sunzhe Yang,Qiuhai Yan,Kang Chen,Tingting Wang,Faming Fang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：mobile photography, mobile, fundamental problem, Image denoising, Qualcomm and Arm
备注：
点击查看摘要
Abstract:Image denoising is a fundamental problem in mobile photography. Despite a large number of solutions proposed for this task, the majority of them are trained on synthetically produced noisy images, and are additionally too computationally heavy for processing full-resolution images on mobile devices. This creates a need for efficient deep learning-based models that are not only performant but can also be deployed on constrained mobile hardware. In this Mobile AI challenge, we address this problem and propose the participants to design fast solutions that can denoise Full HD resolution photos while running on popular smartphone GPUs from Qualcomm and Arm. For this, the participants were provided with a large-scale dataset consisting of noisy-clean image pairs captured in the wild. The runtime of all models was evaluated on the Snapdragon 8 Elite Gen 5 and Dimensity 9500 chipsets with the Adreno and Mali GPUs, respectively. Top solutions proposed in this challenge are able to perform high-quality image denoising under 100 milliseconds on both platforms while reaching a PSNR score of over 37 dB. A comprehensive description of the models developed in the challenge is provided in this paper.
237. 【2611.00963】4K Image Super-Resolution on Mobile NPUs: Mobile AI 2026 Challenge Report
链接：https://arxiv.org/abs/2611.00963
作者：Andrey Ignatov,Georgy Perevozchikov,Radu Timofte,Fubin Ren,Shihao Wang,Liwen Zhang,Zhe Xu,Zhipei Lei,Minjian Zhang,Kailing Tang,Dingyong Gou,Yanlin Wu,Cong Li,Xiaohui Cui,Kihwan Yoon,Ganzorig Gankhuyag,Heo MyeongCheol,Yonghyun Park,Juho Jung,Sungjei Kim,Phuong-Nam Nguyen-Pham,Nam-Tien Le,Tinh-Anh Nguyen-Nhu,Matin Fazel,Abdelhak Bentaleb,Xinrui Li,Xusheng He,Jianlong Wu,Mohsin Ikram,Dmitry Ignatov,Hao Chen,Long Sun,Jiangxin Dong,Jinshan Pan,Jinhui Tang,Siyue Teng,Yuxuan Jiang,Fan Zhang,David Bull,Zhe Xiao,Jun Xiao,Zhi-Song Liu,Jiayi Pei,Songtao Wu,Hong Shang,Kuanhong Xu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：super-resolution is widely, mobile devices, popular mobile NPUs, image data, mobile
备注：
点击查看摘要
Abstract:Image super-resolution is widely used on mobile devices for upscaling various types of image data. This creates a need for efficient deep learning-based models that are not only performant but can also be deployed on neural processing units (NPUs) present in the majority of mobile and IoT chipsets. In this Mobile AI challenge, we address this problem and propose the participants to design fast solutions that can upsample images from Full HD to 4K resolution while running on popular mobile NPUs from Qualcomm and MediaTek. For this, the participants were provided with the DIV2K dataset and trained models to do an efficient 3X image upscaling. The competition had two tracks: in the first track, the models had to be fully quantized (INT8), and the runtime of all models was evaluated on the Qualcomm Snapdragon 8 Elite Gen 5 NPU. In the second track, the participants were developing floating-point solutions that were evaluated on the MediaTek Dimensity 9500 NPU. Top solutions proposed in this challenge are able to reconstruct 4K images under 5 milliseconds while reaching a PSNR score of 30 dB. A comprehensive description of the models developed in the challenge is provided in this paper.
238. 【2611.00953】PSF-Informed Reconstruction: An Enhanced 2D Directional Filtered Backprojection Method for Cone-Beam Rotary Computed Laminography
链接：https://arxiv.org/abs/2611.00953
作者：Chengxiang Wang,Wei Yu,Baodong Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Cone-beam rotary computed, rotary computed laminography, high aspect ratios, Cone-beam rotary, computed laminography
备注：
点击查看摘要
Abstract:Cone-beam rotary computed laminography (CL) presents a viable alternative to cone-beam CT for imaging objects with high aspect ratios. Conventional reconstruction techniques, such as CL-FBP and CL-FDK, often yield suboptimal results charac?terized by pronounced superimposition artifacts, reduced contrast,and blurred edges, primarily due to their reliance on 1D row-wise filtering along detector rows. To address these limitations and improve reconstruction quality, we proposed a novel 2D directional filtered backprojection (DFBP) method based on the point spread function (PSF). First, an exact expression for the projection process is derived by establishing the relationship between a reconstructed pixel and its corresponding projection point on the detector. Second, a revised backprojection process incorporating two weighting factors is introduced to counteract the nonlinearity inherent in conventional backprojection, leading to a simplified PSF formulation. Third, to circumvent the computational burden of 3D image space filtering,an approximate method by linearizing the coordinate relationship in Fourier space under some assumptions is developed that transfers the 3D filtering operation to the 2D projection space. This approach facilitates the derivation of a formally simple yet effective 2D direc?tional filter, which integrates a 2D von Hann window and a 2D sinc window. Experimental results demonstrate that the proposed method produces reconstructions with superior contrast, sharper boundaries,and fewer superimposition artifacts compared to CL-FBP and CL?FDK. Moreover, it enables more accurate recovery of internal structures, such as bubble defects and electronic components.
239. 【2611.00937】What Helps Denoising Can Hurt Memory: Rethinking History in Long Video Generation
链接：https://arxiv.org/abs/2611.00937
作者：Yubin Jing,Ziyang Zhang,Meng Chen,Yuyao Li,Haofan Wang,Yichen Gong
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Autoregressive video, historical context, Commit Forcing, generators produce long, Autoregressive video generators
备注： 41 pages, 9 figures, 56 tables
点击查看摘要
Abstract:Autoregressive video generators produce long videos block by block, using historical context to maintain temporal consistency. After denoising, a committing pass encodes each clean block into keys and values (KV) that later blocks read, and the same clean block can be encoded into different KV depending on the history it reads. We therefore study historical context not only as a condition for denoising but also as an input to committing. Older historical context that supports denoising can harm subsequent generation when read during committing. At fixed context size and temporal positions, older historical context lowers mean clip-to-clip Subject Consistency. Across 5 generator configurations supporting longer contexts, consistency rises, plateaus, and then declines as committing context expands. Motivated by these findings, we propose Commit Forcing, a training-free rule that organizes committing into a chain. During committing, each block reads only the preceding block's stored KV, so older historical context reaches new entries only through the chain. We apply this rule to 6 pretrained generators. On 60-second VBench, Commit Forcing improves Quality and Total on all 6 generators, by up to 1.27 Quality points and 1.10 Total points. Long-range consistency gains extend to 240-second videos. In a blinded comparison on 120-second LongLive videos, Commit Forcing achieves win rates of 83.5% for subject and scene consistency and 82.9% for overall preference against the base generator, excluding ties.
240. 【2611.00926】UI-UG 2: Advancing Mobile UI Understanding and Generation with Fine-Grained Supervision and Reinforcement Learning
链接：https://arxiv.org/abs/2611.00926
作者：Hao Yang,Shuoyang Liu,Xiaoyu Lin,Zhou Fang,Maji Huang,Zhaosong Huang,Ruichao Mao,Teng Guo,Hai Rao
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)
关键词：reliable structured synthesis, UI-UG, Mobile UI understanding, generation, Group Relative Policy
备注： 30 pages, 17 figures, 10 tables, including references and appendices
点击查看摘要
Abstract:Mobile UI understanding and generation require both fine-grained component perception and reliable structured synthesis. Inspired by the unified direction introduced by UI-UG, we present UI-UG 2, a compact 4B-parameter multimodal large language model (MLLM) that advances mobile UI Understanding and Generation with broader task coverage, a front-end-aligned taxonomy, and online render-aware reinforcement learning. UI-UG 2 constructs a multi-source understanding corpus from RICO, VINS, Android in the Wild, and Android Control, annotated with an 80-category two-level UI taxonomy aligned with front-end component semantics, and pairs it with over 5,000 requirement-screenshot-JSON tuples for progressive structured UI generation through a domain-specific language (DSL). For understanding, UI-UG 2 introduces decomposed rewards for category prediction, OCR fidelity, color recognition, dense grounding, and GUI grounding. Unlike the offline Direct Preference Optimization (DPO)-style generation optimization in UI-UG, UI-UG 2 optimizes generation through end-to-end online Group Relative Policy Optimization (GRPO): sampled DSL outputs are rendered with a Playwright-based server-side pipeline and evaluated using LLM-as-a-Judge and contrastive preference ranking. Experiments show that UI-UG 2 achieves the strongest referring and dense-grounding results among the evaluated models on our 80-category benchmark, and achieves the best composite generation score among compared models at a compact scale (4B). More importantly, we observe a consistent understanding-to-generation transfer: adding fine-grained UI perception supervision improves generation quality under a fixed training budget, suggesting that component-level semantics provide a shared representational foundation for both tasks.
241. 【2611.00908】ZOPGA-KD: Zeroth Order PGA Guided Data Free Knowledge Distillation
链接：https://arxiv.org/abs/2611.00908
作者：Tuhin Subhra Mukherjee,Tiya Rose Pulikunnel,Vaidhav Adit,Devanand Thanissery,S.H. Shabbeer Basha
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：original training data, small student network, large teacher network, teacher, original training
备注：
点击查看摘要
Abstract:Knowledge distillation (KD) enables the transfer of learned representations from a large teacher network to a small student network. In foundational KD, the student network uses the original training data of the teacher model to accomplish this task. However, due to privacy concerns, the original training data is often not available. To overcome this reliance on original training data, several data-free knowledge distillation methods have been developed. Some of these methods operate in the white-box setting, and a few methods generate synthetic data by training a generator network. White-box methods use the teacher model's parameters to obtain a synthetic dataset. To avoid relying on teacher parameters, some methods use computationally expensive generative approaches to obtain such a dataset. There also exist certain black-box methods that generate the synthetic data without accessing teacher parameters. These methods are also computationally intensive. We propose a data-free knowledge distillation method that utilizes just the teacher's output logits and does not require access to its architecture, parameters, or gradients. We generate synthetic data via Projected Gradient Ascent (PGA) starting from smooth random noise signals. Required gradients are obtained through zeroth-order gradient estimation rather than backpropagating through the teacher's parameters. The student is then trained on these synthetically generated samples. We evaluate the proposed method on several benchmark datasets and show that the distillation performance is comparable with approaches that have access to the teacher model parameters.
242. 【2611.00899】FilmTogether: Cinematic Video Generation from Low-Cost Inputs
链接：https://arxiv.org/abs/2611.00899
作者：Shiying Zhang,Xiaobin Hu,Qianchi Zhang,Jiaqi Zhao,Xiaoda Yang,Bo Yin,Shuicheng Yan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：democratized video recording, stark aesthetic divide, aesthetic divide persists, persists between casual, widespread adoption
备注： 14 pages. Project page: [this https URL](https://shiying-zhang.github.io/FilmTogether/)
点击查看摘要
Abstract:The widespread adoption of mobile devices has democratized video recording, but a stark aesthetic divide persists between casual, low-cost captures and high-cost cinematic productions. Bridging this gap requires upgrading heterogeneous production elements, such as lighting, specialized costumes, and materials, without altering the core layout, identity, and temporal motion of the original footage. However, this task is heavily bottlenecked by two important challenges: 1) Lacking a high-quality paired training data specifically designed to handle complex low-to-high appearance shifts. 2) Ignoring the capacity of current video editing models to perceive and enhance the multiple low-cost compositions. To address these issues, we present CineCraft-120K, a large-scale dataset of aligned low- and high-cost video pairs annotated with pair-aware editing prompts. CineCraft-120K features a diverse, high-resolution and high-cost Cinematic Crafting bank spanning decades of media production, meticulously taxonomized into 5 broad domains and 23 fine-grained sub-categories. It also provides element-level mapping between low- and high-cost counterparts, offering pair-aware rich textual prompts that precisely detail the required aesthetic transformations while anchoring structural layout. Architecturally, we propose a simple yet effective dual-memory feature adapter, where a text-memory expands semantic capacity for low2high appearance changes, and a hint memory supplies layer-wise visual feature corrections of high-cost element before context injection. Extensive experiments and ablation studies demonstrate the superiority of CineCraft-120K for low-to-high-cost video editing, alongside the effectiveness of our dual-memory adapter.
243. 【2611.00892】Learning to Group and Order: Cross-Instance Self-Supervised RL for Vision-Centric MLLMs
链接：https://arxiv.org/abs/2611.00892
作者：Songming Yang,Hong-Tao Yu,Xiu-Shen Wei
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：multimodal large language, Reinforcement learning, improving multimodal large, large language models, Self-Supervised Reinforcement Learning
备注： Accepted to NIPS 2026
点击查看摘要
Abstract:Reinforcement learning (RL) post-training has become an important paradigm for improving multimodal large language models (MLLMs), especially with automatically verifiable rewards. Self-supervised visual pretext tasks provide such rewards without human annotations. However, existing methods mainly exploit within-instance structure, offering limited supervision for cross-instance discrimination and fine-grained comparison. We introduce Group-and-Order Self-Supervised Reinforcement Learning (GO-SSL), a cross-instance jigsaw framework for vision-centric MLLM post-training. Given two visual instances, GO-SSL mixes their local elements and trains the model to group them by instance of origin while recovering the order within each group, coupling instance-level comparison with spatial, temporal, or geometric structure recovery. This paired formulation turns the same unlabeled data into richer verifiable supervision through diverse pairings, shuffles, and a random-to-hard curriculum. We instantiate GO-SSL mainly on cross-image jigsaw tasks and further extend it to 3D depth and video temporal ordering. Across diverse benchmarks, GO-SSL consistently improves over the base MLLM and prior self-supervised post-training baselines, with clear gains in fine-grained perception and spatial understanding. Further evaluations across model scales and families support its generality. These results suggest that cross-instance comparison provides a useful self-supervised RL signal for improving transferable visual understanding in MLLMs. Code is available at this https URL.
244. 【2611.00859】Wave Forcing: Towards Speed-of-Light Streaming Video Generation
链接：https://arxiv.org/abs/2611.00859
作者：Yijie Jin,Yuxuan Liu,Jiajun Xu,Ye Huang,Chuzhi Wang,Jiayang Li,Ruiyang Chen,Chenling Hong,Xu Wang,Zhijie Deng
类目：Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC)
关键词：Real-time long-video generation, Real-time long-video, long-video generation requires, generation requires continuous, consistent appearance
备注：
点击查看摘要
Abstract:Real-time long-video generation requires continuous output with consistent appearance and natural motion. Existing chunk-wise autoregressive methods face challenges in both generation efficiency and long-video quality: serialized denoising and history-cache refresh require two forward passes even with one-step denoising, and longer rollouts can degrade quality and cause camera drift. We propose Wave Forcing (WF), which co-designs generation, training, and execution for continuous video output with multi-step denoising. WF uses chunk-wise causal attention to access earlier, cleaner chunks before their denoising is complete, and distributes staggered denoising and cache-refresh stages across full-model replicas to achieve 1F1C: one output chunk per concurrent forward round after pipeline fill. To adapt the model to this continuous generation process, we develop a three-stage training procedure that successively introduces mixed-noise denoising, motion supervision, and causal adaptation using self-generated history. To execute this process efficiently, Wave Runtime (WaveRT) uses Wave Parallelism (WP) for early K/V delivery and communication-computation overlap, together with optimized kernels and pipelined VAE decoding. Experiments on Wan2.1-T2V-1.3B show that 5-step WF maintains overall quality comparable to Rolling Forcing while achieving higher Dynamic Degree on both short and long videos. Our system efficiency experiments show that 4-step WF achieves 147.6 DiT FPS and 134.8 end-to-end FPS on eight H200 GPUs, yielding 7.07x the single-GPU end-to-end throughput. In DiT-only tests with matched SageAttention+W8A8 backends, denoising steps, and GPU counts, WP delivers up to 2.53x the throughput of the faster of the Ulysses and Ring context-parallel baselines across six model scales (1.3B-14B).
245. 【2611.00848】oward Counterfactual Learning for Selective Re-Examination in Agentic Visual Search
链接：https://arxiv.org/abs/2611.00848
作者：Ao Chen,Shengchao Chen,Yan Luximon
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：high-resolution images requires, vision-language model, high-resolution images, images requires, requires a vision-language
备注： 32 pages, 17 figures, 14 tables
点击查看摘要
Abstract:Visual search over high-resolution images requires a vision-language model (VLM) not only to determine where to inspect, but also whether another observation is warranted before committing to an answer. Existing prompting, demonstrations, and outcome-based reinforcement learning can encourage re-examination, yet do not directly supervise whether it is beneficial at a particular search state. We introduce ReSee, a benchmark of re-examination decisions comprising 3,227 visual-search trajectories and 8,827 explicit commit-or-re-examine decisions, with counterfactual adjudication that distinguishes states where additional inspection is warranted from those where commitment is preferable. Building on this formulation, we propose CARE (Counterfactual Advantage for Re-Examination), a decision-level reinforcement learning method that compares paired continuations under commit and re-examine verdicts from the same search state. Their cost-aware return difference estimates the counterfactual value of an additional observation and is assigned only to the corresponding verdict tokens, providing localized credit for whether search should continue. Experiments expose limited re-examination selectivity in existing VLMs and show that CARE significantly improves accuracy and decision selectivity over GRPO across two backbones, with higher accuracy and fewer visual requests on six unseen OOD benchmarks.
246. 【2611.00843】Running a 20B Video Diffusion Transformer on Consumer Hardware: A Deployment and Measurement Report for MiniMax H3 on Apple Silicon
链接：https://arxiv.org/abs/2611.00843
作者：Luke Shi,Steven Shi
类目：Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC)
关键词：Apple Silicon hardware, consumer Apple Silicon, Apple Mac mini, video diffusion transformer, Apple Silicon
备注： Also published as a Zenodo record, DOI [https://doi.org/10.5281/zenodo.23803987](https://doi.org/10.5281/zenodo.23803987)
点击查看摘要
Abstract:We report the end-to-end deployment and measurement of MiniMax H3, a 20.38-billion-parameter video diffusion transformer (DiT) - the count measured from the safetensors headers of the Q8 checkpoint as deployed locally (Section 3.2) - running entirely on consumer Apple Silicon hardware: an Apple Mac mini with M5 Pro chip and 64 GiB of unified memory. Using the official bf16-to-Q8 (8-bit, group size 64) quantization path executed locally on the machine, we produced a working text-to-video pipeline with no cloud dependency. We document the full deployment procedure, including two non-trivial blockers and their fixes, and report measured figures for build time, peak memory, and per-clip render latency across four resolution tiers (Draft 384x640 through Native 768x1344). A 15.08-second 576x1024 clip rendered in 4838.49 seconds with a measured MLX peak of 27.467 GiB. We further operated the system as an unattended production pipeline, completing 17 clips in 26.49 hours with zero render failures. A blind human review of the 17 production clips (generation prompts withheld) averaged 3.12, 3.18, and 2.94 out of 5 for structural integrity, temporal consistency, and visible artifacts. All figures in this report are our own measurements except where explicitly labeled as third-party data. This is a systems/empirical report; we make no claim of model innovation.
247. 【2611.00833】Fewer Tokens, More Answers: Verifiable-Reward Tuning of an Ornith-Style VLM for Multi-View Driving QA
链接：https://arxiv.org/abs/2611.00833
作者：T N Rickesh,Pranav Vinodh,Sowmya Kamath S
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：turn intermediate deliberation, turn intermediate, intermediate deliberation, Reasoning-enabled model derivatives, Reasoning-enabled model
备注： 7 pages, 2 figures, 3 tables
点击查看摘要
Abstract:Reasoning-enabled model derivatives must turn intermediate deliberation into a usable answer within a deployment budget. We study that transition in an Ornith checkpoint adapted to multi-camera driving question answering with verifiable rewards. Paired archived outputs show that, on a selected 400-question development screen with a 256-token cap, GRPO increases answer extraction from 78.25% to 90.25% and accuracy from 55.50% to 63.75%. Of 39 wrong-to-correct transitions, 33 begin with an unextractable base response. The base's 87 unextractable responses all reach the token cap. Checkpoint-verified reconstruction on those same questions gives a much smaller first-pass accuracy gain at 512 tokens: +0.75 percentage points, versus +8.25 at 256. A later answer-cued continuation is analyzed separately; it helps the base more and narrows the adapter difference. On the full 2,511-question development set, this recovery-enabled pipeline reduces mean generated tokens from 108.6 to 47.1, while the paired accuracy interval includes zero gain. We frame these findings as adaptation of answer delivery under finite budgets, with explicit selection and provenance limits. Ornith's self-scaffolding lineage and newer reasoning-enabled derivatives such as Bonsai motivate the problem, but our measured results concern Ornith alone and do not establish a shared architectural mechanism or cross-model transfer.
248. 【2611.00828】Answer Correction with Verifiable Rewards: A Gemma-Family Study of Multi-View Driving QA
链接：https://arxiv.org/abs/2611.00828
作者：T N Rickesh,Pranav Vinodh,Sowmya Kamath S
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Multi-camera driving question, reflect changed selected, driving question answering, Multi-camera driving, changed selected answers
备注： 6 pages, 2 figures, 3 tables
点击查看摘要
Abstract:Multi-camera driving question answering provides a discrete test of vision-language models, but post-training gains can reflect changed selected answers or improved answer extraction. We investigate this distinction within the Gemma model family using archived, task-linked WaymoQA evaluations. A zero-shot diagnostic on 5,519 test questions spans effective-small, mixture-of-experts, unified, and dense checkpoints, with serving differences disclosed rather than interpreted as architecture effects. The strongest controlled evidence is a matched-harness Gemma-4-12B base/GRPO pair: accuracy rises from 73.78% to 75.43%, a gain of 1.65 percentage points with a scene-cluster bootstrap interval of [+0.84, +2.41]. There are 215 improvements and 124 regressions; 213 improvements start from an extractable but incorrect base answer, and only two recover previously unextractable responses. Crossing correctness with extraction state shows why correct noncompliant outputs cannot be counted as prediction errors. Category counts reveal a critical safety asymmetry: routine perception gains (+5.93 pp) mask a regression in safety-critical hazard prediction (-1.82 pp), demonstrating that unweighted outcome rewards can trade off rare edge cases for aggregate accuracy. Reward saturation describes sampled training dynamics rather than an architectural ceiling. A separate archived Gemma-31B thinking comparison yields no detected average improvement, with uncertainty that does not establish equivalence. These results support a modest answer-selection gain for the recorded tuning configuration and a reproducible diagnostic accounting, without attributing corrected labels to specific grounding mechanisms or claiming superiority over matched supervised tuning.
249. 【2611.00823】Beyond Temporal Overlap: Consumer-Aware Evaluation of Sign-Language Segmentation across Three Corpora
链接：https://arxiv.org/abs/2611.00823
作者：Guohou Zhang,Kalin Stefanov
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Sign-language segmentation divides, divides continuous signing, segmentation divides continuous, Sign-language segmentation, divides continuous
备注： Submitted to IEEE FG 2027. 9 pages, 4 figures. Supplementary material included
点击查看摘要
Abstract:Sign-language segmentation divides continuous signing into clips. In this study, the downstream consumer is a frozen recognizer that assigns one sign label to each predicted clip. Existing metrics instead compare predicted clips with manually annotated boundaries. They do not directly measure whether a clip preserves the visual evidence needed by the recognizer or whether the segmenter produces too many clips. We therefore ask whether overlap metrics and this consumer prefer the same segmenter. We evaluate 27 outputs from three segmentation architectures, three random seeds, and three corpora. Controlled boundary edits separate the effect of removing sign evidence from that of adding surrounding context. Overlap predicts recognition on average, but it does not always determine model choice. At the same intersection-over-union, different recognizers can prefer the shorter or the longer clip. The real outputs reveal two operating regimes. On DGS, overlap, recognition, and sequence error select the same model. On BSL, recognition-based selection recovers and recognizes more reference signs but increases word error rate (WER). Dicta-Sign shows the reverse trade-off: WER selection reduces in-vocabulary WER by 31.17 points but misses more recognizable signs. Segmenters should therefore be evaluated on four axes: temporal agreement, reference recovery, clip recognition, and sequence error, rather than on overlap alone.
250. 【2611.00819】ODC: Orthogonal Drift Correction for Improved Text-to-Image Semantic Alignment at Inference
链接：https://arxiv.org/abs/2611.00819
作者：Kasra Kamali,Basim Azam,Tuan Duong Trinh,Jean Honorio,Naveed Akhtar
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：achieved remarkable success, generating high-quality images, textual descriptions, achieved remarkable, remarkable success
备注： Accepted to Transactions on Machine Learning Research (TMLR) 2026
点击查看摘要
Abstract:Text-to-image models have achieved remarkable success in generating high-quality images from textual descriptions. However, they often struggle with "semantic drift," where the generated output fails to precisely align with complex or nuanced text prompts. While recent approaches have attempted to address semantic errors regarding attribute binding or object presence, there remains a gap for a more holistic method that addresses these issues by directly refining the text embeddings of the initial user prompt. In this work, we introduce Orthogonal Drift Correction (ODC), an inference-time guidance method designed to mitigate semantic drift without requiring model retraining or additional user inputs. ODC guides image generation through a two-stage process. In the first stage, it identifies the semantic drift by evaluating the initially generated image against the user prompt in a shared vision-language embedding space. It then isolates the component of this drift vector that is orthogonal to the prompt's direction and translates it back into text via a vocabulary-based surrogate mechanism. In the second stage, it produces refined text conditioning for a second generation pass by feeding both the initial text embedding and the re-embedded drift representation into an adaptive rank-reduced concept removal module. Our experiments demonstrate that ODC consistently improves prompt-image alignment, increasing CLIP scores by up to 5.4% over the baseline on the COALBench-300 and PartiPrompts benchmarks. Furthermore, on the T2I-CompBench complex subset, ODC improves the average 3-in-1 score by 4.5% over the competing methods. As a plug-and-play module, ODC offers a practical and efficient method for improving the reliability of text-to-image models. Code is available at this https URL.
251. 【2611.00810】UniCaMo: Unified Camera and Motion Control for Video Diffusion Models
链接：https://arxiv.org/abs/2611.00810
作者：Long Vu,Tan Ngo,Animesh Karnewar,Amir Habibian,Binh-Son Hua,Hung Bui,Minh Hoai Nguyen,Phong Nguyen
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：diffusion models, unified framework, framework for joint, UniCaMo constructs motion-consistent, UniCaMo
备注： Qualitative videos are available on our project page: [this https URL](https://phongnhhn.info/Unicamo/)
点击查看摘要
Abstract:We present \textbf{UniCaMo}, an unified framework for joint control of camera and object motion in image-and-text-to-video diffusion models. Given a reference image, text prompt, sparse 3D object trajectories, and a 3D camera trajectory, UniCaMo constructs motion-consistent input noise that directly encodes the desired motion. Our 3D-grounded noise construction combines reference-derived noise propagation with a spherical Gaussian noise representation for newly revealed regions, providing a simple and effective motion prior without requiring reconstruction of unseen scene geometry. UniCaMo requires no architectural modifications or dedicated control modules and can be adapted using lightweight LoRA fine-tuning with low training data volume. Experiments on standard controllable video generation benchmarks demonstrate state-of-the-art motion controllability and high visual quality with minimal inference overhead.
252. 【2611.00804】raining-free Conditional Object Composition for Multi-object Image Generation with Diffusion Models
链接：https://arxiv.org/abs/2611.00804
作者：Hsuan-Fu Wang,Hsuan-Tien Lin
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：diffusion models remains, models remains challenging, Multi-object image generation, diffusion models, remains challenging
备注： Accepted for oral presentation at TAAI 2026
点击查看摘要
Abstract:Multi-object image generation in text-to-image diffusion models remains challenging, as existing approaches struggle to reliably generate all objects specified in a prompt. Compositional approaches that generate objects independently often fail to capture the interactions among them, whereas joint generation methods tend to suffer from inter-object interference. In this work, we propose a training-free framework, termed conditional object composition, that relaxes joint generation methods by taking one step back toward compositional approaches. Our framework decomposes the generation of $N$ objects into two stages: it first generates a subset of $N-1$ objects and then composes the remaining object conditioned on the generated content. To enable effective composition, we adopt an inpainting-based formulation with layout guidance to preserve existing regions and encourage spatially coherent placement. To address the challenge of selecting which objects to generate separately, we introduce an attention-based scoring mechanism based on cross-attention maps and further explore the use of off-the-shelf object detectors. We evaluate our method on multi-object image generation using the widely adopted MS COCO dataset. Experimental results show that our approach achieves competitive or improved performance compared to existing methods, particularly as the number of objects increases. Further studies highlight the importance of the proposed design choices. The source code is available at this https URL
253. 【2611.00794】Crop Mapping Evaluation under Sampling Bias
链接：https://arxiv.org/abs/2611.00794
作者：Akram Zaytar,Kemunto Ochwang'i,Caleb Robinson,Girmaw A. Tadesse,Gilles Q. Hacheme,Rahul Dodhia,Inbal Becker-Reshef,Juan M. Lavista Ferres
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：monitor food security, set agricultural policy, Government agencies, crop maps, monitor food
备注： 17 pages, 4 figures, 5 tables. Code: [this https URL](https://github.com/microsoft/PaPPI)
点击查看摘要
Abstract:Government agencies use crop maps to estimate production, monitor food security, and set agricultural policy. These crop maps are usually validated against field labels, but these labels are rarely a random sample of the area the map covers. Field teams tend to label parcels near roads and skip ones that are small or hard to reach, so performance measured on held-out labels mainly describes the places they visited. We call the difference between this reported performance and performance over the whole mapped region the deployment performance gap. To estimate performance over the whole region, we use a weighted form of prediction-powered inference (PPI). The classifier's predictions on unlabeled points across the region give a first estimate, and its errors on the labeled points correct that estimate, with more weight on labels from under-sampled conditions. We test this in five European regions where crop registers label every declared parcel, so the true performance is known. Simulating six documented collection practices there produces gaps of up to 0.20 macro-F1. On the collection rule that creates the largest gap in each region, 5 km block cross-validation still overestimates macro-F1 by as much as 0.18, while PPI with weights estimated from satellite embeddings reduces the largest error across regions to 0.07. Importance-weighted cross-validation with the same weights does almost as well, so most of the improvement comes from the weights themselves. We also apply the method to three Kenyan datasets that have no region-wide reference labels. For a roadside dataset collected with helmet-mounted cameras, the estimated macro-F1 falls from 0.93 under random cross-validation to 0.61, although the correction relies on a small number of heavily weighted labels. Our code is available at this https URL.
254. 【2611.00791】PhoneValue-Bench: A Multimodal Benchmark and Datasets for Consumer Smartphone Recommerce Valuation
链接：https://arxiv.org/abs/2611.00791
作者：Zihan Deng,Jun Gao
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：quote binding repurchase, binding repurchase prices, seller-uploaded multi-view photos, smartphone recommerce scales, consumer smartphone recommerce
备注：
点击查看摘要
Abstract:As consumer smartphone recommerce scales, buyers must quote binding repurchase prices from seller-uploaded multi-view photos and diagnostic screenshots before devices reach the warehouse. Accurate remote valuation requires fusing noisy cosmetic evidence with identity, battery, lock, and channel risk from screenshots and staff forms, since an error in any modality changes both grade and payout. However, existing multimodal resources mainly target general VLM competence, screen reading, or factory defect detection, and largely overlook staff-aligned trade-in fields, dual appearance/staff ground truth, and executable valuation scorecards. This gap stems from two challenges: (1) the lack of large-scale real trade-in data with audited dual annotations and a compact ranking benchmark kept separate from training labels, and (2) the need to jointly reason over unordered multi-view cosmetics and diagnostic screens under operational deduction rules. To address these challenges, we propose PhoneValue-Bench, a dual-GT evaluation suite with tier-gated scorecards, together with PhoneValue-Corpus, a matched weakly labeled training set of over twenty thousand orders and hundreds of thousands of captioned images. We further present ValueAgent, a staged perception-fusion-valuation reference pipeline aligned with production inspection, plus an executable public scorer and submission schema. Experiments show that ValueAgent reaches a measured 84.1/100 on Bench-Full, with 97.0 appearance fill and 54.1 staff-field fill, establishing a practical dual-GT benchmark for multimodal recommerce valuation.
255. 【2611.00785】CheXPoT: Post-Hoc Visual Verification and Correction of VLM-Generated Radiology Reports
链接：https://arxiv.org/abs/2611.00785
作者：Joey Guo,Rayan Ansari,Alaa Youssef
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：Vision-language models, radiograph report generation, chest radiograph report, lifts micro-average precision, shown promise
备注： 15 pages, 12 figures
点击查看摘要
Abstract:Vision-language models (VLMs) have shown promise for chest radiograph report generation, but adoption remains limited because of hallucinated findings that are not grounded in the image. Correcting these hallucinations and improving overall report quality remains a significant challenge. Prior work has addressed this problem by refining models with reinforcement learning, preference optimization, or chain-of-thought supervision, often at substantial compute cost. To address this gap, we introduce CheXPoT, a program-of-thought (PoT) framework that verifies each generated finding against image features and removes those it cannot ground. CheXPoT decomposes generated reports into predicates with RadGraph and an LLM, grounds these predicates against a DenseNet-121 and Grad-CAM visual evidence table, executes PoT verification code, and rewrites reports after removing unsupported predicates. On a 4,145-image held-out split, CheXPoT yields statistically significant precision gains on 8 of 14 CheXpert classes and F1 gains on 5, with no significant decreases in either metric. CheXPoT lifts micro-average precision from 19.2% (MedGemma-4B) to 46.8% (MedGemma-4B + CheXPoT) and micro-average F1 from 23.0% to 49.4%, absolute gains of 27.6% and 26.4% respectively. We also tested CheXPoT on other VLM report generators. On LLaVA-Med, CheXPoT lifts micro-average precision from 4.5% to 17.7% and micro-average F1 from 6.3% to 19.4%. On MAIRA-2, CheXPoT lifts micro-average precision from 15.6% to 42.1% and micro-average F1 from 21.0% to 45.3%. Our results suggest that inexpensive post-hoc visual verification may improve VLM trustworthiness by correcting unsupported findings from generated reports. CheXPoT lays a foundation for tools that help validate VLM-generated radiology reports and reduce unsupported findings. These innovations may subsequently help increase trust and adoption of VLM tools in Medicine.
256. 【2611.00784】ConstraintMatch: Compositional Image-Text Matching through Constrained Regional Evidence Selection
链接：https://arxiv.org/abs/2611.00784
作者：Yuhong Zhou,Yubo Gao,Xiangbo Shu
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：find strong evidence, Local image, find strong, individual concepts, concepts yet favor
备注：
点击查看摘要
Abstract:Local image--text matching can find strong evidence for individual concepts yet favor captions with incorrect attribute--entity bindings. We introduce ConstraintMatch, a training-free inference method that turns entity-level regional consistency into an explicit matching cost. On the same frozen condition--region similarity matrix, it compares independent crop selection for each category and attribute with a shared crop choice within each entity. Their gap quantifies the score advantage obtained by relaxing the shared-region constraint. Spatial references from the same image calibrate this gap by keeping category evidence fixed while jointly shifting an entity's attribute maps. Per-entity clipping prevents cancellation across residuals, and the scaled mean cost is subtracted from global similarity. ConstraintMatch uses pooled embeddings, and spatial calibration requires no additional encoder calls. With parameters fixed per backbone across tasks, ConstraintMatch improves over global matching by 7.70 percentage points on full ARO Attribute and 5.63 points on held-out SugarCrepe++ attribute swaps, averaged across Qwen~2B and CORE~2B. Against SGI adapted to the same 13-crop budget, the respective gains are 4.85 and 3.51 points. Controlled analyses distinguish the effects of shared-region matching and candidate score calibration. The results establish entity-level evidence selection as a practical scoring principle for compositional multimodal retrieval.
257. 【2611.00780】Now You See Them, Now You Dont FusionGhost Gait for Occlusion-Robust Gait Recognition with ArabGait dataset
链接：https://arxiv.org/abs/2611.00780
作者：Seba Al Mokdad,Tamer Shanableh,Reham Mohamed Aburas
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Skeleton-based gait recognition, stable pose extraction, Skeleton-based gait, gait recognition includes, pixel-based methods
备注： Submitted to "Engineering Applications of Artificial Intelligence", Elsevier
点击查看摘要
Abstract:Skeleton-based gait recognition is generally more robust to appearance changes than pixel-based methods, but this robustness depends on stable pose extraction. Clothing variation in gait recognition includes changes in garments, silhouette, and carried items; under Gulf clothing (Kandoora/Abaya), the dominant failure mode shifts from appearance change to lower-limb pose degradation caused by severe occlusion. To study this regime, we introduce ArabGait, a 45-subject indoor multi-view dataset with four walking conditions across three viewpoints, and show that Gulf clothing lowers mean lower-limb confidence from 0.811 to 0.683 and raises lower-limb failure rate from 7.98% to 17.82%, with ankles most affected. We propose FusionGhost-Gait, a fused spatiotemporal architecture that integrates spatial graph blocks and temporal modeling in one residual unit, removes redundant channel projections, and uses compact temporal Ghost kernels as a lightweight regularization mechanism for pose-noisy trajectories while preserving efficient temporal downsampling. On ArabGait cross-clothing evaluation, including Protocol A and Protocol B, FusionGhost-Gait reaches up to 67.91% Rank-1 while remaining compact (108,970- 133,674 parameters and 0.035-0.052 billion floating-point operations (GFLOPs)), achieving more than 65% fewer parameters and 75% lower FLOPs than existing baselines. These results indicate that the proposed model generalizes effectively to challenging Gulf-clothing conditions while remaining lightweight and deployable for surveillance and access-control biometric systems.
258. 【2611.00769】DramaVQA: Probing Detailed Understanding of Ultra-Long TV Dramas
链接：https://arxiv.org/abs/2611.00769
作者：Xinyue Huo,Pengfei Chen,Jiannan Ge,Kaiwen Duan,Jiacheng Shao,Yunning Cao,Lingxi Xie,Qi Tian
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：recent progress, focus on short, short clips, clips or hour-scale, current benchmarks
备注： 36 pages. Project page: [this https URL](https://github.com/xinyuehuo/DramaVQA)
点击查看摘要
Abstract:Despite recent progress in long-form video understanding, current benchmarks mostly focus on short clips or hour-scale videos. This leaves a major gap in evaluating ultra-long video understanding, where videos often last tens of hours. To bridge this gap, we introduce DramaVQA, a large-scale benchmark built upon long-form TV dramas. Containing approximately 20K question-answering (QA) pairs, the scale of DramaVQA exceeds previous long-video datasets, such as Video-MME and LVBench, by an order of magnitude. Our benchmark has two main features that make it stand out from existing datasets. First, we establish a scalable, LLM-assisted annotation pipeline that uses multimodal large language models (MLLMs) to generate complex questions, followed by strict human checking to ensure high data quality. Second, DramaVQA introduces a multi-level time structure; queries are designed across different video lengths, with the hardest questions requiring overall understanding across the entire drama. Extensive evaluations show that state-of-the-art MLLMs face major challenges when tested on these very long videos, highlighting the need for agentic AI algorithms capable of managing long-term memory. The project is available at this https URL
259. 【2611.00768】DADKC: Distribution-Aware Adaptive Differentiated Knowledge Consolidation for Cloth-Hybrid Lifelong Person Re-identification
链接：https://arxiv.org/abs/2611.00768
作者：Yan Zhang,Minghao Long,Meiqi Wan,Yan Yang,Xin Yuan,Wei Wang,Xiao Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Lifelong Person Re-identification, sequentially collected data, Person Re-identification, Differentiated Knowledge Consolidation, Lifelong Person
备注： Accepted by MMM 2027
点击查看摘要
Abstract:Lifelong Person Re-identification (LReID) aims to match the same person using sequentially collected data. In practical long-term deployments, however, the model must handle both domain shifts across cameras and scenes, and irregular clothing changes of the same identity. This gives rise to the Cloth-Hybrid Lifelong Person Re-identification (CH-LReID) task, which demands balancing cloth-relevant and cloth-irrelevant knowledge in streaming data. While existing LReID methods have explored replay-based or distillation-based anti-forgetting strategies, they typically fail to sufficiently model stage-aware domain distributions and cross-stage feature continuity under exemplar-free training. To address this problem, we propose a Distribution-Aware Adaptive Differentiated Knowledge Consolidation (DADKC) framework. The core idea is to enhance the existing Differentiated Knowledge Consolidation (DKC) paradigm with adaptive distribution modeling. To this end, three lightweight modules are designed: (1) an Anchor Pool Adapter (APA) to retrieve learnable anchor cues for refining identity features; (2) a Phase Path Mixer (PPM) to perform stage-aware expert routing for integrating domain-specific distribution paths; and (3) a Stage Bridge Alignment (SBA) module to regularize the continuity of base, anchor, and path representations between adjacent stages. Extensive experiments on the CH-LReID and LReID benchmarks show that DADKC gains 4.1%/4.5% mAP/R1 on Order-1 and 3.6%/3.4% mAP/R1 on Order-2 over the DKC baseline, and lowers weighted forgetting from 2.4%/1.7% to 1.8%/1.4%, while storing neither historical images nor per-image features. The code is available at this https URL.
260. 【2611.00758】Old Is Not False: Valid-Time Memory for Interactive Video World Models
链接：https://arxiv.org/abs/2611.00758
作者：Ziming Wang,Chuyue Gong,Hongliang Cao,Jingmin Zhu,Chutian Wang,Yuheng He,Xiuyu Li
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Interactive video world, earlier frames stamped, Interactive video, video world models, world models draw
备注： 40 pages, 16 figures, 38 tables
点击查看摘要
Abstract:Interactive video world models draw each frame from a memory bank of earlier frames stamped with their capture times. With frames, weights and noise fixed, reversing the timestamps of two views flips the state that generators of two families draw: they take the newest timestamp as the truth. That reading is right as long as states never return. After an agent undoes an action, the newest view of a region is outdated and the only view of the present is older; memories for changing worlds delete that older view, and memories that keep it hand the generator the past. Temporal databases separate when a record is stored from when its content holds, its valid time. ReDate keeps every frame and dates each retrieved token by its valid time, read from the agent's action log. The frozen generator then reads a reverted region as one that has just reached a new state, so ReDate needs no training. We prove that trusting the newest timestamp is right exactly when every current view is dated after every outdated one, that without a view taken after the return only the action log tells a reverted region from an up-to-date one, and that a generator able to draw from its own prediction gains more from re-dating than from deletion when the moved tokens keep little weight. After an undo, ReDate raises the share of FAR's steps showing the current state from 0.36 to 0.62 and HY-WorldPlay's from 0.003 to 0.19. We also propose a calibrated state metric to test any memory after undos.
261. 【2611.00756】SceneBound: How Much Should a Streaming 3D Reconstruction Model Remember?
链接：https://arxiv.org/abs/2611.00756
作者：Ziming Wang,Chuyue Gong,Chutian Wang,Jingmin Zhu,Hongliang Cao,Yuheng He,Xiuyu Li
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：past video frames, fast weights, test-time training, past video, weights from test-time
备注： 34 pages, 8 figures, 27 tables
点击查看摘要
Abstract:Streaming 3D reconstruction models keep past video frames in a recurrent state, fast weights from test-time training, or a key-value (KV) cache. Each written frame shifts the coordinate frame of later cameras or occupies GPU memory. Training-free rules decide what to write from a signal of the current frame. How much they write accounts for their mean accuracy: spending the update budget of a gate at uniformly spaced frames, with no signal, matches nine published gates, and the budget bounds the drift of the state wherever the writes fall. We propose SceneBound, a training-free rule that writes a frame only when its predicted camera pose lies at least a fixed radius from every stored keyframe. Its keyframe count stays within a constant factor of the covering number of the visited poses, the fewest views that keep a keyframe near every camera, so the count grows with the places visited and stays flat when the camera returns. In large scenes, SceneBound closes a submap once decoding its first frame again reveals drift. SceneBound uses one radius across four released models and three memory types. In the recurrent state of CUT3R and the KV cache of StreamVGGT, it achieves the lowest mean trajectory error among the published training-free rules we evaluate, in one pass and over nine passes of a scene, where its keyframes grow by 3% to 6%.
262. 【2611.00722】SAVIER: Source-Anchored Visual Inspection and Evidence-Guided Repair for Vietnamese Cultural Text-to-Image Generation
链接：https://arxiv.org/abs/2611.00722
作者：Gia-Huy Thai,Duc-Tien Khong,Trung-Nghia Le
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：named Vietnamese cultural, Vietnamese cultural entity, scene details requested, named Vietnamese, Vietnamese cultural
备注： Accepted at SOICT 2026. 11 pages, 1 figure
点击查看摘要
Abstract:We present SAVIER, a training-free, one-pass framework that repairs the depiction of a named Vietnamese cultural entity in a generated image while preserving the scene details requested by the user. The problem is hard because a plausible scene can miss the cues that identify the entity, and prompt-level refinement never inspects the image it produces. SAVIER starts from a Culture-TRIP expanded prompt; a Curator separates source-linked cultural cues from prompt-preservation requirements, a prompt-blind Observer describes the first image, and a Refiner turns the discrepancies into at most three positive instructions before one regeneration with the same seed and a fixed bank of reference photographs. On the 50 bilingual prompts of ViCuP, evaluated with SDXL and FLUX.1-dev against a frozen, human-verified visual contract, SAVIER raises contract fulfillment from 55.6 to 69.6 and from 59.1 to 67.3 over Culture-TRIP and raises CAIRE cultural relevance on FLUX.1-dev. A reference-only ablation that removes the agent repair shows that SAVIER's photographs account for most of the contract gain; the agent roles add country-level relevance on FLUX.1-dev without lowering adherence to the original prompt under the official VQAScore. Project page: this https URL
263. 【2611.00715】Adversarial robustness does not entail human-aligned categorization
链接：https://arxiv.org/abs/2611.00715
作者：Itay Reznik,Raz Lapid,Moshe Sipper,Tal Golan
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Neurons and Cognition (q-bio.NC)
关键词：behavior remains unclear, classification behavior remains, biological vision, remains unclear, acquire human-aligned classification
备注：
点击查看摘要
Abstract:Adversarial training can improve some forms of correspondence between artificial and biological vision, but whether robust classifiers acquire human-aligned classification behavior remains unclear. We generated 1,008 controversial stimuli by optimizing latent inputs to a pretrained GAN to elicit high-confidence disagreements between pairs of robust ImageNet classifiers. We compared four adversarially robust ImageNet classifiers - ResNet-101, ViT-B, ConvNeXt-L, and Swin-L - with two-alternative category judgments from 60 participants. We first evaluated each classifier on stimuli optimized to elicit disagreement with another model. Across classifiers, accuracy in predicting individual participants' single-trial category choices was near chance (48.6-51.3%), whereas majority judgments from other participants predicted responses with 85.0-86.8% accuracy. An analysis incorporating model prediction strength and participants' reported confidence found weak positive model-human correspondence for the two convolutional models. On stimuli optimized for disagreement between other model pairs, all four robust classifiers predicted human responses above chance but less accurately than predictions based on other participants' majority judgments; the same pattern held for 17 additional RobustBench models not used in stimulus generation. Across these 17 models, mean model-participant agreement was 67.3%, versus 81.3% mean participant-participant agreement on the same images. These results identify model-specific failures of human alignment and a model-human mismatch that persists across robust classifiers and substantially exceeds disagreement among human observers. Our findings show that adversarial robustness alone does not guarantee human-aligned categorization and suggest that robustness and human alignment should be evaluated as distinct properties of visual recognition systems.
264. 【2611.00704】LoD-Loc v4: Towards Generalized Aerial Visual Localization via Panoptic LoD 3D Map Registration
链接：https://arxiv.org/abs/2611.00704
作者：Shuaibang Peng,Chengming Zhang,Juelin Zhu,Xia Li,Xiaoya Cheng,Zeyu Cui,Shen Yan,Maojun Zhang,Yu Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：recently gained significant, gained significant traction, significant traction due, storage efficiency, Aerial visual localization
备注：
点击查看摘要
Abstract:Aerial visual localization over Level-of-Detail (LoD) 3D Maps has recently gained significant traction due to its global scalability, storage efficiency, and privacy-preserving nature. However, existing methods rely almost exclusively on building elements, which leads to catastrophic localization failures in rural or undeveloped areas where buildings are sparse or non-existent. To address this, we construct a unified Panoptic LoD 3D Map by fusing OpenStreetMap (OSM), Digital Elevation Models (DEM), and LoD assets, reformulating the problem as a panoptic registration task. By parsing the query image into discrete building `thing' instances and continuous `stuff' regions comprising road, vegetation, and water, we establish a holistic alignment with this map to robustly optimize the camera pose. To enable reliable panoptic perception, we develop a new automated pipeline that constructs AirPan - the largest aerial panoptic segmentation dataset to date, comprising 85k images with pixel-accurate annotations. This empowers our panoptic segmentation model to exhibit remarkable zero-shot generalization capabilities. Extensive experiments demonstrate that LoD-Loc v4 consistently outperforms state-of-the-art (SOTA) baselines by a significant margin. Most notably, it successfully maintains reliable localization in building-less scenarios, completely overcoming the catastrophic failures of prior building-centric paradigms.
265. 【2611.00699】Vision-based Sensing of Urban Environment using Hardware-Software co-design at Scale
链接：https://arxiv.org/abs/2611.00699
作者：Akshit Gupta,R Venkatesha Prasad
类目：ystems and Control (eess.SY); Computer Vision and Pattern Recognition (cs.CV)
关键词：current approaches rely, approaches rely heavily, limited terrestrial RGB, lacking comprehensive multispectral, comprehensive multispectral perspectives
备注： IEEE World Forum for Internet of Things 2026
点击查看摘要
Abstract:Urban environmental monitoring is crucial for climate-adaptive cities, yet current approaches rely heavily on human inspection, overhead remote sensing, or limited terrestrial RGB imagery, thereby lacking comprehensive multispectral perspectives at street level. To bridge this gap, this paper introduces UrbanScapes, an adaptable and flexible hardware-software co-design platform for large-scale, vision-based sensing of urban environments. Built on a modular architecture, UrbanScapes seamlessly integrates multispectral imaging channels, including Red, Green, Blue (RGB), Near-Infrared, and Thermal, to capture multispectral street-level imagery. The system is designed for both opportunistic deployment on bicycles, vehicles, or pedestrians and targeted deployments on municipal fleets, ensuring high spatio-temporal scalability without requiring hardware redesigns. Crucially, the platform utilizes on-device deep learning models to automatically remove personally identifiable information (PII) at the edge, addressing privacy concerns inherent in street-level data collection. By combining this multispectral street-level imagery with overhead multispectral remote sensing imagery, UrbanScapes enables scalable calculation of physics-based environmental indices, providing a foundational tool for advanced citywide analysis.
266. 【2611.00684】Density-Aware Calibration for Resource-Efficient Medical Vision-Language Models
链接：https://arxiv.org/abs/2611.00684
作者：Tien-Dat Dam,Huu-Thuan Huynh,Minh-Triet Tran,Trung-Nghia Le
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：memory requirements hinder, Medical vision-language models, resource-constrained clinical hardware, requirements hinder deployment, vision-language models
备注： 15 pages, 2 figures. Accepted at SOICT 2026
点击查看摘要
Abstract:Medical vision-language models (VLMs) show promise for clinical image understanding, but their computational and memory requirements hinder deployment on resource-constrained clinical hardware. Post-training quantization (PTQ) offers a practical compression strategy without retraining, yet its effectiveness depends strongly on the calibration data. We propose CoreCalib, a training-free and quantizer-agnostic framework for constructing compact calibration sets that preserve the target medical VQA distribution. CoreCalib stratifies data by clinical question class, identifies representative visual modes using frozen DINOv2 features with UMAP and HDBSCAN, and expands selected images into class-balanced question-answer pairs. On Kvasir-VQA-x1, we evaluate CoreCalib with MASQuant, GPTQ, and QIG using a fixed 128-pair budget. CoreCalib achieves the best METEOR with all three quantizers and the best ROUGE-L with MASQuant and GPTQ. With W4A8 MASQuant, it improves METEOR from 0.5672 with COCO calibration to 0.6234, recovering approximately 41% of the degradation relative to BF16. These results support CoreCalib as a data-centric component for resource-efficient medical VLM deployment. Project page: this https URL .
267. 【2611.00683】Content-Preserving Principal Feature Blending for Training-Free Style Personalization
链接：https://arxiv.org/abs/2611.00683
作者：Le-Hoang Bui,Hoang-Nguyen Cao,Trung-Nghia Le,Minh-Triet Tran,Dinh-Khoi Vo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Reference-based style personalization, Reference-based style, personalization should reproduce, reproduce the appearance, preserving the subject
备注：
点击查看摘要
Abstract:Reference-based style personalization should reproduce the appearance of a style reference while preserving the subject specified by a content prompt. In visual autoregressive models, dominant reference features can also carry object and spatial information, causing content leakage. We propose Content-Preserving Principal Feature Blending (CoPFB), a training-free method that estimates a low-rank content basis from a clean generation branch and removes the content-aligned component of the style residual. CoPFB applies rank-one blending at the first two autoregressive scales, followed by weaker content-projected refinement at the next three scales. On 1,900 combinations of Parti content prompts and FineStyle reference images, CoPFB improves text alignment from 0.293 to 0.297 and the harmonic score from 0.391 to 0.393 over PFB+SAC, while style similarity decreases from 0.590 to 0.577. CoPFB requires no fine-tuning or learnable parameters. Project page: this https URL.
268. 【2611.00681】ROD-Dataset: A Pedestrian-Perspective Benchmark of Urban Obstacle Classes for YOLO-Based Detection
链接：https://arxiv.org/abs/2611.00681
作者：Abtin Zandi,Ariyan Azami,Bardia Sabagh Kermani,Parsa Abbasian,Roza Ganjipour,Sarvin Nami,Hamed Farbeh
类目：Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY)
关键词：pedestrians face avoidable, face avoidable risk, city sidewalk, visual impairment, divided attention
备注：
点击查看摘要
Abstract:Two groups of pedestrians face avoidable risk on the city sidewalk: people living with visual impairment, who reach an obstacle before anything warns them, and people walking with divided attention, who register a hazard late or not at all. A vision system can warn them only about obstacles it has learned to recognize, so its training data limits the protection it offers. No suitable training set exists: public benchmarks are recorded from vehicles, aerial platforms, or fixed rigs, general-purpose detectors omit the street furniture that causes trips, and pedestrian-focused collections are confined to single regions with incompatible class schemes. This paper introduces the Real-time Obstacle Detection (ROD) dataset: more than 24,000 images and 40,000 annotated obstacles across 25 classes, from vehicles and people to the stairs, manholes, traffic cones, and benches that general-purpose detectors overlook. Because street furniture differs between cities, ROD unifies twenty-nine public collections onto one taxonomy and adds eye-level imagery from two contrasting cities on two continents, Tehran and Toronto. Every label is human-verified, and each capture campaign is admitted only after a compact detector shows it can learn the class. Six lightweight YOLO detectors (nano and tiny variants) benchmarked on ROD all exceed 0.86 recall; YOLO12n attains the highest recall (0.889), YOLO26n the highest precision (0.925), and YOLOv9t the best mAP@0.50 (0.882) with the fewest parameters. Because the recall and mAP rankings disagree, selecting a model by mAP does not minimize missed obstacles, so per-class recall is reported for all 25 classes.
269. 【2611.00676】Smooth bounding box for object detection
链接：https://arxiv.org/abs/2611.00676
作者：Chao Zhou,Shenghua He,Fengchuang Xing,Han Yang,Qiangguo Yu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Deep learning-based object, Deep learning-based, bounding box, annotated training data, learning-based object detection
备注：
点击查看摘要
Abstract:Deep learning-based object detection models are highly dependent on the quality of annotated training data. However, large-scale datasets often contain inevitable label noise, with bounding box localization errors being a prevalent and impactful form in object detection. While label noise handling techniques are well-studied for image classification, their adaptation to the more complex problem of bounding box errors remains underexplored. To address this, we propose a novel Smooth Bounding Box (SBB) strategy to mitigate the adverse effects of bounding box annotation inaccuracies. Our key insight is that annotation errors are often linked to annotator factors rather than specific image content, allowing for a statistical correction approach. Based on object size distribution within datasets, we implement the SBB strategy through two methods: 1) Global Scaling Correction (GSC), which applies a uniform scaling factor to estimate and correct a global average error; and 2) Interval Scaling Correction (ISC), which categorizes objects by size into intervals and estimates a dedicated correction factor for each, enabling more precise, fine-grained calibration. For efficient optimization of multiple parameters in ISC, we design a tailored model fine-tuning strategy. Furthermore, we introduce a Normalized Residual Fluctuation (NRF) metric to quantitatively assess the smoothing effect and training stability. Extensive experiments on multiple benchmarks demonstrate that our method consistently enhances detection accuracy across various model architectures. Both GSC and ISC achieve significant performance improvements over strong baselines, including the latest YOLOv11n, without adding inference overhead. The codes are available at this https URL.
270. 【2611.00671】From White Canes to Edge AI: A Survey of Assistive Navigation Technologies for Blind and Low-Vision Individuals
链接：https://arxiv.org/abs/2611.00671
作者：Abtin Zandi,Arian Ashrafi,Sarvin Nami,Seyed Sina Negahban,Amirabbas Entezari,Parsa Abbasian,Ariyan Azami,Parisa Taherzadeh,Bardia SabaghKermani,Roza Ganjipour,Hamed Farbeh
类目：Human-Computer Interaction (cs.HC); Computer Vision and Pattern Recognition (cs.CV)
关键词：historically evolved slowly, Independent mobility, blind and low-vision, evolved slowly, autonomy of blind
备注：
点击查看摘要
Abstract:Independent mobility is a foundational requirement for the autonomy of blind and low-vision (BLV) individuals, yet the assistive technologies that support it have historically evolved slowly. This survey systematically reviews 108 peer-reviewed studies published between 2008 and 2026, organizing the field into four technological eras: (i) a foundational era of passive mechanical aids, namely the white cane and the guide dog; (ii) a hardware era of electronic travel aids built on ultrasonic, infrared, and satellite positioning sensors that alert users to proximity but lack semantic understanding; (iii) a deep learning era in which convolutional and transformer-based detectors introduced context-aware scene understanding, initially tethered to cloud infrastructure; and (iv) a contemporary edge-native era defined by model compression, quantization, hardware acceleration, and multi-sensor fusion that relocate intelligence onto resource-constrained wearable and mobile devices. For each era we analyze representative systems, sensing modalities, computational architectures, and reported performance, and we consolidate the field's model-optimization techniques into a single technical reference spanning four detector families and twelve compression strategies. Across the corpus, we find a persistent mismatch between rapid algorithmic progress and slow real-world adoption, driven by cognitive overload in user interfaces, fragmented evaluation protocols, and the scarcity of studies involving BLV participants. We conclude with open challenges, including seamless indoor-outdoor transition, standardized benchmarks, privacy-preserving perception, and the emerging role of multimodal foundation models, and outline a roadmap for socially acceptable, user-centered assistive navigation.
271. 【2611.00658】SE-Mem: Semantic-Episodic Memory for Scene-Consistent Generative View Synthesis
链接：https://arxiv.org/abs/2611.00658
作者：Changsong Lei,Yihan Li,Yu-Hui Wen,Huankun Sheng,Ming Li,Yeying Fan,Minnan Luo,Yong-Jin Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：synthesize novel-view videos, user-defined camera trajectories, Generative view synthesis, Generative view, aims to synthesize
备注： 13 pages, 6 figures
点击查看摘要
Abstract:Generative view synthesis aims to synthesize novel-view videos from reference observations along user-defined camera trajectories. Maintaining global scene consistency throughout this process remains challenging for camera-conditioned interactive video generators. Existing approaches typically select reference frames based solely on camera poses, overlooking whether the content remains semantically relevant or even visible. To address these limitations, we draw inspiration from semantic and episodic memory in human cognition, in which semantic memory captures generalized knowledge across experiences, whereas episodic memory preserves information tied to specific past events and contexts. Motivated by the complementary roles of semantic and episodic memory, we introduce SE-Mem, a Semantic-Episodic Memory framework that organizes historical observations in a structured 3D representation and augments its elements with semantic importance scores. A two-stage memory retrieval strategy is designed to identify the most informative frames to provide contextual guidance. Taking into account both semantic significance and geometric visibility, SE-Mem preserves semantic coherence and fine-grained visual details during novel view synthesis. Extensive evaluations show that our approach improves visual quality and achieves competitive geometric consistency across multiple benchmarks.
272. 【2611.00653】Regularized Wasserstein Distance for Discrete Generative Modeling and Clustering Analysis
链接：https://arxiv.org/abs/2611.00653
作者：Senmao Ye,Fei Liu,Dawei Zhang,Yuqian Zheng,Jun Zhang,Zhonglong zheng
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：formulate clustering analysis, discrete generative modeling, Discrete Distribution Network, Discrete Generative Clustering, discrete candidate space
备注：
点击查看摘要
Abstract:In this paper, we formulate clustering analysis as discrete generative modeling. Specifically, when the generator is restricted to a finite candidate space, the generated samples naturally emerge as the most representative prototypes of the underlying data distribution. To model such a discrete candidate space, we employ a Discrete Distribution Network (DDN). However, DDN suffers from unstable training due to its hard nearest-neighbor selection. To stabilize training and encourage geometric consistency, we replace DDN's l2 loss between images with regularized Wasserstein distance between the empirical distributions of real and generated images. The resulting framework, termed Discrete Generative Clustering (DGC), offers four notable advantages: 1) the learned cluster centers are directly interpretable, as they are realistic synthetic samples; 2) the inference cost scales logarithmically with the number of clusters, i.e., O(log K), making the method scalable to extremely large K; 3) the regularized Wasserstein distance provides a smooth and well-behaved optimization objective that facilitates stable convergence, whereas DDN's l2 loss tends to converge to poor local optima; and 4) DGC replaces DDN's nearest-neighbor selection with random-neighbor selection, which avoids the density shift problem during multi-step forward. Extensive experiments on several benchmarks demonstrate the effectiveness and desirable properties of DGC. The code is publicly available at GitHub.
273. 【2611.00634】PREM: Prediction-Regulated Memory for Robot Manipulation
链接：https://arxiv.org/abs/2611.00634
作者：Xiao Huang,Ya Zhang,Weidi Xie
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：earlier visual evidence, visual evidence absent, recent motion, motion or earlier, evidence absent
备注： 23 pages, 7 figures
点击查看摘要
Abstract:A robot's next action can depend on recent motion or earlier visual evidence absent from its current observation. A recurrent visual-memory architecture can retain this history in a visual state, but its usefulness depends on what the state represents and how it is updated with new observations. We introduce Prediction-Regulated Memory (PREM), a framework that uses action-conditioned future prediction to guide both memory learning and updating in vision-language-action policies. During training, predicting future visual features provides temporal supervision for memory learning. During execution, PREM compares current visual features with the prediction made at the preceding decision and uses the spatially normalized prediction discrepancy to regulate updates to the visual state at each spatial location. The updated visual state supplies temporal context for action generation alongside current observations. Built on $\pi_{0.5}$, PREM improves average success rate from 9.63% to 20.74% on DOMINO dynamic manipulation tasks and from 14.4% to 83.8% on the RMBench M(1) memory-dependent setting. Further evaluations on LIBERO and LIBERO-Pro show improvements in general manipulation and robustness to spatial perturbations. PREM incurs a mean inference overhead of 7.7 ms on a single NVIDIA H800 GPU.
274. 【2611.00608】Words Before Pixels: Selective Modality Routing for Vision-Language Model Unlearning
链接：https://arxiv.org/abs/2611.00608
作者：Laura Yao,Haochen Zhang,Jinhao Duan,Sijia Liu,Tianlong Chen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：preserving retained capabilities, Vision-language model, removes undesirable behavior, objective-design problem, retained capabilities
备注：
点击查看摘要
Abstract:Vision-language model (VLM) unlearning is often treated as an objective-design problem: given multimodal forget data, the goal is to optimize a loss that removes undesirable behavior while preserving retained capabilities. We argue that this view overlooks an equally important data-centric question: how should each forget example be represented before optimization? Existing methods typically keep image-conditioned failures in their original image-text form, implicitly assuming that pixels are the right route for unlearning whenever pixels appear in the input. We challenge this assumption by constructing modality-decomposed versions of VLM benchmarks, enabling controlled comparisons among image-only, text-only, and multimodal representations of the same examples. Our modality-mixing experiments show that unsafe instruction-following behavior is more effectively suppressed through textual representations than through images alone, while purely text-only unlearning can still weaken visual grounding when the target behavior depends on visual evidence. Motivated by this trade-off, we introduce ModRoute, a gradient-guided per-sample modality routing strategy that selectively converts high visual-pressure examples to text-only form while keeping the remaining examples multimodal. Notably, on VLGuard with LLaVA-1.5-7B, ModRoute has the strongest composite unlearning-utility score of 0.847 at $\gamma=0.5$, a 2.5% improvement over the best random-switching score and $\geq$46% better than pure multimodal or text unlearning. Overall, our results show that effective VLM unlearning depends not only on the objective, but also on the composition and per-sample modality routing of the unlearning data.
275. 【2611.00566】Structured Channel Network Pruning with Bi-Sparse Matrix Factorization
链接：https://arxiv.org/abs/2611.00566
作者：Jingjing Liu,Ziyang Wang,Xianchao Xiu,Wanquan Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Structured channel pruning, plays an important, deep learning, important role, role in pattern
备注：
点击查看摘要
Abstract:Structured channel pruning for convolutional neural networks (CNNs) plays an important role in pattern recognition and deep learning. Nevertheless, existing methods usually calculate channel importance scores based on the magnitudes of individual filters, making it difficult to distinguish shared redundancy from individual channel contributions. To tackle this limitation, we propose a novel structured channel pruning method termed bi-sparse matrix factorization (BSMF). Specifically, BSMF characterizes the convolutional weight matrix as output-channel coefficients over a shared basis with row-wise $\ell_{2,p}$-norm and column-wise $\ell_{2,q}$-norm regularization terms, respectively. Note that $p,q\in[0,1)$, which, to our best knowledge, has not been explored in the literature. To solve the resulting non-convex optimization problem, we develop an efficient update scheme built upon the alternating direction method of multipliers (ADMM), in which all subproblems admit closed-form solutions. After that, a compact CNN is obtained by reconstructing the convolutional filters from the learned factors and discarding the redundant channels. Extensive experiments on the CIFAR-10 and ImageNet-1K datasets demonstrate that our proposed BSMF achieves significant network compression while maintaining high reconstruction accuracy. The source code is publicly available at this https URL
276. 【2611.00556】Spatial-Spectral Interactive POCS Network for Large-Gap Seismic Data Interpolation
链接：https://arxiv.org/abs/2611.00556
作者：Baisong Jiang,Chunxia Zhang,Anxiang Di,Xiaoli Wei,Xiangyu Zhao,Deng Xiong,Chuangji Meng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：acquisition disrupt reflection, seismic acquisition disrupt, hinder spectral recovery, disrupt reflection events, acquisition disrupt
备注：
点击查看摘要
Abstract:Large gaps in seismic acquisition disrupt reflection events and hinder spectral recovery. Existing seismic interpolation deep unfolding networks primarily rely on localized spatial priors, limiting their ability to aggregate the global context necessary for reconstructing these extensive missing regions. We propose a spatial-spectral interactive projection-onto-convex-sets network (SSI-POCS) to tackle this severely ill-posed problem. By unfolding the classical iterative solver, our network integrates physical consistency with dual-domain deep priors via learned transforms, soft thresholding, and exact data reinsertion. Within the learned prior, a spatial Restormer branch captures local waveform structures, while a fast Fourier convolution (FFC) branch extracts global context, effectively suppressing incoherent components and enhancing spectral energy concentration in the $f-k$ domain. A dual-domain fusion module exchanges these complementary features via bidirectional channel attention and gated modulation, yielding substantial interpolation improvements. To overcome the severe loss of lateral continuity caused by large gaps, we introduce structural similarity (SSIM) supervision, complemented by focal frequency loss (FFL) and transform consistency constraints to suppress incoherent high-frequency components and regularize training. Experiments on a synthetic salt dome and a North Sea field dataset under 50% random and consecutive trace removal demonstrate the effectiveness of SSI-POCS. It significantly enhances event continuity across large gaps and mitigates artifacts, achieving a 3.285~dB SNR improvement over the best competing method while reducing parameters by 75.66%.
277. 【2611.00551】RATR: Training-Free Material Rebinding via Role Assignment and Temporal Routing
链接：https://arxiv.org/abs/2611.00551
作者：Jiehui Tang,Yunlong Yu,Zhao Wang,Jungong Han
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：target object geometry, Material rebinding aims, Material, target, geometry and identity
备注：
点击查看摘要
Abstract:Material rebinding aims to transfer the material appearance from a reference image while preserving the target object's geometry and identity. Existing methods typically struggle to balance material fidelity with structural preservation due to the coupled influence of structural and appearance cues in their visual conditions. We identify role entanglement in the target and reference conditions as a contributing factor the target condition carries both geometry and its original appearance while the reference condition contains material cues alongside object-specific structure. To address this issue, we propose RATR, a training-free material rebinding method built on a diffusion-based image editor that assigns complementary roles to the two conditions and coordinates their influence during denoising. To make the target condition primarily convey structure, we introduce an albedo-resolved surface release mechanism, which suppresses the target's original surface appearance while retaining geometric cues, yielding a structure-oriented condition for material transfer. On the reference side, the designed material evidence isolation mechanism emphasizes material cues while reducing interference from object-specific structure, yielding a complementary material-oriented condition.
278. 【2611.00527】3D Neural Rendering for Automated Ultrasonic Laser Scans
链接：https://arxiv.org/abs/2611.00527
作者：Thomas Pierson,Matthew Mitchell,Kira Perna,Anand Iyer,Eric Flynn,Adam Wachtor
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO); Applied Physics (physics.app-ph)
关键词：Laser doppler vibrometer, Laser doppler, doppler vibrometer, cracks in manufactured, Neural Radiance Field
备注： LA-UR-26-28755 , For SEM-IMAC-CV
点击查看摘要
Abstract:Laser doppler vibrometer (LDV) scans can be used to detect defects and cracks in manufactured parts before they are deployed. This work presents a method for reconstructing the steady-state surface wavefield of a three-dimensional part by combining automated robotic manipulation with neural rendering. A six-degree-of-freedom (6-DOF) robotic manipulator (UFactory xArm6) with an embedded piezoelectric transducer presented an acoustically excited test article to a stationary LDV at a sequence of known orientations, yielding a set of complex-valued 2D scans with poses derived analytically from the arm kinematics rather than from image-based pose estimation. These scans were used to train a novel complex-nerfacto model, a modified Neural Radiance Field (NeRF) pipeline that replaces the standard three-channel RGB output head with a two-channel output. Complex-nerfacto represents the real and imaginary velocity components of a wavefield, preserving the complex measurement without quantization. Reconstructions of a welded aluminum cylinder and a welded T-bracket were evaluated against measured scans using Z-normalized cross-correlation (ZNCC). The complex-valued pipeline achieved a mean ZNCC of 0.60 at held-out viewing angles, compared with 0.28 for a baseline RGB nerfacto model trained on rendered images of the same data. The resulting surface wavefield reconstructions supported defect detection and characterization on complex components. We identify geometry reconstruction from sparse LDV scans as the remaining obstacle to practical deployment.
279. 【2611.00523】SASFormer: Stage-Aware Selective Attention Transformer for All-in-One Blind Image Restoration
链接：https://arxiv.org/abs/2611.00523
作者：Xiangpeng Tian,Mingyang Li,Fajing Liu,Xiaofeng Wang,Xiaohai He,Chao Ren
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：single unified model, recover high-quality images, aims to recover, recover high-quality, adaptive selective
备注： Accepted by IEEE Transactions on Circuits and Systems for Video Technology
点击查看摘要
Abstract:All-in-one image restoration aims to recover high-quality images from multiple degradation types using a single unified model. Recent methods improve unified restoration with hybrid attention, prompt learning, or routing mechanisms, but generally focus on enhancing degradation adaptivity while employing similar feature modeling strategies across network stages. Consequently, the distinct representation requirements of encoding and decoding under diverse degradations remain insufficiently explored. In this paper, we propose SASFormer, a Stage-Aware Selective Attention Transformer for all-in-one blind image restoration. SASFormer follows a stage-aware design principle: the encoder uses established hybrid channel-spatial attention to build robust content-preserving and degradation-aware representations, while the decoder employs adaptive selective attention for restoration-oriented reconstruction. To address the stage-specific requirements of decoder reconstruction, we develop Adaptive Selective Channel Self-Attention (ASCSA) and Adaptive Selective Spatial Self-Attention (ASSSA), enabling the decoder to dynamically identify restoration-relevant channel responses and spatial contexts. Specifically, ASCSA performs adaptive query-channel selection and attention masking, while ASSSA adaptively integrates spatial attention across multiple window sizes. Compact implicit prompts further modulate the selection process without requiring explicit degradation labels. Extensive experiments on 3-, 5-, and 11-degradation settings demonstrate that SASFormer achieves strong restoration performance with favorable parameter efficiency. Moreover, stage-wise representation analysis and ablation studies provide empirical support for the proposed stage-aware design and the effectiveness of decoder-side adaptive selection.
280. 【2611.00507】Selecting or Solving? What Best-of-N Verification Delivers in Video Reasoning
链接：https://arxiv.org/abs/2611.00507
作者：Martin Q. Ma,Yuxiao Qu,Ruslan Salakhutdinov,Louis-Philippe Morency,Paden Tomasello,Juan Pino
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：vision-language models remain, Answering a complex, grounding problem, Selection Increment, long video
备注： Accepted at NeurIPS 2026 VLM4WRD workshop
点击查看摘要
Abstract:Answering a complex question about a long video is a grounding problem: the answer turns on a few seconds of evidence, and vision-language models remain well below human accuracy at finding them. The standard way to spend extra test-time compute on this kind of video reasoning is best-of-N selection: sample several chain-of-thought answers from a fixed model, then let a second model re-watch the video and pick one. Such pipelines are reported by a single headline number, their margin over a majority vote. That number conflates two effects with opposite deployment consequences: the benefit the second model adds by selecting among candidates, and the benefit it would have supplied by solving the question itself. We separate them, measuring the Selection Increment (SI) -- selection accuracy minus the same verifier's accuracy with the candidates withheld -- alongside the margin over self-consistency, across five long-video benchmarks. The Selection Increment is largest for the weakest verifiers: a verifier that solves poorly on its own leaves the candidates the most room to help. Beating the majority vote follows the opposite profile: where the vote already sits near its ceiling no verifier we test improves on it; below that ceiling only the strongest do. On Video-Holmes, the two come apart on a single pool of candidates -- a weak verifier gains +19.3 points from the candidates yet lands 7.1 points below the vote, while the frontier verifier gains the least and beats the vote. The weakest verifier also shows a failure mode: on EgoSchema it picks by where an option sits in the list rather than by what the video shows. Read as a merit score, SI puts a verifier that fails to beat a majority vote at the top of its ranking; read as an audit, it says which of the two effects a headline number delivers. Code is available at this https URL.
281. 【2611.00482】A Straight Line Is Not a Camera Pose: Auditing Short-Clip Pose Benchmarks
链接：https://arxiv.org/abs/2611.00482
作者：Xinyi Shi
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：SLAM to feed-forward, ATE, camera-motion accuracy, standard measure, measure of camera-motion
备注： 34 pages (8-page main text and appendix), 7 figures, 21 tables
点击查看摘要
Abstract:The absolute trajectory error (ATE) is the standard measure of camera-motion accuracy, from SLAM to feed-forward 3D reconstruction. On the common Sintel protocol, a constant-velocity straight line using no images has a lower mean ATE than 10 of 11 recent models re-run with official code. Two properties of ATE's alignment explain this. First, it maps any constant-velocity prediction onto the best-fitting line through the true path, so the line scores the path's regression residual. A residual signal-to-noise ratio (SNR) criterion predicts when moving a prediction towards its constant-velocity fit lowers ATE. It gives the outcome for 95% of 1056 model-clip pairs, 98% of 792 held-out pairs and 97% of 1034 ScanNet pairs, and it separates Sintel (median SNR 0.86) from TUM, ScanNet and full-length Bonn and Wild-SLAM (2.7 to 27), where straightening raises every model's mean ATE. Second, position-only alignment ignores where cameras look: rotating a trajectory by 30 degrees against its orientations leaves ATE unchanged, yet worsens the reprojection of static points for every model on Sintel, TUM and ScanNet in the main setting, and the line, second by mean ATE on Sintel, places them worst by geometric mean: a lower ATE need not mean better geometry. Fitting the alignment's rotation to the predicted orientations gives pose-anchored ATE, a one-function change in ATE's units costing 0.17 ms per clip (ATE: 0.11 ms). It ranks every image-free reference below every model on Sintel, tracks the reprojection error under rotation and straightening, where ATE does not (Spearman 0.61 vs. 0.32), largely preserves the models' order, and ties 10-frame translational relative pose error (RPE) and the discernible trajectory error (DTE) on our rotation and reference tests. Code, predictions and results will be released.
282. 【2611.00478】Spatial Uncertainty Analytics for Budget-Limited Inspection of Hyperspectral Scenes
链接：https://arxiv.org/abs/2611.00478
作者：Ritesh Sharma,Yuichi Motai
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Land-cover maps classified, wide-area hyperspectral surveys, Land-cover maps, maps classified, classified from wide-area
备注：
点击查看摘要
Abstract:Land-cover maps classified from wide-area hyperspectral surveys are least reliable along class boundaries and in ambiguous regions, so their errors are spatially structured. We study how this structure can direct a limited verification budget: when a low-altitude UAV or a ground crew can visit only a handful of sites, where it should go depends on how classifier uncertainty is arranged across the scene and how a fixed sensor footprint tiles that arrangement. We estimate a per-pixel uncertainty surface from the disagreement of an ensemble of spectral classifiers and select sites by greedy, field-of-view-aware coverage of the uncertainty mass. On seven benchmark scenes, the highest-uncertainty decile of pixels is 2.6 to 7.9 times richer in errors than the scene as a whole, and the coverage greedy covers up to 57% of the classifier's errors with 15 sites, 1.7 to 18 times as many as uncertainty-agnostic sampling of the same labelled region. A non-overlapping selection of the footprints richest in uncertainty does equally well, so the gain comes from scoring whole footprints by uncertainty mass. The advantage persists under spatially blocked evaluation and with a spectral-spatial classifier, although disagreement then ranks errors less well. It requires restricting the surface to labelled land cover: over the whole scene, disagreement peaks on unlabelled ground, where inspections cannot be scored. The best policy for covering connected high-uncertainty regions depends on the scene and on the threshold that defines them, and Gaussian-process selection covers less uncertainty than the coverage greedy on every scene. The pipeline runs on commodity CPUs.
283. 【2611.00458】PRISM-Net: Dynamic Routing Network with VLM-Guided Disentangled Attribute Distillation for Explainable Fine-Grained Product Retrieval
链接：https://arxiv.org/abs/2611.00458
作者：Chung-Ming Lo,Che-Wei Chang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：multimedia systems demands, systems demands discriminative, demands discriminative representations, discriminative representations capable, simultaneously resolving macro-level
备注： 10 pages
点击查看摘要
Abstract:Fine-grained visual product retrieval in large-scale e-commerce multimedia systems demands discriminative representations capable of simultaneously resolving macro-level category semantics and micro-level visual attributes such as structural contour (line) and chromatic appearance (color). However, conventional backbones including convolutional neural networks (CNNs) and vision Transformers (ViTs) inherently suffer from feature entanglement and shortcut learning. To learn the micro-level visual attributes without costly manual attribute annotations, we propose phase-routed interpretable semantic mixture-of-experts network (PRISM-Net), an explainable multi-expert architecture that disentangles holistic visual features into disentangled line and color expert pathways governed by a conditional meta-router. In phase 1, we introduce an external VLM-Guided sigmoid semantic distillation mechanism with gradient-detached routing gates, utilizing zero-shot text prompts from SigLIP to supervise specialized structural and chromatic experts. In phase 2, the disentangled expert embeddings are adaptively fused with macro base features via a learned meta-router gate to calibrate category boundaries. Extensive 5-fold cross-validation across 275,454 e-commerce images (18 categories) and full-scale retrieval benchmarks (55,091 queries against a 220,363-image gallery) across SwinV2, ConvNeXt-V2, and DINOv3 demonstrate substantial gains. On SwinV2, PRISM-Net boosts full-fold product mAP@10 from 80.98% to 83.90% (+2.92%), line mAP@10 by +5.74%, and color mAP@10 by +9.12%. Furthermore, unsupervised distribution analysis of the meta-router gate reveals that both ViT and CNN backbones emergently allocate up to 6.8x higher structural line weights to rigid appliances and hardware while dedicating 96% chromatic weight to clothing.
284. 【2611.00430】Real-VAS: a Real-World Video Amodal Segmentation Dataset
链接：https://arxiv.org/abs/2611.00430
作者：Finlay G. C. Hudson,William A. P. Smith
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：precise ground-truth annotations, combine real-world complexity, Real Video Amodal, ground-truth annotations, Video Amodal Segmentation
备注： 34 pages, including supplementary material. Project page: [this https URL](https://finlay-hudson.github.io/real_vas)
点击查看摘要
Abstract:Amodal video object segmentation is fundamentally limited by the absence of datasets that combine real-world complexity with precise ground-truth annotations. To address this, we present Real Video Amodal Segmentation (Real-VAS), a new large-scale, zero-shot evaluation dataset built from composited real-image video. We introduce a novel data generation pipeline that enables the creation of programmatically consistent amodal ground truth for real-world footage, in which the object mask, occlusion boundary, and composited image are all derived from a single unoccluded source, without relying on human estimation or expensive 3D reconstruction. Our dataset is structured into two challenging scenarios: dynamic Occlusion, created by compositing two clips of moving objects, and a unique Container category featuring complex, physically constrained interactions. These container scenarios--On Surface Containment, Articulated Containment, and Mobile Containment--allow us to generate precise ground truth by simulating an object's motion based on its container's tracked transformation. As a result, Real-VAS provides a diverse and challenging benchmark for evaluating amodal segmentation models on realistic video with the precision of synthetic data. The dataset and our generation code will be made publicly available.
285. 【2611.00427】Spoofing the Latent State: Imperceptible Goal-Image Attacks Derail Planning in LeWorldModel
链接：https://arxiv.org/abs/2611.00427
作者：Kunal Bhosikar,Nicole Meng,Charu Sharma,Yingjie Lao
类目：Computer Vision and Pattern Recognition (cs.CV); Cryptography and Security (cs.CR); Machine Learning (cs.LG)
关键词：Joint-embedding predictive architectures, general-purpose visual world, visual world models, Joint-embedding predictive, predictive architectures
备注： 14 pages, 5 figures, 13 tables
点击查看摘要
Abstract:Joint-embedding predictive architectures (JEPAs) have recently emerged as general-purpose visual world models for control. A prominent example is LeWorldModel (LeWM), which trains end-to-end from pixels using an isotropic Gaussian anti-collapse regularizer (SIGReg) and plans by minimizing the squared Euclidean distance between predicted and goal embeddings. In this work, we investigate the test-time robustness of this latent planning interface. Analyzing the learned metric on Push-T, we first find that task-relevant object state heavily dominates latent distance: shifting the block by a single pixel displaces the embedding $3\times$ further than an equivalent agent shift, and swapping the block pose alone accounts for $99\%$ of the distance between scene pairs. However, because this pose information is distributed across a curved, high-dimensional manifold rather than a fixed linear subspace, the encoder cannot be trivially edited post-hoc to isolate or redirect it. We next demonstrate that this geometry is highly vulnerable at test time. A white-box $\ell_\infty$ perturbation of just $\epsilon{=}4/255$ applied to a single input frame causes the encoder to register the block at an arbitrary, attacker-chosen pose in $73$--$95\%$ of scenes without disturbing the encoded agent state. Perturbing either the goal image or the live camera observation drops Push-T planning success from $87\%$ to $32\%$, whereas uniform random noise at twice the magnitude has negligible impact. This vulnerability persists across all four standard LeWM benchmarks (Push-T, Two-Room, Reacher, and OGBench-Cube). At $\epsilon{=}8/255$, the attack bridges $82$--$97\%$ of the squared latent distance to the target embedding in every environment, inducing planning degradation proportional to each task's reliance on the spoofed entity.
286. 【2611.00423】PAM-Mamba - Efficient Dense Action Detection using Mamba
链接：https://arxiv.org/abs/2611.00423
作者：Dhruvraj Singh Rawat,Faegheh Sardari,Armin Mustafa
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Dense action detection, multiple overlapping actions, action detection requires, long untrimmed videos, detection requires precisely
备注：
点击查看摘要
Abstract:Dense action detection requires precisely localising multiple overlapping actions in long untrimmed videos. Transformer-based methods achieve strong accuracy but their $O(T^2)$ self-attention cost limits scalability. We present PAM-Mamba, a linear-time $O(T)$ architecture built on Mamba with a multi-branch temporal encoder. Gated Learnable Positional Encoding (GLPE) controls positional signal injection via a scalar gate initialised to zero, starting training without added positional signal. A Hub-and-Spoke Funnel extends the non-hierarchical multi-scale design of PAT with a direct residual from the original full-resolution input to each coarse branch, providing each coarse branch with a projection of the input features. Bi-TemBa (Bidirectional Temporal Mamba) first extracts local motion cues with a shallow Temporal Convolution Module, then applies a cascaded bidirectional Mamba scan; the backward pass refines the forward-scanned representation from the opposite direction, giving each temporal position access to context from both directions in linear time. Uncertainty-Based Mixup uses prediction entropy to guide the selection of mixup partners. Using the PAT evaluation implementation, we obtain 26.82 (Charades I3D), 34.59 (Charades CLIP), 46.56 (MultiTHUMOS I3D), and 46.92 mAP (MultiTHUMOS CLIP), with 26.1-27.9M parameters, 61-63% fewer than PAT.
287. 【2611.00406】AP-Out: Tracking Any Point in 360° via Outpainting
链接：https://arxiv.org/abs/2611.00406
作者：Finlay G. C. Hudson,James A. D. Gardner,William A. P. Smith
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：tracking visible correspondences, field of view, visible correspondences, points that leave, leave the camera
备注： Accepted at BMVC 2026. 22 pages, including supplementary material. Project page: [this https URL](https://finlay-hudson.github.io/tapout/)
点击查看摘要
Abstract:Tracking points that leave the camera's field of view (FoV) requires reasoning about unobserved scene dynamics, a fundamentally different problem from tracking visible correspondences. We present TAP-Out, an offline method that makes this out-of-view (OOV) reasoning explicit by leveraging generative video outpainting as a world-model prior. Given a narrow-FoV input video, TAP-Out outpaints a complete 360° equirectangular video, locates target objects within the panoramic scene via video object segmentation, and synthesises object-centred perspective crops on which standard in-frame trackers operate. This decoupled design composes off-the-shelf foundation models without requiring task-specific architectural modifications. On the TAPVid360 benchmark, TAP-Out achieves state-of-the-art performance, improving OOV tracking accuracy by approximately 3x over the best prior method. We demonstrate its flexibility on out-of-frame object segmentation and detection and we provide detailed diagnostic analyses across motion regimes, static versus dynamic content, and hallucination quality, characterising when and why the approach succeeds or fails.
288. 【2611.00396】Evaluating SAM-based and Convolutional Architectures in Thin Retinal Vessel Segmentation: Model Capacity, Computational Cost and Foundation Pre-training
链接：https://arxiv.org/abs/2611.00396
作者：Carlos Eduardo Fontaneli,Cesar Henrique Comin
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：plain Vision Transformers, convolutional neural networks, coarse patch tokenization, large training sets, weak locality bias
备注：
点击查看摘要
Abstract:In retinal vessel segmentation, plain Vision Transformers (ViTs) are commonly expected to perform worse than convolutional neural networks (CNNs) on thin vessels, for reasons such as their coarse patch tokenization, their weak locality bias and their need for large training sets. Although this expectation is widely shared in the literature, how plain ViTs actually compare with CNNs on thin vessels has not been systematically quantified. We address this question by comparing a model with a plain ViT encoder (MedSAM), a hybrid Transformer (LiteMedSAM) and three CNNs of different sizes on three retinal datasets (DRIVE, HRF, FIVES) and, as a second-domain check, a microscopy dataset (VessMap). We measured the centerline recall and precision of thin vessels and compared the models while also considering their computational cost and how many epochs they needed to train. We found that the pre-trained MedSAM had a centerline recall of thin vessels that was not significantly different from that of the best CNN on all four datasets (-0.6 to +2.5 percentage points). A compact plain ViT obtained through architecture search but trained from scratch did not retain this performance. For pre-trained plain ViTs, our results do not support the expectation that they miss thin vessels, although similar thin-vessel performance can be obtained with much smaller models.
289. 【2611.00383】LF-VideoQA: Evaluating Long-Video Understanding with Long-Form Theory-of-Mind Questions
链接：https://arxiv.org/abs/2611.00383
作者：Shaden Shaar,Bradon Thymes,Majd Aldaye,Claire Cardie,Bharath Hariharan
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：hardest part, moment but synthesizing, tracking what develops, develops across hours, hours of content
备注：
点击查看摘要
Abstract:The hardest part of understanding a long video is not pinpointing any one moment but synthesizing many, e.g., answering a question that requires tracking what develops across hours of content and articulating how the pieces fit together. To date, most long-video QA datasets require only a short answer or a multiple-choice selection, oversimplifying the long-video understanding task to retrieval. We introduce LF-VideoQA, a dataset for long-form, open-ended question answering over long narrative videos built on theory-of-mind questions: a character's belief depends on everything they have seen or been told, so each question demands assembling and reasoning from evidence distributed across the video. The dataset contains more than 6,300 questions on 94 recent films; each requires reasoning over scenes spanning an average of 23 minutes and comes with a question-specific rubric for recall and precision scoring. The dataset is created entirely automatically by annotating screenplays with scene events and each character's first-order beliefs and meta-beliefs, then generating (question, answer, rubric) triples through LLM-based question generation and verification; human studies validate their quality. We evaluate four families of state-of-the-art open-source VLMs across three settings and find the task highly challenging: (i) even an oracle with access to the screenplay falls well short of complete answers; (ii) the best non-oracle model attains barely half of the recall level of the oracle; (iii) unlike on prior long-video benchmarks, captions and subtitles underperform the video itself, indicating that the questions need visual evidence; and (iv) recall is the predominant bottleneck, with answers omitting many required rubric claims.
290. 【2611.00375】MoRE-GS: Motion-Regime Experts for Future Gaussian Splatting
链接：https://arxiv.org/abs/2611.00375
作者：Shima Salehi,Joshua Peeples
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Future dynamic novel-view, novel-view synthesis requires, synthesis requires extrapolating, requires extrapolating multiple, dynamic novel-view synthesis
备注：
点击查看摘要
Abstract:Future dynamic novel-view synthesis requires extrapolating multiple motion regimes within the same scene. A single dynamics model may not simultaneously represent stationary regions, coordinated motion, local interactions, and articulated trajectories. We introduce Motion Regime Expert Routing for Gaussian Splatting (MoRE-GS), a causal, render-aware framework for forecasting dynamic 3D Gaussian scenes. MoRE-GS freezes a Gaussian representation reconstructed exclusively from the observed temporal prefix and forecasts its control-keypoint motion using four complementary experts: persistence, a coefficient-space Transformer, a graph convolutional network, and a structured Transformer with rigid and non-rigid motion constraints. A compact routing table assigns expert mixtures across soft motion groups and forecast-horizon bins, while a persistence gate suppresses unreliable extrapolation. Across D-NeRF and HyperNeRF scenes, MoRE-GS achieves improved performance against other methods, and these results demonstrate that renderer-calibrated composition of complementary motion predictors improves causal dynamic Gaussian forecasting across heterogeneous motion regimes. Project page: this https URL
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2611.00375 [cs.CV]
(or
arXiv:2611.00375v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2611.00375
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
291. 【2611.00367】When appearance and motion disagree: evaluating class--motion consistency against disguised uncrewed surface vessels
链接：https://arxiv.org/abs/2611.00367
作者：Jon Reifschneider
类目：Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：uncrewed surface vessels, approaching benign craft, distinguish approaching benign, warning to act, distinguish approaching
备注：
点击查看摘要
Abstract:Defense systems for maritime assets must distinguish approaching benign craft from uncrewed surface vessels (USVs) with sufficient warning to act. Shore cameras using computer vision can separate hostile vessels from benign traffic, but these systems may be attacked using an adversarial hull patch or physical disguise. We evaluate adversarial hull patches and find they suppress detection in up to 29% of attempts but never cause misclassification as benign. Physical disguise, however, can bypass both a camera check and a radar presence check. To evaluate defenses, we develop a hybrid replay protocol from automatic identification system (AIS) tracks that combines recorded benign motion with direct or off-axis attack run-ins. We find that for recreational-labeled vessels attacking via direct run-in within 4 nautical miles, an asset-relative closing-rate check flags 94-95% at 15-20 knots, compared with 12% for a track-only speed check. The checks are complementary on off-axis approaches, constraining the attacker to remain below both thresholds and extending the time required to reach the asset. Flagging on either check has a 4.9% held-out false-alarm rate overall and 12.3% on recreational traffic. The replay-based evaluation protocol supports comparative test and evaluation of defense methods.
292. 【2611.00351】SIEVE: Preserving Cross-Image Evidence via Depth-Aware Token Compression
链接：https://arxiv.org/abs/2611.00351
作者：Nitish Shukla,Surgan Jandial,Nhat-Tan Bui,Arun Ross
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：incur substantial computation, long visual sequences, incur substantial, substantial computation, processing long visual
备注： 19 pages, including supplementary material. Code: [this https URL](https://github.com/nitishshukla86/SIEVE)
点击查看摘要
Abstract:Multi-image vision-language models (VLMs) incur substantial computation when processing long visual sequences. Compressing these sequences must preserve complementary evidence across images and keep tokens from different images separate. Global selection can underrepresent question-relevant images, and pruning in early decoder layers risks removing relevant content before sufficient multimodal processing, yet existing methods spend most of the budget on these early layers. We propose SIEVE, a training-free, single-pass framework that jointly allocates visual tokens across images and decoder depth. SIEVE first pools each image into a compact spatial grid to reduce early processing cost. It then progressively selects representatives using prompt attention under equal per-image quotas and aggregates unselected tokens into similar representatives from the same image. These operations keep every image represented and its tokens separate from other images, while refining the retained representations. A closed-form schedule sets retention counts to target a prescribed average token budget across decoder layers. Across four VLM backbones, SIEVE achieves the highest average at a 6.25% budget on five multi-image benchmarks and four single-image benchmarks, and the highest mean on two video benchmarks. On LLaVA-OneVision-7B, it outperforms the strongest baseline by 9.96 and 9.03 points at 6.25% and 12.5% budgets, and at 12.5% it exceeds the uncompressed model by 2.01 points with 6.6x fewer prefill FLOPs.
293. 【2611.00328】Déjà Vu: Cycle-Consistent Re-ranking for Semantic Correspondence
链接：https://arxiv.org/abs/2611.00328
作者：Xiaoran Zhang,Huidong Liu,Yang Liu,Chien-Chih Wang,Jinfa Huang,Lingkai Kong,Bryan Wang,Yan Gao,Hongdong Li,Alex Wong,James S. Duncan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：test-time decoding module, Déjà, test-time decoding, semantic correspondence, correspondence
备注：
点击查看摘要
Abstract:We propose \emph{Déjà Vu}, a test-time decoding module for semantic correspondence. Matching semantically equivalent keypoints across images of the same object category is challenging due to variations in appearance, viewpoint, and scale. While features from large pretrained vision models carry strong zero-shot correspondence ability, existing methods reduce final matching to greedy top-$1$ nearest-neighbor selection. We show that the correct correspondence appears among the top-ranked candidates far more often than top-$1$ matching achieves: with $30$ candidates, zero-shot features exceed the top-$1$ accuracy of a supervised model. This reveals a \textit{decoding bottleneck} rather than a limit of the representation. Motivated by this observation, we formulate semantic correspondence as a \textit{recall-then-rerank} problem. Our method first nominates an adaptive candidate set, larger when the similarity distribution is ambiguous and smaller when it is confident, then re-ranks the candidates with a graded cycle-consistency score: each candidate is matched back to the source image and penalized by how far its reverse match lands from the original keypoint. The module operates entirely on the similarity matrix already computed by the base method. It consistently improves three representative baselines on SPair-71k, its geometric subset, and PF-Pascal under both unsupervised and weakly supervised settings, with gains of up to $+1.8$ PCK@0.10 on SPair-71k and $+3.4$ PCK@0.15 on PF-Pascal, and $+4.9$ under Keypoint Average Precision.
294. 【2611.00293】Seeing the Unseen: Unified Visible--Invisible Motion for Physically Consistent Video Generation
链接：https://arxiv.org/abs/2611.00293
作者：Mingyang Bao,Fangda Ye,Xihao Chen,Bobo Li,Jason Li,Shengqiong Wu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：impressive visual quality, achieved impressive visual, Recent advances, underlying physical processes, visual quality
备注： 25 pages, 14 figures, 9 tables, NeurIPS 2026
点击查看摘要
Abstract:Recent advances in video generation have achieved impressive visual quality, yet they often fail to produce physically consistent dynamics due to the lack of explicit modeling of underlying physical processes. Existing approaches either rely on simulators with strong assumptions or use coarse semantic guidance, and further struggle to effectively inject physical priors into generation models. In this work, we propose Seeing the Unseen, a unified framework for physics-grounded video generation. Our approach decomposes the problem into two stages: learning physical dynamics and injecting them into video synthesis. First, we introduce a lightweight Particle-based Graph Dynamics Simulator (PGDS) that learns generalizable physical interactions from data and predicts plausible 3D motion trajectories. Second, we propose a Visible--Invisible Motion Field (VIMF) that captures both motion observable in the input frame and motion that emerges over time due to object dynamics. This representation enables more complete and structured motion guidance compared to conventional physical signals. By integrating these trajectories into a diffusion-based generator, our method produces videos that are both visually coherent and physically consistent. Extensive experiments demonstrate improved motion accuracy, interaction consistency, and reduced physical artifacts compared to strong baselines.
295. 【2611.00288】Seeing Less in a Sparse World: Cross-View Geolocalization from Limited Field-of-View Observations
链接：https://arxiv.org/abs/2611.00288
作者：Fahimul Aleem,Shruti Vyas
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Navigation Satellite System, Global Navigation Satellite, Global Navigation, localization in Global, Satellite System
备注：
点击查看摘要
Abstract:Cross-view geolocalization aims to determine the geographic location of a ground-level image by retrieving its corresponding satellite image, offering a promising alternative for localization in Global Navigation Satellite System (GNSS)-denied or degraded environments such as urban canyons, dense forests, and disaster scenarios. Despite recent progress, existing approaches remain limited by the lack of globally diverse training datasets and benchmarks that are often geographically restricted. Furthermore, most benchmarks rely on panoramic ground views, which do not reflect the limited field-of-view imagery captured by real world cameras. To address these challenges, we introduce Cross-View World 500k (CVW500k), a large-scale globally distributed dataset containing over 500,000 ground-satellite image pairs collected across diverse geographic regions and environments. Unlike previous datasets, CVW500k uses limited field-of-view ground images, providing a more realistic and challenging setting for cross-view geolocalization. In addition, we propose GeoQueryNet, a query-based cross-view fusion transformer framework designed to bridge the viewpoint gap between ground and satellite images. The model leverages a CLIP-based visual encoder with parameter-efficient LoRA adaptation and introduces a Cross-View Alignment Module that uses learnable query tokens to extract geographically consistent features across viewpoints. Our code can be found here: this https URL .
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2611.00288 [cs.CV]
(or
arXiv:2611.00288v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2611.00288
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
296. 【2611.00253】SketchForge: Training-Free Scene-to-Vector Sketching via Decoupled Structure and Texture Optimization
链接：https://arxiv.org/abs/2611.00253
作者：Quang-Thinh Nguyen,Duy-Khang Do,Hien Trinh,Tam V. Nguyen,Minh-Triet Tran,Trung-Nghia Le
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：vectorization methods struggle, stroke-editable vector sketch, texture remains challenging, tonal texture remains, arbitrary input image
备注： SIGGRAPH Asia 2026, Technical Communications
点击查看摘要
Abstract:Converting a raster image into a resolution-independent, stroke-editable vector sketch while faithfully preserving both structural contours and tonal texture remains challenging: raster-space rendering pipelines are difficult to edit at the stroke level, while generation-from-scratch vectorization methods struggle to remain faithful to an arbitrary input image. We present SketchForge, a training-free framework that converts an input raster image into a resolution-independent SVG sketch through per-instance test-time optimization of Bezier curves, requiring no additional training or fine-tuning. Strokes are seeded via a contour and attention-guided initialization, then refined by a vector-native differentiable rendering pipeline that decouples structural contour strokes from free-form texture strokes under dedicated objectives, composited via multiply-blend layering. Extensive experiments show that SketchForge consistently outperforms existing vector-based baselines in structural fidelity and generation quality. Project page: this https URL
297. 【2611.00247】aurus: LLM-in-the-Loop CT Annotation Matches Coding Agents at Half the Cost
链接：https://arxiv.org/abs/2611.00247
作者：Bing Hu,Rishabh Sharma,Jatin Mehta
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Dense labels, slow to draw, free-form Opus agent, model, free-form agent
备注： 24 pages (10 main text, 12 appendix), 8 figures, 10 tables
点击查看摘要
Abstract:Dense labels of the aorta in CT are slow to draw, and the public aortic CT datasets that could stand in for them each label different structures under their own conventions. Large language model (LLM) agents can now write code and read images. We asked whether such a model labels these scans better as a free-form agent that writes its own segmentation code, or inside a harness, where an automated pass labels the scan and the model reviews the result. We built a harness, Taurus, and compared it with free-form agents by blind label recovery: we withheld the human labels of six public datasets (939 volumes) and scored every approach against each dataset's own classes. In the first version of Taurus, the model's review raised the primary metric on only two of six datasets, by less than the noise between two reviews of the same case. A free-form agent running Claude Opus 5.5 scored higher on most datasets. Moving what the free-form agents did well into the automated pass then carried most of the gain on 38 held-out cases. The final version smooths the label surfaces with a fixed rule and checks for the large errors the automated pass tends to make, such as an aneurysm drawn to half its size. Each check that fires puts a multiple-choice question to the model, with candidate corrections drawn on the scan. It matched the surface smoothness of the human references, and in the primary metric we found no difference from the free-form Opus agent, at under half its cost, $1.22 against $2.71 per case. Most of what made Taurus competitive came from the harness and its automation rather than from the language model itself. Taurus shows that this kind of annotation can be automated, so that expert time can move from drawing labels to checking them.
298. 【2611.00245】SketchBloom: Training-Free Vector Sketch Outpainting with Stroke-Level Style Control
链接：https://arxiv.org/abs/2611.00245
作者：Quang-Thinh Nguyen,Duy-Khang Do,Tam V. Nguyen,Minh-Triet Tran,Trung-Nghia Le
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：style remains challenging, Outpainting sparse sketches, preserving contour coherence, remains challenging, sparse sketches
备注： WACV 2027
点击查看摘要
Abstract:Outpainting sparse sketches while preserving contour coherence and stroke style remains challenging. We present SketchBloom, a training-free framework that combines pretrained raster outpainting and style-transfer guidance with per-instance vector optimization. Given a sketch, a scene prompt, and an optional reference style, it produces an editable Scalable Vector Graphic (SVG) composed of Bezier strokes. Adaptive latent blending balances content contours and reference texture without model retraining. A reference-derived stroke vocabulary initializes contour- and DINO-attention-guided strokes, which are optimized separately for structure and texture before contour-emphasizing multiply fusion. As in prior optimization-based vector sketching, no task-specific network is trained; our contribution is the synthesis design specialized to sketch outpainting. On LineArtOut-1K, comprising 1,024 input and style combinations, SketchBloom improves perceptual, semantic, and structural fidelity over the evaluated vector baselines when all methods vectorize the same outpainted raster. This protocol evaluates vector synthesis rather than end-to-end outpainting or reference-style superiority. Runtime is approximately six minutes per pair on a single NVIDIA H200 GPU. Project page: this https URL
299. 【2611.00191】MemU-Bench: Benchmarking GUI Agents on Long-Horizon User Interactions
链接：https://arxiv.org/abs/2611.00191
作者：Yizhou Liu,Zhengxi Lu,Fei Tang,Yiwen Qiu,Yong Du,Tongbo Chen,Bofan Chen,Tao Jiang,Wenhao Xu,Yunfeng Shu,Wenqi Zhang,Weiming Lu,Jun Xiao,Yueting Zhuang,Yongliang Shen
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Existing Graphical User, Graphical User Interface, Existing Graphical, benchmarks predominantly rely, User Interface
备注：
点击查看摘要
Abstract:Existing Graphical User Interface (GUI) benchmarks predominantly rely on precise and stateless user instructions. In everyday usage, however, instructions are often \emph{vague and history-dependent}: users omit the exact details of their past operations because they no longer remember them, leaving the agent to recover the missing context from long and noisy interaction histories. To bridge this evaluation gap, we introduce \textbf{MemU-Bench}, a mobile benchmark of \textbf{118 vague tasks} grounded in 29 long-horizon user trajectories, where agents must distill raw interaction streams into memory and retrieve the missing context on demand, with task outcomes verified against serialized application databases. Alongside Success Rate, we incorporate Interaction Efficiency (IE) and Success weighted by Path Length (SPL) to expose agents that succeed by exhaustively searching across different applications rather than by \emph{genuinely recalling} the history. Evaluations show that without user history, state-of-the-art systems struggle under such ambiguity: the best-performing Gemini-3.1-Pro achieves an SPL of only 16.4\%, and end-to-end GUI agents fall below 5\%. To address this, we further propose \textbf{AppMem}, a training-free framework that distills user history into a \emph{structured, app-centric} memory bank, tracks interrupted intents across application switches, and selectively retrieves relevant memories via target-app inference. AppMem raises the SPL of GPT-5.5 from 15.7\% to 66.9\% (\textbf{+51.2\%}), outperforms a naive summary baseline by 9.3\%, and delivers consistent gains across evaluated backbones.
300. 【2611.00180】Learning to Live: A Step Toward Lifelong Embodied Intelligence
链接：https://arxiv.org/abs/2611.00180
作者：Lirong Che,Peidong Wang,Yimeng Su,Jiong Wang,Yang Chen,Wenbo Fu,Zhenyu Huang,Tiancheng Xu,Yuzhe Yang,Dongli Xie,Xu Cao,Chuang Wang,Daqi Liu,Jian Su
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Embodied agents, organized around individual, Lifelong Intelligence, Embodied, individual tasks
备注：
点击查看摘要
Abstract:Embodied agents are usually organized around individual tasks, yet the physical world keeps changing between tasks and during execution. We introduce LIFE (Lifelong Intelligence from Experience), a framework in which a robot observes continuously, remembers selectively, and turns experience into new capabilities. RoboBeats, a family of lightweight streaming gates, tracks conditions set by the agent and discovers new events, deciding when an observation warrants a response or a memory write. Selected observations enter Plastic Memory, a flat store of images and structured records that keeps the source evidence, so new fields and indexes can be added when later questions need them. When existing tools fall short, Explore-Distill-Mount (EDM) turns solutions found during problem solving into validated, reusable tools and skills. Under matched protocols, RoboBeats substantially improves condition tracking over its base models and, at the same writing budget, retains more useful evidence for memory question answering than uniform sampling. A case study of limited scale, replaying 24 hours of continuous video recorded by a real robot, illustrates how the integrated system builds memory from a day of experience and uses it to answer everyday questions. LIFE takes a step toward robots that become more familiar with their surroundings and more capable through experience: learning not only to complete tasks, but to live in the world.
301. 【2611.00179】How to Simplify a Line Chart: A Taxonomy and Feature-Based Evaluation
链接：https://arxiv.org/abs/2611.00179
作者：Rifat Ara Proma,Paul Rosen
类目：Human-Computer Interaction (cs.HC); Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：producing interpretable line, Simplifying large, interpretable line charts, existing methods vary, methods vary widely
备注：
点击查看摘要
Abstract:Simplifying large or noisy time-series is often a prerequisite for producing interpretable line charts, yet existing methods vary widely in how they alter visual features such as trends, extrema, periodicity, curvature, roughness, and overall complexity. We introduce a feature-based taxonomy of line chart simplification that evaluates 19 commonly used algorithms across three families: Transformers, Reducers, and Aggregators. We also formalize 12 perceptually motivated, computationally defined visual features commonly used when analyzing time-series in line charts. We assess preservation using multiple similarity metrics per feature to capture different aspects of fidelity, yielding 21 distinct feature-preservation measurements. To capture the trade-off between fidelity and simplicity, we introduce a Feature--Complexity (FC) score that combines feature preservation with complexity. Our systematic evaluation on 80 datasets reveals distinct family-level patterns: Transformers such as Gaussian, Mean, and Median filters achieve A-mode grades on nearly all metrics but retain full temporal resolution; Reducers such as Douglas-Peucker and M4 receive predominantly D-F mode grades trading fidelity for a reduction in the number of rendered points; and Aggregators ASAP and PAA occupy a middle ground with primarily B-C mode grades. We further characterize the predictability of algorithm behavior across datasets: some methods produce consistent grades regardless of dataset type (Gaussian, Mean, Douglas-Peucker), while others exhibit high data-dependency, with performance varying substantially based on dataset characteristics (FPCS, ASAP). An interactive website supporting exploration of all evaluated techniques, datasets, and results is available at this https URL.
302. 【2611.00177】AuroraWorld: Structured 4D World Modeling for Exo-to-Ego Video Generation in Robot Manipulation
链接：https://arxiv.org/abs/2611.00177
作者：Hao Xue,Peng-Fei Zhang,Ying Cheng,Lanyun Zhu,Lei Zhu,Heng Tao Shen
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：visuomotor policy learning, capturing contact interactions, capturing contact, external cameras, robot-centric view
备注：
点击查看摘要
Abstract:Egocentric observations provide a robot-centric view of manipulation processes, capturing contact interactions and object-state changes that are important for visuomotor policy learning but difficult to observe from external cameras. However, collecting such data at scale remains expensive due to additional hardware requirements and platform-specific deployment costs. Synthesizing egocentric observations from large-scale exocentric manipulation videos provides a scalable alternative. However, existing methods struggle to synthesize physically consistent and policy-relevant egocentric videos under substantial viewpoint transformations, severe occlusions, complex object interactions, and inherently sparse observations from available exocentric viewpoints.
303. 【2611.00175】Interpretable structural temperature scaling for calibrating graph neural networks and point-cloud segmentation
链接：https://arxiv.org/abs/2611.00175
作者：Chenyi Huang
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：Graph-aware calibrators make, Graph-aware calibrators, graph neural networks, Interpretable Structural Temperature, Structural Temperature Scaling
备注： Under consideration at Pattern Recognition Letters. 7 pages, 6 tables, 1 figure; supplementary material in ancillary files
点击查看摘要
Abstract:Graph-aware calibrators make graph neural networks (GNNs) more trustworthy by predicting a temperature for each node, usually with auxiliary networks whose decisions are hard to inspect. We propose Interpretable Structural Temperature Scaling (ISTS), a twelve-parameter linear model that sets each node's temperature from named descriptors of its confidence, neighbourhood and closeness to labelled nodes, so every temperature traces back to descriptor contributions. ISTS preserves predictions, and cross-validated regularisation lets the calibration data decide how far the model departs from temperature scaling (TS). Its explanations are faithful at the level of node groups: on test nodes, ISTS softens groups that a global temperature leaves over-confident and sharpens under-confident ones (Spearman correlation 0.67 over 246 groups). On seven graphs with two backbones and eleven baselines, ISTS has the best average rank in negative log-likelihood (NLL) and Brier score and lowers NLL relative to TS by 1.8%, more than twice the gain of an identically fitted entropy-based temperature. It ranked first again on four held-out graphs under a protocol fixed in advance. From about 100 calibration nodes on, ISTS is a cheap and inspectable choice, and on point-cloud segmentation it significantly improves NLL, Brier score and the ranking of points for rejection.
304. 【2611.00122】CDBM: Complexity-Diversity Framework for Building Morphology Analysis
链接：https://arxiv.org/abs/2611.00122
作者：Evgenii Maslov,Alexandra Vabnits,Denis Karpov,Alexey Morozov,Anastasia Antsiferova,Art Prosvetov,Valentin Khrulkov
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Complexity-Diversity Building Metrics, introduce Complexity-Diversity Building, Building Metrics, twelve interpretable descriptors, building massings represented
备注：
点击查看摘要
Abstract:We introduce Complexity-Diversity Building Metrics (CDBM), twelve interpretable descriptors for building massings represented as vertical extrusions. They measure how strongly geometric detail is expressed (complexity) and how unevenly it varies across one- and two-dimensional elements (diversity). Computed for 482,241,306 OpenStreetMap buildings and compared with 3D Building Metrics (3DBM) and the LION shape latent on task-specific samples, CDBM is tested on function, region, contextual relevance, real-generated discrimination, human preference and geometry-conditioned generation. With gradient boosting, CDBM best separates generated from mapped massings and best matches human preference; with logistic regression it matches 3DBM on realism. 3DBM leads on the other three tasks. As generation targets, the descriptors show that models struggle to produce strongly expressed and heterogeneous forms. CDBM complements existing indicators.
305. 【2611.00120】DTP-OPSD: Reinforcement Learning with Distractor-Aware Temporal-Privilege On-Policy Self-Distillation for Temporal Video Grounding
链接：https://arxiv.org/abs/2611.00120
作者：Zhaoyu Chen,Yongwei Nie
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Temporal Video Grounding, Video Grounding, Relative Policy Optimization, aims to localize, localize the start
备注：
点击查看摘要
Abstract:Temporal Video Grounding (TVG) aims to localize the start and end times of an event described by a language query in a video. The task becomes particularly challenging when the same video contains multiple repeated, similar, or opposite events. On these hard examples, all responses sampled by Group Relative Policy Optimization (GRPO) may miss the target and receive zero temporal Intersection-over-Union (tIoU). Their group-relative advantages are then all zero, leaving no useful policy gradient signal. To address this, we propose DTP-OPSD, a reinforcement learning framework with distractor-aware temporal-privilege on-policy self-distillation. The student observes the clean video and generates responses on-policy, while a shared-weight teacher observes a privileged video in which the target window is marked by red full-frame borders and same-video distractor windows by blue full-frame borders. For the distillation loss, the teacher evaluates student-generated prefixes and provides dense token-level Jensen-Shannon divergence supervision. This supervision remains informative even when GRPO provides no policy gradient signal. We suppress distillation when the teacher does not outperform the student and strengthen it for groups where the teacher performs better but all student rollouts receive zero tIoU. We also construct a compact hard-interference training set through VLM screening and human verification. With only 300 additional post-training examples, DTP-OPSD achieves the highest mIoU among the compared open-source 8B models on Charades-TimeLens, ActivityNet-TimeLens, and QVHighlights-TimeLens, reaching 55.93, 54.77, and 66.71, respectively. Compared with Pure GRPO trained on the same data, DTP-OPSD improves all 12 reported metrics, with R1@0.7 gains of 1.28, 1.62, and 1.78 points on the three benchmarks. Code will be released at this https URL
306. 【2611.00114】Brain-Behavior Modeling from Multimodal MRI using Opportunistic Pretraining and Common-Cohort Adaptation
链接：https://arxiv.org/abs/2611.00114
作者：Md. Tanvir Rahman,Taslima Ferdaus Shuva,Nabil Anan Orka,Asaduzzaman Khan,Mohammad Ali Moni
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Incomplete imaging coverage, imaging coverage limits, coverage limits sample, limits sample sizes, multimodal cognitive prediction
备注： 39 pages, 4 figures. This work has been submitted to the Elsevier NeuroImage for possible publication
点击查看摘要
Abstract:Incomplete imaging coverage limits sample sizes for multimodal cognitive prediction. We evaluated a two-stage opportunistic deep ensemble using baseline Adolescent Brain Cognitive Development Study data to predict fluid, crystallized, and total cognition. Separate neural models processed structural/diffusion, resting-state, and task-based MRI data with covariates. Models were pretrained on eligible modality cohorts (up to 9,686 participants), adapted to common training cohorts, and fused via Ridge regression (trimodal cohort: 4,216 participants). Five-fold family-aware cross-validation compared this approach against constituent and covariate-only models. Two-stage training increased mean test coefficient of determination (R^2) in 24 of 27 comparisons (median gain: 0.0081). Fusion increased mean R^2 by 0.0051-0.0333 over the strongest constituent and reduced mean absolute error by 0.0067-0.0976. Task-plus-resting-state and trimodal ensembles reduced absolute error across all targets (nominal p = 0.0108). Task-plus-resting-state fusion achieved the highest mean R^2 for fluid (0.2222) and total cognition (0.3665), while structural-plus-resting-state led for crystallized cognition (0.3706), yielding R^2 gains of 0.0805, 0.1180, and 0.0890 over covariate-only references. Ablations showed expanded pretraining drove most improvements. Gradient-based attribution identified target-dependent input patterns. These findings support using partially observed cohorts for model development to achieve modest fusion gains. Pending external validation, this approach may support MRI-informed cognitive phenotyping.
307. 【2611.00113】Predicting Cognitive Profiles from Structural MRI using Spatial Graph Representation Learning
链接：https://arxiv.org/abs/2611.00113
作者：Taslima Ferdaus Shuva,Md. Tanvir Rahman,Risala Tasin Khan,Mohammad Ali Moni,ASM Ashraf Mahmud
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Predicting cognitive abilities, neuroimaging remains challenging, remains challenging due, structural neuroimaging remains, Predicting cognitive
备注： 15 pages, 4 figures. This work has been submitted to the Elsevier Array for possible publication
点击查看摘要
Abstract:Predicting cognitive abilities from structural neuroimaging remains challenging due to the high dimensionality and geometric complexity of brain morphology. Conventional models typically flatten regional morphometry into tabular features, failing to explicitly represent spatial relationships. We propose a Spatial-Topological Graph Neural Network (ST-GNN) to predict four distinct cognitive phenotypes across large pediatric cohorts (N = 2,378 to 2,424). By projecting regional morphometry onto a population-level standardized spatial graph, ST-GNN restricts message passing to defined neighboring regions. Evaluations demonstrate that ST-GNN effectively fuses spatial morphology with systemic covariates, outperforming linear baselines and topology-free deep models. Ablations reveal that imposing a sparse geometric topology (K-nearest neighbors) and utilizing global feature scaling - which preserves absolute morphometric scale - outperform fully connected networks and region-normalized approaches. These choices provide transferable architectural inductive biases, revealing differences between computational routing and morphometric feature attribution. Integrated Gradients analysis identified distinct morphological features consistent with neuroanatomical evidence, such as cerebellar volume for working memory and superior frontal surface area for executive function. These findings suggest standardized structural MRI provides useful information for task-specific cognitive prediction, establishing a foundation for MRI-based neurodevelopmental assessment.
308. 【2611.00111】SpatialVec: A Unified Representation Learning Framework for Geospatial Objects with Boundary-Aware Sampling
链接：https://arxiv.org/abs/2611.00111
作者：Samya Acharja,Kanchan Chowdhury
类目：Computer Vision and Pattern Recognition (cs.CV); Databases (cs.DB); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：Geospatial Artificial Intelligence, Artificial Intelligence, Geospatial Artificial, essential for Geospatial, enabling machine learning
备注： Accepted to 2026 IEEE International Conference on Big Data as a full research paper
点击查看摘要
Abstract:Spatial representation learning is essential for Geospatial Artificial Intelligence (GeoAI) applications, enabling machine learning models to capture the geometry, location, and spatial relationships of geographic entities such as points, polylines, and polygons. Existing spatial encoding methods often struggle to preserve fine-grained topological information, particularly for interactions involving complex geometries such as polylines and polygons. These approaches inadequately capture boundary structure and local spatial context, causing topology-sensitive relationships near geometry boundaries to be underrepresented in the learned embedding space. Consequently, accurately modeling complex spatial interactions remains a significant challenge for downstream spatial reasoning tasks. To fill the gap, we introduce SpatialVec, a boundary-aware spatial representation learning framework that adaptively samples geometry boundaries and their surrounding regions, capturing fine-grained geometric structures critical for topology-aware spatial reasoning. A transformer-based encoder-decoder trained through geometry reconstruction produces compact, geometry-aware, and unified representations for points, polylines, and polygons. Empirical evaluation on two real-world datasets shows that SpatialVec substantially improves the preservation of challenging topological relationships involving polygonal interactions and outperforms state-of-the-art baselines significantly on downstream prediction and classification tasks.
309. 【2611.00110】A New Formulation of the Elastica Model with Application to Image Inpainting
链接：https://arxiv.org/abs/2611.00110
作者：Zuoqiang Shi,Xue-Cheng Tai
类目：Computer Vision and Pattern Recognition (cs.CV); Optimization and Control (math.OC)
关键词：Euler elastica energy, Euler elastica, elastica energy, interfaces play, play a central
备注：
点击查看摘要
Abstract:Curves and interfaces play a central role in computer vision and image processing, and Euler's elastica energy is one of the most successful tools to model and manipulate them. The elastica energy is usually computed through a level-set or a phase field representation of the curve, in which the curvature term makes the energy nonlinear, non-convex and, in the level-set case, non-differentiable, so that its minimization is notoriously difficult. In this paper, we propose a new formulation of the elastica model based on a binary representation of curves. The key ingredient is a very simple formula for the curvature: if $\phi$ is the $\pm1$ binary function associated with a curve $\Gamma$, then along $\Gamma$ the curvature is given by $-\frac{1}{C_0\epsilon}\left(R_\epsilon *\phi\right)+O(\epsilon)$, where $R_\epsilon$ is a radial kernel supported in a ball of radius $\epsilon$ and $C_0$ is an explicit constant. No derivative of $\phi$ is involved and the convolution is evaluated by FFT. The resulting energy is a weighted total variation, so that formally the new formulation is a generalization of the well-known ROF model; a phase field type model is obtained from the same curvature formula. Combining FFT with the split Bregman iteration, which for the present problem coincides with an augmented Lagrangian method (ALM), we obtain efficient algorithms whose subproblems are either linear systems solved by conjugate gradient or explicit pointwise formulas. Numerical experiments on the inpainting of binary images are presented to demonstrate the effectiveness of the proposed algorithms.
310. 【2611.00107】Dynamic Merging Mutually-Distilled Multi-View Networks for RGB-Event-based Representation Learning
链接：https://arxiv.org/abs/2611.00107
作者：Futian Wang,Fan Zhang,Xiao Wang,Yuhe Ding,Shiao Wang,Jingxi Huang,Jin Tang
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：substantial research attention, recently attracted substantial, attracted substantial research, conventional frame-based cameras, algorithms combining conventional
备注：
点击查看摘要
Abstract:Multi-modal fusion algorithms combining conventional frame-based cameras and event cameras have recently attracted substantial research attention. Typically, existing approaches convert event streams into frames, voxels, or tensors, and then learn the required spatiotemporal information from these transformed event representations for fusion with conventional frame-camera data. Obviously, such paradigms only exploit the limited representational capacity of event data. Moreover, standard training pipelines fail to fully leverage diverse model parameters obtained throughout the learning process. In this paper, we propose a novel mutual distillation method leveraging multi-view teacher network weights to better integrate multiple event representations and achieve model-parameter level fusion. Specifically, we employ multiple encoders to extract different types of event representations and perform mutual knowledge distillation at both the feature-level and logit-level in this process. Afterwards, we perform a dynamic hierarchical model merge strategy on the model parameters from the first stage to yield a unified multi-modal RGB-Event representation model. Experimental results across multiple event-based datasets demonstrate that our proposed framework achieves significant performance improvements.
311. 【2611.00105】Detector-Integrated Multi-Cue Association for Occlusion-Aware UAV Multi-Object Tracking
链接：https://arxiv.org/abs/2611.00105
作者：Shu-Hung Chou,Trong-An Bui,Wei-Ming Chen,Hsin-Piao Lin
类目：Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)
关键词：unmanned aerial vehicle, visually similar, Multi-object tracking, imagery is challenging, identity switches
备注：
点击查看摘要
Abstract:Multi-object tracking (MOT) in unmanned aerial vehicle (UAV) imagery is challenging because vehicles are small, visually similar, and frequently occluded, which leads to identity switches (IDSW). Appearance-based trackers such as DeepSORT rely on a standalone re-identification (ReID) network, whose per-target inference limits runtime speed, while the appearance of small or occluded vehicles remains unreliable. This paper proposes a detector-integrated multi-cue tracking framework. Lightweight projection heads are attached to the neck of the YOLOv8n detector to extract target embeddings through ROIAlign, producing detections and embeddings in a single forward pass. A multi-cue association cost then combines motion, IoU, and appearance distances with weights determined through ablation, complemented by low-score rescue and appearance-memory protection. On the UAVDT benchmark, the proposed method achieves a MOTA of 28.33, a HOTA of 31.16, and an IDF1 of 38.18 at 82.59 FPS, the best among the compared trackers in all three metrics, and reduces IDSW by 58.4\% compared with DeepSORT.
312. 【2611.00102】Demystifying Prompt Stealing Attacks against Synthetic Video
链接：https://arxiv.org/abs/2611.00102
作者：Junyan Huang,Sanskar Agmain,Chen Gong,Yan Pang,FNU Suya
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR)
关键词：Creators publicly showcase, publicly showcase generated, enable unauthorized reproduction, Creators publicly, showcase generated content
备注： 19 pages, 12 figures
点击查看摘要
Abstract:Creators publicly showcase generated content to advertise and sell their work, but these examples may also enable unauthorized reproduction and customization. We study whether an adversary can derive reusable inputs from a single public video for faithful reconstruction and controlled editing, without access to the original prompt or generator. We adapt captioning and prompt optimization approaches to video prompt stealing attacks (PSAs) and find that prompt recovery alone provides limited reconstruction fidelity. Even the original prompt produces different spatial and temporal realizations when the initial noise changes. Using an independent generator enlarges the reconstruction gap, as reusing the original prompt and seed can still produce substantially different videos. We propose V-PSA, which uses a recovered caption and DDIM inversion to construct a reference trajectory under an independent generator. Null-Text Inversion then optimizes per-step unconditional embeddings to reduce deviations from this trajectory during reconstruction. The resulting inputs also guide generation when the caption is modified, supporting edits that change selected content while preserving the target's layout and motion. We construct a benchmark containing 12,000 video-prompt pairs from three victim generators and four prompt sources. V-PSA achieves video-to-video similarity around 0.9 between target and reconstructed videos, substantially improving over prompt-only baselines with similarity score of 0.6, and supports multiple controlled variations that preserve the target's structure. Additional experiments show that augmenting prior image PSAs with inversion-derived inputs also improves reconstruction. Our results show that evaluations restricted to prompt recovery can underestimate an attacker's ability to reconstruct public generative outputs.
313. 【2611.00099】A Novel Lightweight Multi-Scale Branching Encoder for Few-Shot Image Classification
链接：https://arxiv.org/abs/2611.00099
作者：Oriod Malo(AI Lab UMT),Alexandre Xavier Falcão(IC),Laurent Najman(KUSTAR, LIGM)
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：addresses classification scenarios, Prototypical Network encoder, small number, number of labeled, original Prototypical Network
备注： Preprint version. This manuscript has not yet been submitted to a journal, IEEE Access, In press, pp.1-1
点击查看摘要
Abstract:Few-Shot Learning (FSL) addresses classification scenarios in which only a small number of labeled examples are available for each class. This paper presents the Sum12 Multi-Scale branching encoder, a lightweight convolutional architecture designed to improve the embedding stage of Prototypical Networks without substantially increasing computational cost. The encoder uses seven parallel convolutional branches whose kernel-size combinations sum to 12, allowing local and broader spatial structures to be represented within a unified Multi-Scale feature space. The proposed architecture was evaluated on Omniglot, CIFAR- FS, FC100, and miniImageNet under controlled few-shot learning protocols and compared with the original Prototypical Network encoder and Inception-inspired branch variants. Additional ablation studies have investigated fusion strategies, dilated convolutions, branch compositions, and receptive field budget. Beyond few-shot learning, the encoder was also tested on the MedMNIST 2D benchmark to assess its behavior in conventional supervised medical image classification. Across these experiments, Sum12 generally improved the low-shot classification performance with respect to the basic ProtoNet encoder while preserving a compact model size. These properties suggest that the proposed encoder may be suitable for low-data visual recognition and resource-constrained intelligent imaging applications. However, complete end-to- end validation on the target embedded platform, including resolution of the observed implementation discrepancies, remains future work.
314. 【2611.00097】Pano2BIM: A Geometry-Constrained Vision-Language Agent for As-Built BIM Generation from a Floor Plan and a Single 360$^\circ$ Image
链接：https://arxiv.org/abs/2611.00097
作者：Juan Diego Castaño Molina,Borja García de Soto
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：models remains costly, twins require accurate, building information models, structured BIM information, require accurate
备注： 16 pages, 8 figures, 4 tables. Preprint
点击查看摘要
Abstract:Digital twins require accurate, up-to-date building information models (BIM) that reflect physical conditions, yet generating and maintaining as-built models remains costly and labor-intensive. Emerging image-based methods can capture visual appearance without inherently producing structured BIM information, while vision-language models (VLMs) struggle with reliable metric object placement. This paper presents Pano2BIM, a geometry-constrained VLM agent that generates approximate IFC4 models at Level of Development (LOD) 200 from a floor plan with known room dimensions and a single 360-degree photograph. The VLM identifies landmarks and objects, while deterministic tools estimate camera pose, compute metric positions through ray casting, and check spatial constraints. An optional second stage enriches the presentation model through render-and-compare feedback without modifying the primary furniture geometry. In a preliminary evaluation on one laboratory, the proposed Measure workflow achieved a mean furniture-footprint intersection over union (IoU) of 0.53, compared with 0.44 for a single-response baseline using identical modeling instructions, and matched an average of 4.0 versus 2.3 of seven fixed furniture elements across three runs. Centroid disagreements were similar for the four elements consistently identified by both approaches. The measurement stage averaged 3.8 minutes and USD 1.63 in API costs per run, while the complete demonstrated workflow required approximately 42 minutes and USD 11. These findings demonstrate the feasibility of rapid, low-cost as-built BIM generation, with potential applications in maintaining digital twins that reflect changing physical conditions.
315. 【2611.00092】OCRia-1 Technical Report
链接：https://arxiv.org/abs/2611.00092
作者：Aman Rangapur,Antonio Jimeno Yepes,Daniel Bustamante,Nutchapol Dendumrongsup,Sebastián G. Acosta,Pierre-Loïc Doulcet,Simon Suo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：retaining text formatting, preserving table structure, extracting chart data, document parsing, text formatting
备注：
点击查看摘要
Abstract:We introduce OCRia-1, a 4B vision-language model (VLM) for document parsing that excels at preserving table structure, extracting chart data and retaining text formatting. OCRia-1 handles content that has traditionally been challenging in document parsing: merged cells and spanning headers, tables with thousands of cells, chart data, and meaningful text formatting such as bold, italics, subscripts and superscripts, preserving details needed for business-critical document analysis. At the time of this report, it achieves the highest scores on tables, charts and text formatting among the systems evaluated, including a 35B model and Mistral OCR 4.1. Its mean ParseBench score over the four dimensions we evaluate is 0.87, against 0.75 for the next-best system. We emphasize data quality and reward design in training OCRia-1. Synthetic pages provide exact ground truth for long tables and rich formatting, while real pages are transcribed using a pipeline grounded in the PDF text layer. We attribute OCRia-1's performance primarily to careful data curation that prioritizes quality and diversity over quantity. Dimension-specific rewards evaluate table reconstruction, chart-data extraction and text-formatting fidelity. We train the model on the curated data using supervised fine-tuning (SFT), then refine it through reinforcement learning with verifiable rewards (RLVR). To our knowledge, OCRia-1 is the fastest published document-parsing VLM in its class, decoding at about 4,700 tokens per second with a single request on one B200 GPU, about nine times faster than the base model on stock vLLM. This is achieved through a block-diffusion speculator, quantization and custom kernels.
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2611.00092 [cs.CV]
(or
arXiv:2611.00092v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2611.00092
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
316. 【2611.00091】Rethinking Feature Perturbation for Single-Source Domain Generalization: A Representation-Space Analysis and Spectral Case Study
链接：https://arxiv.org/abs/2611.00091
作者：Badr-Eddine Benelmostafa,Sohaib Baroud
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：single-source domain generalization, domain generalization, single-source domain, typically evaluated, perturbation
备注：
点击查看摘要
Abstract:Feature perturbation is widely used in single-source domain generalization (SSDG), yet it is typically evaluated by task performance rather than by the representation changes it induces. We investigate whether perturbations can be compared through measurable descriptors of these changes. We introduce a four-dimensional representation-space description comprising feature displacement $D_F$, relational displacement $D_R$, a task-region ratio $\Theta_{\mathrm{Task}}$, and subspace deviation $\Theta_{\mathrm{Subspace}}$. We use these descriptors as an empirical analysis framework, not as a universal geometry, to characterize existing perturbation mechanisms. Across two object-detection settings involving style and weather shifts, we observe distinct geometric profiles and a concentration of relatively strong out-of-domain (OOD) configurations within a bounded region of the descriptor space. These findings do not establish a universal optimum but motivate investigating whether regions associated with stronger SSDG performance can be identified without target-domain access. As a case study, we introduce Dual-Invariant Spectral Perturbation (DISP), a non-learned Fourier-phase perturbation with explicit controls over phase magnitude $\rho$, channel coupling $\kappa$, and frequency support $\mathcal{M}$. We empirically examine how these controls affect the proposed descriptors. DISP achieves strong OOD performance in our experiments, illustrating how explicit perturbation controls can be analyzed through a representation-space description. We hope this viewpoint can contribute to more interpretable, controllable, and ultimately testable approaches to feature perturbation in SSDG.
317. 【2611.00084】AdaptAD: Foundation Model Adaptation with Missing Modality Robustness for Alzheimer's Disease Staging Across the Disease Continuum
链接：https://arxiv.org/abs/2611.00084
作者：Dawa Chyophel Lepcha,Sophie A. Martin,Pierrick Coupé,Shabbir Syed Abdul
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：single structural MRI, structural MRI remains, MRI remains difficult, mild cognitive impairment, networks overfit small
备注： 44 pages, 11 figures, 6 supplementary figures
点击查看摘要
Abstract:Staging Alzheimer's disease (AD) across its continuum, from cognitively normal (CN) through mild cognitive impairment (MCI) to dementia from a single structural MRI remains difficult because 3-D networks overfit small cohorts, and FreeSurfer morphometry is often unavailable. We present AdaptAD, which reads a registered T1-weighted scan as 16 anatomically placed 2.5-D slices through the medial temporal lobe and adapts a frozen ImageNet-pretrained ViT-B/16 with low-rank adaptation (LoRA), training 3.5 M of 89 M parameters. Morphometry enters as tokens when present, or as a learned [MISSING] token, and a missing-aware stacker fuses both experts. Under a pre-registered protocol, ten methods were compared for three-class CN/MCI/AD staging on identical 5-fold splits of 597 ADNI participants, 29% without FreeSurfer, with Holm-corrected paired bootstrap tests. The locked model was tested once on 993 OASIS-3 participants (988 scored by every method). On ADNI, AdaptAD achieved a three-class macro-AUC of 0.745 (95% CI 0.709 to 0.781), ranking first and significantly exceeding full fine-tuning, ShaSpec and a 3-D CNN. On OASIS-3 it reached 0.780 (0.748 to 0.814), and on the CDR-based label (0.804) it significantly outperformed every 3-D and image-tabular method. LoRA matched full fine-tuning with 25 times fewer trainable parameters, and removing morphometry changed external macro-AUC by less than 0.003. The disease score tracked MMSE and CDR-SB within diagnostic groups and stratified MCI-to-dementia progression (log-rank p 0.001), while saliency concentrated in medial temporal and periventricular regions. A parameter-efficient 2-D foundation model can therefore stage the full AD continuum from a routine T1 scan without morphometry, offering a scalable route to memory-clinic deployment.
318. 【2611.00081】HistGramBench: Measuring Structural Recovery When Multimodal Models Redraw Historical Mathematical Diagrams as TikZ
链接：https://arxiv.org/abs/2611.00081
作者：Minh Quang Tran,Carter He,Cameron Bloch,Zitai Huang,Thien Truong Vo,Trong Nguyen Tran,Isaac Chen
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Digital Libraries (cs.DL)
关键词：Euclidean proofs depend, Digital libraries preserve, remain scanned images, Digital libraries, Euclidean proofs
备注： 34 pages, 8 figures, 12 tables. Code: [this https URL](https://github.com/VietAlpha/histgrambench) ; data: [this https URL](https://huggingface.co/datasets/VietAlphaLabs/HistGramBench)
点击查看摘要
Abstract:Digital libraries preserve mathematical books printed from the sixteenth to the twentieth century, but the lettered diagrams in them, the figures on which Euclidean proofs depend, remain scanned images whose content cannot be searched. Redrawing such a diagram as a short drawing program would record which points lie on which lines and circles. But a printed plate offers no source code against which the redrawing could be checked. We introduce HistGramBench, a benchmark of 2,507 diagrams from 95 works printed between 1551 and 1933 in eight languages. For each diagram, two AI models from different providers agree on the facts a reader takes from the figure, such as which lines are parallel or where two lines meet, and every redrawing is checked against those facts on the model's own drawing. We evaluate six affordable AI models. The best recovers about three fifths of these facts, and most of what the models miss comes from programs that never produce a drawing. Parallels and tangencies are the hardest relations to reproduce. HistGramBench gives historians and librarians a way to measure when such tools can make old mathematical diagrams searchable.
319. 【2611.00080】Sequential Transfer Learning for Plant Disease Recognition Across Perennial Crop Domains Using MobileNetV2-CBAM
链接：https://arxiv.org/abs/2611.00080
作者：Ropkathaa Choudhury
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Block Attention Module, Convolutional Block Attention, target-domain heterogeneity increases, learned disease-recognition representation, learned disease-recognition
备注： 17 pages, 5 figures, 5 tables
点击查看摘要
Abstract:Purpose: This study investigates whether a learned disease-recognition representation can be progressively reused across distinct perennial crop domains and how its predictive behaviour changes as target-domain heterogeneity increases. Design/methodology/approach: A lightweight MobileNetV2 framework enhanced with the Convolutional Block Attention Module (CBAM) was evaluated through sequential transfer from Walnut to Cashew, Coffee and Mango, followed by validation on the heterogeneous ABCGMP six-crop benchmark. Each stage used the preceding model representation and was evaluated on an independent test set using complementary classification measures. Findings: Test accuracy increased from 75.76% for the Walnut baseline to 84.85% after CBAM integration, followed by 90.67% on Cashew, 100.00% on Coffee and 99.50% on Mango. The final ABCGMP evaluation achieved 88.44% accuracy, 81.49% Balanced Accuracy and 0.9949 ROC-AUC. The results show that substantial predictive capability was retained through successive crop transfers, while broader multi-crop heterogeneity introduced a measurable performance constraint. Originality: The study provides an empirical characterisation of sequential knowledge reuse across multiple perennial crop domains using a common lightweight attention-enhanced representation, extending evaluation beyond isolated source-to-target transfer.
Comments:
17 pages, 5 figures, 5 tables
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2611.00080 [cs.CV]
(or
arXiv:2611.00080v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2611.00080
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Ropkathaa Choudhury [view email] [v1]
Sun, 18 Oct 2026 15:16:22 UTC (776 KB)
320. 【2611.00079】Faithful Where You Look: Anchor-Based Evaluation Hides Text Fabrication in Image-Conditioned Video Generation
链接：https://arxiv.org/abs/2611.00079
作者：Yujia Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：output stays faithful, show real places, Image-conditioned video models, real places, Image-conditioned video
备注： 18 pages, 2 figures; includes supplementary material (S1-S11). Code and data: [this https URL](https://github.com/geoywang/refanchor-bench)
点击查看摘要
Abstract:Image-conditioned video models are used to show real places, so whether their output stays faithful to the place they were shown is a practical question. The text benchmarks we found that check fidelity against a reference do so at an anchor - an annotated region, typically the sign the task is about. We show that this choice hides most of the failure. We conditioned four models from three vendors on 48 street-level references of Tokyo storefronts and measured text fidelity at the annotated sign and in the periphery, the other text the reference covers. At the anchor, all four models are close to a no-model control (anchor text fidelity 0.90-0.94 against 0.996) and are not reliably separated from one another. In the periphery, 36-54% of generated text regions have no counterpart in the reference, against 1.6% for the control, although every prompt forbade new readable text. Two blinded raters agree on which regions are fabricated (kappa = 0.83-0.96), the result held in preregistered rounds on two vendors whose videos the measure had never seen (42% and 56%), and VBench-I2V's reference-based consistency scores show no evidence of tracking it in our sample. Most fabricated text is legible-looking text where the reference shows none or cannot be read - a form that string-matching metrics discard, which is why our own first measure missed it. A preregistered Latin-script replication in London missed its bar in a first round and met it in an independent second round. We release code, annotations, per-video scores, ratings and every preregistration. Code and data: this https URL
321. 【2611.00078】From Zero to OCR: A Data-Centric Framework for Unsupported Low-Resource Scripts
链接：https://arxiv.org/abs/2611.00078
作者：Faizan Iqbal,Haq Nawaz Malik,Hafsah Pervaiz
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：script-specific visual structure, preserve script-specific visual, Optical character recognition, Optical character, remains inaccessible
备注： 9 pages, 9 figures, 4 tables. Model: [this https URL](https://huggingface.co/Faizaniqbal/KoshurOCR-CRNN-Baseline)
点击查看摘要
Abstract:Optical character recognition (OCR) remains inaccessible to many low-resource scripts because annotated document images are unavailable and synthetic training data can fail to preserve script-specific visual structure. We present a data-centric framework that builds end-to-end OCR for such scripts from only an unannotated text corpus and digital fonts, without manually annotating a single training image. A synthetic data engine renders word, line and page images with correct complex-script shaping and automatically derived labels; a YOLOv8 word detector and a convolutional recurrent recognizer trained with connectionist temporal classification learn from these images; and a stage-gate evaluation protocol isolates recognition error before detection is introduced. We demonstrate the framework on Kashmiri, a Perso-Arabic Nastaliq script with approximately 6.8 million speakers that none of six widely used OCR engines supports. Three line-level recognizers, including one transferred from Arabic, stalled between 41% and 79% character error rate (CER), motivating a word-level formulation; subsequent improvements came primarily from rendering fidelity, diacritic-preserving crop margins and tuned non-maximum suppression. The resulting system achieves 0.39% CER on held-out words, 10.0% on synthetic pages and 13.5% on browser-rendered digital pages, and establishes reference results of 18.45% on typeset book pages and 49.8% on degraded historical documents. We publicly release the trained models, the inference code and a synthetic dataset of 285,864 Kashmiri text-line images, and we describe a step-by-step procedure for building OCR for other unsupported scripts.
322. 【2611.00077】AegisBench: Auditing Aerial Search-and-Rescue Person Detection Under the Conditions It Is Deployed In
链接：https://arxiv.org/abs/2611.00077
作者：Amogh Vinaykumar(Flower Mound High School),Prem Kamasani(Flower Mound High School)
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：find missing people, Drone-based person detection, adopted by emergency-management, emergency-management agencies, agencies to find
备注： 19 pages, 5 figures, 12 tables. Accepted at the Trustworthy AI for Good (AI4GOOD) workshop at NeurIPS 2026. Code and results: [this https URL](https://github.com/Altis-2026/SentinelBench)
点击查看摘要
Abstract:Drone-based person detection is being adopted by emergency-management agencies to find missing people faster than ground teams can. The benchmarks behind that adoption were collected in calm, clear daylight, while the missions that trigger deployment happen in floods, wildfires, storms, and at night. AegisBench measures that gap. It applies nine physically motivated corruptions from four disaster families, each at three severities monotone in a declared image statistic or physical quantity, to two aerial search-and-rescue datasets, HERIDAL and SARD. Three architecturally distinct detectors (Faster R-CNN, YOLOv11, RT-DETR) are scored across 168 conditions by one shared evaluator, at confidence thresholds frozen on clean validation data as a fielded system would run. Robustness is highly uneven. Low light is the extreme case: a 4.5-stop exposure loss drives recall to exactly zero for all three detectors on both datasets, a result that holds under threshold-free mAP and across three training seeds, and is mirrored on 300 real night drone images, where 2 of 759 people are found. Surviving detections largely stay on target, so the failure is silent: an empty frame looks the same as one whose occupants the system cannot see. Fine-tuning on milder low-light levels recovers 0.06 to 0.19 recall at the held-out severity, at an architecture-dependent cost on other conditions, and does not transfer to real night imagery. Spatial corruptions rank differently on the two datasets, which we cannot attribute to altitude alone because their parameters scale with frame size rather than person size. We release the corruption engine, evaluation pipeline, and all per-condition results as an audit instrument for anyone evaluating these systems.
323. 【2611.00076】CRAFT: Corrective and Robust Multi-Agent Framework for Text-to-Parametric CAD
链接：https://arxiv.org/abs/2611.00076
作者：Mohammed Musthafa Rafi,Anushrut Jignasu,Mahdi Saraeian,Chinmay Hegde,Aditya Balu,Adarsh Krishnamurthy
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Graphics (cs.GR)
关键词：make mechanical CAD, existing approaches face, CAD more accessible, mechanical CAD, output fidelity
备注： Accepted at the 2026 IEEE International Conference on LLM-Aided Design (ICLAD). 11 pages, 5 figures, 10 tables. Code: [this https URL](https://github.com/idealab-isu/CRAFT)
点击查看摘要
Abstract:Text-to-CAD generation has the potential to make mechanical CAD more accessible, but existing approaches face a trade-off between data dependence and output fidelity. Supervised methods rely on large paired text-model datasets, while zero-shot prompting strategies are often brittle and tend to lose the parametric structure needed for downstream editing and customization. We present CRAFT, a corrective and robust multi-agent framework that produces parametric OpenSCAD programs from natural language without task-specific training. At its core is a JSON intermediate representation that carries symbolic parametric expressions throughout the generation process, so the resulting models remain editable and retain their parametric structure. CRAFT combines semantic understanding, parametric planning, compilation, rendering, self-correction, and component-level verification within a layered recovery process, using multi-view visual feedback to detect and repair geometric errors. Across NopSCADlib, ABC, and Slice-100K, CRAFT is competitive with direct zero-shot baselines in perceptual and geometric quality while exposing substantially more editable parametric structure.
324. 【2611.00074】When Morphs Look Better: Face Image Quality as a Training-Free Signal for Morphing Attack Detection
链接：https://arxiv.org/abs/2611.00074
作者：Hao Peng,Fu Bo,Mahmoud Elshirbeny,Guray Ozgur
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：automated face recognition, Face image quality, Face image, image quality assessment, automated face
备注：
点击查看摘要
Abstract:Face image quality assessment (FIQA) estimates the utility of a face image for automated face recognition and has been proposed as a morphing attack detection (MAD) signal that requires no morph-specific training. We evaluate 17 FIQA methods from all current FIQA categories on 20 morphing attack sets from two datasets, FRLL and FEI, including five diffusion-based attack sets. Each quality score is used directly as a MAD decision score. Unlike prior work, which inverted a quality measure when this lowered its error, we fix the score direction of each method in advance from its definition, so that cases in which morphs receive higher quality than bona fide samples remain visible. On FRLL, DifFIQA(R) achieves a mean D-EER of 11.42%, and together with CLIB-FIQA and eDifFIQA(L) clearly outperforms all other FIQA methods. A strong separation of bona fide and morph scores does not imply good detection performance: on the diffusion-based attacks, up to 11 of 17 methods assign higher quality to morphs than to bona fide samples, and the largest reversed separation in the study coincides with the worst detection result of the study. Performance also depends strongly on the attack: GraFIQs(L), the best detector of DCMorph and Arc2Morph on FRLL, performs poorly on the landmark-based and GAN-based attacks. On FEI, the lowest mean D-EER is 39.75%, and a threshold set on the bona fide data of one dataset does not transfer to the other.
325. 【2611.00073】When frequency domain classification is superior to spatial
链接：https://arxiv.org/abs/2611.00073
作者：Yanir Harel,Shalom Rosner,Ronit D. Gross,Tal Halevi,Shilo Glam,Ella Koresh,Ido Kanter
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Modern image classification, frequency domain, Modern image, models largely rely, spatial domain
备注：
点击查看摘要
Abstract:Modern image classification models largely rely on local characteristics and feature extraction for their predictions. This focused approach works well in the spatial domain, but reportedly falls short in the frequency domain, even though both representations contain the same information. This study demonstrates that the significant reduction in accuracy in the frequency domain stems from the lack of local features. Locally swapping data in the frequency domain significantly decreases its inverse spatial domain accuracy, even below that of the frequency domain; however, the frequency domain accuracy remains relatively constant. Moreover, the use of datasets containing global features in the spatial domain yields higher accuracy in the frequency domain. Using these results, a hybrid model is constructed, combining one model trained only in the frequency domain and another trained only in the spatial domain to achieve higher classification accuracy. The proposed visual geometry group (VGG) and vision transformer (ViT) architectures are trained on the ImageNet-100, WikiArt, DTD, FMD, PSVRT, and KTH-TIPS2-b datasets and evaluated.
326. 【2611.00072】CRaFT-XDet: Causal and Robust Fusion Transformer for Dual-Energy X-ray Prohibited Item Detection
链接：https://arxiv.org/abs/2611.00072
作者：Moinul Hossain,Munshaibur Rahman Mahin,Taskin Khaleque,Mohammad Sakib Mahmood,M. F. Mridha,Md. Jakir Hossen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Automated prohibited item, severe object overlap, spurious correlations induced, X-ray security imagery, Automated prohibited
备注：
点击查看摘要
Abstract:Automated prohibited item detection in X-ray security imagery is fundamentally constrained by severe object overlap, scanner-dependent domain shifts, and spurious correlations induced by cluttered baggage composition. Existing detectors largely rely on appearance-driven supervision, limiting their robustness and cross-scanner generalisation. We introduce CRaFT-XDet, a causality-grounded and physics- motivated detection framework that reformulates X-ray threat detection as invariant representation learning under attenuation-driven modality variation. Our approach is grounded in a Scanner-Invariant Causal Detection formalisation (Theorem 1), which establishes that minimising the proposed Causal Invariance Regularisation (CIR) objective across partitioned scanner environments approximates the interventional distribution P (Y | do(Xobj)) under standard identifiability assumptions, providing a principled causal formulation for dual-energy X-ray detection. CRaFT-XDet integrates: (i) causal feature disentanglement to suppress context-induced shortcuts; (ii) physics-motivated regularisation to enforce material-consistent embeddings; and (iii) transformer-based cross-energy interaction modelling for structured reasoning in cluttered scenes. With 29.2 M parameters, 89.5 GFLOPs, and 345 FPS (1.7 ms inference), CRaFT-XDet is real-time deployable. Trained on SIXray with five-fold cross-validation, the framework achieves 0.9389 mAP@0.5 and 0.8021 mAP@0.5:0.95. Without domain adaptation, CRaFT-XDet maintains strong cross- dataset performance on OPIXray and HiXray, indicating robust generalization across heterogeneous scanner distributions. In category-agnostic binary threat detection, the model attains 93.92% recall and 0.9031 mean IoU, highlighting reliability in safety-critical screening where missed detections are costly.
327. 【2611.00071】How Reliable Are Object Detection Models Beyond Clear Weather? A Deployment-Oriented Robustness Study for Autonomous Driving
链接：https://arxiv.org/abs/2611.00071
作者：Munshaibur Rahman Mahin,Isha Das,Most. Sonia Islam,Mohammad Sakib Mahmood,M. F. Mridha,Md. Jakir Hossen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：maintain reliable object, Autonomous driving perception, Autonomous driving, reliable object detection, maintain reliable
备注：
点击查看摘要
Abstract:Autonomous driving perception systems must maintain reliable object detection under diverse environmental conditions, not only in clear daytime scenes. However, the cross-weather robustness of modern detectors remains insufficiently characterised under source-only evaluation. This study evaluates representative object detection architectures trained exclusively on clear daytime driving scenes and tested without adaptation under unseen fog, rain, snow, and night conditions. The evaluation covers lightweight and medium-scale one-stage, two-stage, and transformer-based detectors within a unified protocol. Robustness is assessed using performance Drop (%), a Weather Robustness Index (WRI), and class-level sensitivity analysis for critical road participants, including cars, buses, trucks, and persons. Prediction confidence reliability under environmental domain shift is measured using Expected Calibration Error (ECE). Results reveal consistent performance degradation in adverse conditions, reaching 62.90% at night. Buses show the highest sensitivity to environmental variability, while cars remain comparatively stable across weather transitions. Comparisons indicate that YOLO-based detectors exhibit the lowest calibration mismatch, reflecting stronger agreement between predicted confidence and empirical detection correctness. In contrast, DETR achieves the lowest robustness score, with a WRI of 0.6859, indicating greater vulnerability to cross-weather domain shift. These findings offer deployment-oriented insights into detector robustness and confidence reliability for safety-critical intelligent vehicle perception systems.
328. 【2611.00069】SAMP: Self-Adaptive Margin Prioritization For Robust Diffusion Watermarking
链接：https://arxiv.org/abs/2611.00069
作者：Yuhao Xue,Jiuan Zhou,Yu Cheng,Zhaoxia Yin
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)
关键词：made high-fidelity visual, high-fidelity visual generation, visual generation widely, producing convincing visual, convincing visual forgeries
备注：
点击查看摘要
Abstract:Diffusion models have made high-fidelity visual generation widely accessible, while also lowering the barrier to producing convincing visual forgeries and complicating content provenance. Existing watermarking methods typically use a fixed embedding strength throughout denoising or treat all watermark dimensions equally. As a result, they may introduce unnecessary distortion when some watermark dimensions are already reliable, while failing to sufficiently reinforce those that are more vulnerable to subsequent perturbations. Therefore, robust watermarking requires adapting both the embedding strength during denoising and the optimization priority across watermark dimensions. To address this problem, we present SAMP, a self-adaptive framework consisting of global margin regulation and vulnerability-sensitive allocation. Global margin regulation adjusts the embedding strength according to the separation between the target codeword and competing codewords, together with the estimated effects of common attacks. Vulnerability-sensitive allocation identifies watermark dimensions that are more easily weakened by local perturbations and gives them higher optimization priority. Experimental results demonstrate that SAMP achieves an average information recovery accuracy of 0.993. Compared with state-of-the-art methods, SAMP improves PSNR by 16.8% and reduces LPIPS by 47.1%. These results validate the effectiveness of SAMP for reliable and high-quality diffusion watermarking.
329. 【2611.00067】MedICL: Modality-Anatomy-Aware Visual In-Context Learning for Medical Visual Question Answering
链接：https://arxiv.org/abs/2611.00067
作者：Ji-jun Park,Soo-joon Choi,Seungmin Han,Haeun Kwon,Jiwon Jeong,Taeyang Yoon
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：visual in-context learning, wrong answering style, Training-free adaptation, medical vision-language models, injects modality
备注：
点击查看摘要
Abstract:Training-free adaptation of medical vision-language models (LVLMs) is a deployment requirement, yet visual in-context learning (ICL) injects modality- and style-mismatched demonstrations into medical contexts, teaching a frozen model the wrong answering style. We present MedICL, which curates demonstrations instead of retraining the model. MADS selects modality-anatomy aligned demonstrations that cover complementary interpretation dimensions; W2C curates them with weak retrieval signals and a strong verification vote that checks demonstrations rather than the model's own outputs; ECC answers with W anchored demonstration sets, aggregates by abnormality-aware signatures, and re-answers once on conflict. On VQA-RAD, SLAKE, and PathVQA under the LLaVA-Med zero-shot protocol, MedICL improves the strongest zero-shot baseline by +11 - +14 points on open-ended and +7 - +14 on closed questions, recovers 71% of fine-tuned open-ended performance on VQA-RAD at zero training cost, and stays robust to shifted or corrupted demonstration banks.
330. 【2611.00066】Comparing Monocular and Multi-View 3D Pedestrian Reconstruction Strategies for Urban Intersection Sensing
链接：https://arxiv.org/abs/2611.00066
作者：Kauan Mariani,Matheus Carvalho,Joel Perca,João Rulff,Jorge Poco
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：mobility planning, traffic-safety assessment, smart-city sensing, move and interact, interact at urban
备注： 6 pages, 4 figures
点击查看摘要
Abstract:Understanding how pedestrians move and interact at urban intersections is central to traffic-safety assessment, mobility planning, and smart-city sensing. Such analyses rely on physically grounded descriptions of motion: 3D body pose, metric trajectories, and pose-derived descriptors such as stature and walking speed. Recovering these from fixed roadside cameras is difficult: viewpoints are oblique and long-range, occlusions are frequent, and neither ground-truth 3D pose nor cross-camera identity labels are typically available. We compare two strategies for deriving pedestrian motion descriptors from a multi-camera intersection dataset: a monocular learned pipeline that combines text-prompted segmentation, tracking, and learned 3D body estimation, and a calibrated multi-view geometric pipeline that combines 2D pose estimation, tracking, cross-camera association, and triangulation. Because 3D ground truth is unavailable, we evaluate both with reference-free criteria relevant to intersection analysis: pedestrian coverage, anthropometric plausibility, walking-speed distributions, computational cost, and failure modes. The two strategies exhibit complementary trade-offs. The learned pipeline is simpler to deploy and covers more pedestrians, but suffers from scale ambiguity and systematic height compression; the geometric pipeline yields metric reconstructions more efficiently, but requires calibration, discards pedestrians seen by only one camera, and can produce severe outliers in dense crowds. We distill these findings into practical guidance for selecting a reconstruction strategy and configuring camera infrastructure according to the target analysis task.
331. 【2611.00065】BreastXAgent: A lightweight agentic explainability framework for breast density classification
链接：https://arxiv.org/abs/2611.00065
作者：Muhammad Turab,Raja Vavekanand,Knooz Fatima
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Deep learning models, breast density classification, density classification typically, classification typically return, Deep learning
备注： 8 pages, 2 figures. Published in Proceedings of SPIE, Vol. 14346, Third International Conference on Frontiers of Applied Optics and Computer Engineering (AOCE 2026)
点击查看摘要
Abstract:Deep learning models for breast density classification typically return only a label and confidence score. This paper presents BreastXAgent, a lightweight agentic framework that combines a pretrained classifier, Grad-CAM visual explanation, LangGraph-based routing, LLM report generation, and rule-based guardrails to produce controlled, faithful, non-diagnostic reports. On 160 mammography images, uncontrolled LLM reporting produced 75% Grad-CAM overclaims and 62.5% clinical overclaims. Strict prompting and LangGraph routing improved safety but did not eliminate violations. The full BreastXAgent achieved 100% safety pass rate, zero overclaims, and highest utility score. Results demonstrate that agentic guardrails enable safe, structured explanation generation without modifying the underlying classifier.
332. 【2611.00064】OpenMidnight: Closing the Performance Gap Between Open and Proprietary Pathology Foundation Models
链接：https://arxiv.org/abs/2611.00064
作者：Ratna Sagari Grandhi,Anis Chihoub,Ryan Kim,Daniel Z. Kaplan,Chao Feng,Anish Dulal,Leema Krishna Murali,Rohitkumar Datchanamourty,Nevasini Sasikumar,Debojyoti Das,Ahmed Hassayoune,Rhizo Nymph,Anas Zafar,Connor Lane,Benjamin Warner,Hassan Muhammad,Tanishq Mathew Abraham,Paul S. Scotti
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：offer transferable representations, hinder independent validation, Cancer Genome Atlas, substantial compute requirements, pipelines hinder independent
备注：
点击查看摘要
Abstract:Pathology foundation models offer transferable representations for a range of downstream tasks in computational pathology, but reliance on proprietary data, substantial compute requirements, and limited availability of training code and preprocessing pipelines hinder independent validation and further methodological development. We present OpenMidnight 1.1, an open-source replication and refinement of Midnight trained on approximately 12,000 publicly available whole-slide images from The Cancer Genome Atlas. Using an encoder initialized with pretrained DINOv2 weights, OpenMidnight 1.1 uses approximately 320 H100 GPU-hours for pathology pretraining, a 34-fold reduction relative to the compute reported for Midnight. Across 16 classification and four segmentation datasets in THUNDER, OpenMidnight 1.1 achieves the highest mean segmentation Dice (69.7) and ranks fourth among 14 models, ahead of Midnight, with performance that matches or exceeds models trained on substantially larger datasets in several tasks. Our ablation studies additionally examine how initialization, data volume, model size, and tissue composition affect downstream performance, providing empirical evidence to inform the development of future training recipes. Our release of the training code, preprocessing pipeline, and model weights lowers barriers to reproducible research and further development of competitive pathology foundation models.
333. 【2611.00063】Where Generated Floor Plans Stop: Encoding Practice Acceptance Rules to Evaluate Machine Learning Floor Plan Generators
链接：https://arxiv.org/abs/2611.00063
作者：Yiliang Shao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Machine learning floor, Machine learning, room adjacencies match, learning floor plan, design decisions
备注： 31 pages, 8 figures. Checker released as floorcheck v0.1.1, [this https URL](https://doi.org/10.5281/zenodo.23129970)
点击查看摘要
Abstract:Machine learning floor plan generators are proposed as aids to design decisions, yet they are judged mainly by how closely a generated plan's room adjacencies match the request, a measure without architectural knowledge. We encode an architecture practice's floor plan acceptance rules, taken from its production layout software, as six checks applied in a fixed order, report each plan at the first check it fails, and calibrate the two room-shape limits, which no building code states, so that each alone rejects 5 per cent of built apartments. A transfer specification records which checks public data can carry. Applied to four published generators and two built corpora, RPLAN and Modified Swiss Dwellings (MSD), the checks stop the generators at different points. A room proportion check alone refuses 33.7 per cent of the House-GAN++ plans the checker can read and build, against 5.0 per cent of RPLAN, a gap that survives three measurement controls. At the 5 per cent rate, MSD apartments pass all six checks 5.5 to 23.5 points more often than House-GAN++, depending on the plans counted. The two generators that score best on the adjacency measure, Compatibility, pass least, because of how they represent plans, and within the two that pass most it barely predicts which plans pass. The checks thus expose what the standard measure misses; the checker is released. Passing is not shown to mean acceptance in practice.
334. 【2611.00062】CarDiff: Anatomically Aware Dental Caries Synthesis using Diffusion
链接：https://arxiv.org/abs/2611.00062
作者：Sanyam Jain,Bruna Neves de Freitas,Alexandros Iosifidis,Ruben Pauwels
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Synthetic medical image, Synthetic medical, address limited annotated, limited annotated data, under-represented caries classes
备注：
点击查看摘要
Abstract:Synthetic medical image generation can help address limited annotated data in dental imaging, particularly for under-represented caries classes. In this work, we present CarDiff, a semi-supervised framework for dental caries synthesis in panoramic radiographs. The method combines paired mask-image learning with self-supervised generation from augmented masks, while incorporating anatomy-aware conditioning between lesion regions and surrounding structures. Semantic consistency is enforced through segmentation-guided supervision and adversarial anatomical alignment. Experiments on the MLUA-DC1000 dataset show that CarDiff achieves improved synthesis quality compared with existing semantic synthesis baselines, obtaining the best Fréchet Inception Distance (FID) (90.76) and Learned Perceptual Image Patch Similarity (LPIPS) (0.48) scores among evaluated methods. We further assess the generated radiographs for downstream segmentation augmentation across seven architectures. Using a 5x augmented training set improves average Dice score by up to 6.5%, with larger gains observed for medium and combined lesion classes. These results suggest that anatomically consistent diffusion synthesis may be useful for dental radiograph augmentation under limited supervision. The code is available at this https URL.
335. 【2611.00061】DDEL: Closed-Loop Mutual Enhancement of Dataset Distillation and Ensemble Learning
链接：https://arxiv.org/abs/2611.00061
作者：Weiqi Zhang,Yongquan Yang
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Dataset distillation, reduces a training, training set, distilled set remains, set remains fixed
备注： 11 pages, 1 figure, 3 tables
点击查看摘要
Abstract:Dataset distillation (DD) reduces a training set to a small set of examples, while ensemble learning (EL) combines predictions from several models. When applied in sequence, the distilled set remains fixed as the ensemble learns. We introduce DDEL, a framework that feeds ensemble behavior back into distillation. Each round trains the ensemble, measures loss and prediction disagreement on the source data, and uses these signals to guide the next data update. We implement this loop with distribution matching and a homogeneous three-member ensemble. Preliminary experiments cover skin lesion classification (ISIC 2019), treatment-response prediction (I-SPY1), and binary two-year prognosis classification (NSCLC-Radiomics). With the same images-per-class budget as the open-loop comparison, DDEL reaches balanced accuracy 0.3471 on ISIC and mean ROC-AUC 0.5120 and 0.5597 on I-SPY1 and NSCLC. The I-SPY1 difference is small, and the ISIC trajectory shows that more rounds do not consistently improve performance. These results offer initial evidence for studying DD-EL feedback, with its computational cost and robustness still requiring controlled evaluation.
Comments:
11 pages, 1 figure, 3 tables
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
Cite as:
arXiv:2611.00061 [cs.CV]
(or
arXiv:2611.00061v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2611.00061
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
336. 【2611.00059】Not All Minorities Are Equal: Fairness Outcomes in Private Image Generation
链接：https://arxiv.org/abs/2611.00059
作者：Cohen Archbold,Usman Hassan,Sen-ching Samson Cheung
类目：Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY)
关键词：artificial intelligence systems, remain poorly understood, generative models, intelligence systems, poorly understood
备注： 5 pages, 3 figures, Under review for ICASSP 2027
点击查看摘要
Abstract:Differential privacy (DP) provides formal guarantees for protecting individuals in artificial intelligence systems, but its consequences for fairness in generative models remain poorly understood. We investigate how privacy-preserving training affects the representation of demographic groups and visual attributes in generative models of human faces. Across two facial image datasets and multiple privacy levels, we find that stronger privacy can disproportionately degrade the quality and utility of some underrepresented groups, suggesting that privacy can amplify existing disparities. However, representation alone does not explain these effects: several well-represented attributes also experience substantial degradation, while some underrepresented attributes remain comparatively robust. These findings show that the impact of privacy-preserving learning cannot be explained solely by data representation and may depend on the characteristics and interactions of the information being learned. Our results highlight the need to consider both privacy and fairness when evaluating generative models.
337. 【2611.00058】CausalPrune: Counterfactual Causal Token Pruning for Efficient Large Vision-Language Models
链接：https://arxiv.org/abs/2611.00058
作者：Pengcheng Zheng,Chaoning Zhang,Ya Wen,Jiaxin Huang,Jiaquan Zhang,Caiyan Qin,Kuien Liu,Sheng Zheng,Pietro Liò,Yang Yang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Large Vision-Language Models, achieved remarkable progress, Large Vision-Language, excessive visual tokens, substantial computation introduced
备注： 33 pages
点击查看摘要
Abstract:Large Vision-Language Models (LVLMs) have achieved remarkable progress in multimodal understanding, but their practical deployment is still limited by the substantial computation introduced by excessive visual tokens. Visual token pruning offers an effective solution by removing redundant visual tokens during inference. However, existing methods typically estimate token importance from correlational statistics, which cannot distinguish tokens that causally determine the model output from those spuriously associated with it. To address this issue, we propose \textbf{CausalPrune}, a counterfactual causal token pruning framework for efficient LVLMs. We formulate LVLM inference as a Structural Causal Model and introduce the Causal Token Importance Score (CTIS), which estimates the Average Treatment Effect of intervening on each visual token. To make causal estimation practical, we derive an efficient first-order approximation of CTIS and incorporate backdoor adjustment to mitigate latent cross-modal confounding. Within this causal formulation, layer-wise causal mediation decomposes token importance into direct and indirect effects through intermediate hidden states, enabling progressive pruning across transformer layers in a principled manner. Extensive experiments on various LVLM architectures, such as LLaVA-1.5 and Qwen2.5-VL, demonstrate that CausalPrune maintains comparable or even superior multimodal performance while achieving substantial reductions in FLOPs and prefill latency, consistently outperforming existing pruning methods.
338. 【2611.00056】SemaNorm: Stain Normalization via Semantic and Morphology Alignment for Robust Cross-Hospital Computational Pathology
链接：https://arxiv.org/abs/2611.00056
作者：Subhankar Chattoraj,Sawon Pratiher,Arijit Ghosh,Prashant Khare,Writankar Kundu,Karan Vishwakarma,Preha Handa,Kirti Rashmi,Hubert Konik
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：methods largely optimize, largely optimize color, Stain variability remains, optimize color consistency, explicitly preserving morphology
备注： Accepted at IEEE International Conference on Bioinformatics and Biomedicine (BIBM) 2026
点击查看摘要
Abstract:Stain variability remains a major source of domain shift in computational pathology, yet existing normalization methods largely optimize color consistency without explicitly preserving morphology or diagnostic semantics. We propose SemaNorm, a self-supervised stain canonicalization stain normalizer to recover clean patches from strongly perturbed inputs, avoiding paired transfer, adversarial instability, and identity collapse. It further combines a frozen pathology foundation-model consistency loss with a differentiable nuclei-structure loss to preserve semantic and cellular organization. SemaNorm is evaluated across Camelyon17-WILDS and NCT-CRC-HE-100K using cross-hospital tumor classification, cell-graph morphology metrics, and semantic stability measured with an independent held-out foundation encoder. SemaNorm improves out-of-distribution accuracy by 5.9% over the strongest normalization baseline and by 13.5% over no normalization, while achieving the best morphology preservation. Independent foundation-model and cell-graph analyses further confirm improved semantic and structural stability. These results establish morphology- and semantics-aware optimization as a principled alternative to color-only stain normalization.
339. 【2611.00055】From Clips to Streams: A Unified Framework for Streaming Sign Language Translation
链接：https://arxiv.org/abs/2611.00055
作者：Hoang Quan Dang,Xin Shen,Yanbin Liu,Xin Yu,Ling Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Sign Language Translation, define Streaming SLT, Sign Language, Streaming Sign Language, Sign Language Segmentation
备注： 27 pages, 7 figures, the paper has been accepted to NeurIPS 2026
点击查看摘要
Abstract:Sign Language Translation (SLT) research has typically focused on pre-segmented clips, a constraint that disconnects models from the continuous reality of real-world communication. To bridge the gap from clips to streams, we formally define Streaming SLT, a realistic task demanding the joint discovery and translation of linguistic events from continuous, untrimmed video inputs. To address this challenge, we propose StreamSLST, the first end-to-end framework for Streaming Sign Language Segmentation and Translation via Deformable Transformer architecture. Unlike cascaded approaches that suffer from error propagation, StreamSLST employs a parallel decoding strategy to jointly optimize temporal segmentation and translation in a single pass. To enable scalable training on long-form videos, we incorporate a Sentence-aware Sliding Window Sampler that crops continuous streams into trainable units. We further design a Tri-modal Visual-Language Pretraining stage that aligns pose dynamics with textual semantics before joint optimization. To support comprehensive evaluation, we conduct experiments on two real-world streaming datasets, BOBSL and How2Sign, together with two newly constructed synthetic streaming benchmarks, Streaming-Phoenix-2014T and Streaming-CSL-Daily. The results demonstrate that StreamSLST consistently outperforms a matched cascaded segmentation-then-translation pipeline. Interestingly, our analysis reveals that joint optimization learns wider, translation-effective temporal support that simple expansion or rescaling of the annotated spans fails to reproduce. Our work establishes the first robust benchmark for continuous sign language understanding and paves the way for accessible real-world communication interfaces. The source code and data are available at this https URL.
340. 【2611.00054】Auditing GeoFM Evaluation for Field-Extent Segmentation: Label Proxies, Baselines, and When Frozen Features Match Fine-tuning
链接：https://arxiv.org/abs/2611.00054
作者：Santosh Pant
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Geospatial foundation-model, cropland land-cover proxies, benchmarks for agricultural, AUROC, land-cover proxies
备注： 20 pages, 3 figures. Published in Transactions on Machine Learning Research (08/2026). OpenReview: [this https URL](https://openreview.net/forum?id=qRXVTe1yYp)
点击查看摘要
Abstract:Geospatial foundation-model (GeoFM) benchmarks for agricultural field-extent segmentation often rely on cropland land-cover proxies and compare against per-pixel spectral baselines. We measure how these choices affect conclusions using identical single-date Sentinel-2 pixels from six countries. Replacing polygon-derived field labels with ESA WorldCover cropland raises random-forest AUROC from 0.55-0.82 to 0.79-0.96, showing that the proxy creates a more spectrally separable task. On the actual field-extent labels, a from-scratch U-Net reaches 0.89-0.98 AUROC and has higher point AUROC than a Prithvi frozen linear probe in five of six regions. We then compare a frozen backbone and full fine-tuning using the same decoder for Prithvi and TerraMind, with ten matched seeds. At $\varepsilon=0.02$ AUROC, 9 of 12 region$\times$model cells are TOST-equivalent. Kenya is the common failure case: positives cover roughly 0.1% of pixels, and full fine-tuning performs better for both models. Cross-region results are less favorable to frozen models. On AUROC and average precision (AP), the U-Net leads the full 30-transfer matrix, while an exploratory analysis excluding Kenya finds that both frozen decoders outperform their fine-tuned counterparts; no AUROC difference is detected between frozen TerraMind and the U-Net in that subset. For Prithvi, a frozen decoder trains about $110\times$ fewer parameters than full fine-tuning. These results argue for auditing labels and baselines before interpreting GeoFM rankings, and for testing a frozen decoder before assuming that full fine-tuning will help. Our conclusions are limited to single-date, per-pixel field-extent segmentation, not parcel-boundary or instance delineation.
341. 【2611.00053】SIMIT: Self-Improving Vision-Language Models via Imagination at Test-Time
链接：https://arxiv.org/abs/2611.00053
作者：Mehmet Onurcan Kaya,Desmond Elliott,Dim P. Papadopoulos
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：vision-language model creates, query-specific training data, unlabeled test query, query-specific training, model
备注： Project Page: [this https URL](https://monurcan.github.io/simit)
点击查看摘要
Abstract:We introduce SIMIT, a test-time self-improvement framework in which a vision-language model creates its own query-specific training data before answering an unlabeled test query. Our goal is to improve performance on a given target test set without annotations or external models. To pursue this goal, some test-time methods improve answers through longer reasoning or repeated sampling but leave the model unchanged. Others update the model using rewards based on majority agreement among multiple candidate answers or the model's own judgments of correctness, but such rewards can reinforce existing mistakes. SIMIT instead imagines similar problems whose solutions it controls: a model need not correctly solve the target query to construct useful practice examples. It synthesizes diverse (question, answer, image) triplets by specifying each answer before realizing its image. To support diverse multimodal tasks, SIMIT combines native image generation with an extensible skill library for structured visuals, including documents, charts, and diagrams. Within this pipeline, multi-stage verification checks that images support their assigned answers, while difficulty filtering retains informative examples. Adaptive budgeting further targets this practice by allocating more samples to queries the model is less confident in answering. The resulting data can improve the model in-context (SIMIT-ICL) or in-weight (SIMIT-FT). Across 17 diverse benchmarks, SIMIT outperforms existing self-improvement methods. Its best configuration achieves a +7.20% mean relative gain over BAGEL-7B, while training-free SIMIT-ICL achieves +6.98%.
342. 【2611.00050】ReactionBench: A Human-Anchored Benchmark for Modeling Reactions to Video
链接：https://arxiv.org/abs/2611.00050
作者：Yibo Zhao,Ao Qu,Xuan Jiang,Jiahao Xu,Keane Ong,Hang Jiang,Zhaofeng Wu,Dingyi Zhuang,Yihong Tang,Kaichen Zhou,Jinhua Zhao,Paul Pu Liang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：responsive multimodal systems, socially responsive multimodal, person responds, person observes, sufficient for socially
备注： Accepted at the NeurIPS 2026 Workshop on Evaluation of Interactive Agents (IAEval). 49 pages (10 main text), 9 figures, 46 tables. Project page: [this https URL](https://yibozh.github.io/ReactionBench-page/)
点击查看摘要
Abstract:Understanding what happens in a video is not sufficient for socially responsive multimodal systems: such systems also aim to relate what a person observes to how that person responds. Existing video benchmarks largely evaluate events, temporal reasoning, or people depicted in the video, while affective and viewer-response datasets often focus on emotion labels, aggregate responses, or prediction from the stimulus alone. This leaves an underexplored question: can current multimodal models ground an observed viewer reaction in the stimulus context associated with it? We introduce ReactionBench, a human-anchored benchmark for reaction-specific video understanding. Built from a candidate pool of 31,834 synchronized stimulus-reaction clips spanning 433 hours and eight domains, ReactionBench evaluates three complementary abilities: ranking the intensity of a viewer's reactions within a video, matching a reaction to its temporally aligned stimulus, and explaining the concrete stimulus cues linked to that reaction. Human annotation provides 14,894 ratings over 3,257 moments, and the frozen evaluation comprises 250 intensity profiles, 112 matching items, and 200 rationale items with 447 blind-written human references. Across seven multimodal models, reaction-specific grounding remains challenging: the best model reaches 50.9% accuracy on four-way stimulus-reaction matching, while GPT-5 shows no detectable loss under reaction substitution. Performance is also sensitive to evaluation protocol. Project page: this https URL
343. 【2611.00049】Background Bias Assessment and Mitigation in Plant Disease Detection Using EfficientNet-B0 with Image Processing
链接：https://arxiv.org/abs/2611.00049
作者：Majed Molhi,Nishi Gupta,Ali Algumaei
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：remarkable accuracies exceeding, achieved remarkable accuracies, Plant disease detection, accuracies exceeding, achieved remarkable
备注： 6 pages, accepted and published at 2026 IEEE CSPA
点击查看摘要
Abstract:Plant disease detection using deep learning has achieved remarkable accuracies exceeding 99% on benchmark datasets. However, these metrics may mask a critical vulnerability: models may be taking advantage of false background correlations instead of learning real pathological features. This study presents a systematic investigation of background bias in plant disease detection through a two-stage training framework with quantitative validation. We propose a three-condition evaluation protocol testing models on original, leaf-only, and background-only images to directly measure background dependency. Our approach combines standard transfer learning using EfficientNet-B0 and manipulation of background information during optimization. Experimental results on the PlantVillage dataset (20,638 images, 15 disease classes) show that while our model achieves 98.97% accuracy on the original images and maintains 96.62% accuracy on leaf-only images, the performance drops to 23.58% on background-only images. The calculated background bias (BBC) coefficient of 0.762 indicates that a large part of the model's predictive performance depends on leaf-related features rather than background distortions. This research offers clear evidence that even with the most advanced models, environmental shortcuts can be leveraged, and this highlights the importance of bias evaluation. The approach that has been used has laid a foundation for the development of agricultural AI that is ready for deployment. The implementation, models, and evaluation process are all publicly available.
344. 【2611.00048】Keyframes First, Motion Second: Revisiting Compressed-Domain Video Captioning under Limited Supervision
链接：https://arxiv.org/abs/2611.00048
作者：Asok B K,Ashim Nepal,Loknath Regmi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Compressed-domain video captioners, pretrained encoder reads, bitstream directly, Compressed-domain video, turn the codec
备注： 13 pages including a 3-page supplementary appendix
点击查看摘要
Abstract:Compressed-domain video captioners such as CoCap read the H.264 bitstream directly: a pretrained encoder reads the keyframes (I-frames), while motion and residual encoders, trained from scratch, turn the codec's motion vectors and residuals into action tokens. This motion branch costs decoding time and supervision, both scarce on edge devices. We ask when it pays off under limited supervision. In a controlled study on 2,500 VATEX training clips, we fix a frozen SigLIP 2 keyframe encoder, a GPT-2 caption decoder and the training schedule, vary only the visual tokens the decoder receives (34 configurations), and report held-out test CIDEr with paired bootstrap intervals and three seeds. Motion encoders trained from scratch bring no measurable benefit: CoCap-style action tokens change CIDEr by -0.55 (95% CI [-2.3, +1.2]), and six other uses of motion do not help. Warm-started from a model trained on 48x the caption samples, they add +1.3 CIDEr on average, though not significantly across seeds, and only while the keyframe tokens stay frozen. Reading the keyframes better matters more: fine-tuning SigLIP 2's own attention-pooling head adds 5.4 CIDEr, and one to eight such tokens beat the 16 CoCap-style tokens on every seed while decoding only I-frames (7.3 ms instead of 44-114 ms per clip). The same holds on MSVD's full split in CoCap's own video encoding, where the readout leads by 14.2 CIDEr and action tokens bring no reliable gain, also with clean single-reference motion vectors. Under limited supervision, keyframes come first and motion second.
345. 【2611.00047】opoMix: Continuous Spatial Mixing for Long-Tailed Data Augmentation
链接：https://arxiv.org/abs/2611.00047
作者：Yefan Wang,Yusen Wu,Zihui Ling,Jianyuan Ni
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：hard spatial replacement, fixed global ratio, combine two training, global ratio, methods improve generalization
备注： Accepted by 2026 IEEE International Conference on Systems, Man, and Cybernetics (SMC 2026)
点击查看摘要
Abstract:Most mixing-based augmentation methods improve generalization through a simple idea: combine two training samples with a fixed global ratio or a hard spatial replacement. While effective, this design leaves little room for local variation, which becomes a more visible limitation in long-tailed recognition, where minority classes are especially sensitive to the quality of augmented samples. We propose TopoMix, a training-free augmentation method that replaces fixed mixing with continuous spatial mixing. TopoMix constructs a smooth spatially varying mask from a low-resolution random control grid, bicubic interpolation, and stochastic non-linear shaping, and uses this mask for element-wise image mixing and label reweighting. Without introducing trainable parameters or auxiliary networks, TopoMix offers a simple way to make mixing more flexible in the input space. Experiments on standard long-tailed benchmarks show that it consistently improves over representative mixing-based baselines, indicating that smooth spatial mixing is an effective augmentation strategy for long-tailed recognition.
346. 【2611.00046】Circumpolar Wall-to-Wall Detection of Retrogressive Thaw Slumps with Scarce Labels and Extreme Class Imbalance
链接：https://arxiv.org/abs/2611.00046
作者：Yili Yang,Heidi Rodenhizer,Robb Young,Brendan M. Rogers,Marlena Bartkus,Stefano Potter,Greg Fiske,Scott Zolkos,Wenwen Li,Chia-Yu Hsu,Luigi Marini,Todd C. Nicholson,Benjamin C. Maglio,Jennifer Watts,Anna Liljedahl,Susan M. Natali
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Retrogressive thaw slumps, dynamic ground deformations, ground deformations caused, Retrogressive thaw, permafrost thaw
备注：
点击查看摘要
Abstract:Retrogressive thaw slumps (RTS) are among the most dynamic ground deformations caused by permafrost thaw. Abrupt thaw processes such as RTS could roughly double the contribution of permafrost thaw to climate warming, and already threaten a third of Arctic infrastructure. Circumpolar RTS mapping has advanced quickly, yet released inventories together cover only part of the permafrost region. RTS occupy only 0.1-0.5% of image tiles and labels are costly, so a detector must be designed and evaluated as a rare-target problem. We therefore developed a deep learning system and mapped 20.68 M square kilometres of circumpolar permafrost using 41.6 M tiles of 4.8 m PlanetScope imagery. Training used 22,259 tiles with 2,609 RTS instances in 1,718 of them, and the model was tuned through 172 controlled experiments. A convolutional network matched every alternative tested, including multimodal fusion, foundation-model encoders and masked-autoencoder pretraining, each at far more compute for similar or worse results. Labelled data moved performance most, and a foundation model's advantage appeared only when labels were scarce. Tested once on held-out ecoregions at the real-world prevalence of 0.1-0.5%, the final model achieved an area under the precision-recall curve of 0.812-0.855, an object precision of 0.854 and F1 of 0.644. Deployed wall-to-wall, the model produced a circumpolar map of 19,068 high-confidence detections whose sampled precision ranges from 0.54 to 0.90 by size class. We present an evaluation protocol for rare targets, a controlled account of what governs accuracy under scarce labels, and the circumpolar RTS map the validated model produced.
347. 【2611.00045】Faces or Models? Where the Age Gap in Facial Expression Recognition Comes From
链接：https://arxiv.org/abs/2611.00045
作者：Jessica Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：older faces, systems are increasingly, elder care, rarely measured, open-source FER models
备注：
点击查看摘要
Abstract:Facial expression recognition (FER) systems are increasingly used in elder care, yet their accuracy on older faces is rarely measured. This study evaluated five open-source FER models on the FACES database, which holds 2,052 posed photographs of 171 adults aged 19 to 80. The models cross three architectures (ResNet-18, POSTER++ and QCS) with two training datasets (RAF-DB and AffectNet). All models lost accuracy on older faces by 11.7 to 15.2 percentage points. Older faces were harder for people too: human raters lost 8.6 points, a classifier using only facial geometry lost 8.3, and for anger, fear, and happiness older adults differed more from one another when posing. On specific expressions the models fell much further than people did. AffectNet-trained models misread older neutral faces as sad or angry 62% of the time. RAF-DB-trained models lost fear, disgust, and anger instead. The gap persisted after controlling for architecture, image quality, cropping, and expression intensity. When only the final classification layer was refitted on older faces, the gap shrank from 11 to 21 points to 4 points or less, suggesting that the models' learned features can represent older faces and that the deficit lies in how the final layer was trained.
348. 【2611.00044】SparseWAM: Driving World-Action Models are Worth 16 Register Tokens
链接：https://arxiv.org/abs/2611.00044
作者：Yixiang Yang,Lizhong Zhang,Xingyu Zhang,Zhiwen Chen,Jie Ling,Qiankun Yu,Xingliang Liu,Yang Lei,Zhipeng Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：World Action Models, transfer scene-dynamics priors, jointly forecasting future, forecasting future scenes, Action Models
备注：
点击查看摘要
Abstract:World Action Models (WAMs) transfer scene-dynamics priors to planning by jointly forecasting future scenes and ego trajectories. However, WAMs built on video generators must generate dense future videos at inference, incurring prohibitive latency, while efficient variants discard the world branch at deployment and thus forgo test-time imagination. Even when dense video latents are replaced with patch-level DINO or JEPA features, these representations still involve long token sequences and encode decision-irrelevant information. We therefore propose SparseWAM, which forecasts in a sparse register space of only 16 tokens per frame, compressed from frozen DINOv2 features and shaped by joint planning-and-scoring pretraining to concentrate decision-relevant information. Within this space, SparseWAM employs a modality-decoupled Mixture-of-Transformers with a causal attention mask that lets action tokens condition on imagined future registers, retaining explicit imagine-then-act reasoning at deployment. Its compactness further enables low-cost multimodal sampling. As a result, our SparseWAM achieves 92.6 PDMS on NAVSIM v1, 90.1 EPDMS on NAVSIM v2, and 39.6 on NavHard at only 164 ms latency, roughly 1/5 that of DriveVA, demonstrating the efficiency of the sparse register space. Code will be released upon acceptance.
349. 【2611.00043】Out-of-distribution AI-generated image detection with zero-phase deconvolution for residual whitening
链接：https://arxiv.org/abs/2611.00043
作者：Yusuf Yigit Pilavcı(UNICAEN, GREYC),Antoine Mallet(CRIStAL),Vincent Itier(IMT Nord Europe, CRIStAL, CERI SN - IMT Nord Europe),Jan Butora(CRIStAL),Jérémie Boulanger(CRIStAL),Patrick Bas(CRIStAL)
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Image and Video Processing (eess.IV)
关键词：Current AI-generated image, Current AI-generated, detection methods struggle, testing conditions, methods struggle
备注：
点击查看摘要
Abstract:Current AI-generated image detection methods struggle in out-of-distribution testing conditions because detectors are usually not robust when evaluated on generators not included in the training set. This work explores a way to mitigate the forensic bias between sources of images -whether real or generated -by removing generator-specific fingerprints. This new training process can be approximated by pre-processing involving a deconvolution operation designed to remove correlated noise patterns inducing loss of generalization. Indeed, we show that whitening the spatial distribution of the image noise residuals can significantly improve the performance of detectors on images coming from generators unseen during training. In particular, an end-to-end CNN model trained on whitened image residuals improves detection by 12.6% on average compared to a training involving original images.
350. 【2611.00042】Diagnosing Zero-Shot Forgetting in CLIP Fine-Tuning: Attention Drift Characterizes Adaptation, Representation Drift Predicts Transfer Degradation
链接：https://arxiv.org/abs/2611.00042
作者：Ruize Xia
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：downstream task typically, task typically reduces, labeled transfer benchmark, loss ordinarily requires, Fine-tuning CLIP
备注： Accepted to the ICDM 2026 Workshops (ICDMW), Teen Research Track
点击查看摘要
Abstract:Fine-tuning CLIP on a downstream task typically reduces its zero-shot accuracy on other tasks, and quantifying this loss ordinarily requires a labeled transfer benchmark. We study whether the loss can be anticipated from unlabeled target images that are already available during fine-tuning. Four signals are compared: the entropy of CLS token attention, linear centered kernel alignment (CKA) with the pretrained model, embedding drift, and relative weight change. ViT-B/32 is adapted by full fine-tuning (Full FT) and by LoRA on EuroSAT and Oxford-IIIT Pets over four learning rates and three seeds, with an additional ViT-B/16 grid; DTD and GTSRB are held out as confirmation targets, and forgetting is measured as zero-shot retention on CIFAR-100, Food-101, and ImageNet-R. Within a fixed configuration, the change in attention entropy is strongly associated with forgetting (mean $|\rho|=0.860$). Its sign, however, depends on the dataset, the adaptation method, and the backbone, and the pooled correlation falls to 0.361. A block decomposition shows that this sign is determined almost entirely by blocks 7 to 12. CKA ranks runs by retention at $\rho=0.960$, and the ranking is already established after the first of six epochs ($\rho=0.959$). On the held-out targets, CKA reaches $\rho=0.95$, and the block account correctly predicts the sign of the attention change for both datasets. These results support a simple decision rule: CKA is suited to comparisons across configurations, whereas attention entropy is informative only within a single configuration. The evidence is limited to one model family and short training schedules.
351. 【2611.00041】hink Before You Locate: Clinical Chain-of-Though Supervision for Sequential Medical Image Grounding
链接：https://arxiv.org/abs/2611.00041
作者：Adinath Madhavrao Dukre,Govinda Kolli,Yifan Lu,Ziyun Zou,Azmine Toushik Wasi,Sara Atito,Behzad Bozorgtabar,Dwarikanath Mahapatra,Muhammad Awais,Imran Razzak
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Clinicians rarely localize, Clinicians rarely, rarely localize, localize a finding, Clinicians
备注：
点击查看摘要
Abstract:Clinicians rarely localize a finding from one image alone. They compare current and prior scans, follow structures across slices, and match regions across views or modalities. Yet vision-language models for sequential medical grounding usually learn only from bounding boxes. Boxes show where the target is, but they do not explain why that region in that image answers the question. We study whether explicit, image-grounded reasoning can improve localization, and which tasks benefit from it. We introduce method, whose core is MedChain, a corpus of 182,573 filtered rationales spanning eight sequential grounding tasks and ten imaging modalities. A medical VLM (FlemingVL-38B) first drafts a caption-like rationale, and a multimodal refiner (Qwen3.5-397B-A17B) then re-examines the images, question and annotated box to write a box-conditioned explanation with explicit cross-image reasoning. We fine-tune Qwen3.5 on these rationales with deliberative chain-of-thought supervision (dCoT-SFT). Across 4B, 9B, and 27B models, dCoT-SFT sets a new state of the art on MedSG-Bench. The 27B model reaches 77.24 mIoU and 85.20 Acc@0.5, improving over the strongest prior model by 4.69 and 5.49 points. In a paired comparison using fixed 4B checkpoints, dCoT-SFT improves over answer-only SFT by 3.56 mIoU (95% CI 3.13--4.00). The gains mainly come from change detection and object tracking, while performance drops on three appearance-matching tasks. Replacing a model's own rationale with a rationale from another task reduces mIoU by 12.2 points, showing that localization depends strongly on the reasoning context. Finally, adding GRPO with an IoU reward after dCoT-SFT gives only small and task-dependent gains, which we analyze through controlled multi-seed development experiments.
352. 【2611.00040】Real-Time Obstacle Detection and Distance Estimation on Smartphones for Visually Impaired and Distracted Pedestrians
链接：https://arxiv.org/abs/2611.00040
作者：Abtin Zandi,Sarvin Nami,Roza Ganjipour,Bardia Sabagh Kermani,Amirreza Tarabkhah,Hamed Farbeh
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Performance (cs.PF); Software Engineering (cs.SE)
关键词：World Health Organization, billion people worldwide, severe vision loss, Health Organization, people worldwide live
备注： 10 pages, 3 figures, 4 tables
点击查看摘要
Abstract:According to the World Health Organization, at least 2.2 billion people worldwide live with visual impairment, including tens of millions with severe vision loss. Traditional aids such as white canes or guide dogs remain costly, limited in capability, and inaccessible to many. At the same time, smartphone distraction in public spaces has been linked to elevated risks of collisions with vehicles, trips, and falls. These dual challenges motivate lightweight, smartphone-based solutions that combine accessibility with low latency. We present a Kotlin-based Android application that uses a YOLOv8 detector, retrained to recognize eighteen common urban obstacle classes, to deliver real-time obstacle alerts for both user groups. The detector was optimized with pruning, quantization, and early-exit branches, and deployed through the Android Neural Networks API (NNAPI), which can dispatch inference to GPU, NPU, or DSP accelerators when available. On a mid-range smartphone, these optimizations reduced average inference latency from about 3.2 s for the off-the-shelf YOLOv8n to 0.39-0.48 s; the recommended configuration (INT8 quantization with early exit) runs in 0.42-0.48 s while retaining a recall of 0.81. The application combines the optimized detector with ARCore-based or monocular focal-length distance estimation, so it works with a single smartphone camera and requires no LiDAR, depth camera, or other specialized sensor. Multimodal feedback, including Text-to-Speech guidance for visually impaired users and vibration alerts for distracted pedestrians, supports use across different contexts.
353. 【2611.00039】Beyond Black Boxes: An Ontology Based Vision Framework for Transparent Fruit Disease Detection
链接：https://arxiv.org/abs/2611.00039
作者：M.J. Marapperuma,B.V.K.I. Vidanage
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：minimize crop loss, learning based methods, Efficiency and reliability, large annotated dataset, based methods
备注：
点击查看摘要
Abstract:Efficiency and reliability in the timely identification of phytopathogens would help minimize crop loss in agricultural sectors but existing deep learning based methods, although accurate, would require a large annotated dataset and are black-boxed in their operation, thus, restricting flexibility and transparency. The current paper presents a hybrid detection framework that is able to overcome these drawbacks through the unified real-time vision with a semantic knowledge base. Web Ontology Language (OWL) was used to develop a comprehensive ontology of the disease of fruits that formally codifies phytopathological knowledge, such as symptom phenotype, spectral phenotype (HSV), and morphological phenotype. Such knowledge-guided configuration guides the image processing pipeline, making it possible to diagnose using this knowledge under expert specified rules without a large training dataset. The ontology underwent a computationally verified test of its structural soundness and commonsensical practical usefulness and scored an overall of 7.4/10. On the public set of MangoFruitDDS, the diagnostic performance was an F1 Score of 85.00%, precision of 85.00%, and a recall of 85.23%. These findings are very competitive and similar to other known deep learning models like the VGG16 that prove that the knowledge-driven approach provides an accurate, transparent, and scalable solution on automated fruit disease diagnosis.
354. 【2611.00037】Deep Learning for Detecting Building Setback Rule Violations in Urban Planning: A Case Study on Bangladesh
链接：https://arxiv.org/abs/2611.00037
作者：Farzana Tasnim,Faria Yasmin,Md. Tauseef-Ur-Rahman,Amina Islam,Tamzid Bin Tariq,Yuki Bhuiyan,Muhammad Ibrahim
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：blocking emergency access, rapid urban growth, Dhaka rapid urban, Dhaka Metropolitan Area, setback violations common
备注： 22 pages
点击查看摘要
Abstract:Dhaka's rapid urban growth has made building setback violations common, narrowing footpaths and blocking emergency access. RAJUK, responsible for building control in the Dhaka Metropolitan Area, enforces setback rules mainly through manual field inspection, which scales poorly. We present a systematic comparison of four machine learning approaches for classifying building setback conditions from street-level photographs: negative (compliant), moderate (borderline), and positive (violation). We built a labeled dataset of 372 geo-tagged images from sixteen Dhaka neighborhoods and expanded it with 5,968 augmented copies for training. We trained and evaluated a multi-layer perceptron (MLP), a Random Forest ensemble on frozen ResNet50 embeddings, a support vector machine on frozen ResNet18 embeddings, and a fine-tuned ResNet18 CNN. On a 1,275-image test set, the fine-tuned CNN achieved 65.4% accuracy (macro-F1 0.50), followed by Random Forest at 59.9% (macro-F1 0.44) and SVM at 58.2% (macro-F1 0.45). All models classify the compliant class reliably but struggle with the borderline moderate class due to visual ambiguity. These results establish reference performance levels for automated setback-compliance screening in a South Asian regulatory setting.
355. 【2611.00036】From Single-Shot QA to Continuous Perception: Revisiting the Energy Composition and Optimization Boundary of Edge VLMs
链接：https://arxiv.org/abs/2611.00036
作者：Yiting Duan,Miaoxin Wang,Aoqing Guo,Bo Peng
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Jetson AGX Thor, single-shot workloads, continuous perception, Visual-prefill energy conclusions, Thor and Orin
备注： 5 pages, 3 figures. Accepted at IEEE International Conference on Data Mining 2026 Teen Research Track
点击查看摘要
Abstract:Visual-prefill energy conclusions for edge vision-language models (VLMs) are commonly drawn under single-shot workloads; we revisit them under continuous perception. Profiling nine VLMs across three architecture families on Jetson AGX Thor and Orin (4,508 records, calibrated with a pure-text task), we find two mutually independent energy laws: the per-output-token decode cost grows monotonically with model scale, whereas the visual-prefill (image-encoding) cost is dominated by visual-encoder architectural efficiency, not scale. Under continuous perception ($N{=}10$) with sparse output, visual-prefill energy reaches 92--97\% of total. We derive optimization strategies---visual frame reuse, adaptive output truncation, task-aware routing, and encoder throughput optimization---for edge VLM deployment.
356. 【2611.00035】Selective Positional Allocation for Noise-Robust Query Retrieval in Small-Object Detection
链接：https://arxiv.org/abs/2611.00035
作者：Yangchen Zeng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：detecting tiny targets, Selective Positional Allocation, Selective Positional Embedding, remote-sensing imagery, detecting tiny
备注： 12 pages, 4 figures, 4 tables
点击查看摘要
Abstract:In aerial and remote-sensing imagery, detecting tiny targets is frequently hampered less by the representational capacity of the backbone network than by the manner in which positional priors are distributed across ill-defined foreground and background regions. We introduce SPAR (Selective Positional Allocation and Retrieval), a detection framework that re-conceptualizes positional cues as an allocatable resource: they are intensified at semantically meaningful locations while responses driven by scene clutter are actively attenuated. At the heart of SPAR lies Selective Positional Embedding (SPE), an interpretable embedding mechanism paired with an activation-bar visualization that facilitates direct inspection and hyper-parameter tuning. The encoder branch, termed MOHFE, fuses heatmap-modulated positional signals with category-specific and box-level evidence to yield more compact multi-scale features; the decoder branch, termed HIDQ, employs a foreground gating operation to discard background-dominated candidates prior to query decoding. To cope with the extreme sparsity of small-object evidence, we additionally design DPSConv (Dual-Path Sampling Convolution), which augments retrieval-oriented representations through two geometrically complementary sampling routes. Notably, all heatmap supervision is derived from existing detection objectives and consumed exclusively during training, requiring no auxiliary heatmap annotations and leaving inference as an ordinary forward pass with no additional gradient overhead. Comprehensive evaluations on DOTA, DIOR, VisDrone, PASCAL VOC, NWPU VHR-10, and AITOD demonstrate the effectiveness of the proposed design: relative to the baseline, SPAR attains an improvement of up to 9.1 percentage points, shortens the decoder from eight layers to three, and reduces model parameters by 59.4% (66.3M versus 163M).
357. 【2611.00034】A Trustworthy Clinical Decision Support Framework for Brain Tumor MRI Classification: Integrating Attention-Guided Learning, Explainable AI, and Out-of-Distribution Validation
链接：https://arxiv.org/abs/2611.00034
作者：Arjun Kumar Gupta,Harminder Pal Monga
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Deep learning models, Deep learning, achieve high classification, achieve high, Block Attention Module
备注： Accepted for presentation at the IC3AI-2026 IEEE conference in Dec 2026. It has been accepted/selected but is not yet published. 6 pages, 4 figures, 6 tables
点击查看摘要
Abstract:Deep learning models for brain tumor diagnosis need to do more than achieve high classification accuracy. For practical use, they should also provide understandable predictions, recognize unsuitable inputs, and work within a usable clinical system. This paper presents a framework for classifying brain MRI into four categories: glioma, meningioma, pituitary tumor, and no tumor. The model uses InceptionResNetV2 with a Convolutional Block Attention Module (CBAM), while Grad-CAM provides visual explanations of its predictions. A two-stage out-of-distribution (OOD) mechanism screens unsuitable inputs using an initial grayscale check followed by Mahalanobis distance, softmax confidence, and predictive entropy. These components are brought together in NeuroScan AI, a real-time web application. Evaluated on a Mendeley brain tumor MRI dataset of 12,064 images, the framework achieved 98.70% validation accuracy, 96.73% test accuracy, and a macro-average AUC of 0.9965. The OOD pipeline achieved 99% detection accuracy on a preliminary 100-image benchmark. Grad-CAM visualizations showed qualitative correspondence with clinically established tumor locations across all four classes. Overall, the work brings classification, explainability, input validation, and deployment into one framework, while recognizing that broader clinical and OOD validation is still required.
358. 【2611.00033】Multimodal Cross-Condition Learning for Temporal Sentence Grounding in Videos
链接：https://arxiv.org/abs/2611.00033
作者：Allen He
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：preserves query-relevant evidence, sentence grounding requires, preserves query-relevant, query-relevant evidence, Video Prefix Adapter
备注： 9 pages, 3 figures, 4 tables
点击查看摘要
Abstract:Temporal sentence grounding requires a video representation that preserves query-relevant evidence and a sentence representation that reflects the visual context in which it is interpreted. Prior end-to-end grounding addresses the first requirement through sentence-conditioned visual adaptation, but leaves the language representation independent of the video. This work proposes Multimodal Cross-Condition Learning (MCCL). Its Video Prefix Adapter (VPA) converts pooled visual context into a sequence of continuous tokens that condition a frozen DistilBERT encoder. Combined with the Sentence Conditioned Adapter (SCADA), VPA supports an ordered exchange from vision to language and back to vision. A comprehensive study examines two video backbones, LSTM and Mamba temporal modules, and four conditioning modes on two datasets. Bidirectional conditioning exceeds the stronger one-way mode by 1.6--2.3 mIoU points in all four Charades-STA settings. ActivityNet Captions exhibits a different pattern: bidirectionality helps I3D--Mamba, whereas video-to-text conditioning is stronger with C3D. The study extends one-way visual adaptation into a configurable multimodal framework and reports descriptive gains over the corresponding baselines.
359. 【2611.00032】Gaussifier: Fast 2D Gaussian Decomposition
链接：https://arxiv.org/abs/2611.00032
作者：Yunlai Zhou,Yu Yin,Michael W. Jenkins,Yehe Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Gaussians render images, thousands of frames, Gaussians render, Gaussians, Gaussian
备注：
点击查看摘要
Abstract:2D Gaussians render images at thousands of frames per second. However, fitting an image takes seconds of optimization. This confines 2D Gaussians to offline use. Feedforward methods are faster but less accurate without per-image fine-tuning. We present Gaussifier, a lightweight feedforward framework for 2D Gaussian decomposition. We learn a density map of Gaussian centers from per-image fitting data. Equal-mass Voronoi places Gaussians so that each Voronoi cell holds approximately equal density. A stateless, reusable network then refines the output in a few iterations. Gaussifier reaches 40.73/38.61\,dB PSNR on Kodak-24/DIV2K at over 60 FPS. At the same Gaussian count, it exceeds every feedforward baseline by 3.0 to 15.6\,dB in PSNR. With fewer Gaussians than any baseline, it still leads the strongest one by 2.5 to 3.5\,dB. At the same count, baselines with their own per-image fitting need 26 to 326 times longer to reach its PSNR. Gaussifier makes high-fidelity 2D Gaussian images fast and light enough for real-time applications. We release code, weights and a browser-based WebGPU demo at this https URL.
360. 【2611.00031】Monocular Badminton Speed Estimation with Air Drag and Court Geometry
链接：https://arxiv.org/abs/2611.00031
作者：Diwen Huang,Sarvesh Madullapalli,Ishan Pendyala,Oliver Chen,Kevin Li,William Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：slowly moving object, moving object nearby, rapidly moving object, moving object, slowly moving
备注：
点击查看摘要
Abstract:A single camera cannot distinguish between a slowly moving object nearby and a rapidly moving object in the distance without additional information. For a shuttlecock, air drag provides a strong deceleration cue that can be combined with known court geometry. We fit a gravity-and-drag trajectory to smartphone video and compare a free monocular fit with a fit constrained to cross the net plane. Camera calibration uses court lines, and the trajectory is fitted to observed shuttle positions and frame timestamps by robust nonlinear least squares. We evaluated 51 badminton shots from two recording sessions, spanning drop shots, drives, half-smashes and smashes. The net-plane fit reduced the median absolute speed difference from a drag-based stereo reference from 13.3% to 8.6%. A second reference, obtained by differentiating triangulated positions without a drag model, also gave a smaller median difference for the net-plane fit. The results support combining court geometry with flight dynamics for badminton speed estimation from a single camera.
361. 【2611.00029】DiA: Directional Adapter
链接：https://arxiv.org/abs/2611.00029
作者：Ashish Kumar Singh,Prakash Chandra Chhipa
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Fine-grained action recognition, Fine-grained action, action unfolds, unfolds over time, action recognition
备注： Accepted at NeurIPS 2026. Joint first authors with equal contributions. Code - [this https URL](https://github.com/prakashchhipa/DiA-Directional-Adapter)
点击查看摘要
Abstract:Fine-grained action recognition often depends on how an action unfolds over time rather than on appearance alone. Visually similar classes may differ in preparation, execution, or completion phases, making uniformly aggregated temporal context suboptimal. We study this problem under a practical objective: i) improving recognition performance with few tunable parameters, ii) being compute efficient, and iii) using only the readily available video modality. Motivated by this missing temporal observation and the accuracy--compute efficiency--unimodality objective, we propose Directional Adapter (DiA), a parameter-efficient adapter on top of CLIP. DiA formulates temporal specialization into causal and anti-causal directions, allowing past-to-present and future-to-present cues to be modeled differently. To keep this directional modeling parameter- and compute-efficient, both directions use depth-wise temporal convolutions in a compact bottleneck space and are combined through a learnable fusion. DiA achieves state-of-the-art performance among methods using a single video input modality across seven public benchmarks, with only $\sim$3.6M tunable parameters, while also delivering higher throughput and lower inference latency than prior methods. Code is available at this https URL.
362. 【2611.00028】A Systematic Analysis of Live Intraoperative Surgical Expert Narrations
链接：https://arxiv.org/abs/2611.00028
作者：Arda Mamur,Matthias Seibold,Christoph Laux,Florian Wanivenhaus,Philipp Fürnstahl
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Manual annotation remains, surgical video understanding, Manual annotation, video understanding, remains the principal
备注： Accepted as abstract at the SafeSurg Workshop at MICCAI 2026
点击查看摘要
Abstract:Manual annotation remains the principal bottleneck in surgical video understanding. Live intraoperative narration by the operating surgeon is a scalable alternative that requires no manual annotation, but the information it contains has not been characterized. We analyzed 13 endoscopic lumbar spine decompression procedures (13.2 h) by two senior spine surgeons, using time-synchronized close-mic German audio. An annotation-free pipeline (word-level speech recognition, deterministic correction of surgical-term errors, utterance fusion, LLM-based translation to English, and relevance filtering) converted speech into time-stamped procedural cues labelled with the surgical entities they reference and their speech act. Of 3,171 utterances, 1,201 (37.9%) were retained as procedural cues, while 57.6% were non-procedural and removed. Retained cues referenced instruments (60.7%), anatomy (48.0%) and surgical actions (57.1%), and 98.5% carried at least one of these. 39% of cues (472 of 1,201) were directives, mainly instrument requests and commands. All 467 manually verified instrument requests preceded the instrument's appearance in the field, by a median of 8.2 s. Domain-term transcription corruption affected 18.0% of retained cues. Live narration is thus a dense, annotation-free supervisory signal describing instruments, anatomy, actions and team coordination, but it is noisy and temporally displaced from the events it names, and this displacement must be modelled before safe downstream use.
363. 【2611.00027】SFA: A Statistical Physics-Inspired Diffusion Transformer for Efficient and High-Quality Image Generation
链接：https://arxiv.org/abs/2611.00027
作者：Zixuan Huang(1 and 2),Tianhao You(1),Guozhang Chen(1, 3 and 4) ((1) School of Computer Science, Peking University, Beijing, China, (2) School of Physics, Peking University, Beijing, China, (3) State Key Laboratory of Multimedia Information Processing, Peking University, Beijing, China, (4) National Engineering Research Center of Visual Technology, Peking University, Beijing, China)
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Graphics (cs.GR); Image and Video Processing (eess.IV)
关键词：achieved remarkable success, achieved remarkable, remarkable success, success in image, remains a major
备注： 47 pages, 14 figures
点击查看摘要
Abstract:Diffusion transformers have achieved remarkable success in image generation, but accelerating attention while preserving generation quality remains a major challenge at high resolutions. Inspired by statistical physics and the widespread occurrence of scale-free laws in nature, we introduce Scale-Free Attention (SFA), which preserves fine local interactions while summarizing distant regions at progressively coarser scales. For $N$ tokens, mean pooling, token-count correction, and a shared softmax over a scale-free spatial hierarchy give SFA $O(N\log N)$ complexity in both forward and backward passes. Our Triton implementation achieves $357.3\times$ forward and $265.6\times$ backward attention speedups over FlashAttention at 262,144 tokens. After 40 epochs of PixelFlow training from scratch on ImageNet at $256\times256$ resolution, SFA achieves the best generation quality among five attention mechanisms, including full attention. Fréchet inception distance evaluated on 50,000 generated samples (FID-50k) improves from 13.25 for full attention to 12.51, and the advantage over full attention persists through 80 epochs. SFA also achieves the best generation quality among the compared efficient-attention methods on Flickr-Faces-HQ (FFHQ). Beyond training from scratch, Stable Diffusion 3.5 Medium with attention replaced by SFA retains the generation quality of its full-attention counterpart under matched fine-tuning budgets. We obtain similar results when fine-tuning pretrained PixelFlow on ImageNet. SFA establishes scale-free structure as an effective design principle for efficient, high-quality diffusion transformers.
364. 【2611.00026】he Margin Knows the Background: Uneven Abstention in Frozen Vision-Language Models
链接：https://arxiv.org/abs/2611.00026
作者：Satwik Sai Prakash Sahoo,Bibhor Puhan,Shubhankar Mahanta
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：single confidence threshold, uncertain inputs, disproportionately reject, LAION CLIP, single confidence
备注：
点击查看摘要
Abstract:Selective prediction allows a model to abstain on uncertain inputs, but a single confidence threshold can disproportionately reject examples from particular groups. We study how confidence scores produce this imbalance in frozen vision-language models (OpenAI CLIP, LAION CLIP, SigLIP). We express a family of scores, including the margin and maximum logit, through the average and the difference of the two highest class logits, and ask which carries group information. We show that equal group coverage at every threshold is equivalent to independence between the score and group membership. A randomized margin baseline tests whether a reduction in coverage disparity beats what adding noise achieves. With score choices fixed before testing, the effect of choice depends on the dataset. On Waterbirds, the margin creates coverage gaps 2.5 to 5.5 times larger than maximum logit at 80% coverage, its group signal is in the difference component, and paired background swaps show the background moves it, although maximum logit increases overall error. On NICO++, maximum logit instead increases worst-context error by 5.4 to 6.6 points and offers no improvement over the randomized baseline for OpenAI CLIP. Across both datasets, how far a score pushes a group down its ranking tracks the coverage gap (Spearman 0.88, 0.92) better than plain group identifiability (0.61, 0.65). These results explain why a score that abstains more evenly on one dataset may be less effective on another and motivate judging group coverage and selective risk together against randomized baselines.
365. 【2611.00025】Edge-Optimized YOLOv11n Architecture for Offline Recognition of Nigerian Sign Language Alphanumeric Gestures
链接：https://arxiv.org/abs/2611.00025
作者：Adeleke Adeniyan,Abimbola H. Afolayan,Olanrewaju V. Johnson
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：faces regional hurdles, core empirical focus, sub-Saharan society faces, society faces regional, Deaf inclusion
备注： 12 pages, 6 figures, 7 tables
点击查看摘要
Abstract:Deaf inclusion across sub-Saharan society faces regional hurdles, with Nigeria as the core empirical focus. Existing recognition models demand heavy computational infrastructure. However, standard mobile phones used locally rarely exceed 1 GB to 4 GB of RAM. This study addresses constraints through a lightweight YOLO11n object-detection framework. The system provides real-time Nigerian Sign Language recognition for low-resource hardware. A benchmark dataset containing 11,208 raw gesture images was established. The data spans 33 static classes collected from five signers. Partitioning isolates signers S1 through S3 for training. Signer S4 provides validation data. Signer S5 is reserved for testing. Spatial augmentations are restricted strictly to the training set. This yields 23,509 training images. The validation and test sets each maintain 1,681 images across varied environments. The framework integrates a quantization-aware compression objective. Loss functions merge with squared Frobenius-norm penalties to govern weight distortion. A Spatial-Density Occlusion Index quantifies background complexity and self-occlusion. A latency-profiling equation relates floating-point operations and memory bandwidth to chipset clock speed. Performance testing on physical Android hardware utilizes unquantized FP32 weights. Mean inference latencies span 405.5 ms to 1,759.4 ms. Measured against test data, the algorithm attains a Precision of 0.9975. Recall reaches 0.9991. Mean Average Precision is 0.9942. Outcomes support offline functionality on constrained mobile devices. Practical deployment operates through a mobile utility using CameraX. The application captures gestures in real time. Recognized signs display as text instantly.
366. 【2611.00024】Covariance-aware Scoring: A Geometric Correction for Vision-Language Test-Time Adaptation
链接：https://arxiv.org/abs/2611.00024
作者：Lakpa Tamang,Saman Forouzandeh,Kamal Berahmand,Wei Shao,Hamid Beigy,Mahdi Jalili
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：enables vision, Test-time adaptation, source data, shifts without labels, labels or access
备注： 18 pages, 5 figures, Under review at ICLR2027
点击查看摘要
Abstract:Test-time adaptation (TTA) enables vision--language models such as CLIP to adapt to distribution shifts without labels or access to source data. Existing methods adapt through feature caching, prototype estimation, or the online accumulation of feature statistics, but most ultimately score a test feature against a class representative in the ambient embedding space, typically through cosine similarity. We identify this shared decision rule as a limitation under anisotropic feature distributions, which means when a small number of directions account for a large fraction of feature variance, the score can be dominated by high-variance directions that are not necessarily discriminative. In light of this, we propose CARe, a covariance-aware scoring for TTA that replaces the ambient geometry with a Mahalanobis geometry induced by the target feature second moment. Theoretically, we show that under a shared-covariance Gaussian model the covariance-aware decision direction coincides with that of the Bayes-optimal linear discriminant, with ambient-space scoring as the isotropic special case, and establish that the potential benefit of covariance-aware scoring grows with feature anisotropy. Empirically, we show that CARe improves adaptation accuracy over its base cosine scoring on both standard and fine-grained distribution-shift benchmarks across two backbones. Consistent with our analysis, the gains are largest on datasets whose features are most anisotropic and vanish as the features approach isotropy.
367. 【2611.00023】FORCE: Factorized Object Relations for Counterfactual Editing in Video World Models
链接：https://arxiv.org/abs/2611.00023
作者：Suraj K. Sood,Yugyung Lee
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：World models predict, Factorized Object Relations, counterfactual world models, World models, scenes evolve
备注： 18 pages, 6 figures
点击查看摘要
Abstract:World models predict how scenes evolve, but they are difficult to interrogate: given a model that forecasts a video, one cannot easily ask what would have happened had a particular interaction between two objects been different. We present Factorized Object Relations for Counterfactual Editing (FORCE), a world model that infers pairwise interactions from raw video without supervision and represents each as an explicit latent per object pair, so that a relation can be removed, changed, transferred or introduced directly. Objects are extracted by slot attention over frozen self-supervised features; a relation encoder infers each pair latent from a short observation window, and an interaction head turns it into a force. The latent is held fixed across the rollout, so an edit persists rather than being recomputed, and every edit acts on the model's own quantities with no mapping to simulator parameters. We evaluate in a simulated environment where the true outcome of an edit is available, scoring the change each edit induces against the change the simulator produces under the same operation. On held-out clips, FORCE's edits made from video agree with the simulator's response at 0.19 to 0.37 on our effect-based score; trained and scored on exact object positions instead, the same architecture reaches 0.57 to 0.85. The gap therefore lies not in the learned relational dynamics but in perception: what bounds an edit is how precisely objects can be located from video, and the precision editing needs lies just beyond what current object-centric perception delivers. Closing that gap is a concrete target for making counterfactual world models work from video.
368. 【2611.00022】Diagnosing Prototype Estimation in Few-Shot Class-Incremental Learning: Training-Free Geometry Selection and Unlabeled-Query Prototype Rectification
链接：https://arxiv.org/abs/2611.00022
作者：Md Tanvir Hossain Saikat,Md Akib Haider,Md. Tahmid Islam Tomal,Md Hasanul Kabir
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Frozen visual encoders, few-shot class-incremental learning, residual head gap, Frozen visual, make prototype heads
备注： -
点击查看摘要
Abstract:Frozen visual encoders make prototype heads competitive in few-shot class-incremental learning (FSCIL), but it remains unclear how much of the residual head gap is sensitive to noisy novel-class means rather than to the subsequent changes introduced by classifier refitting. On identical features, we construct a retrospective matched counterfactual: first replace each five-shot novel mean with its complete-data counterpart under fixed cosine scoring, then fit a linear probe. Across sixteen strong encoder dataset pairs, mean replacement accounts for the majority of this ordered gap. Shot and classwise diagnostics support a finite-sample mechanism, whereas a weaker base-only encoder does not satisfy the same criterion. This diagnosis motivates ShrinkSel, a support-only selector over prototype radius and covariance shrinkage whose family contains shared LDA as an exact fallback. Across sixteen evaluated pairs, it improves LDA on fifteen by 0.04-1.52 points and selects the exact LDA endpoint on Aircraft. We further introduce Query Prototype Rectification (QPR), a batch-transductive extension that uses gated unlabeled queries to update novel directions while preserving the selected geometry. On CLIP ViT-B/16, QPR adds 1.21-2.03 points; exact query-wise self-exclusion retains the benefit, showing that the gains do not require self-inclusion. The update repairs scarce novel prototypes at a measurable base-class cost and weakens with plentiful supports or very small cohorts. Thus, the evidence available for prototype estimation is a central constraint in frozen-feature FSCIL.
369. 【2611.00020】Intervenable Concept Dynamics for Video Activity Forecasting
链接：https://arxiv.org/abs/2611.00020
作者：Patrick Knab,David Steinmann,Giovanni De Felice,Felix Divo,Udo Schlegel,Wolfgang Stammer,Sascha Marton,Christian Bartelt
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：bottleneck models route, models route predictions, intermediate states inspectable, making their intermediate, inspectable and editable
备注： Accepted at NeurIPS 2026 Workshop FMTS
点击查看摘要
Abstract:Concept bottleneck models route predictions through human-understandable concepts, making their intermediate states inspectable and editable. Extending this model family to forecasting requires modeling how concept activations evolve over time as objects, actions, and their interactions change, yet existing CBMs ground concepts only in observed inputs and do not forecast their future evolution. We study this problem using videos of ongoing activities and forecast future activities through a named-concept state. We propose TRACE-CBM (Temporal Relational Activity Concept Evolution), which first refines observed concept activations with sparse spatio-temporal graphs. It then recursively predicts future concept states, conditioning each transition on the prior activity distribution, and decodes both observed and predicted states with a shared activity classifier. At inference time, the model supports editing concept values, activity activations, and learned edges without parameter updates, exposing the relational spatio-temporal dependencies used for forecasting. Across multiple datasets, TRACE improves observed-activity Top-1 accuracy over concept-based methods by 1.2-8.5 percentage points and attains H3 forecast Top-1 accuracy within 1.9-2.2 points of matched black-box forecasters. Intervention experiments show concept-node edits correct 25.6-34.4% of initially incorrect H3 forecasts without flipping initially correct ones, and concept steering achieves the requested target activity in up to 90.0% of cases.
370. 【2611.00017】Beyond the Last Layer: Global Inter-Layer Aggregation for AI-Generated Image Detection
链接：https://arxiv.org/abs/2611.00017
作者：Wenbin Shen,Zhichao Lian
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：made AI-generated images, AI-generated images increasingly, images increasingly close, AI-generated images, images increasingly
备注：
点击查看摘要
Abstract:The rapid development of generative models has made AI-generated images increasingly close to real images. It has also brought several challenges to detectors, including rapid generator updates, large changes in data distribution, and limited cross-dataset generalization. Many existing methods based on pretrained vision encoders primarily use the global representation from the last layer, potentially leaving useful information from intermediate layers underexplored. To address this issue, we propose Global Inter-Layer Aggregation (GILA). GILA extracts global representations from different depths of a frozen encoder, models interactions among layer representations through inter-layer self-attention, and adaptively aggregates the resulting contextualized representations. The method is not tied to a single pretraining objective and does not require fine-tuning the pretrained encoder. We evaluated GILA on three vision backbones with different pretraining objectives, ten seen generators, and three external datasets. The experimental results show that GILA makes better use of multi-layer information in pretrained encoders and improves detection performance and cross-dataset generalization.
371. 【2611.00004】Do the Numbers Match the Plot? Statistical-Visual Verification for Automated Exploratory Data Analysis
链接：https://arxiv.org/abs/2611.00004
作者：Zixun Fu,Jian Huang,Maojun Sun,Yancheng Yuan
类目：Human-Computer Interaction (cs.HC); Computer Vision and Pattern Recognition (cs.CV)
关键词：execute statistics correctly, producing misleading interpretations, exploratory data analysis, execute statistics, statistics correctly
备注：
点击查看摘要
Abstract:Automated exploratory data analysis (EDA) systems can execute statistics correctly while producing misleading interpretations. For example, correlations may be driven by influential observations, and mean differences may arise from skewness, overlap, or sparse subgroups rather than broad distributional shifts. We present EDAgent, a sequential framework that performs targeted visual verification before report synthesis. For each finding, the system records the statistical result, generates a visualization request identifying relevant distributional features, creates the corresponding chart, and uses the observed pattern to retain, qualify, or reconsider the interpretation. We call this process statistical-visual verification. EDAgent includes VisPlan, an 8B-parameter model that converts visualization rationales into detailed chart plans. We evaluate 87 end-to-end reports on EDA-Bench using a six-dimension rubric and GPT-5.1 multimodal evaluation. Maximum-score proportions reached 87.4% for factuality and visual consistency, 93.1% for statistical-visual cross-validation, and 96.6% for analytical narrative. On 166 open-ended VisEval tasks, VisPlan improved the mean overall score from 4.55 (Qwen3-8B) to 4.62, with the largest gain in aesthetics. These descriptive results indicate that visual verification can make automated EDA reports more transparent about how statistical findings relate to underlying data structure.
372. 【2603.18101】raining-Only Heterogeneous Image-Patch-Text Graph Supervision for Advancing Few-Shot Learning Adapters
链接：https://arxiv.org/abs/2603.18101
作者：Mohammed Rahman Sherif Khan Mohammad,Ardhendu Behera,Sandip Pradhan,Swagat Kumar,Amr Ahmed
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Emerging Technologies (cs.ET); Machine Learning (cs.LG)
关键词：Recent adapter-based CLIP, adapter-based CLIP tuning, CLIP tuning, Recent adapter-based, adapter-based CLIP
备注： Accepted at The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2026
点击查看摘要
Abstract:Recent adapter-based CLIP tuning (e.g., Tip-Adapter) is a strong few-shot learner, achieving efficiency by caching support features for fast prototype matching. However, these methods rely on global uni-modal feature vectors, overlooking fine-grained patch relations and their structural alignment with class text. To bridge this gap without incurring inference costs, we introduce a novel asymmetric training-only framework. Instead of altering the lightweight adapter, we construct a high-capacity auxiliary Heterogeneous Graph Teacher that operates solely during training. This teacher (i) integrates multi-scale visual patches and text prompts into a unified graph, (ii) performs deep cross-modal reasoning via a Modality-aware Graph Transformer (MGT), and (iii) applies discriminative node filtering to extract high-fidelity class features. Crucially, we employ a cache-aware dual-objective strategy to supervise this relational knowledge directly into the Tip-Adapter's key-value cache, effectively upgrading the prototypes while the graph teacher is discarded at test time. Thus, inference remains identical to Tip-Adapter with zero extra latency or memory. Across standard 1-16-shot benchmarks, our method consistently establishes a new state-of-the-art. Ablations confirm that the auxiliary graph supervision, text-guided reasoning, and node filtering are the essential ingredients for robust few-shot adaptation. Code is available at this https URL.
373. 【2611.03465】HIVE-Diff: High Frame Rate HDR Video Reconstruction from a Single LDR Frame and Events
链接：https://arxiv.org/abs/2611.03465
作者：Caixin Wang,Qingrui Wang,Jie Zhang,Ralph Etienne-Cummings
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：High frame rate, frame rate HDR, High frame, rate HDR video, scientific imaging
备注： Accepted to WACV 2027 (Applications Track). 8 pages main paper + 8 pages supplementary material (included as appendix), 12 figures, 5 tables. Code: [this https URL](https://github.com/caixinw4-afk/hive-diff)
点击查看摘要
Abstract:High frame rate HDR video is important in applications such as autonomous driving and scientific imaging, where rapid motion and extreme illumination often occur simultaneously. Conventional frame cameras face a trade-off between temporal resolution and dynamic range, while event cameras provide complementary high-speed brightness-change measurements over a wide illumination range. These properties have motivated event-based HDR reconstruction, with existing methods broadly following event-only and hybrid event-frame paradigms. Event-only HDR reconstruction, however, suffers from brightness and color drift due to the lack of absolute intensity references. Hybrid event-frame methods alleviate this ambiguity using low-dynamic-range (LDR) frames as anchors, but most perform one-to-one HDR reconstruction at available LDR timestamps. In this work, we investigate single-reference HDR temporal expansion, reconstructing N HDR frames from one LDR reference and events instead of N aligned LDR observations. We develop HIVE-Diff, an event-conditioned video diffusion framework that decomposes the task into event-guided temporal generation and HDR content completion. Because paired real HDR-event data are scarce, we train on synthetic data and adapt the model to real event domains using LDR-event sequences as proxy supervision with teacher-student distillation. Experiments on synthetic and multiple real-world datasets demonstrate strong reconstruction quality and robust real-data adaptation.
374. 【2611.03078】Cross-Layer Refinement and Frequency-aware Fusion Network for Multi-Source Remote Sensing Image Classification
链接：https://arxiv.org/abs/2611.03078
作者：Wenhan Xiao,Chuanzheng Gong,Feng Gao,Junyu Dong,Qian Du
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：Multi-source remote sensing, remote sensing image, sensing image classification, image classification benefits, Multi-source remote
备注： Under review at IEEE GRSL
点击查看摘要
Abstract:Multi-source remote sensing image classification benefits from complementary spectral and structural information. However, identifying discriminative cross-modal features remains challenging. This letter proposes a Cross-Layer Refinement and Frequency-aware Fusion Network (CRFNet) within a lightweight dual-branch architecture. Specifically, a Cross-Layer Refinement Attention (CLRA) module propagates selected attention relationships across successive layers and employs top relation selection to progressively strengthen discriminative spatial dependencies while suppressing irrelevant responses. Furthermore, a Frequency-aware Complementary Fusion (FCF) module combines frequency-wise interactions with cross-modal channel attention in the Fourier domain. The resulting representations are then converted into spatial-domain gates to selectively modulate complementary features. Experiments on the Houston 2013 and Augsburg datasets demonstrate that the proposed CRFNet consistently outperforms several state-of-the-art methods. The codes are publicly available at this https URL
375. 【2611.03069】Shared-Pattern Collaborative Network for Multi-Source Remote Sensing Data Classification
链接：https://arxiv.org/abs/2611.03069
作者：Chenfang Yang,Chuanzheng Gong,Feng Gao,Junyu Dong,Qian Du
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：Multi-source remote sensing, growing attention recently, remote sensing data, received growing attention, Multi-source remote
备注： Accepted for publication in IEEE JSTARS 2026
点击查看摘要
Abstract:Multi-source remote sensing data classification has received growing attention recently. However, existing methods still struggle to jointly model long-range contextual dependencies and shared spatial patterns across heterogeneous modalities. To address this issue, we propose a Shared-Pattern Collaborative Network (SPCNet) for HSI and SAR/LiDAR joint classification. To enhance cross-modal collaborative learning, Shared-Pattern Collaborative Block (SPCB) is designed by introducing a shared large-kernel operator and a dynamic convolution branch, enabling the network to capture common spatial structures and content-adaptive local features. Furthermore, Region-Adaptive Modality Allocator (RAMA) is developed to assign spatially varying modality weights for reliable feature fusion. Experiments on Houston2013, Augsburg, and Houston2018 datasets demonstrate that SPCNet achieves superior classification performance over several state-of-the-art methods. The code will be made publicly available at this https URL
376. 【2611.02405】MirrorComm: A Communication-Efficient Cooperative Perception Framework via Mirrored World Models
链接：https://arxiv.org/abs/2611.02405
作者：Shenghan Luo,Yin Xu,Cixiao Zhang,Yang Wang,Yujie Cao,Zhuoran Xiao,Wenjun Zhang
类目：ignal Processing (eess.SP); Computer Vision and Pattern Recognition (cs.CV)
关键词：Cooperative perception, requires substantial communication, exchange sensing information, requires substantial, connected agents
备注：
点击查看摘要
Abstract:Cooperative perception (CP) requires substantial communication bandwidth to exchange sensing information among connected agents. A variety of compression techniques have been proposed to reduce transmission costs while retaining task-relevant information. However, most existing methods follow a frame-wise compression paradigm, overlooking temporal predictability and repeatedly transmitting information that could be inferred from historical context. To address these limitations, we propose MirrorComm, the first world model-based communication-efficient CP framework. Specifically, mirrored world models at the transmitter and receiver predict the transmitter's current observation from a shared history of its reconstructed observations. The transmitter compares this prediction with its current observation and selectively transmits observation updates to correct prediction errors, reducing repeated transmission of predictable information. Experiments on the OPV2V dataset across two downstream tasks including object detection and semantic segmentation show that MirrorComm reduces communication bandwidth requirements by up to approximately 66-fold while maintaining comparable performance to a state-of-the-art (SOTA) method. Ablation studies further demonstrate the effectiveness of the individual components.
377. 【2611.02364】Spectral-spatial vision test-time training for hyperspectral image classification
链接：https://arxiv.org/abs/2611.02364
作者：Xiang Zhao
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：limited labeled supervision, Hyperspectral image, contiguous spectral signatures, spatial HSI classification, Vision test-time training
备注： 25 pages,9 figures,10 tables
点击查看摘要
Abstract:Hyperspectral image (HSI) classification requires the representation of contiguous spectral signatures and spatial context under limited labeled supervision. Vision test-time training (TTT) offers an alternative to fixed-weight token mixing by performing self-supervised inner-model updates on the input sequence, but its application to center-pixel HSI classification remains insufficiently characterized. We present ViTTT-HSI, a spectral-spatial adaptation of the vision test-time training (ViT3) architecture. A spectral-aware embedding stem extracts ordered-band information using spectral convolution and forms spatial tokens without reducing their spatial resolution. Two ViT3-based TTT encoder blocks perform patch-conditioned token mixing, followed by the fusion of center-pixel and neighborhood-average features for classification. We evaluate the framework on Indian Pines, Pavia University, Salinas, and Houston 2013 using ten random seeds and dataset-specific training fractions of 1% or 5%. The mean overall accuracies are 97.6390%, 98.8753%, 99.3292%, and 98.4283%, respectively. Ablations reveal a substantial contribution from the TTT inner update on Indian Pines and a smaller positive contribution on Pavia University, while the relative benefits of the spectral stem and feature fusion depend on the dataset. The results demonstrate the feasibility of using patch-conditioned vision TTT for spectral--spatial HSI classification and highlight the role of the inner adaptation mechanism.
378. 【2611.02245】Modeling Visual Cortex with Layerwise Multiscale Manifold Capacity Maximization
链接：https://arxiv.org/abs/2611.02245
作者：Thomas Yerxa,SueYeon Chung,Eero P. Simoncelli
类目：Neurons and Cognition (q-bio.NC); Computer Vision and Pattern Recognition (cs.CV)
关键词：Task-optimized deep neural, primate visual cortex, Task-optimized deep, deep neural networks, predictive phenomenological models
备注：
点击查看摘要
Abstract:Task-optimized deep neural networks have risen to prominence as the most predictive phenomenological models of responses in primate visual cortex, but leave much to be desired from the perspective of biological plausibility. One such limitation is the reliance on precise credit assignment through global backpropagation of error signals. Recent work has shown that this weakness can be circumvented by requiring each subsequent stage to solve a distinct and increasingly complex task, allowing for layerwise local learning signals. We propose a novel strategy for crafting such intermediate losses that uses an efficient coding framework formulated in terms of manifold capacity, and which can be computed using a sequence of {canonical cortical computations}. In particular, we leverage the relationship between the multiscale nature of visual signals and the dilation of receptive field sizes in cascaded visual representations to modulate complexity, allowing for the reapplication of these common loss computations at each stage of the hierarchy. We evaluate our approach on its ability to predict neural datasets spanning three areas of the ventral stream hierarchy in macaques, as well as human psychophysical data on an object classification task. We find that our unsupervised layerwise model matches or exceeds the performance of competitive architecture-matched baselines on all evaluations considered.
379. 【2611.01992】Cross-Dataset Generalization of Glaucoma Detection CNNs: Effects of Operating Threshold, Multi-Source Training, and Color Normalization
链接：https://arxiv.org/abs/2611.01992
作者：Al-Amin Rahman,Saifuddin Ahmed,Resalat Ahmed
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：Deep learning models, Deep learning, AUC, Deep, cross-source AUC
备注： 17 pages, 10 figures, 11 tables
点击查看摘要
Abstract:Deep learning models for glaucoma detection are usually tested on images from the same dataset used for training. That says little about how they will work at a new hospital or with a new camera. We fine-tuned five ImageNet-pretrained CNNs (ResNet50, DenseNet121, MobileNetV2, EfficientNet-B0, InceptionV3) with identical settings on one of three public fundus datasets (ACRIMA, ORIGA, RIM-ONE DL). Each was tested on a held-out part of its own dataset and on the other two datasets in full. We used three random seeds and report mean and SD over seeds. Mean in-domain AUC was 0.913 and cross-source AUC was 0.702, a drop of 0.211 (SD 0.030; 95% CI 0.135 to 0.286). After correction for multiple comparisons we found no evidence that any architecture did better, though three seeds give low power. At thresholds set on the source validation data, specificity fell from 0.870 to 0.506 and sensitivity from 0.831 to 0.726. Resetting the threshold on 10% of the target images raised specificity to 0.670 but lowered sensitivity to 0.609, and balanced accuracy rose only from 0.616 to 0.639. Training on two sources together did not help (held-out AUC 0.695 versus 0.702). LAB reference normalization (cross-source AUC 0.755) and strong color augmentation (0.754) gave similar gains, cutting the drop to about 0.16. Ben Graham normalization (0.733) and CLAHE (0.712) helped less, and gray-world (0.696) did not help. The two best methods raised specificity but lowered sensitivity. On G1020, used only for testing, AUC stayed near 0.5 in every condition, and networks trained within G1020 were also close to chance. Strong in-domain results do not show that a glaucoma model will work on new data. Normalization and color augmentation reduce the drop but do not remove it. Studies should report external validation and check the operating threshold, not only AUC.
380. 【2611.01675】Learned optical compression for single-pixel quantitative phase imaging
链接：https://arxiv.org/abs/2611.01675
作者：Ary Portes,Yuntian Wang,Che-Yung Shen,Shiqi Chen,Aydogan Ozcan
类目：Optics (physics.optics); Computer Vision and Pattern Recognition (cs.CV); Applied Physics (physics.app-ph)
关键词：spatially resolved intensity, reveals optical path-length, optical path-length variations, resolved intensity measurements, path-length variations
备注： 35 Pages, 11 Figures
点击查看摘要
Abstract:Quantitative phase imaging (QPI) reveals optical path-length variations in transparent objects but typically relies on spatially resolved intensity measurements. Here we numerically and experimentally demonstrate learned optical compression for single-pixel QPI, jointly optimizing a diffractive encoder and a digital neural decoder to concentrate reconstruction-relevant phase information into a compact measurement vector. A single reconfigurable phase-modulation plane sequentially displays the learned encoding patterns, which are independent of the input object, each yielding one scalar intensity measurement. Operating at a visible wavelength, the experimental system reconstructs quantitative phase images of unknown objects with ~40-fold dimensional compression, using only 2.55% as many intensity measurements as reconstructed pixels. Experimental blind testing on handwritten digits and grating-like phase objects achieves mean Pearson correlation coefficients of 0.945 and 0.848, respectively. Benchmarking under the same measurement budget demonstrates substantially higher reconstruction fidelity than other encoding strategies, highlighting the advantages of learned optical compression. With the optical encoder fixed, decoder-only neural adaptation enables experimental transfer to previously unseen data distributions, extending the utility of the learned measurement representation. These results establish learned optical compression as a measurement-efficient and reusable framework for QPI, integrating phase-information compression into single-pixel intensity measurements while retaining adaptability to new data. This approach paves the way for low-data-rate phase imaging and sensing, with the potential to extend QPI to spectral regions where high-quality detector arrays are costly or unavailable.
381. 【2611.01537】ask-driven sparse-view planar X-ray computed tomography for axial metrology
链接：https://arxiv.org/abs/2611.01537
作者：Yibin Tian,Shuming Yang,Wolfgang Heidrich
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：complete image recovery, imaging can reduce, system is designed, designed around task-relevant, planar X-ray tomography
备注：
点击查看摘要
Abstract:Computational imaging can reduce the acquisition burden when the system is designed around task-relevant information rather than complete image recovery. We investigate this framework for sparse-view planar X-ray tomography (XCT) of layered objects, using measurement of the axial termination gap (ATG) of back-drilled printed-circuit-board (PCB) vias as a representative task. Instead of using 3D reconstruction, the proposed method estimates ATG directly from polychromatic projection data through a physics-based sensitivity model. A gated hierarchical estimator first fits ATG together with radiometric perturbations and selectively introduces global geometry and specimen-warp models only when a reduced chi-squared adequacy test and Bayesian information criterion justify the added degrees of freedom. The same low-dimensional perturbation model is incorporated into marginalized Fisher-information analyses, yielding task-specific conditional and calibration-aware Cram'er-Rao bounds. Numerical experiments show that, under a fixed total photon budget, task-driven metrology changes little over 12-64 views, while reconstruction-driven metrology is strongly view-dependent with much larger errors. The direct estimator also follows the expected photon-limited scaling. These results demonstrate a computational sensing strategy in which XCT acquisition, physical modeling, and inference are evaluated according to the quantitative information required by the task rather than for general-purpose volumetric image fidelity.
382. 【2611.01511】OpenULF: A Modular Toolkit Enables Data-Driven Ultra-Low-Field MRI with both Classical and Quantum Sensors
链接：https://arxiv.org/abs/2611.01511
作者：Hanhan Wu,Yuchen Yuan,Weiwen Jiang
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Medical Physics (physics.med-ph)
关键词：Magnetic Resonance Imaging, Magnetic Resonance, Superconducting Quantum Interference, Quantum Interference Device, Resonance Imaging
备注： 8 pages, 6 figures, 3 tables. Accepted for publication in the 44th IEEE International Conference on Computer Design (ICCD 2026). Code available at [this https URL](https://github.com/Wu-Hanhan/OpenULF)
点击查看摘要
Abstract:Ultra-low-field (ULF) Magnetic Resonance Imaging (MRI) offers a portable, low-cost alternative to conventional scanners by operating at field strengths below 10 mT. At these fields, two sensor technologies compete: quantum SQUID (Superconducting Quantum Interference Device) sensors, which provide high sensitivity but require cryogenic cooling, and classical induction coils, which are inexpensive and room-temperature but produce weaker signals. With conventional physics-based imaging, both suffer from low signal-to-noise ratios (SNR). Data-driven reconstruction has overcome similar limits in related inverse problems, but its use for ULF-MRI has been hindered by a lack of open datasets, benchmarks, and flexible simulators. To close this gap, we present OpenULF, a modular, open-source simulation toolkit that generates paired training data and supports end-to-end machine-learning (ML) reconstruction. OpenULF integrates a Bloch-equation-validated physics simulator, calibrated SQUID and coil receiver models, reconstruction ML networks, and an automated design-space exploration engine. Architecturally, a receiver abstract base class, a typed HDF5 contract that decouples physics from learning, and a resumable sweep engine make sensors, models, and datasets independently substitutable. Using OpenULF, we train 774 models across four anatomical datasets and conduct three design-space explorations. The effectiveness of ML reconstruction depends strongly on the dataset and the sensor. We identify a SQUID-to-coil crossover near 450 $\mu$T and demonstrate that sensor hardware and ML model capacity can be traded off during system design. Sensor and reconstruction choices must therefore be co-designed: the best sensor is set by the dataset and field strength, not by SNR.
383. 【2611.01050】Adaptive Land Units from Earth Embeddings
链接：https://arxiv.org/abs/2611.01050
作者：Albert Alonso,Jamal Jokar Arsanjani,Andres R. Masegosa
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：spatial detail, computational budget, resolution is set, detail the process, process requires
备注： 13 pages, 5 figures, 3 tables, including supplementary material. Code and data at [this https URL](https://doi.org/10.5281/zenodo.23836328)
点击查看摘要
Abstract:Modeling land use starts with a choice of spatial units, typically a regular grid of pixels whose resolution is set by the spatial detail the process requires and, often more critically, by the computational budget. With Earth observation data more abundant than ever, we ask whether good land units can instead emerge from the data itself. To do that, we cluster AlphaEarth embeddings with a parallel Bayesian hierarchical clustering into adaptive land units, large where the land is uniform and small where it is highly heterogeneous. Using Denmark as a case study, we turn 402M land pixels into 1.27M newly defined units, about 320 times fewer, without any labels (i.e., unsupervised), making it possible to fit the whole country on a single consumer-grade GPU. Importantly, these units describe the land well, as a regular grid needs about 5 times as many cells to match them against land-use labels, and about 4 times as many against the declared crop of every field. Compared to clustering the satellite images themselves, the embeddings need half the units for the same purity. But more notably, they work as modeling units. Land-use maps learned on them are within a few points of accuracy of pixel models at a small fraction of the cost, and they make whole-country land-use estimates with reliable uncertainty possible in under a minute, where the same model on pixels does not even fit in device memory.
384. 【2611.00763】he MASSIMAL Dataset: UAV Hyperspectral Images and Ground Truth Observations for Coastal Habitat Mapping in Norway
链接：https://arxiv.org/abs/2611.00763
作者：Martin Hansen Skjelvareid,Eli Rinde,Kasper Hancke,Katalin Blix,Galice Guillaume Hoarau,Nicolo Grometto,Maia Røst Kile
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：mapping shallow water, MASSIMAL dataset, shallow water coastal, images, kelp forests
备注： 25 pages, 8 figures. Submitted to Scientific Data (part of Nature portfolio)
点击查看摘要
Abstract:The MASSIMAL dataset was collected in an effort to develop new remote sensing methods for mapping shallow water coastal habitats, such as kelp forests, seagrass meadows and maerl beds. The main component of the dataset is a set of hyperspectral images collected using a unmanned aerial vehicle (UAV). Images were collected during 45 UAV flights performed at 4 main areas along the Norwegian coast, spanning across a wide latitude range, from 59 to 67 degrees north. The ground sampling distance of the hyperspectral images is 3.5 cm, and the spectral range is 400-1000 nm, sampled across 300 spectral bands. During acquisition, push-broom imagery was automatically split into images with a maximum along-track length of 2000 lines. Out of approximately 1000 hyperspectral images, 221 have been annotated, using segmentation masks and a hierarchical taxonomy. An open source image processing pipeline has been developed as part of the dataset preparation, enabling efficient generation of reflectance images and glint-corrected images based on published radiance images. The dataset also includes color images (RGB) and multispectral images collected using UAV, and georeferenced image mosaics constructed from these. Ground truth data supporting the remote sensing images include hours of underwater video, thousands of geotagged underwater images, and tens of kilometers of single-beam sonar data. The data provide a foundation for assessing habitat distribution, tracking changes, and evaluating ecosystem services, thus supporting evidence-based management in Norwegian coastal environments.
385. 【2611.00238】Directional Dual-Head Supervision for Real-Time Source-Free Polyp Segmentation
链接：https://arxiv.org/abs/2611.00238
作者：Hai-Dang Nguyen,Nhat-Khoi Le,Huu-Thuan Huynh,Minh-Triet Tran,Trung-Nghia Le
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：preserving data privacy, unlabeled target domain, accessing source data, Source-free domain adaptation, Source-free domain
备注： Accepted to MMM 2027
点击查看摘要
Abstract:Source-free domain adaptation (SFDA) is critical for medical image segmentation as it adapts a model to an unlabeled target domain without accessing source data, thereby preserving data privacy. However, its effectiveness is often limited by confirmation bias: self-training models tend to miss small polyps, hallucinate foreground, and produce imprecise contours. We propose MedRT-SFSeg, a real-time SFDA framework built on a dual-head one-to-one/one-to-many YOLO segmentation architecture. Mask-DHF fuses precision- and recall-oriented predictions into stable pseudo-instances, while DURR uses the sign of pixel-level dual-head disagreement as a directional cue to expand or shrink masks, and additionally recovers missed instances and suppresses hallucinations. Seg-MARD further regularizes feature representations through mask-guided, region-stratified sampling. Experiments on bidirectional adaptation between Kvasir-SEG and CVC-ClinicDB show that MedRT-SFSeg achieves 80.43%/80.77% Dice and 5.53/8.44 mm ASD, improving the non-adapted baseline by 7.7 and 9.8 Dice points while running at more than 62 FPS end-to-end. These results suggest that segmentation-aware dual-head supervision can improve pseudo-label quality without sacrificing real-time inference. Project page: this https URL
386. 【2611.00192】VC-1K: A Diverse Video Test Set for Real-Time Communication
链接：https://arxiv.org/abs/2611.00192
作者：Yu-Chen Sun,Jie Dong,Sergey Sablin,Hassene Tmar,Sriram Srinivasan
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：introduce Video Conferencing, set comprising approximately, open-source test set, test set comprising, sequences specifically designed
备注： Accepted for publication at the 2026 IEEE International Conference on Visual Communications and Image Processing (VCIP 2026)
点击查看摘要
Abstract:We introduce Video Conferencing 1000 (VC-1K), an open-source test set comprising approximately 1,000 video sequences specifically designed for evaluating video processing and encoding pipelines in real-time communication (RTC) scenarios. Unlike existing test sets that primarily rely on studio-produced or screen content, VC-1K consists of user-generated video call content captured on consumer mobile devices under a wide variety of conditions. The dataset predominantly features talking-head sequences with distinct faces, but also includes a small subset of outward-facing, rear-camera videos without faces to reflect additional common RTC use cases. It spans a wide range of real-world variables including device type, lighting conditions, motion levels, indoor/outdoor environments, and demographic diversity. All video sequences are accompanied by synchronous audio to facilitate multimodal research. We detail the dataset's design methodology and statistical distribution, and demonstrate its utility through a comparative encoder evaluation of OpenH264, SVT-AV1, and libaom under constant bitrate (CBR) encoding at resolutions typical of RTC deployments. Furthermore, two super-resolution approaches, RealESRGAN and GFPGAN, are evaluated on VC-1K, highlighting the dataset as a useful benchmark for pre- and post-processing research. VC-1K is intended to serve as a publicly available dataset for the video RTC research community.
387. 【2611.00184】Does Vendor Image Processing Matter? Learning Echocardiography Display Appearance from Native Beamspace Data
链接：https://arxiv.org/abs/2611.00184
作者：Elias Stenhede,Arian Ranjbar
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：affect model performance, vendor-processed images, performance and robustness, reproduce General Electric, General Electric display
备注：
点击查看摘要
Abstract:Most echocardiography datasets contain vendor-processed images, but processing is often undocumented and may affect model performance and robustness. To address this, we train a small convolutional neural network to reproduce General Electric display appearance from native beamspace brightness-mode ultrasound, using 8 406 recordings from 605 unique patients. The beamspace CNN reduces test mean absolute error by 43% over the optimal pointwise brightness map, outperforms an equivalent Cartesian CNN and runs in real time on a CPU. Across the EchoXFlow and CAMUS datasets, unfiltered training followed by filtered evaluation yields the lowest mean Dice for every class, suggesting filtering may be useful as augmentation when evaluation data are filtered or their processing is unknown. Code and pretrained weights: this https URL
388. 【2611.00181】A Rate-Distortion Optimized Skip Mode Coding Framework for Neural Video Compression in AVS
链接：https://arxiv.org/abs/2611.00181
作者：Yuntian Jiang,Shuai Li,Yanbo Gao,Jinglin Zhang,Hui Yuan,Mao Ye
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：Skip mode coding, Audio Video Coding, Skip mode, mode coding, neural video compression
备注： Published in IEEE TCSVT
点击查看摘要
Abstract:With the development of deep learning, neural video compression (NVC) is gaining increasing interest and is currently under standardization in the AVS (Audio Video Coding Standard). Skip mode coding, a crucial component in the traditional video compression, is also adopted in AVS NVC. Although the skip mode takes a large portion in encoding the motion and residual features in the NVC, there is a lack of investigation on the rate distortion performance of the skip mode coding. In this paper, we first thoroughly investigate the rate and distortion distribution in the skip mode coding within a spatial frame and under different temporal reference qualities, and demonstrate that distortion distribution changes spatially and temporally. Therefore, a rate-distortion optimized skip mode coding (RDOSkip) framework is proposed, where the rate and distortion in the skip mode coding is formulated based on a statistical distribution predicted by the hyperprior and the Bayes' theorem. An adaptive skip mode decision method based on spatial-temporal joint RD optimization is developed for the skip mode coding among channels and frames in a group of pictures. It addresses the limitation of the rigid fixed-distortion distribution assumption in skip mode coding within the existing methods that rely on a fixed skip threshold. The temporal skip mode decision method has been adopted in the ongoing AVS NVC standard and incorporated into the reference software. The proposed RDOSkip can be directly used in the inference without any training and with negligible complexity increase. Experimental results further demonstrate that the proposed RDOSkip can improve the performance by 0.90% and 1.29% on AVS and HEVC datasets, respectively, in terms of BD-rate saving.
389. 【2611.00157】FlowFPR: Flow Matching Prior for Oversampled Fourier Phase Retrieval
链接：https://arxiv.org/abs/2611.00157
作者：Li Jiatai,Cao Wenfei,Chen Yang
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：channel ambiguities make, color-image recovery challenging, Fourier phase retrieval, ambiguities make natural, make natural color-image
备注： 14 pages, 4 figures
点击查看摘要
Abstract:Fourier phase retrieval reconstructs images from magnitude measurements without phase information, but noise and channel ambiguities make natural color-image recovery challenging. Although diffusion-prior methods provide strong image constraints, their recovery can deteriorate under stronger measurement noise, and repeated generative updates incur substantial computational cost. This paper proposes FlowFPR, which integrates a pretrained Flow Matching prior with relaxed averaged alternating reflections for oversampled Fourier phase retrieval. Each outer iteration obtains a clean image estimate through a single time-dependent Flow prediction, applies measurement-consistency correction, and reconstructs the next path state after fusing the two candidates. This process requires no backpropagation of measurement errors through the Flow network. To address ineffective or excessive correction caused by prescribed fusion weights and fixed inner depths, we introduce adaptive fusion based on residual improvement and a controlled inner search combining early stopping with best-so-far candidate selection. Their combination yields a joint variant alongside the basic method and the two independent improvements. Experiments on natural face images under a common ground-truth-assisted multiple-restart evaluation protocol show that the joint variant achieves the best mean quality among the evaluated methods at the two tested nonzero noise levels, while same-hardware timing demonstrates lower end-to-end runtime than the diffusion-based baselines.
390. 【2611.00151】Interpretable Multiple-Instance Learning of Glomerular Pathomics and Subtype Ratios for eGFR Classification
链接：https://arxiv.org/abs/2611.00151
作者：Tianyu Shi,Yuechen Yang,Leiyue Zhao,Daniel Reisenbüchler,Jing Jin,Thangamani Muthukumar,Kenji Ikemura,Mert R. Sabuncu,Yihe Yang,Ruining Deng
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：Chronic kidney disease, Chronic kidney, kidney disease, disease is characterized, characterized by structural
备注：
点击查看摘要
Abstract:Chronic kidney disease is characterized by structural alterations in renal tissue and progressive loss of kidney function. While glomerular subtype ratios provide a compact and clinically meaningful summary of glomerular composition, representing pathomic information using whole-slide image (WSI)-level mean values diminishes glomerulus-level heterogeneity and the contribution of less prevalent patterns. In this proof-of-concept study, we investigated whether modeling individual glomeruli using multiple-instance learning (MIL) could provide complementary information to conventional subtype ratios for estimated glomerular filtration rate (eGFR) classification. We analyzed 162 kidney-biopsy WSIs from 162 patients, categorizing renal function as eGFR 60 or = 60 mL/min/1.73 m^2. Quantitative size, shape, intensity, and texture features were extracted from segmented glomeruli, representing each patient as a bag of glomerular instances. An attention-based MIL model was trained to aggregate these heterogeneous pathomic profiles. We evaluated subtype ratios, pathomics, and their combination using ABMIL, with a mean-pooled multilayer perceptron baseline. In five-fold cross-validation, the subtype-ratio-only model achieved an AUC of 0.7262 +/- 0.0596. MIL using pathomics alone achieved an AUC of 0.7362 +/- 0.0788, whereas integrating pathomics with subtype ratios produced the highest mean AUC of 0.7630 +/- 0.0665. SHapley Additive exPlanations (SHAP) were used to examine individual feature contributions. These results demonstrate that MIL-based pathomics can complement established glomerular subtype ratios by capturing additional glomerulus-level information for quantitative kidney-biopsy analysis.
391. 【2611.00150】Contrastive Astromer: Two-Stage Contrastive Representation Learning for Astronomical Light Curve Classification
链接：https://arxiv.org/abs/2611.00150
作者：Justin Minggan Wei,Pavlos Protopapas,Guillermo Cabrera-Vives
类目：Instrumentation and Methods for Astrophysics (astro-ph.IM); Computer Vision and Pattern Recognition (cs.CV)
关键词：Large astronomical surveys, labels remain scarce, astronomical surveys collect, surveys collect abundant, Large astronomical
备注：
点击查看摘要
Abstract:Large astronomical surveys collect abundant light curves, but reliable class labels remain scarce. ASTROMER 2 learns from unlabeled light curves by reconstructing masked observations, yet this objective does not explicitly encourage class separation in a compact representation of each light curve. We introduce Contrastive Astromer, a two-stage approach that makes these representations more useful for classification without changing the ASTROMER 2 encoder architecture. First, unsupervised contrastive learning on single-band MACHO light curves brings together representations of augmented views of the same object. Supervised contrastive learning, supported by an auxiliary classification loss, then uses a separate labeled Alcock sample to strengthen class discrimination. We evaluate the resulting representations by freezing the encoder and training a separate classifier. On a held-out set of 600 objects, this classifier achieves a macro-F1 of 0.7943 with 500 labeled examples per class, exceeding our reproduction of the ASTROMER 2 finetune-and-classify pipeline by 5.10 percentage points. With downstream classifier training budgets of 20 and 100 examples per class, macro-F1 reaches 0.7078 and 0.7704, respectively, also surpassing this baseline. Embedding-space analyses further show that supervised adaptation improves local class consistency and global class separation. These results show that contrastive adaptation makes pretrained light-curve representations more effective for classification and more informative about the structure of variability classes.
392. 【2611.00140】oward Contrast-Free Breast MRI: Improving Cancer Detection With Virtual Contrast Enhanced Imaging
链接：https://arxiv.org/abs/2611.00140
作者：Hongxi Chen,Sunwoo Kwak,Sanyukta Adap,Katerina Dodelzon,Paula Feldman,Mert R. Sabuncu
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：intravenous gadolinium administration, gadolinium administration introduces, administration introduces additional, introduces additional considerations, VCE MRI
备注： 5 pages, 2 figures, 1 table. Submitted to ISBI 2027
点击查看摘要
Abstract:Although contrast-enhanced (CE) breast MRI is an important tool for cancer detection, intravenous gadolinium administration introduces additional considerations for patients and clinical workflows. AI based virtual contrast enhanced (VCE) MRI could help identify patients for whom acquired CE imaging may be avoidable without compromising diagnostic performance. We developed a framework that combines non contrast (NC) and VCE MRI predictions for cancer detection. On the held-out test set, cancer detection using NC MRI alone achieved an AUROC of 0.865. Combining the predictions from NC and VCE MRI improved AUROC to 0.901. Building on this complementary predictive value, we evaluated patient-level routing to progressively replace acquired CE examinations with the NC plus VCE pathway, prioritizing patients with the most confident NC predictions. This simulation suggests that diagnostic performance can be largely preserved while limiting acquired CE imaging to approximately 40% of patients. Together, these findings demonstrate the complementary value of VCE MRI and suggest its potential to support selective contrast use in breast cancer screening.
393. 【2611.00038】ropical Cyclone Wind Field Diagnosis with Image-to-Image Models
链接：https://arxiv.org/abs/2611.00038
作者：Sarah J. Ollier,David S. Nolan,Brian D. McNoldy,Eduardo Siman
类目：Atmospheric and Oceanic Physics (physics.ao-ph); Computer Vision and Pattern Recognition (cs.CV)
关键词：generative adversarial networks, complete tropical cyclone, infrared brightness temperature, wind fields, wind
备注： Preprint prior to peer review. Submitted to Artificial Intelligence for the Earth Systems on 8th September 2026
点击查看摘要
Abstract:This study presents a novel application of image-to-image generative adversarial networks (GANs) to produce a complete tropical cyclone (TC) surface wind field diagnosis from a single frame of satellite infrared brightness temperature (IR). Because TC surface wind fields are infrequently observed, we train on two data sets. The first contains 3,323 image pairs of IR and wind fields from Weather Research and Forecasting Model (WRF) simulations (WRF2WRF). The second contains 11,886 real IR satellite images paired with parametric wind fields built on the extended best-track data set (IBTrACS) of TC intensities and wind radii (GOES2PARA). Both models, conditioned on storm intensity, motion, and latitude, transform single-channel IR into wind fields over 6$^{\circ} \times$ 6$^{\circ}$ (WRF2WRF) and 7$^{\circ} \times$ 7$^{\circ}$ (GOES2PARA) domains, at 256 $\times$ 256 pixel resolution. GOES2PARA captures outer wind field asymmetries, enabling diagnosis of 64, 50, and 34-knot wind radii (R64, R50, R34) in each quadrant. WRF2WRF also produces detailed rainbands and eyewall asymmetries. Pixel-wise RMSE against held out truth demonstrates realistic wind field generation with mean RMSE of 6.4 knots (GOES2PARA) and 7.2 knots (WRF2WRF). Compared against IBTrACS, WRF2WRF achieved mean absolute errors (MAE) of 14.8 nautical miles (NM) for radius of maximum wind (RMW) and 25.9 NM for R34. GOES2PARA achieved 10.0 NM MAE for RMW and 25.9 NM for R34. Against Synthetic Aperture Radar wind fields GOES2PARA yielded a lower mean pixel-wise error (RMSE 12.1 kt, MAE 9.5 kt) than WRF2WRF (RMSE 13.9 kt, MAE 11.3 kt). Unlike many existing operational surface wind speed algorithms, our image-to-image models provide updated wind fields with every new satellite image.
394. 【2611.00003】InSARFlow: Riemannian Flow Matching for Interferometric SAR
链接：https://arxiv.org/abs/2611.00003
作者：Georges Le Bellier(LIP, OCKHAM, CEDRIC - VERTIGO),Arnaud Breloy(CEDRIC - VERTIGO),Nicolas Audebert(IGN, CEDRIC - VERTIGO, UR-LSTI-ENSMSE)
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Signal Processing (eess.SP)
关键词：Interferometric synthetic aperture, synthetic aperture radar, aperture radar, enables the analysis, urban areas
备注：
点击查看摘要
Abstract:Interferometric synthetic aperture radar (InSAR) enables the analysis of topological changes in natural sites or urban areas. This technique operates by recovering the surface displacement from the study of the phase difference (interferogram) between two or multiple SAR images of the same scene at different times. In practice, the use of phase denoising algorithms is necessary to extract relevant information from the interferograms, which motivated numerous developments in the past decade. Due to the inherent periodicity of phases, interferograms can naturally be represented as points on a Riemannian manifold (specifically, the flat torus). This strong prior knowledge motivates the design of learning-based methods that respect the interferogram's intrinsic geometric constraints. Building on this observation, this paper introduces InSARFlow: a generative modeling framework for the denoising and generation of interferograms. Unlike conventional deep learning approaches formulated in Euclidean spaces, which may violate phase periodicity and produce invalid estimates, this method leverages Riemannian flow matching to learn distributional transports directly on the torus. The interest of this approach is demonstrated on two use cases: (1) realistic interferogram generation, in which we model the transport between uniform noise on the torus to real-world interferograms; (2) interferogram denoising, where InSARFlow transports noisy interferograms to their denoised counterparts. Extensive experiments on a controlled synthetic dataset validate the effectiveness of InSARFlow for interferogram denoising. The proposed approach consistently outperforms studied baselines, highlighting the benefits of geometry-aware learning on the torus. Code and weights available at this https URL.
395. 【2610.42111】SATFRONT: Detecting Atmospheric Fronts with Satellite Data using Machine Learning
链接：https://arxiv.org/abs/2610.42111
作者：Ioannis Dravilas,Miruna Stoicescu,Roope Tervo,Carlos Horn,Oriol Hinojo Comellas,Sina Montazeri,Andrea Meraner,Ana Lucic
类目：Atmospheric and Oceanic Physics (physics.ao-ph); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：classification remain largely, remain largely manual, manual and subjective, Atmospheric fronts, high-impact weather
备注：
点击查看摘要
Abstract:Atmospheric fronts are associated with much of the high-impact weather in the mid-latitudes, yet their identification and classification remain largely manual and subjective. Existing deep learning approaches rely primarily on gridded reanalysis or forecast data, limiting their applicability to satellite observations available for time-critical applications. We introduce SATFRONT, a machine learning framework for detecting cold, warm, and occluded fronts over Europe from geostationary satellite observations, with reanalysis data as an optional additional input. The model is trained on frontal analyses from five European national meteorological services and evaluated against UK Met Office analyses for 2024. Using satellite observations alone, SATFRONT achieves a Critical Success Index (CSI) of 0.428 at a 150 km tolerance, within the range of agreement between analyses from different meteorological services (0.277-0.501) and higher than that of an operational rule-based front detector that uses satellite data (0.133). Adding ERA5 reanalysis increases the CSI to 0.591. ERA5 substantially improves the placement of individual fronts, although its effect on their annual spatial distribution varies by front type. These results demonstrate that cold, warm, and occluded fronts can be detected directly from geostationary satellite observations, providing a basis for automated frontal analyses at the high temporal frequency required for time-critical applications.
396. 【2610.40702】Anchored Fusion for Automated Airway Segmentation in Pediatric and Adult CT
链接：https://arxiv.org/abs/2610.40702
作者：Huseyin Umut Isik,Ege Mert Balcik,Duygu Atasoy,Asutosh Sahu,Seyda Ertekin,Sila Kurugol
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：enables branch-level measurement, peripheral bronchi remain, bronchi remain hard, annotated scans exist, size and growth
备注： 9 pages, 3 figures, 2 tables. Code, weights and web application: [this https URL](https://github.com/quin-med-harvard-edu/airway-seg)
点击查看摘要
Abstract:Airway segmentation from chest CT enables branch-level measurement of airway size and growth, but peripheral bronchi remain hard to segment, particularly in children, whose airways are smaller and for whom few annotated scans exist. Different models recover complementary branches of the airway tree. Their union improves overall tree coverage but also introduces disconnected non-airway objects. We propose anchored fusion (A-Fuse), which takes the voxel-wise union of TfeNet, a retrained MEDPSeg and a reimplemented AirMorph and retains the connected component with greatest overlap with the AirMorph mask. On 30 held-out adult CTs from the ATM'26 training set, A-Fuse reaches a Dice score of 93.24% and the highest branch detection rate among compared methods (92.05%). On nine pediatric scans, it reaches 94.15% Dice and 68.79% branch detection. A-Fuse retains the airway tree in all 39 test scans, whereas keeping the largest component selects a non-airway object in four. A-Fuse is deployed as an automated web application and we release all code, trained weights and an open-source ITK-SNAP extension for 3D tubular segmentation editing.
