本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。
统计
今日共更新1646篇论文，其中：
- 自然语言处理207篇
- 信息检索35篇
- 计算机视觉319篇
自然语言处理
1. 【2611.12872】HiVe-Mem: Interleaving Horizontal Memory Expansion and Vertical Evidence Composition for Multimodal Agents
链接：https://arxiv.org/abs/2611.12872
作者：Haozhen Zhang,Bohan Liu,Jianzhu Bao,Qingyuan Liu,Haodong Yue,Xiao Li,Zi Pong Lim,Wenya Wang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：agents accumulate increasingly, accumulate increasingly long, long interaction histories, increasingly long interaction, multimodal agents accumulate
备注： Code is available at [this https URL](https://github.com/ViktorAxelsen/HiVe-Mem)
点击查看摘要
Abstract:As multimodal agents accumulate increasingly long interaction histories, effectively retrieving and utilizing past information becomes critical for long-term interaction. Existing memory systems typically rely on semantic retrieval over compressed memories and expose predefined representations, which may miss relevant memories and overlook heterogeneous evidence needs across queries. We introduce \textbf{\hivemem}, a multimodal memory framework that interleaves \textbf{\textsc{H}}or\textbf{\textsc{i}}zontal Memory Expansion with \textbf{\textsc{Ve}}rtical Evidence Composition. For horizontal memory expansion, \hivemem organizes memory episodes into a relational graph using textual and visual anchors, expanding semantically retrieved seeds with related neighbors to recover complementary information. For vertical evidence composition, each retrieved memory retains multiple evidence forms, including compact summaries, captions, grounded visual views, raw images, and interaction history. A lightweight trainable selector independently composes an evidence subset for each retrieved memory, enabling query-adaptive utilization of heterogeneous multimodal information. This two-dimensional design jointly broadens memory coverage and adapts the evidence contributed by individual memories. Experiments across three multimodal memory benchmarks show that \hivemem consistently improves task performance across base models while reducing token consumption by about 90\% compared with the most efficient competing multimodal baselines.
2. 【2611.12864】Is Persona Generalization Predictable?
链接：https://arxiv.org/abs/2611.12864
作者：Olina Mukherjee,Arnav Goel,Aditi Raghunathan,Jacob Mitchell Springer
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Persona generalization occurs, domain induces behavioral, Persona generalization, domain induces, observed in emergent
备注： 55 pages
点击查看摘要
Abstract:Persona generalization occurs when fine-tuning a language model in one domain induces behavioral changes in others -- for example, the broadly unsafe behavior observed in emergent misalignment. We discover a surprising "on-the-line" phenomenon in persona generalization: in-domain and out-of-domain persona rates across various fine-tuning hyperparameters follow an approximately probit-linear relationship, and the specific probit-linear relationship is surprisingly shared even across model families and model sizes, including Qwen and Llama. Training choices that leave the set of trainable parameters unchanged, such as learning rate, weight decay, and training duration, largely move models along the same line, reducing transfer mainly by weakening in-domain learning. Changing which layers are fine-tuned, however, can change the slope. For unsafe behavior, fine-tuning only later layers yields shallower slopes, retaining strong in-domain learning while reducing out-of-domain misalignment. This "on-the-line" phenomenon unifies unexpected, isolated observations of persona generalization within a quantitative framework for predicting and controlling behavioral transfer.
3. 【2611.12856】WorkflowArena: Benchmarking Executable Workflow Orchestration in LLM-Based Multi-Agent Systems
链接：https://arxiv.org/abs/2611.12856
作者：Zheng Jiang,Fang Niu,Bo Peng,Houde Qian,Wenyi Li,Deyao Hong,Mingju Gao,Yizhe Chi,Youjie Zheng,Kaisen Yang,Calvin Xiao,Lifeng Sun,Huan-ang Gao
类目：Computation and Language (cs.CL); Software Engineering (cs.SE)
关键词：Large language model, Large language, standalone model operating, increasingly deployed, deployed as multi-agent
备注： Project page: [this https URL](https://lab.einsia.ai/workflowarena)
点击查看摘要
Abstract:Large language model agents are increasingly deployed as multi-agent systems rather than as a standalone model operating within a single context. Recent agent harnesses allow the model to instantiate worker agents and to author the executable workflow that coordinates them, shifting the design of system structure from developers to the model at run time. The quality of this organization therefore constitutes a distinct capability, yet existing benchmarks either measure end-to-end task completion or evaluate coordination under structures specified in advance. We formalize this capability as workflow orchestration and introduce WorkflowArena, a benchmark of 145 long-horizon tasks spanning 8 professional domains, from software engineering and formal mathematics to legal analysis and 3D production. Each task specifies an initial workspace and an integrated deliverable composed of interdependent components, which is assessed by a hidden verifier. Agents determine autonomously whether and how to delegate, and all delegation is recorded, enabling joint evaluation of deliverable quality and the organization of the underlying work. Experiments with nine models show that no single configuration performs best across all domains and that systems exhibit distinct delegation strategies: at high effort, Claude models in Claude Code invoke workflows less frequently but with larger worker groups, whereas GPT models in Codex delegate more frequently in smaller units. When the executing model is held fixed on a challenging subset of tasks, workflows authored by Claude Opus 5.5 substantially improve weaker executors, indicating that workflow organization is itself a measurable determinant of task performance.
4. 【2611.12820】How Well Does AI Peer Review Work? A Benchmark Built from 100 Planted Errors
链接：https://arxiv.org/abs/2611.12820
作者：Paul Litvak
类目：Computation and Language (cs.CL)
关键词：open-access psychology papers, open-access psychology, review tools, run through frontier, commercial AI review
备注： 5 pages; accepted at Cognitive Security for Human-AI Systems (CogSec 2026), a non-archival workshop at ACM HCOMP / CI 2026
点击查看摘要
Abstract:One hundred known errors were planted into 10 open-access psychology papers, and the modified papers were then run through frontier models and two commercial AI review tools. The best single system caught 71 of the 100 errors, while the worst caught 30. Pooling every system's output caught 93. Models are only partly correlated in the errors they find, which makes ensembling a big lever for finding issues in papers. Seven errors could not be caught by any system, and all seven were omissions: information deleted from a paper rather than mistakes inserted into it. this http URL contributes more unique catches than any other single system, though it is expensive on a per-error basis. False positives were not measured, and how this error distribution compares to the distribution of errors in real papers remains unknown. The papers, errors, model outputs, and full experiment log are public, so that others can build on this toward a comprehensive evaluation benchmark across disciplines.
5. 【2611.12814】Curbside Chatbots: Auditing the Mental Health Interventions Large Language Models Recommend to Clinicians, Caregivers, and Patients
链接：https://arxiv.org/abs/2611.12814
作者：Matthew Flathers,Jill Noorily,Phuong Anh Nguyen,Mark Kalinich,Mina Fallah,Victoria Lisowski,Christine Shi,Rebekah M. Bodner,Anna Simms,Mihika Hete,Meiting Chen,Samuel K. Powell,Tatum Williamson,Laura Ospina-Pinillos,Haruka Notsu,Julian Herpertz,John Torous
类目：Computers and Society (cs.CY); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
关键词：mental health questions, models mental health, language models mental, receiving answers, mental health
备注： 100 pages: 30 page main text and references, 70 page appendix. 7 figures, 2 tables. Results explorer: [this https URL](https://mindbench.ai/audits/interventions)
点击查看摘要
Abstract:Users are asking language models mental health questions and are receiving answers. We audited what 41 language models recommend to users when the same clinical information reaches them from three footings: a clinician describing a patient, a caregiver describing a loved one, or a person describing themselves. Across 19 case vignettes and five questions, we collected 35,055 free-text responses, extracted every intervention named with a validated judge, and had 29 models rate the full option lists on a seven-point Likert scale for the same cases. Models largely recommend what they rate well, with recommendation behavior differing by footing, and many models offering clinicians a consultation-style response and lay users hedged, simplified advice. When asked about recommendations for a specific intervention type, models more often named options they themselves rated below zero as initial choices, usually with conditions attached. We will release the instrument, code, and full corpus on publication as a living audit.
6. 【2611.12791】Large Language Models as a Universal Searcher for Open-World Automated Machine Learning
链接：https://arxiv.org/abs/2611.12791
作者：Yuxuan Hu,Jihao Liu,Weikang Shi,Xijie Huang,Linda Wei,Mingjie Zhan,Aojun Zhou,Rui Liu,Hongsheng Li
类目：Computation and Language (cs.CL)
关键词：Developing effective machine, current Automated Machine, complex manual tuning, requires complex manual, isolate model architecture
备注：
点击查看摘要
Abstract:Developing effective machine learning models requires complex manual tuning, while current Automated Machine Learning (AutoML) frameworks remain domain-specific and isolate model architecture, training hyperparameter, and data ratio optimization. Here, we bridge this gap by proposing a universal, large language model (LLM)-based AutoML framework that jointly optimizes these configurations for the first time without the need for task-specific fine-tuning. We propose NCode, a unified numerical encoding scheme that translates diverse AutoML design choices into universal discrete sequences and effectively reframes the optimization process as a unified ranking task. Trained solely on optimization trajectories derived from a limited, single-domain vision task, the proposed LLM-based searcher demonstrates impressive cross-task, cross-modality and joint search-space optimization generalizability, achieving state-of-the-art performance across image classification, image segmentation, speaker verification and text-to-image benchmarks. Crucially, it exhibits superior scalability in the large-scale training and joint optimization of a billion-parameter Diffusion Transformer, requiring 896 GPU-days and attaining a state-of-the-art GenEval score of 0.91. By leveraging reinforcement learning to instill Chain-of-Thought reasoning, we provide a systematic way to interpret the LLM-based searcher's internal decision-making mechanisms, revealing its optimization strategy shifted from the early-stage diversity-driven exploration to the late-stage anchor exploitation. Our proposed framework provides a scalable, generalizable, and interpretable pathway toward general-purpose open-world machine learning optimization.
7. 【2611.12763】PORT: Preference Optimization via Robust Token-Level Reweighting
链接：https://arxiv.org/abs/2611.12763
作者：Ding Zhu,Xiukun Wei,Tian Xie,Zhihui Zhu,Xueru Zhang,Mohammad Mahdi Khalili
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：aligning large language, large language models, effectiveness depends heavily, textbf, central approach
备注： 10 pages, 4 figures, neurips 2026
点击查看摘要
Abstract:Preference optimization has become a central approach for aligning large language models with human values, but its effectiveness depends heavily on the quality of preference annotations. In practice, preference data is often noisy due to annotation errors and ambiguity. Existing robust preference optimization methods primarily operate at the sequence level, implicitly treating entire responses as uniformly correct or incorrect. However, rejected responses may still contain informative reasoning steps, while preferred responses can include subtle errors. In this work, we propose \textbf{P}reference \textbf{O}ptimization via \textbf{R}obust \textbf{T}oken-level reweighting \textbf{(PORT)}, a fine-grained framework for robust alignment under noisy preferences. PORT performs token-level reweighting using the empirical cumulative distribution function (CDF) of token log-probabilities, yielding an efficient forward-pass-only proxy to gradient-norm penalization that selectively suppresses corrupted tokens without additional backward-pass computation. We provide theoretical analysis showing that PORT reduces the gradient bias from noisy preference labels by minimizing an upper bound on the bias term. Extensive experiments across diverse noise settings demonstrate that PORT consistently improves robustness and outperforms existing sequence-level baselines. The code is available at this https URL
8. 【2611.12750】he Narrative Gap: Can LLMs Help Us Navigate Diverse Narratives Across Languages?
链接：https://arxiv.org/abs/2611.12750
作者：Nikhil Sharma,Kelly Marchisio,Kenton Murray,Ziang Xiao
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Information Retrieval (cs.IR)
关键词：Large language models, Large language, increasingly mediate, information, mediate how people
备注： NeurIPS 2026 Evaluations and Dataset Track
点击查看摘要
Abstract:Large language models (LLMs) increasingly mediate how people seek and consume information, including accounts that differ across languages and regions, especially on contested topics. Supporting diverse information seeking requires models to help users navigate competing narratives across languages and information streams. We define six capabilities necessary for diverse multilingual information seeking: three foundational capabilities for narrative inclusion, narrative exclusion, and missing narrative identification; and three higher-level capabilities for presenting diverse narratives, preserving narrative coverage under confirmatory queries, and maintaining information parity across languages. To guide the development of those information seeking capabilities, we introduce \textsc{NarrativeBench}, a benchmark comprising 1,333 news articles in 23 publication languages across 23 contested topics and 460 Reddit-grounded queries. Evaluating 14 LLMs across 24 query languages, we find that current models lack the capabilities needed to reliably navigate diverse narratives, limiting users' control over the perspectives they receive and leaving substantial gaps in exposure to competing accounts even when diversity is explicitly requested. Information access also differs across query framings and languages, risking echo chambers, linguistic filter bubbles, and information disparities that weaken the common ground needed for democratic discourse. \textsc{NarrativeBench} provides a foundation for developing information systems that give users across languages and regions agency to navigate diverse narratives.
9. 【2611.12728】Safe Reinforcement Learning for Multi-Turn Clinical Agents: When Dense Rewards Beat Outcome Rewards
链接：https://arxiv.org/abs/2611.12728
作者：Brendan P. Murphy,Agustina Saenz
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：language model reasoning, remain poorly understood, improve language model, decision procedures remain, procedures remain poorly
备注： 31 pages, 11 figures. Code: [this https URL](https://github.com/csbrendan/Safe-Reinforcement-Learning-for-Multi-Turn-Clinical-Agents)
点击查看摘要
Abstract:Reinforcement learning with verifiable rewards is increasingly used to improve language model reasoning, yet its effects on sequential decision procedures remain poorly understood. We study this problem in clinical multi-turn agents that must decide what information to request, when to stop gathering evidence, and which action to take. We introduce three controlled environments: medication refill triage, acute diagnostic work-up, and dosing titration, each with hidden clinical states, query costs, exact adaptive oracles, and deterministic outcome verifiers. Across these tasks, outcome-only group relative policy optimization often improves aggregate reward while producing undesirable procedures, including premature commitment, one-question collapse, and failures on rare high-risk cases. In diagnostics, assigning dense credit to questions that reduce uncertainty improves held-out value and moderate-case support across three training seeds relative to outcome-only reinforcement learning, without the high-risk seed collapse observed under outcome-only training. Separating exploration from exploitation further increases high-risk support at its best checkpoint, but at the cost of excessive information gathering on low-acuity cases. Additional experiments show that the optimal strength of process credit is task-dependent; that after a supervised warmup that already gathers carefully, reinforcement learning raises aggregate reward by trimming questions while degrading high-risk performance; and that reinforcement learning does not reliably repair rare behavior gaps inherited from biased supervised data. Verifiable final outcomes are therefore insufficient for training reliable multi-turn agents: reward design must account for the procedure used to reach an answer, and evaluation must distinguish adaptive information gathering from reward-exploiting shortcuts.
10. 【2611.12709】A local language model layered with rule-based and neural detectors for clinical text de-identification: an open-source toolkit and evaluation
链接：https://arxiv.org/abs/2611.12709
作者：Valentin Burkin
类目：Computation and Language (cs.CL); Computers and Society (cs.CY); Software Engineering (cs.SE)
关键词：protected health information, toggle, locally hosted large, clinical named-entity recognition, clinical NER model
备注： 17 pages, 2 figures, 4 tables; supplementary material as ancillary file. Code: [this https URL](https://github.com/valburkin/DeidSharp)
点击查看摘要
Abstract:Objectives: To measure whether a locally hosted large language model (LLM), stacked with deterministic and clinical named-entity recognition (NER) detectors, finds more protected health information (PHI) than open tools, and at what precision. Materials and Methods: DeidSharp, an open-source .NET toolkit, combines the findings of pluggable detectors (patterns, a clinical NER model, a local 26B mixture-of-experts LLM) and fails closed on any detector error. Configurations fixed on tuning halves were compared, under a prespecified protocol, with deid, Philter, the Stanford/Penn de-identifier, OpenAI Privacy Filter and GLiNER on reporting halves of PhysioNet's nursing notes (889 spans) and semi-synthetic MIMIC-IV-Note discharge summaries (29,023 spans), and on synthetic ASQ-PHI queries, with paired patient-level bootstrap intervals. Results: In the nursing notes, against Stanford/Penn, the recall-first stack found 98.9% of PHI (+2.8, 95% CI 1.4 to 4.4) at 9.3 points lower precision; the precision-first stack, without NER, found 96.5%, matching Stanford/Penn, at 19.6 points higher precision (83.2%). In the discharge summaries, both stacks led Stanford/Penn by more than 20 points (recall-first 95.3%, +21.5, 20.5 to 22.4), almost entirely on generated untyped names; on typed labels all three exceeded 99%. All four prespecified comparisons held. No configuration beat deid significantly on its home corpus; Philter found more discharge-summary spans than the recall-first stack at 23 points lower precision. Discussion: The LLM was the main detector and NER added place names; asked to verify its own findings, the LLM discarded a quarter of true PHI. Conclusion: A local LLM layered with deterministic detectors offers recall-first and precision-first operating points without sending text off-site.
Comments:
17 pages, 2 figures, 4 tables; supplementary material as ancillary file. Code: this https URL
Subjects:
Computation and Language (cs.CL); Computers and Society (cs.CY); Software Engineering (cs.SE)
Cite as:
arXiv:2611.12709 [cs.CL]
(or
arXiv:2611.12709v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2611.12709
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Valentin Burkin [view email] [v1]
Mon, 9 Nov 2026 17:02:05 UTC (255 KB)
function toggleList(whichLayer,toggleThis)
{
var elem, vis;
if( document.getElementById ) // standard
elem = document.getElementById( whichLayer );
else if( document.all ) // old msie versions
elem = document.all[whichLayer];
else if( document.layers ) // nn4
elem = document.layers[whichLayer];
vis = elem.style;
// if the style.display value is blank we try to figure it out here
if(vis.display==''!=undefined!=undefined)
vis.display = (elem.offsetWidth!=0!=0)?'inline':'none';
vis.display = (vis.display==''||vis.display=='inline')?'none':'inline';
// toggle link inner text
status = vis.display;
if(vis.display=='inline'){
document.getElementById('toggle').innerHTML = "(collapse list)";
document.getElementById('toggle').title = "Collapse list";
} else {
document.getElementById('toggle').innerHTML = "("+toggleThis+")";
document.getElementById('toggle').title = "Show complete list";
}
}
Full-text links:
Access Paper:
View a PDF of the paper titled A local language model layered with rule-based and neural detectors for clinical text de-identification: an open-source toolkit and evaluation, by Valentin BurkinView PDFHTML (experimental)TeX Source
view license
Ancillary-file links:
Ancillary files (details):
supplementary.pdf
Additional Features
Audio Summary
Current browse context:
cs.CL
prev
|
next
new
|
recent
| 2026-11
Change to browse by:
References Citations
SciXGoogle Scholar
Semantic Scholar
export BibTeX citation
Loading…
BibTeX formatted citation
loading…
Data provided by:
Bookmark
checked="checked"class=“labs-tab-input”>
Bibliographic Tools
Bibliographic and Citation Tools
Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media
Code, Data and Media Associated with this Article
alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos
Demos
Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
Related Papers
Recommenders and Search Tools
Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
Author
Venue
Institution
Topic
About arXivLabs
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv’s community? Learn more about arXivLabs.
Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)
mathjaxToggle();
We gratefully acknowledge support from our major funders,
member institutions, ,
and all contributors.
About
Help
Contact
Subscribe
Copyright
Privacy
Accessibility
Operational Status (opens in new tab)
11. 【2611.12691】A Lattice-Based HMM Approach to Aruz Scansion of Ottoman Poetry
链接：https://arxiv.org/abs/2611.12691
作者：Mehmet Emre Tiryaki
类目：Computation and Language (cs.CL)
关键词：Ottoman Divan poetry, quantitative meter based, Ottoman Divan, Divan poetry, composed in aruz
备注： 14 pages, 5 figures, 8 tables. Code: [this https URL](https://github.com/MehmetETiryaki/aruz-paper) . Web tool: [this https URL](https://mehmetemretiryaki.com/aruz)
点击查看摘要
Abstract:Ottoman Divan poetry is composed in aruz, a quantitative meter based on the weights of syllables. The meter is sensitive to specific characters recorded in the original writing in the Arabic script. This work is concerned with automatic meter finding and scansion alignment for Ottoman Divan poetry, especially on modern Turkish spelling without the special diacritics that scholarly transliterations of Ottoman preserve. We define two tasks on this input, first identifying the meter used in the poem, and second aligning the meter's weights with the syllabification of the poem, identifying the flaws and freedoms the poet has taken along the way. We build a corpus of 52,000 lines split by poet, with scansion annotations for 500 test lines, and a robustness benchmark generated at the deviation rates measured on real web and OCR copies. Our model is a hidden Markov model over the positions of each meter, decoded over a lattice of every candidate path, and trained by EM from the printed meter, without scansion labels. On a held-out set it scans 77.6% of the test lines fully correctly, against 26.8% for the available rule-based scanner, 55.0% for a neural tagger trained with the same supervision and 63.6% for Claude Opus 5.5 few-shot. The code is open-sourced and the tool is released on the web.
12. 【2611.12640】rialDesignBench: Benchmarking Language Models for Phase-I Trial Design Against Clinical Knowledge
链接：https://arxiv.org/abs/2611.12640
作者：Yihan Hank Tang(1),Peng Yang(2),Jiayi Xin(1),Tianqi Shang(1),Xuyang Chen(1),Ying Yuan(2),Yi Lian(1),Qi Long(1) ((1) University of Pennsylvania, (2) The University of Texas MD Anderson Cancer Center)
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Applications (stat.AP)
关键词：clinical trial pipeline, FDA Project Optimus, design, trial pipeline, trial
备注： 13 pages, 3 figures, 6 tables. Presented as a poster at the NeurIPS 2026 Workshop on World Models for High-Stakes Health (WMHS). Code and data: [this https URL](https://github.com/hanktang-research/TrialDesignBench)
点击查看摘要
Abstract:AI is used in much of the clinical trial pipeline. However, selecting the statistical design of a trial, a crucial step that determines how drug doses are tested on humans and evaluated, has seen almost no AI progress. LLMs appear to be a natural fit given their strengths in biomedical knowledge and statistical reasoning. Nevertheless, there is currently no appropriate way to evaluate such abilities because recent regulatory and methodological shifts, most notably FDA's Project Optimus, have redefined what constitutes a reasonable design and rendered many previous designs obsolete. To lay the groundwork for AI-assisted trial design, we introduce TrialDesignBench, a benchmark of 617 Phase-I/I-II oncology dose-finding trials, each paired with an expert-validated reference design that is consistent with the latest FDA regulatory initiatives. This reference standard is produced through a formalization of the expert design process. We evaluate five frontier LLMs, none of which matches the reference standard. Our ablation experiments trace this performance gap to two main causes, inference of latent, unrecorded design determinants from trial sources (supplying them raises class-wise balanced accuracy by 0.22) and structured decision-tree reasoning (+0.24). TrialDesignBench offers a reproducible, contemporary-standard objective for evaluating and enhancing AI-assisted trial design.
13. 【2611.12634】How Far Does Second-Order Linear Response Predict Quantization Mismatch? Pre-Registered Measurements on Five Language Models
链接：https://arxiv.org/abs/2611.12634
作者：Dezhen Lu,Zixiang Ni
类目：Computation and Language (cs.CL); Cryptography and Security (cs.CR); Machine Learning (cs.LG)
关键词：Serving systems choose, Serving systems, systems choose, choose a weight, expansion underlying Hessian-aware
备注：
点击查看摘要
Abstract:Serving systems choose a weight format for each model and deployment. A low-cost screen predicts the resulting KL divergence from the unquantized model's Fisher information using $\tfrac12\Delta^\top F\Delta$, the expansion underlying Hessian-aware and second-order post-training quantizers. We assess the reliability of this screen in GPU batches with channel-wise int8, per-tensor fp8 and group-wise int4 on Qwen3-8B, Qwen3-4B, OLMo-2-7B, Qwen3-32B and Qwen3-30B-A3B. Relative predictions hold across a 16-fold range of perturbation scales, int4 group sizes and rounding modes, while absolute predictions are heavy-tailed. A trimmed average brings 10 of 12 cells on Qwen3-4B and OLMo-2 within 15% of measured KL. The MoE model exhibits nonquadratic response at small perturbations, with int8 KL scaling as $\alpha^{0.63}$. Computing per-sequence gradients in bf16 can cause fourfold prediction errors. We trace these errors to arithmetic in the lower half of the backward pass and eliminate them by using fp32 there. Batch-invariant kernels run at 0.55 times the throughput, while changes in reduction order introduce a floor of 0.17-0.22 nats per sequence. We build a screener with one streamed fp32 Fisher pass, trimmed tensor-block predictions with a band, a flag for aligned tensors and per-layer format allocation. On the unseen Mistral-7B-v0.3 family, all six predictions fall within the band, all three KL budgets are met, and vLLM throughput is predicted within 0.4%.
14. 【2611.12628】Adapting Small Language Models to Romanized Nepali: Tokenizer Fertility, Reference Likelihood, and Generation Metrics
链接：https://arxiv.org/abs/2611.12628
作者：Pujan Pant,Sagar Newpane,Hari Sitaula,Manish Sakhakarmy
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：reliably small open, small open language, Latin script, written in Latin, open language models
备注：
点击查看摘要
Abstract:Romanized Nepali, Nepali written in Latin script, is common in digital communication but has no standard spelling and few resources, and it is unclear how reliably small open language models can be adapted to it. We adapt three 2-3B base models from different families, Llama-3.2-3B, Qwen2.5-3B, and Gemma-2-2B, with QLoRA on 9,000 instruction examples produced by deterministic transliteration of Nepali instruction data. Each model is trained with one shared recipe and three seeds and evaluated on 1,000 held-out examples with reference-overlap metrics, byte-normalized reference likelihood (bits per byte, BPB), and an output audit, against zero-shot baselines under two prompts. Fine-tuning raises chrF++ from 10-14 to 29.0-30.6 and lowers BPB from 2.23-2.41 to 0.78-0.84; most zero-shot outputs (54-92%) are English-like. Likelihood and overlap disagree on how far apart the models are. Llama-3.2-3B has the lowest BPB in every seed, 0.042 below Qwen2.5-3B (95% CI 0.039-0.046), yet the two cannot be separated on chrF++ (30.51 and 30.61) or BLEU, even with paired item-level tests. Gemma-2-2B, whose tokenizer splits Romanized Nepali words least (2.72 tokens per word), scores worst on every measure. Which model gains most over its zero-shot baseline depends on the zero-shot prompt. In a supplementary comparison with an identical tokenizer, Llama-3.1-8B lowers BPB by 0.053 (0.050-0.056) relative to Llama-3.2-3B, while chrF++ and BLEU rise by only 0.68 and 0.58 points. Lower fertility and higher reference likelihood therefore did not identify the model whose outputs were closest to the references.
15. 【2611.12618】ype-logical grammars and formal languages
链接：https://arxiv.org/abs/2611.12618
作者：Richard Moot(LIRMM,CNRS,LIRMM | PIPL,UM)
类目：Computational Complexity (cs.CC); Computation and Language (cs.CL); Formal Languages and Automata Theory (cs.FL); Logic in Computer Science (cs.LO)
关键词：first-order linear logic, fixed recognition problem, NP-complete fixed recognition, first-order linear, linear logic
备注：
点击查看摘要
Abstract:We show that type-logical grammars with the standard rules for product, associativity, extraction and infixation have an NP-complete fixed recognition problem, adapting a construction for first-order linear logic from Pshenitsyn (2025), who already showed that grammars in first-order linear logic are closed under intersection and therefore not semilinear and not mildly context-sensitive. We strengthen these results and shown that grammars in first-order linear logic can simulate the quasi-linear grammars of Book \ Greibach (1970), the grammars recognised in non-deterministic linear time (NSPACE(n) or. NLIN). I argue that NLIN is an interesting class of formal languages as well, and a useful upper bound on the time complexity of formalisms used for natural language, just like LOGCFL is a useful upper bound on the space complexity. Taken together this means that first-order linear logic can be seen as the logic of non-deterministic linear-time string languages, graph languages and automata.
16. 【2611.12597】Unmasking Four Knapsack Problems in the Traveling Thief Benchmark
链接：https://arxiv.org/abs/2611.12597
作者：Mohammed Mizan Alanazi,Mahdi Khemakhem
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：traveling thief problem, TTP instances, traveling thief, instances, TTP
备注：
点击查看摘要
Abstract:The traveling thief problem (TTP) asks a thief to choose a tour and a packing together, and the benchmark of 9,720 instances of Polyakovskiy et al. (2014) is the standard test set for comparing TTP heuristics. We show that four of these instances are not TTP instances at all. Their files give a renting rate of 0.00, so the tour has no effect on the objective and each instance reduces to a 0-1 knapsack problem. One of them belongs to the 60 categorized instances on which new methods are usually compared, and on it five of nine published methods report exactly the same value. The cause is the format of the files, which keep the renting rate with two decimals, while the rule of the generator gives a rate close to 0.003 on these instances. The same rounding may shift the rate of 949 other instances by more than 1%. Since the tour and the packing used by the generator were not published, the original rates cannot be recovered. We therefore define new rates with the same rule, applied to a fully specified reference solution that we publish, and we show with a published heuristic that the corrected instances behave as TTP instances again. We also give reference results on the corrected instances and recommendations for future studies. Finally, we present ttplib, a new open-source Python library that loads any of the 9,720 instances, including the corrected ones, without downloading the whole benchmark.
17. 【2611.12592】Fairness in Explainable AI Narratives: Decomposing Social Disparities in LLM-Generated Explanations
链接：https://arxiv.org/abs/2611.12592
作者：Wannes Van den Bulck,Sofie Goethals,David Martens
类目：Computation and Language (cs.CL)
关键词：Large language models, translate technical explainable, Large language, SHAP into explanatory, lay users
备注： 25 pages, 8 figures, 9 tables. Code, prompts, narratives and extractions available at [this https URL](https://github.com/WannesVandenBulck/fairxain)
点击查看摘要
Abstract:Large language models (LLMs) are increasingly used to translate technical explainable AI (XAI) artefacts such as SHAP into explanatory narratives (XAINs) for lay users. In high-risk domains, these explanations are often the main resource through which individuals can understand and contest adverse decisions. Yet LLMs are known to reproduce social bias, even from proxy variables alone, and fairness in XAINs remains unstudied. Because XAINs are bound to a ground-truth artefact, fairness concerns not only what a narrative says and how, but also whether it is equally faithful across social groups. We introduce fairness in XAINs as a new field of research and propose a framework that generates narratives under three conditions (protected attribute disclosed, withheld, or counterfactually swapped), allowing five comparisons that pinpoint the cause of disparities. We apply it to adversely classified instances from four datasets in credit scoring, education and employment, generating narratives with five LLMs, and evaluate faithfulness, feature coverage and sentiment. We find significant disparities across all datasets, metric families and models, arising in two ways. Faithfulness disparities result from feature values: LLMs make plausible but false statements, triggered by values that are unequally distributed across social groups. Feature coverage and sentiment disparities stem from the protected attribute itself: once it is disclosed, LLMs give less explanation to, or frame more negatively the narratives of, groups that have historically been discriminated against or are stereotypically associated with worse outcomes. A more faithful model removes the faithfulness disparities, and withholding protected attributes mostly removes the others, but neither suffices on its own. Fairness in XAINs should therefore be audited separately from the predictive model and its XAI artefact.
18. 【2611.12587】AgentOPSD: Turn-Level Credit Assignment via Recursive Belief Revision
链接：https://arxiv.org/abs/2611.12587
作者：Yizhuo Li
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：verifiable rewards ordinarily, rewards ordinarily spreads, Reinforcement learning, learning with verifiable, verifiable rewards
备注： Preprint. 6 figures, 2 tables
点击查看摘要
Abstract:Reinforcement learning with verifiable rewards ordinarily spreads a single advantage over a whole trajectory, a granularity too coarse to isolate the few decisions on which success in a long, multi-turn interaction actually turns. Privileged self-distillation supplies denser supervision, but it leaves unanswered how a set of local teacher-student discrepancies should be converted into credit along a sequence. We introduce AgentOPSD, a critic-free scheme that assigns credit recursively, one interaction turn at a time. Inside a turn, the token-level log-probability gaps between a skill-conditioned self-teacher and the student are summed, and that sum acts as evidence in a recursive Bayesian update carried out in log-odds space; the resulting revisions reallocate the outcome-derived advantage across turns through a multiplier that is bounded and preserves its sign. With Qwen2.5-3B and Qwen2.5-7B as policy backbones on ALFWorld, the method improves consistently on GRPO and on self-distillation baselines, and attains 89.1% success at the 7B scale. Ablations attribute the gain to aggregating evidence at turn boundaries and to making the belief revision depend on history, rather than to the local gap by itself.
19. 【2611.12574】Evaluating Cross-Signal Coherence in Mammography Vision-Language Models
链接：https://arxiv.org/abs/2611.12574
作者：Rebeca Nam,Chase M. Fensore,Christian A. Fauria-Robinson,Judy Gichoya,Joyce C. Ho
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：medical images directly, outputs increasingly include, interpreting medical images, move toward interpreting, written justification
备注：
点击查看摘要
Abstract:As vision-language models (VLMs) move toward interpreting medical images directly, their outputs increasingly include not just a label but a stated confidence and a written justification. Yet the field still predominantly evaluates VLMs using just accuracy. We evaluate the coherence between answer, confidence, and explanation across four VLMs on breast density and BI-RADS categorization, using two mammography datasets. We perform controlled perturbations of the question, multiple choice option orders, and the images and assess changes in the three outputs. Our results suggest confidence does not decrease even as the mammography image is changed. Shuffling the options also changes most VLMs' answers. Notably, there are cases where a model's own stated reasoning contradicts its final answer, a distinction accuracy alone cannot capture but one that governs whether an AI-generated answer can be trusted.
20. 【2611.12538】Language Defaults Before Content: A Causal Layer Map of Multilingual Generation
链接：https://arxiv.org/abs/2611.12538
作者：Shenbin Qian,Yves Scherrer
类目：Computation and Language (cs.CL)
关键词：generation requires large, requires large language, Multilingual generation requires, requires large, commitments are difficult
备注：
点击查看摘要
Abstract:Multilingual generation requires large language models (LLMs) to determine both what to say and in what language to say it, yet these two commitments are difficult to disentangle from model outputs alone. We use translation as a controlled probe: for multi-parallel segments that a model translates well in one language direction but poorly in another, content is held fixed while language varies. Using activation patching, we write residual-stream states from successful runs into failing ones and compare content-matched states with content-independent controls, allowing us to trace content-specific and language-related signals across layers. Across three LLMs of different scales and architectures, we find a consistent three-stage pattern of multilingual generation. Intermediate layers first express a default English signal; content information becomes causally available one layer later; and the final target language is resolved only at later layers. The ordering of the English default before content also appears in a reading-comprehension task. Our sparse autoencoder analyses reveal a further dissociation: the intermediate language signal is only weakly represented by sparse features, whereas a later language distinction is clearly sparse, but resists intervention at the patched position. These results provide a mechanistic account of how language selection and content information emerge and interact during multilingual generation.
21. 【2611.12521】Can the Confidence and Decisions of System 1 Models Be Trusted? An Explainability and Perturbation Audit of Jev-Style Decision Models
链接：https://arxiv.org/abs/2611.12521
作者：Julien Delaunay
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：replace autoregressive text, autoregressive text generation, single forward pass, forward pass returning, pass returning typed
备注： 36 pages, 4 figures, 16 tables. Code and benchmark artifacts available at [this https URL](https://github.com/j2launay/jev-decision-models-xai)
点击查看摘要
Abstract:"System 1" decision models (pioneered by TypeSafe AI's Jev) replace autoregressive text generation with a single forward pass returning typed probability distributions over declared schemas (Choice, Score, Noul). While deployed for low-latency routing and automated triage, their statistical calibration and post-hoc explainability remain uncharacterized. We introduce an open, deterministic audit benchmark evaluating System 1 decision models across calibration under label-preserving perturbations, cross-question interference, and post-hoc attribution faithfulness. Evaluating five open-weight models (0.8B to 27B) alongside generative System 2 baselines -- both single-token logprob scoring and structured JSON/CoT decoding -- across NLI (e-SNLI), adversarial syntactic shortcuts (HANS), synthetic clinical triage (N=900), prompt injection defense (Tensor Trust, N=250), and an 86-case logic-gate trigger suite yields five findings: (1) provider confidence is an exact closed-form dispersion transform (1 - H(p)/ln K on sub-10B models; normalized margin on Clef-27B) rather than empirical accuracy; (2) bundling multiple questions in one request induces directional cross-question interference (11.7% to 22.4% binary flips on Tev1-0.8B, vs. 0.1% to 0.2% on Tev1-4B); (3) System 1 models with = 4B parameters are faster and better calibrated under syntactic shifts (ECE_w = 0.030 to 0.087) than logprob (0.144) and JSON (0.378) baselines; (4) for prompt-injection defense (N=250), = 4B models achieve 0.988 to 0.998 AUROC with up to 95.2% recall and 0.0% false alarms at 48 to 60 ms; and (5) single-pass inference makes 512-coalition XAI interactive (1.3 to 3.2 s/input), while KernelSHAP with a logit link (S1-SHAP) mitigates softmax saturation on disjunctive OR gates (89.3% to 100.0% gate recovery vs. 57.1% to 82.1% in prob space; p_adj = 0.004).
22. 【2611.12501】xt Grouping Changes Completion-Time Comparisons in Long-Form Simultaneous Speech Translation
链接：https://arxiv.org/abs/2611.12501
作者：Hieu Minh Truong,Dung D. Le
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：measured completion gap, Abstract, speech synthesis change, speech synthesis, measured completion
备注：
点击查看摘要
Abstract:Does grouping translation updates before speech synthesis change the measured completion gap between two translators? We compare StreamAtt with its fixed-audio-history baseline on ten English-German talks. For each translation, we keep the intended text and its availability times fixed and vary how updates are grouped for synthesis. Four-second grouping increases StreamAtt's mean completion lead from 106.6 to 229.1 seconds with XTTS-v2, but reduces it from 169.5 to 146.5 seconds with Piper. Both produce shorter audio; different changes in playback idle account for the opposite effects. These directions recur on a separately selected twenty-talk panel. In continuing CosyVoice 3 sessions, grouping instead leaves paired audio unchanged and delays completion on nineteen of twenty blocks. A speech-timing comparison therefore needs to specify how text enters synthesis, not just which synthesizer is used. Recognition and automatic word timing describe the outputs, but do not establish translation accuracy or intelligibility.
23. 【2611.12487】Detecting AI-Authored Text in Authentic Student Writing: Evidence from PISA 2025
链接：https://arxiv.org/abs/2611.12487
作者：Nils-Jonathan Schaller,Thorben Jansen,Olaf Köller,Andrea Horbach
类目：Computation and Language (cs.CL)
关键词：reach near-perfect scores, AI-text detectors reach, detectors reach near-perfect, contrast fully human-written, reach near-perfect
备注：
点击查看摘要
Abstract:AI-text detectors reach near-perfect scores in evaluations that contrast fully human-written texts with texts generated from researcher-designed prompts. In authentic student writing, however, AI use is voluntary and often partial. We study this setting with the PISA 2025 FLA dataset, in which 15-year-olds in Germany wrote English argumentative essays with and without access to a gpt-4o-mini-based chatbot. Keystroke, clipboard and chat logs let us trace every character of the final essay to its origin. From this provenance, we derive text- and sentence-level labels for human-written, AI-generated and mixed text, and for text written after chatbot use without traceable AI material. We evaluate a feature-based detector and a classifier on frozen Llama-3.1-8B embeddings, both adapted from top-ranked shared-task systems. Both separate AI from human text reliably (macro-F1 up to 0.96 for texts and 0.95 for sentences), independently of spelling errors. The feature-based detector, however, relies on lexical complexity, which a simple student-style rewriting prompt removes (AI recall 0.92 $\to$ 0.60 with gpt-4o-mini, 0.41 with Qwen3). The embedding-based detector stays robust for whole texts (AI recall $\geq$ 0.94) but not for single sentences (AI recall as low as 0.59). Mixed text falls between the two classes, and text without traceable AI material is classified as human-written in about 95\% of texts.
24. 【2611.12464】Phrase-Level Speculative Decoding on a Frozen Target
链接：https://arxiv.org/abs/2611.12464
作者：Madhusudhana Naidu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Speculative decoders raise, decoders raise throughput, Speculative decoders, target, DFlash and DSpark
备注： 10 pages, 9 tables
点击查看摘要
Abstract:Speculative decoders raise throughput by banking more target tokens per forward pass, and Medusa, EAGLE-3, DFlash and DSpark all do it the same way: more candidates that survive verification. All of them draft in the target's own vocabulary, so one node of the candidate tree is one target token, and the tokenizer makes that unit look like a constant. It is not. BPE's pretokenizer splits on whitespace before merges are learned, so no multi-word string can ever become a single token: in Qwen3-4B, "United States of America" is four tokens and no adjacent pair of them exists as one entry, so a phrase is out of reach of any method drafting in the target's vocabulary. We change the unit. A small MLP head reads the frozen target's hidden state and predicts a one- to three-word phrase as one entry in a separate draft vocabulary; greedy longest-match expansion maps it back into the target's own tokens, and N candidates are verified in one forward pass behind a prefix-tree mask, so the change is orthogonal to tree depth and width. The target and its tokenizer stay frozen and a candidate is accepted only while it matches the target's own argmax, so the served output is identical to greedy decoding up to floating-point tie-breaking. On one A5000 at batch 1, against HuggingFace generate(), a 21.94M head (0.545% of Qwen3-4B) reaches 2.391x on GSM8K, 2.444x on MATH-500 and 1.544x on MT-Bench. Because the head's output layer is one row of 257 parameters per entry, the draft vocabulary size is the parameter budget: an 8,000-entry head is 3.434M parameters, 0.0854% of the target and 64x smaller than EAGLE-3's drafter, and keeps 92.3% of the larger head's GSM8K tokens per pass. With EAGLE-3 run on same prompts and baseline, our 21.94M head is ahead of tree-16 on both maths sets and behind tree-60 on every set.
Comments:
10 pages, 9 tables
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
Cite as:
arXiv:2611.12464 [cs.CL]
(or
arXiv:2611.12464v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2611.12464
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
25. 【2611.12429】Can Frontier Auto Researchers Reconstruct Human Research Decisions in AI?
链接：https://arxiv.org/abs/2611.12429
作者：Shengyun Si,Junjie Chu,Ye Leng,Yang Zhang
类目：Computation and Language (cs.CL)
关键词：designing specific solutions, reviewing prior work, Auto Researchers, substantial human effort, research
备注： 14 pages, 18 figures
点击查看摘要
Abstract:Scientific research has long been driven by substantial human effort, from reviewing prior work and identifying research gaps to designing specific solutions. Recent advances in harness-based agent systems have given rise to increasingly capable Auto Researchers, which can autonomously carry out these tasks and, increasingly, entire end-to-end research workflows. Yet despite their rapidly growing capabilities, how closely the research decisions and outputs produced by auto researchers align with those of human experts remains underexplored. We investigate this gap through the lens of research reconstruction and study: Given comparable research context, how similar are the research decisions and outputs produced by Auto Researchers to those of human researchers in AI research? To answer this question, we introduce AutoResearcher-Human Research Similarity (AutoHRS), a stage-wise evaluation framework for assessing how faithfully auto researchers reconstruct human research artifacts across different stages of the scientific workflow. Using 152 ICLR oral papers as our corpus, we generate 456 research trajectories spanning different stages of the research process. Applying AutoHRS to these trajectories, we find that current Auto Researchers frequently fail to recover key research decisions and their resulting artifacts across multiple stages of the research process.
26. 【2611.12420】Path-Level Structural and Semantic Alignment for Hierarchical Multi-Label Text Classification
链接：https://arxiv.org/abs/2611.12420
作者：Xindi Wang,Aifen Xiong,Baiyang Wang,Xuri Ge,Robert Mercer,Frank Rudzicz,Yifan Peng,Zhumin Chen,Hongjun Wang
类目：Computation and Language (cs.CL)
关键词：multi-label text classification, text classification, HMTC, requires models, hierarchy levels
备注： 14 pages, 7 figures
点击查看摘要
Abstract:Hierarchical multi-label text classification (HMTC) requires models to capture both structural dependencies among labels and the fine-grained semantics of labels at different hierarchy levels. Existing methods often model hierarchy through prediction constraints or representations of individual labels and local relations. Structural and semantic supervision, however, are usually formulated separately. We instead use complete root-to-node label paths as a shared unit for both. Our framework introduces two auxiliary training objectives while retaining a standard multi-label classifier at inference. PathSimNCE aligns document representations with hierarchical paths using hierarchy-aware contrastive targets. These targets provide graded supervision for structurally related paths while preserving explicit supervision for the ground-truth paths. The complementary semantic objective uses LLM-generated, document-conditioned descriptions of the same positive paths. It thereby provides context-specific label semantics beyond static label representations. Experiments on three benchmarks show consistent improvements: structural alignment is particularly beneficial in deeper hierarchies, while semantic alignment provides additional gains for fine-grained labels.
27. 【2611.12412】Unprompted coordination through shared memory in LLM agents: a locked two-implementation replication and extension
链接：https://arxiv.org/abs/2611.12412
作者：Pekka Abrahamsson,Muhammad Waseem,Esa Karjalainen,Petrus Jussila,Henri Hansen,Jussi Rasku,Bilhanan Silverajan,Kai-Kristian Kemell
类目：Multiagent Systems (cs.MA); Computation and Language (cs.CL); Software Engineering (cs.SE)
关键词：large language-model agents, software engineering, large language-model, safety and software, deployed in groups
备注： 13 pages, 7 tables, 2 figures. Replication package: [this https URL](https://doi.org/10.5281/zenodo.23965306)
点击查看摘要
Abstract:Coordination between large language-model agents has become a central question for AI safety and software engineering, as such agents are deployed in groups that share infrastructure. Existing research tells the agents that partners exist or asks them to coordinate. Whether coordination arises through shared state alone, with nothing disclosing that anyone else is present, is the key question for deployments that share caches and memory between agents, yet it has rarely been examined, and never with independent replication; this study does both. Four agents each received a short arithmetic task and a key-value store presented to each as its own scratch space; two held complementary halves of one computation, and no prompt mentioned other agents, sharing or collaboration. For reliability, the environment was rebuilt independently from a written protocol, and both implementations ran under hashed locks on design, data and analysis. The results bear novelty value in three respects. Joint success occurred only through the shared store. Whether a model coordinated depended not on its vendor tier but on whether it wrote its intermediate result and looked at the store again, and one ordinary sentence, "check your workspace again before submitting", switched that second look on and off. The findings held under replication. For practice, state shared between agents is a communication channel and should be separated, namespaced and logged. For research, designs should be locked before the data, and the parse rule, endpoint and parameters reported. Future work should test open-weight models and separate using another agent's output from intending to communicate.
28. 【2611.12407】BDBBQ: A Human-AI Collaborative Benchmark for Bengali Social Bias in LLMs
链接：https://arxiv.org/abs/2611.12407
作者：Provat Saha,Ashika Habib Khan,Tahseen Tanha,Hasin Ishrak,Muhammad Iqbal Hossain
类目：Computation and Language (cs.CL)
关键词：Bangladesh sociocultural context, provide limited coverage, Bangladesh sociocultural, benchmarks provide limited, Bengali
备注：
点击查看摘要
Abstract:Despite growing attention to social bias in large language models (LLMs), existing bias benchmarks provide limited coverage of culturally grounded evaluation in Bengali, particularly within Bangladesh's sociocultural context. To address this gap, we develop a bilingual extension of BanglaBBQ comprising 61,312 question-answering instances across 12 social categories in English and Bengali. The benchmark incorporates balanced answer permutations, contrasting question framings, and both ambiguous and disambiguated contexts to systematically examine model performance and stereotype-aligned bias across languages. We validate the dataset through structural checks, 220 statistical tests, and expert annotation of 150 instances by four annotators, achieving strong inter-annotator agreement (Fleiss' \k{appa}=0.8349). We evaluate eight LLMs across 490,496 instances and identify five key findings. First, disambiguated contexts yield substantially greater accuracy improvements in Bengali (+36.59 percentage points) than in English (+17.71). Second, all evaluated models exhibit lower accuracy in Bengali, although Mistral-Nemo shows the smallest cross-lingual accuracy gap (5.12 percentage points). Third, stereotype-aligned bias exhibits language and model dependent variation, increasing in Bengali for Gemma 2 9B but decreasing for Mistral-Nemo. Fourth, higher accuracy does not necessarily correspond to lower stereotype-aligned bias. Finally, bias varies considerably across social categories, with Qwen 2.5 7B exhibiting stronger stereotype alignment in Bengali for Politics and Physical Appearance. These findings demonstrate that cross-lingual performance and social bias are distinct dimensions of LLM behavior and underscore the importance of culturally grounded, language-sensitive benchmarks for evaluating fairness beyond English-centric settings.
29. 【2611.12392】More Than Just Style: Benchmarking Personality Influence in Large Language Models
链接：https://arxiv.org/abs/2611.12392
作者：Yuhao Liu,Mengyu Wang,Xiao Chen,Lu Liu
类目：Computation and Language (cs.CL)
关键词：explicit input prompts, behavioral preferences similar, large language model, language model outputs, underlying behavioral preferences
备注： 37 pages, 8 figures
点击查看摘要
Abstract:In addition to the effects of explicit input prompts and instructions, large language model outputs are influenced by underlying behavioral preferences similar to human personality tendencies. These tendencies can affect how models interpret situations and make decisions. However, their influence is difficult to disentangle from the effects of model capabilities and instructions. Therefore, we introduce SPACE, a benchmark framework combining a controlled evaluation protocol with complementary datasets for personality verification, capability assessment, and hierarchical situational tasks. Controlled comparisons across guidance conditions help distinguish personality influence from measured capability changes and immediate instruction effects. Experimental results demonstrate that although prompting can shift generation style, models' internal personality tendencies are persistent and not readily overridden by opposing instructions. Furthermore, these underlying tendencies have an observable influence on LLM task performance, highlighting the need for greater attention to these characteristics and potential applications. Training code and SPACE benchmark specifications are available at this https URL.
30. 【2611.12311】MNN-Pocket-0.3B Technical Report
链接：https://arxiv.org/abs/2611.12311
作者：MNN Team
类目：Computation and Language (cs.CL)
关键词：technical report presents, supporting context lengths, efficient on-device deployment, report presents, technical report
备注： 24 pages, 9 figures
点击查看摘要
Abstract:This technical report presents MNN-Pocket-0.3B, a compact 300M-parameter dense language model designed for efficient on-device deployment and supporting context lengths of up to 32K tokens. With an INT4 deployment footprint of only 173 MB and decoding throughput of up to 466 tokens/s on iPad Pro M5 (Metal), it can be seamlessly integrated into applications on edge devices such as smartphones and smart glasses. MNN-Pocket-0.3B is developed through the co-design of its architecture, data, training pipeline, and inference system. Hardware-aware architecture selection and dependency-aware vocabulary pruning balance model capability with on-device memory and compute constraints. A four-stage pre-training pipeline covering approximately 4.1 trillion high-quality Chinese and English tokens equips the model with broad knowledge and reasoning capabilities. This is followed by a three-stage post-training pipeline comprising instruction fine-tuning, multi-teacher on-policy distillation, and quantization-aware training. Finally, hardware-specific optimizations in the MNN inference engine enable fast, memory-efficient inference and long-context processing. Extensive evaluations demonstrate that MNN-Pocket-0.3B achieves frontier-level performance among models of comparable size, with particularly strong results in Chinese and English knowledge and reasoning, mathematics, coding, and instruction following. It consistently outperforms similarly sized open-source models and even surpasses several 0.5B-parameter models on instruction-following benchmarks. We release MNN-Pocket-0.3B with open weights and ready-to-use MNN deployment packages. We hope it will provide a practical foundation for capable, responsive, and memory-efficient edge applications while advancing research and development in on-device language models.
31. 【2611.12305】HumanSightBench: A Benchmark for Human Visual Perception in MLLMs
链接：https://arxiv.org/abs/2611.12305
作者：Zixin Su,Yangguang Lin,Zegang Peng,Yuntong Sun,Xuanyi Wang,Jiahao Wang,Qiankai Xu,Bing Yuan,Jinze Bai,Youbin Wu,Jingjia Huang,Ruyang Liu,Yanxu Hu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Multimodal large language, vision-language benchmark datasets, demonstrated strong performance, reasoning-based vision-language benchmark, Multimodal large
备注：
点击查看摘要
Abstract:Multimodal large language models (MLLMs) have demonstrated strong performance on knowledge-intensive and reasoning-based vision-language benchmark datasets, but still struggle to solve the visual questions that people can solve easily. Evaluating the differences between MLLMs and human-level visual perception is challenging due to end-to-end evaluation which combines various skills, or because we are uncertain if individual items are valid. Specifically, observed errors may reflect visual perception, language priors, background knowledge, question ambiguity, and underspecified answers. Our guideline for HumanSightBench is that we construct items that are human-easy by construction and model-hard by evaluation. HumanSightBench contains 2,876 visual questions with short answers across 7 top-level perceptual categories and 21 subcategories. We only include items that pass five inclusion gates: question clarity, answer uniqueness, visual grounding, human solvability, and text-only shortcut filtering. According to the protocol, errors are defined as incorrect answers on human-validated visual tasks with the evaluated interface. The inclusion gates are intended to reduce confounds from ambiguity and external knowledge. The best pass@3 score is 65.6% across eight evaluated MLLMs. No evaluated model exceeds 27.5% on Counting. These results identify capability gaps that are hidden by overall scores and can help future training experiments and held-out evaluation.
32. 【2611.12269】Agent4Crypto: A Dual-Reflective and Market-Feedback-Aligned LLM-Based Multi-Agent System for Cryptocurrency Trading
链接：https://arxiv.org/abs/2611.12269
作者：Guangyan Gan,Jiahao Li,Jiashun Wang,Lin William Cong
类目：Multiagent Systems (cs.MA); Computation and Language (cs.CL)
关键词：fixed aggregation rules, Cryptocurrency markets provide, machine-speed environments, aggregation rules, provide a natural
备注： Guangyan Gan and Jiahao Li contributed equally to this work
点击查看摘要
Abstract:Cryptocurrency markets provide a natural testbed for autonomous AI agents because they are digital-native, high-frequency, and machine-speed environments, yet existing methods often struggle with non-stationary market regimes, opaque decisions, and fixed aggregation rules. In this paper, we propose Agent4Crypto, a dual-reflective and market-feedback-aligned multi-agent system. The framework coordinates specialized agents for data collection, analysis, risk assessment, reflection, and trading, synthesizing heterogeneous signals from prices, indicators, news, and charts in an interpretable decision pipeline. Our central design is a trader-centric decision mechanism: three style-specific trader agents, Aggressive, Neutral, and Conservative, generate candidate actions and natural-language rationales from the same market context, while their influence is learned rather than manually fixed. A PPO-based gating policy dynamically allocates trader weights through a dual-reflective feedback process. One reflection stream evaluates post-trade decision quality from realized portfolio outcomes and distills reusable lessons into a Financial ReasoningBank for retrieval in subsequent trader prompts, while the other estimates trader-level counterfactual contribution, indicating which style has recently aligned better with market movements. The PPO state combines Counterfactual Contribution Memory with market features, previous trader weights, and current trader actions, so trader influence adapts across bull, sideways, and bear regimes. Experiments on BTC, ETH, and XRP show that Agent4Crypto improves total return and Sharpe ratio over traditional strategies, machine learning and reinforcement learning baselines, and existing LLM-based trading systems, demonstrating the value of interpretable trader competition and market-feedback-driven adaptation in volatile cryptocurrency markets.
33. 【2611.12240】Prune, Don't Merge: Expert Compression of Mixture-of-Experts LLMs on Multilingual Production Tasks
链接：https://arxiv.org/abs/2611.12240
作者：Tomas Rasymas,Povilas Kvedaras
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：GPU memory, hold in GPU, cheap to run, run per token, token but expensive
备注： 38 pages, 8 figures, 15 tables
点击查看摘要
Abstract:Mixture-of-Experts language models are cheap to run per token but expensive to hold in GPU memory, which drives the cost of serving them in production. One-shot expert compression shrinks them after a single calibration pass. Its two current state-of-the-art methods are REAP for expert pruning, which deletes the least salient experts, and REAM for expert merging, which merges them into the most salient ones. Both have been evaluated only on academic benchmarks. We compare the two on five multilingual production tasks of a web-hosting company, from classification to the generation of marketing HTML email templates, with two 30B-parameter models (Qwen3-30B-A3B-Instruct-2507 and the hybrid Mamba-attention Nemotron-3.5-Lightning) at 25% and 50% of experts removed and the same calibration data. Pruning wins: on the same rows, REAP is significantly better in 16 of 20 comparisons and REAM in 2. At 25%, REAP keeps 93.6% of Qwen3-30B's generative quality and REAM 62.5%, although on benchmarks the two are within a point for the same model. The damage concentrates in the output contract rather than the content: 89.8-95.2% of each significant loss on email templates comes from hard-gate failures such as invalid JSON, broken mobile layouts and runaway generation, and most failed non-English domain descriptions copy the prompt's English opening phrase. Cross-perplexity and logit divergence, two diagnostics from the REAP paper, also track production quality, as does the rate of repetition loops; n-gram diversity does not. We close with practical guidance for compressing MoE models for production.
34. 【2611.12225】A Cost That Practice Accuracy Hides: Worked Solutions in Self-Generated Training Data and the Compositional Use of New Rules
链接：https://arxiv.org/abs/2611.12225
作者：Jiantong Xu
类目：oftware Engineering (cs.SE); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：newly learned rules, reuse newly learned, make self-generated training, self-generated training targets, make self-generated
备注： 31 pages, 4 figures, 12 tables. Code, data and trained adapters: [this https URL](https://github.com/JetXu-LLM/kestrel-capture-context)
点击查看摘要
Abstract:A worked solution can make self-generated training targets shorter and cheaper, but accuracy on the practiced operation may hide how well a model can reuse newly learned rules. We study this choice in a 2B-parameter reasoning model learning two invented quantitative rules. The model generates targets from a rule sheet alone or from the sheet plus a program-written worked solution; targets are accepted for final-answer correctness, and the support is removed for fine-tuning and evaluation. Training questions request forward use in one segment; composition requires sequential reuse of the same rule across two segments. After six passes, using a program-checked numerical signature, sheet-only targets lead by 24.3 percentage points (95% item-bootstrap CI 14.6-34.0) on composition in a prospective test. On unseen argument values, observed forward accuracy is identical (87.5% each), but composition accuracy is 58.3% versus 23.6%, a 34.7-point gap (25.7-43.8). An independently sampled second target-bank pair repeats the direction (+14.6 points, 2.1-26.0). Ten passes on the shorter worked-solution targets, approximately matching the domain tokens of six sheet-only passes while changing other training quantities, narrow the gap to 16.3 points (6.3-26.7) in the first bank pair and 6.2 points (-6.3 to 18.8) in the second, where the pre-specified test does not hold. At six passes each, the worked-solution policy uses fewer capture tokens and less update time, yet the trained models use 2.6 times as many generated tokens per composition success under the numerical signature (2.1 times in the second bank pair). Choosing a capture context therefore requires testing how the new rules are reused, alongside the inference cost of those uses, rather than relying on forward accuracy alone.
35. 【2611.12206】A Geometric Invariant of Attention Predicts Head Specialization from Weights Alone
链接：https://arxiv.org/abs/2611.12206
作者：Miguel P. Bento
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Transformers are built, attention mechanism, built with continuous, continuous symmetries, Transformers
备注： Accepted as an extended abstract at the Symmetry and Geometry in Neural Representations Workshop (NeurReps), NeurIPS 2026
点击查看摘要
Abstract:Transformers are built with continuous symmetries in the attention mechanism. We derive $\rho$, a scalar invariant that measures each head's capacity to couple to rotary positional encodings. This framework allows us to analyze heads without forward passes, opening a new research direction into data-independent analysis of modern LLMs. Empirically, we find that $\rho$ predicts induction heads, the most-studied circuit type in mechanistic interpretability, with Spearman correlation between $-0.55$ and $-0.74$ across four bias-free RoPE models spanning $135$M to $7$B parameters. As a preliminary proof of concept, we use $\rho$ to apply YaRN to only the top-50% positional heads, which degrades perplexity less than uniform application. Code is available at this https URL.
36. 【2611.12197】rajLift: Lifting Memory Recall Trajectories with Latency-Modulated Heat Diffusion
链接：https://arxiv.org/abs/2611.12197
作者：Jiawen Kang,Jinchao Li,Mingyu Cui,Junan Li,Xixin Wu,Helen Meng
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Neurons and Cognition (q-bio.NC)
关键词：remains largely unexplored, process remains largely, information for Alzheimer, Alzheimer disease, carries rich diagnostic
备注： Accepted by NeurIPS 2026
点击查看摘要
Abstract:Verbal memory retrieval carries rich diagnostic information for Alzheimer's disease through the order, hesitation, and categorical organization of recalled words, yet computational modeling of this retrieval process remains largely unexplored. A key challenge is that timing and hierarchical structure are diagnostically entangled: the diagnostic meaning of retrieval timing depends on its hierarchical context. We propose TrajLift, a spectral framework that models verbal recall as timed trajectories on a hierarchical graph. Our central mechanism is latency-modulated heat diffusion on the semantic hierarchy, a unified operator that lifts each recalled word into a representation of both multi-scale hierarchical structure and continuous retrieval timing. Formal analysis shows that the resulting representation is first-order separable into structural and temporal components with spectral selectivity across hierarchical levels. On synthetic benchmarks requiring structure-time interaction, TrajLift stays near-perfect on deep hierarchies where all baselines fail. On real-world clinical data, we show that TrajLift outperforms diverse baselines by jointly modeling timing and semantic structure, with gains that grow as retrieval timing becomes more informative.
37. 【2611.12196】he Deception Archive as a repository of standardized datasets for large-scale verbal deception detection research
链接：https://arxiv.org/abs/2611.12196
作者：Caterina Borgese,Riccardo Loconte,Lucca Pfründer,Bennett Kleinberg
类目：Computation and Language (cs.CL)
关键词：natural language processing, verbal deception research, verbal deception datasets, verbal deception, existing verbal deception
备注：
点击查看摘要
Abstract:Computational advances in natural language processing and machine learning have substantially expanded the use of automated approaches in verbal deception research. However, existing verbal deception datasets remain fragmented across disciplines, as they are often difficult to identify, access, and reuse, limiting cross-study comparisons and the development of robust computational models. We present the Deception Archive, a curated and standardized repository of publicly available verbal deception datasets built upon a large-scale systematic review. Eligible datasets were retrieved, manually inspected, and standardized following a structured data curation workflow. The current repository comprises 41 publicly available datasets containing 387,995 truthful or deceptive statements. The archive represents a heterogeneous repository (e.g., in data size, topic of investigation, ground-truth, etc.) and a living resource for integrating newly available deception datasets over time. By providing centralized access to standardized datasets and accompanying metadata, the Deception Archive facilitates dataset discovery, cross-dataset validation, and reproducible evaluation of computational models.
38. 【2611.12184】Blind Variation, Selective Retention: Improving Creative Idea Generation in AI Scientists
链接：https://arxiv.org/abs/2611.12184
作者：Guowei Xu,Jiaru Zou,Mete Erdogan,Haotian Ye,Pan Lu,James Zou
类目：Computation and Language (cs.CL)
关键词：Scientific discovery requires, discovery requires ideas, requires ideas, task, information
备注： Project Website: [this https URL](https://zou-group.github.io/BVSR/)
点击查看摘要
Abstract:Scientific discovery requires ideas that are original, useful, and non-obvious. Yet AI scientists are typically given as much task information as possible during idea generation, which can anchor generation toward familiar approaches. Inspired by the cognitive framework of Blind Variation and Selective Retention (BVSR), we propose a discovery framework that separates these two roles of information: it generates proposals under deliberately limited task information to broaden exploration, then learns from proposals previously verified on the same task and their outcomes to retain promising candidates for costly empirical evaluation. We evaluate BVSR across five proposer models and 12 scientific tasks. Limiting task information substantially increases proposal originality and non-obviousness, and produces a larger share of highly creative and high-utility proposals than existing state-of-the-art prompting-based baselines. Learning from prior proposal outcomes on the task further improves candidate selection, discarding half of the candidates while retaining most top-performing proposals. When incorporated into existing AI-scientist workflows, BVSR achieves stronger discoveries across gene expression analysis, drug response prediction, anomaly detection, scaling law discovery, and brain activity prediction. These results suggest that effective AI scientists should use information differently across stages of discovery: constrain task-specific information during exploration while exploiting accumulated empirical experience on the task.
39. 【2611.12180】S-GEAR: Taobao Shangou GEnerative Ad Retrieval
链接：https://arxiv.org/abs/2611.12180
作者：Guofeng Tong,Xu Zhang,Guangliang Yu,Haiqiang Wang,Guannan Cong,Xing Guo,Yang Zhou,Jingjing Duan,Shuang Li,Feng Shi,Hualei Liu
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Uber Eats impose, Uber Eats, DoorDash and Uber, Eats impose, traditional e-commerce
备注：
点击查看摘要
Abstract:On-demand delivery platforms such as DoorDash and Uber Eats impose a constraint absent in traditional e-commerce: merchants beyond the user's delivery range are invalid candidates rather than merely low-ranked. Generative retrieval has recently shown strong potential in large-scale retrieval systems. Adapting it to this setting, however, poses three challenges. First, existing semantic IDs encode geography only as a soft signal, so reachability can only rely on a non-differentiable post-generation hard truncation. Second, user preferences vary substantially across both regions and queries, so aggregating historical behaviors without conditioning on geography and the current query yields biased interest estimates. Third, the retrieved candidate set is evaluated by its collective value, yet autoregressive training scores each sequence independently, with no set-level signal to discourage redundant near-duplicates. To address the challenges, we propose TS-GEAR, a unified generative retrieval framework for on-demand delivery: (1) Geo-Semantic ID splits merchant identifiers into geographic prefixes and semantic suffixes, making reachability a prediction target rather than a post-hoc filter; (2) Query-Geo Target Attention aggregates historical behaviors using the real-time query and location as dual targets, while encoding each behavior's own location into its attention key; (3) GMPO (Group Marginal Policy Optimization) rewrites advantages using a deduplicated group reward and marginal advantage within GRPO, avoiding auxiliary diversity objectives. Deployed online with a lightweight 0.1B backbone, TS-GEAR serves over 150 million queries per day in the search advertising pipeline of Taobao Shangou, consistently outperforming state-of-the-art generative retrieval methods on both HitRate and geographic validity, and achieving 3.8% gains in ad impressions and 4.2% in ad revenue.
40. 【2611.12127】Lost in Rounding: bf16 Recurrent State Makes Hybrid Reasoning Models Think Longer
链接：https://arxiv.org/abs/2611.12127
作者：Yuchuan Weng,Xin Chen,Chi Liu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Gated DeltaNet, models interleave attention, Hybrid reasoning models, reasoning models interleave, interleave attention
备注： 13 pages, 2 figures, 7 tables
点击查看摘要
Abstract:Hybrid reasoning models interleave attention with recurrent mixers such as Mamba-2 and Gated DeltaNet, whose state is cached between decoding steps. Prior work showed that storing this state in FP16 or INT8 with round-to-nearest (RTN) makes Mamba-2 and GDN hybrids more verbose, and that stochastic rounding (SR) fixes it. We study the other 16-bit format that serving engines expose, bf16, on six open hybrid reasoning models and 590 competition-math problems. With bf16 RTN state, five of six models reason longer (geometric-mean length 1.07x to 1.27x; also under greedy decoding in the two models tested) and hit the 32K token cap more often. On Qwen3.5-9B, cap hits rise from 118 to 223 and accuracy falls from 85.6% to 70.8%. On LiveCodeBench, both models tested also reason longer and lose 12.6 and 13.4 points of pass@1. Rerunning the capped items with a 128K budget halves the accuracy gap but does not close it (93.6% vs. 86.6%): bf16 runs that never finish are twice as common, and 85% of them are exact repetition loops. On Nemotron-Nano-9B-v2, by contrast, 30 of 31 extra caps finish at 128K, so the cost there is mostly extra tokens (exploratory). Same-width bf16 SR removes the length increase in four of five affected models, restores Qwen3.5-9B to 87.6% and brings code length and pass@1 near FP32 levels, so the failure is mostly rounding bias, not missing resolution. With an integer-hash random generator, SR on Qwen3.5-9B matches FP32 on cap hits and accuracy (113 vs. 118; 85.6% for both) at the memory and decoding speed of bf16 RTN. In the Nemotron-Nano-v2 lineage, SR on 25% of heads (an intermediate-decay band) removes the effect, while random heads and the top teacher-forced-KL octiles do not; in Nemotron-3 and Qwen3.5-9B the effect is spread across heads. We recommend that evaluations of hybrid models report the state dtype, cap rate and output length alongside accuracy.
41. 【2611.12114】OGDA: Ontology-Grounded Data Agents for Reliable Analysis over Heterogeneous Data Lakes
链接：https://arxiv.org/abs/2611.12114
作者：Boyi Zhang,Hong Ting Tsang,Yisen Gao,Qiao Xiao,LI Yufei,Haoyu Huang,Zhongwei Xie,Jiaxin Bai,Yangqiu Song
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Full-pipeline data analysis, Full-pipeline data, requires LLM agents, data, lakes requires LLM
备注：
点击查看摘要
Abstract:Full-pipeline data analysis over real-world data lakes requires LLM agents to locate and integrate information across large collections of tables with different schemas. Existing data agents follow task-specific exploration, which exhausts the context window in massive lakes. As the context fills, the agent's reasoning degrades, leading it to locate and process incorrect data files. These errors propagate into the final answer. To overcome these limitations, we introduce Ontology-Grounded Data Agent (OGDA), which utilizes a compact ontology to reduce exploration overhead and constrain data processing. OGDA constructs the ontology through agentic hypothesis testing. At each step, a proposer agent induces schemas, concepts, and relations from raw sources, and a verifier checks each proposal against the underlying data. During task execution, the ontology serves as a representation of the data lake for the agent to explore. Every data-processing action is constrained by a task graph, which the agent can extend only after observing the semantic meaning of the data. Across KramaBench and DiscoveryBench with three LLM backbones, OGDA outperforms the strongest baselines by up to 10.82 points. These results suggest that explicitly modeling the data lake is a key step toward reliable end-to-end data agents.
42. 【2611.12078】SadaqahStories: A Verified English-Arabic Corpus of Charity Stories for Children, with an Audit of Errors in AI-Drafted Religious Narratives
链接：https://arxiv.org/abs/2611.12078
作者：Wajdi Zaghouani,Spencer Striker
类目：Computation and Language (cs.CL)
关键词：Zakat and Waqf, illustrated four-page stories, giving in Islam, parallel English-Arabic corpus, present SadaqahStories
备注： 5 pages, 1 figure, 5 tables. Data and code: [this https URL](https://github.com/wajdiz/sadaqahjourney) Website: [this https URL](https://sadaqahjourney.com)
点击查看摘要
Abstract:We present SadaqahStories, a parallel English-Arabic corpus of 41 illustrated four-page stories about charitable giving in Islam (Sadaqah, Zakat and Waqf), written for readers aged 7 to 18. The stories were first drafted with large language model (LLM) assistance, then audited against hadith collections, Qur'an references and historical sources, and finally rewritten for children and signed off by an Islamic scholar. Every story carries an evidence label and links to its sources. We release all three versions of each story (AI-assisted draft, audited text, final child-oriented text) together with the correction log, so the corpus can be used to study how AI drafts of religious and historical content go wrong. The audit found substantive errors in 39 of the 41 drafts. The most frequent were unsupported specific details (dates, figures, prices, names), invented quotations, institutions or anecdotes, and conflation of separate events or people; six drafts contained errors in the wording, grading or ruling of a religious text. Rewriting cut the estimated Flesch-Kincaid grade of the English text from 14.0 to 6.1. We also release an 81-entry charity lexicon covering Modern Standard Arabic and Qatari Arabic, and describe the free, account-free website that serves the corpus (this https URL).
43. 【2611.12068】MIRIX-2.0: Multi-Agent Memory System
链接：https://arxiv.org/abs/2611.12068
作者：Wei-Chieh Huang,Weizhi Zhang,Jiayan Nan,Peng Xia,Yu Wang
类目：Computation and Language (cs.CL)
关键词：LLM agents personalize, stay consistent, Long-term memory, reuse what worked, LLM agents
备注： Code available at [this https URL](https://github.com/Mirix-AI/MIRIX)
点击查看摘要
Abstract:Long-term memory lets LLM agents personalize, stay consistent, and reuse what worked before. Parametric memories need training, consolidation can lose details for good, and keeping every record leaves a growing store to search. We present MIRIX-2.0, a multi-agent memory system designed to be practical, accurate, and efficient at once. It is the most accurate of the compared systems on four of five QA benchmarks. It reaches 91.4% on LoCoMo and 72.6% on LongMemEval-S, where it leads the strongest baseline by 14.3 points, and with AutoDream disabled it gains 31.0 and 22.0 points over HyperMem on single-hop and multi-hop document QA. As procedural memory, it yields the highest mean success among the compared memory methods on ALFWorld and WebShop and reaches 49.2% on MetaClaw-Bench, against 44.0% for MetaClaw's skill library. Six typed memory agents keep complete records as the system of record, and a provenance hypergraph indexes episodic and semantic records with n-ary frames that cite their rows. Retrieval runs under explicit budgets, so the evidence a question inspects does not grow with the history. AutoDream merges duplicate anchors outside the write path without rewriting any record, and it distills task sessions into skills. With AutoDream disabled, MIRIX-2.0 answers faster than HyperMem on all five timed benchmarks. It needs no fine-tuning, runs with closed and open models, and its code is public.
44. 【2611.12062】ranslating KV Caches Between Hybrid-Attention Language Models: MLA Latents, Linear-Attention States and Sparse-Attention Indexers
链接：https://arxiv.org/abs/2611.12062
作者：Povilas Kvedaras,Tomas Rasymas
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：text hand-off shortens, dropping content, MLA, text hand-off, hand-off shortens
备注： 50 pages, 27 figures, 16 tables
点击查看摘要
Abstract:A model that takes over another model's conversation must normally re-read the whole history; a text hand-off shortens the re-read only by dropping content. KV-cache translation instead maps the source's cache into the target's own format, so the target continues from the full context without re-reading it. It works for grouped-query attention (GQA), but open-weights frontier models now cache compressed latents (MLA), sparse-attention indexer keys and fixed-size linear-attention states. We replicate KV-Lingo on a GQA pair and then give, for each of these objects, where to capture and inject it and a mechanism that reaches native quality. We study two hybrid pairs at 16-48B scale in both directions, Kimi-VL-A3B - Kimi-Linear-48B (MLA - MLA + Kimi Delta Attention) and Qwen3.5-27B - Qwen3.8-27B (Gated DeltaNet hybrids), plus a sparse-attention target (Qwen3.8-27B - Qwen3.8-Flash-Next). MLA latents translate with token-wise linear maps; recurrent states are copied with a closed-form correction or synthesised by replaying the target's own recurrence. Exact long-range recall needs token identity: decoding token ids from the source's layer-0 MLA latent raises needle recall from 0.09 to 0.99 at 2-32K and to 0.83-1.00 at 64K, eight times the longest training prompt. The hybrid full-MLA direction is within the paired confidence interval of native quality on every task metric, and same-shape GDN hybrids reach the native level in both directions (apart from 6% refusals inherited from the source), with time to first token 18.7 and 46.8 times shorter than a re-read at 64K tokens. Segment-wise multi-turn transfer stays at the re-prefill level; naive re-translation collapses. On the sparse-attention target, predicted indexer keys recall the needle as well as the target's own keys (one seed). We state as a hypothesis how the recipes transfer to 300B+ hybrid flagships.
45. 【2611.12041】SMO: Compiling Natural Language Skills into Graphs of Reusable State-Move-Outcome Bricks
链接：https://arxiv.org/abs/2611.12041
作者：Chao Chen,Jiashuo Zhang,Yunhang Shen,Liangyu Lian,Rongrong Ji
类目：Computation and Language (cs.CL)
关键词：Large language model, language model agents, model agents increasingly, agents increasingly rely, collections remain accumulations
备注：
点击查看摘要
Abstract:Large language model agents increasingly rely on reusable natural-language skills, yet growing skill collections remain accumulations of isolated text artifacts that are difficult to compare, deduplicate, and compose. We argue that the reusable content of a skill lies not in its surface wording but in its procedural transitions: which operation to execute under a given state and which observable outcome to produce. Based on this observation, we propose State-Move-Outcome (SMO), a compilation-like framework that decomposes raw skills into reusable procedural bricks and organizes admitted bricks as an externalized symbolic structure. When compiling a skill, SMO first retrieves and composes existing bricks, dynamically connects them through Outcome-to-State conditions, and creates a candidate brick only for an uncovered procedure; the candidate becomes reusable only after validation and admission. Experiments on SkillsBench v1.1 demonstrate that SMO represents 232 rawSkills from 87 underlying tasks with 95 shared bricks, reducing the corresponding skill representations from 366,472 to 149,154 tokens--a $\mathbf{59.3}\times$ reduction and $\mathbf{2.46}\times$ compression. Across 232 skill-conditioned evaluation instances, SMO raises the average task score from $\mathbf{0.6379}$ to $\mathbf{0.7478}$ and increases 5/5 Pass instances from $\mathbf{138}$ to $\mathbf{164}$, while matching or outperforming rawSkill on $\mathbf{208}$ of $\mathbf{232}$ instances. It also reduces average runtime token consumption by $\mathbf{38.38\%}$. These results show that compiling natural-language skills into shared procedural units can jointly improve skill reuse, representation efficiency, and downstream execution.
46. 【2611.12020】A generalized transition framework for identifying reduction domains in non-binary constituency parsing
链接：https://arxiv.org/abs/2611.12020
作者：Jungyeul Park,Zihao Huang,Eunkyul Leah Jo
类目：Computation and Language (cs.CL)
关键词：Direct non-binary constituency, non-binary constituency parsing, Direct non-binary, non-binary constituency, identify an ordered
备注：
点击查看摘要
Abstract:Direct non-binary constituency parsing must identify an ordered sequence of children at each phrase-level reduction. We extend our earlier delimiter-guided bottom-up construction to a common calculus for top-down, in-order, and bottom-up parsing. At reduction, the rightmost delimiter marks the left boundary, the nonterminal marker supplies the mother label, and the completed items in the delimited segment determine the children and arity. We use a stack invariant to prove soundness and completeness and derive the exact length of the static oracle's action sequence. A projection-and-lifting theorem shows that each delimiter-guided system and its canonical counterpart generate the same set of trees under both the structural and grammar-licensed transition relations. In controlled experiments on PTB and CTB, the delimiter-guided parsers achieve similar labeled accuracy to their canonical counterparts across all traversal orders. For bottom-up parsing, delimiter guidance reduces the number of action classes and increases the number of supervised decisions per tree.
47. 【2611.12016】Speculative Self-Distillation enables Efficient Knowledge Internalization
链接：https://arxiv.org/abs/2611.12016
作者：Shayan Talaei,Agam Bhatia,Arshia Soltani Moakhar,Jonas Hübotter,Amin Saberi,Azalia Mirhoseini
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：real-world applications require, applications require language, incorporate continually updated, require language models, continually updated facts
备注： NeurIPS 2026. 26 pages, 8 figures, 12 tables. Project page: [this https URL](https://ssd-distill.github.io/) Code: [this https URL](https://github.com/ShayanTalaei/SpeculativeSelfDistillation)
点击查看摘要
Abstract:Many real-world applications require language models to internalize knowledge that was absent from pretraining, to incorporate continually updated facts, or to learn new domain skills. Self-distillation has emerged as a natural approach for this task. A model conditioned on the source material acts as the teacher, and an unconditioned student is trained to reproduce the teacher's behavior closed-book. We propose Speculative Self-Distillation (SSD), an efficient per-token mixed-policy method for self-distillation. The student generates each rollout by default, while the teacher intervenes only at positions where its next-token distribution substantially diverges from the student's. Unlike off-policy distillation with teacher-generated prefixes, this design keeps training rollouts close to the student's test-time behavior, while avoiding the low-signal states that fully on-policy rollouts drift into. In effect, SSD lets the teacher steer the rollout exactly where the privileged context changes the prediction. On three closed-book QA benchmarks measuring fact recall, knowledge updates, and skill acquisition, SSD nearly matches on-policy distillation while using 38-69% fewer supervised tokens and consistently outperforms off-policy distillation on the held-out test set. On a forgetting stress test, SSD retains the most general capability while also achieving the best in-domain accuracy and using less supervision than the on-policy baseline. Overall, SSD establishes a new accuracy-efficiency-forgetting Pareto frontier for self-distillation.
48. 【2611.12012】Robust Domain-Mixture Scheduling for Multi-Teacher On-Policy Distillation
链接：https://arxiv.org/abs/2611.12012
作者：Yankai Chen,Sida Lin,Yifan Li,Hanjun Luo,Hanrong Zhang,Zhuohan Xie,Bowei He,Wei-Chieh Huang,Meng Ding,Wei Xue,Yike Guo,Philip S. Yu,Xue Liu
类目：Computation and Language (cs.CL)
关键词：Multi-teacher on-policy distillation, multiple domain-expert teachers, Multi-teacher on-policy, single compact student, merges the capabilities
备注：
点击查看摘要
Abstract:Multi-teacher on-policy distillation (MOPD) merges the capabilities of multiple domain-expert teachers, such as mathematical reasoning, code generation, and instruction following, into a single compact student. Since all domains share a limited training budget, how to allocate it across domains directly determines the quality of distillation. Existing methods allocate the budget by each domain's learning progress, but offer no guarantee for lagging domains. We therefore introduce distributionally robust optimization (DRO) into MOPD to prioritize the worst-performing domain. However, the per-domain training signals are estimated from a few rollouts and are inherently noisy, so directly applying DRO mistakes noise for the worst case, lets occasional spikes hijack the budget, and protects inherently hard domains rather than truly regressing ones. To address these issues, we propose RDS-MOPD, which keeps the DRO objective and redesigns its three parts: it shifts the allocation only when differences clearly exceed the noise, bounds the influence of any single anomaly, and defines the worst case as the regression from each domain's own best level, all with theoretical guarantees. Experiments show that RDS-MOPD outperforms recent competing methods and ranks first on most mathematical reasoning, code generation, and instruction-following benchmarks.
49. 【2611.11995】Infrathon: Benchmarking Language Agents for Real-World, Long-Horizon AI Infra Optimization
链接：https://arxiv.org/abs/2611.11995
作者：Zhengyu Hu,Zheyuan Xiao,Yike Wang,Hamish Ivison,Haoyu Wang,Yige Yuan,Rulin Shao,Yuetai Li,Niqi Lyu,Yicheng Ding,Shu Yang,Zhichen Zeng,Banghua Zhu,Jiaxin Pei,Kaize Ding,Pradeep Dasigi,Dan Roth,Hannaneh Hajishirzi,Noah A. Smith,Teng Xiao,Radha Poovendran
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：continually improve real-world, continually improve, improve real-world, long horizons, Abstract
备注：
点击查看摘要
Abstract:In this work, we study whether frontier agent can continually improve real-world AI infrastructure over long horizons. We introduce Infrathon, a benchmark of diverse, long-horizon AI infrastructure optimization tasks across different levels. We evaluate six models across 150 runs with 24-hour budgets, totaling over 10,000 GPU-hours. Our results show that model rankings vary with the evaluation horizon, while 135 of the 150 runs achieve further improvements during the second half of their budgets. These findings indicate that shorter evaluations can overlook both optimization gains and changes in relative model performance. We also find agents can discover solutions that outperform human-designed baselines: Claude Opus 5.5 increases the mean KV-cache compression ratio from 6.82% with the human-designed Quant-VideoGen codec to 19.86%. Analysis of agent trajectories identifies task violations, unreliable testing, and premature completion as barriers to sustained improvement. Together, Our Infrathon framework provide resources for constructing long-horizon tasks, evaluating frontier agents, and discovering good infrastructure solutions.
50. 【2611.11994】EmoHarness: Boosting Multimodal Emotion Understanding with Meta-Harness Evolving
链接：https://arxiv.org/abs/2611.11994
作者：Fenghai Li,Bingxuan Li,Jiawen Zhang,Yifan Shen,Jiateng Liu,Yutong Zhang,Yue Guo
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：visual cues conflict, cues conflict, visual cues, Small multimodal models, misjudge emotion
备注： 18 pages, 11 figures, 6 tables. Project page: [this https URL](https://emo-harness.github.io) . Code: [this https URL](https://github.com/Emo-Harness/EmoHarness)
点击查看摘要
Abstract:Small multimodal models can misjudge emotion when words, voice, and visual cues conflict. We present EmoHarness, which runs such a model, the frozen student, inside a harness: the prompts, settings, and verification code around its calls. A human-written starting harness, the scaffold, numbers the student's visual observations, transcript, and prosody descriptions as citable evidence and has the student weigh candidate emotions against it. In Meta-Harness Evolving (MHE), a stronger LLM, the Builder, reads the student's errors and execution traces offline and edits the harness; static checks and validation gates decide which edits are kept, and the Builder never sees evaluation items. On 5,507 MME-Emotion items, EmoHarness raises task-macro Recognition by 7.6-13.4 points over a single video-only call for all four students and both Builders. Transcripts and prosody descriptions supply most of this boost (+5.38 to +10.71); the scaffold changes the audio-augmented call by -0.79 to +2.54, partly through extra multi-label predictions, and evolved edits add at most +0.95, although no evolved increment survives Holm correction. The harness's emotion context also transfers to IntentQA, with small gains for three of four students, none of which survives correction. EmoHarness thus boosts small multimodal students chiefly by supplying and organizing audio-derived evidence.
51. 【2611.11987】When Audio and Video Mislead: Evaluating Multimodal AI for Conversational Emotion Recognition
链接：https://arxiv.org/abs/2611.11987
作者：Youngseok Kim,Minjae Kim,Eunsoo Lee,Jihie Kim
类目：Computation and Language (cs.CL)
关键词：Multimodal Emotion Recognition, Multimodal Emotion, Recognition in Conversation, Emotion Recognition, combines lexical
备注： 40 pages, 3 figures, 24 tables. Full version with appendices of a paper accepted at AICompS 2026 (Springer CCIS). Code and data: [this https URL](https://doi.org/10.5281/zenodo.23970406)
点击查看摘要
Abstract:Multimodal Emotion Recognition in Conversation (MERC) combines lexical, acoustic, visual and conversational cues, but accepting audio and video does not establish their effective or robust use. We audit off-the-shelf Omni models while holding the target transcript and prior textual context fixed and adding, removing or replacing target audio and video. In the primary evaluation of Qwen2.5-Omni-7B, Baichuan-Omni-1.5 and MiniCPM-o 2.6 on MELD and the full five-session six-class IEMOCAP set, T+A improves Accuracy in all six model-dataset pairs, with four gains significant after false discovery rate (FDR) correction. Across three source mappings, unrelated A/V (RandA/V) lowers Accuracy relative to Full in all 18 comparisons; all 18 remain significant under dialogue-cluster inference and BH-FDR correction, both on common-valid pairs and when invalid/OOM outcomes are treated as incorrect. Comparisons with modality-omission baselines further distinguish replacement penalties from mismatch-specific harm. A Qwen/MELD case study finds significantly greater gold-vs-best-candidate margin recovery in Late than Early or Middle under decision-query audio knockout, relative to an edge-count-matched Video-Sham control, using Holm-corrected tests. These results distinguish genuine-modality benefit from sensitivity and vulnerability to misleading input.
52. 【2611.11955】CHO-Bench: How Do Context Hints Affect Ad Rankings in LLM Advertising?
链接：https://arxiv.org/abs/2611.11955
作者：Shiqi Zhang,Yang Fei,Xiaokui Xiao
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：explicit product searches, selects advertisements based, user conversations, diverse user conversations, product searches
备注： 11 pages, 6 figures, 4 tables
点击查看摘要
Abstract:LLM advertising selects advertisements based on user conversations, where user needs may extend beyond explicit product searches. ChatGPT Ads allows advertisers to provide natural-language context hints describing what they offer, who may find it useful, and when it may be useful, as additional information for ranking advertisements across diverse user conversations. However, how to effectively construct these hints remains unclear. We formulate Context Hint Optimization (CHO) as the problem of constructing context hints to improve an advertisement's ranking under a given budget. Drawing on established marketing frameworks, we develop seven context hint generation strategies covering What, Who, and When, along with a Unified strategy that combines all seven dimensions. We introduce CHO-Bench and conduct over 1.19 million paired evaluations across five datasets using embedding-based and LLM-based rankers. Our results show that context hints improve advertisement rankings under the evaluated offline rankers. While individual strategies achieve similar average gains and Unified offers no consistent advantage, strategy differences become more pronounced under specific generation-ranking configurations, with embedding-based and LLM-based rankers favoring different information dimensions. Increasing the hint budget further improves rankings with diminishing marginal gains. These findings establish an offline benchmark for studying ad-side ranking optimization in LLM advertising and highlight opportunities for model-specific hint selection and budget-aware generation and aggregation.
53. 【2611.11952】BharatSynthQA: A Context-Grounded Question Answering Dataset on Indian Temples and Religious Heritage
链接：https://arxiv.org/abs/2611.11952
作者：Riya Naik(1),Shivam Sharma(2),Swati Agarwal(3) ((1) BITS Pilani, K K Birla Goa Campus, India, (2) Indian Institute of Technology Madras, India, (3) PandaByte Innovations Pvt Ltd, India)
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：places of worship, richest repositories, repositories of cultural, Artificial Intelligence, religious tradition
备注： Under review at ECIR 2027 (Resource track)
点击查看摘要
Abstract:India's temples and other places of worship are among its richest repositories of cultural heritage, bringing together religious tradition, history, architecture, and art. Due to the widespread curiosity, people increasingly turn to Artificial Intelligence (AI) assistants for information about them. Current models are rarely trained or evaluated on this domain. We present BharatSynthQA, a passage grounded question answering (QA) dataset focused on Indian temples, which also covers other religious sites connected to them. Our pipeline crawls Wikipedia from topics seeded by authentic heritage sources, filters articles for topical relevance, and locations in India. Further it generates Boolean, factoid, and explanatory QA pairs with a fewshot prompted LLM. An LLM judge filters the pairs on answer correctness, retaining 98,677 of 131,494 generated pairs. Additionally, 300 human-annotated pairs are released separately as a reference set. Human evaluation of the subsample of this dataset showed 89.83% of the questions were formed correctly. Benchmarking five current LLMs shows that factoid token F1 is only 0.18-0.30 without the source passage but 0.73-0.77 with it, indicating that this domain is poorly captured in model knowledge. The dataset is available at this https URL to support research on culturally grounded QA and retrieval-augmented generation for Indian heritage.
54. 【2611.11902】Spectral Unlearning: Transformer Structure-Preserving Updates for Language Models
链接：https://arxiv.org/abs/2611.11902
作者：Sung Il Choi,Junhao Cai,Dohun Kim,Changhee Joo
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Cryptography and Security (cs.CR)
关键词：specific learned knowledge, large language models, remove specific learned, preserving model utility, Machine unlearning
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:Machine unlearning in large language models (LLMs) aims to remove specific learned knowledge, capabilities, or behaviors while preserving model utility. Existing methods have mostly focused on the design of unlearning objectives, while largely overlooking the intrinsic matrix structure of transformer weights. In particular, standard optimizers operate on independent scalar coordinates, thereby ignoring this matrix structure. We propose spectral unlearning, an update framework that combines standard unlearning objectives with matrix-structured optimization. We show that the spectral update corresponds to the steepest-descent direction for transformers composed of linear layers with normalized inputs and outputs. Our approach is applied on top of existing unlearning methods and evaluated across complementary axes of memorization, privacy, and utility, summarized via their harmonic mean. Spectral unlearning consistently outperforms a broad range of baselines and closes most of the gap to a retain-trained reference. Code is available at this https URL.
55. 【2611.11901】Adaptive Entropy-Sparing for Efficient Reasoning
链接：https://arxiv.org/abs/2611.11901
作者：Cong Jiang,Xiaofeng Zhang,Tom Ko,Zheng Zhang
类目：Computation and Language (cs.CL)
关键词：produce explicit chains, risk introducing errors, inefficient reasoning chains, Large Reasoning Models, inflate computational costs
备注： Accepted at NeurIPS 2026. 17 pages, 4 figures
点击查看摘要
Abstract:Large Reasoning Models (LRMs) produce explicit chains of thought to improve transparency, but they frequently overthink, generating long yet inefficient reasoning chains that inflate computational costs and risk introducing errors. While numerous reinforcement learning methods struggle to penalize verbosity to achieve conciseness, they typically apply the penalty uniformly across lengthy sequences, which leads to credit confounding, that is, the failure to distinguish essential reasoning steps from superfluous ones. In this paper, we study a measurable proxy for this confounding: high-entropy tokens that often coincide with surface transition points where reasoning re-enters verification. Based on this insight, we propose Adaptive Entropy-Sparing (AES), which selectively spares high-entropy tokens that occur before an efficient in-group reference, while penalizing overlength high-entropy suffix tokens associated with superfluous branching. Our AES thereby navigates the suppression-exploration trade-off, reducing overthinking while preserving average reasoning accuracy. We also present an entropy-length model that motivates why local uncertainty can serve as a proxy for future reasoning cost. Across eight reasoning benchmarks, AES reduces reasoning length by up to 52.9% while increasing mean accuracy by up to 3.8% over the base models, consistently outperforming existing efficiency-oriented methods. Our code is available at this https URL.
56. 【2611.11897】ShopMind: A Mental World Model for Personalized and Realistic E-commerce User Simulation
链接：https://arxiv.org/abs/2611.11897
作者：Peixuan Hou,Bin Chen,Li He,Jian Xu,Xiuli Ma,Guojie Song
类目：Computation and Language (cs.CL)
关键词：Large language models, Large language, predicting human decisions, mental states, providing a foundation
备注：
点击查看摘要
Abstract:Large language models are widely used in e-commerce user simulation, providing a foundation for understanding users and predicting human decisions. However, existing simulators still struggle to achieve both personalization and behavioral realism. Most methods predict the next action directly from interaction histories and the current context, without accounting for the evolving mental world that underlies user behavior. Theory of Mind suggests that behavior is driven by mental states, including beliefs, uncertainties, and intentions. Users may interpret the same information in distinct ways, leading to divergent behaviors, while an individual's mental state evolves through interaction and shapes subsequent actions. Ignoring this process prevents simulators from faithfully capturing individual differences and realistic behavior patterns, and undermines its effectiveness in downstream applications. To address this, we propose ShopMind, a Mental World Model for e-commerce user simulation that captures how consumers interpret shopping information and how their mental states evolve, better reflecting individual users and real-world behavior patterns. We further use behavior-mental state pairs synthesized by ShopMind to train a Mental State Reconstruction (MSR) model, which infers consumers' latent mental states from observable behavior. Experiments show that ShopMind improves personalization by 18.0% and behavioral realism by 19.6% over the strongest alternatives. Moreover, MSR improves performance on consumption value measurement and CTR prediction, showing the utility of ShopMind for understanding and predicting real user behavior.
57. 【2611.11892】When Answer Decodability Is Not a Decision: Separating Final-Answer and Imminent-Emission Signals in Chain-of-Thought
链接：https://arxiv.org/abs/2611.11892
作者：Hyojung Han,Jongmin Kim,Seung-Hun Jeon
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：final answer, hidden states, Answer probes applied, final response, Answer
备注： 20 pages, 6 figures, 3 tables
点击查看摘要
Abstract:Answer probes applied to chain-of-thought hidden states are often read as evidence that a language model has already decided its final response. This reading overlooks a competing signal, the candidate the model is about to mention. We introduce emission-controlled dual-target probing (ECDP), which fits the same low-rank reader family separately to the imminent mention and to the final answer at identical positions, with target-specific nulls and thresholds fixed before any fit. On correct DecisionDepth (DD) rollouts in which a distractor is mentioned before the final answer, Qwen3.5-4B decodes the next mention at .966 (null .234) but the final answer only at .221 (null .186), an emission gap of .696 [.648, .744]; Llama-3.1-8B gives .575 [.514, .632]. This pattern is not universal. In a pre-specified evaluation of Qwen3-8B with thinking enabled on held-out MMLU questions, using a full-prefix attention reader over every thinking position, both targets are decodable and the final answer is read far more strongly (mention-minus-answer lift -.398 [-.459, -.336] at layer 22 over 467 questions). Model, task, positions, and reader change together between these settings, and an attempted matched comparison on DD produced no valid statistics because the imminent-mention probe did not train reliably, so we do not identify what reverses the order. On DD, planted-signal controls show that the reader recovers an injected final-answer signal at one tenth of full dose. Answer-candidate decodability is therefore target-relative and protocol-dependent: a strong answer readout does not by itself establish when a model commits, and a probe that fails to train is not evidence that the information is absent. ECDP is a practical control for distinguishing imminent text emission from evidence of a settled decision.
58. 【2611.11891】A Large-Scale Dataset for Cross-Lingual Multi-Jurisdiction Patent Drafting from Patent Cooperation Treaty Applications
链接：https://arxiv.org/abs/2611.11891
作者：Trung Phuong Le,Hirofumi Nonaka,Koji Marusaki,Katsuhito Sudoh,Seiya Kawano
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Securing patent protection, national patent office, countries requires drafting, Securing patent, Japan Patent Office
备注： 16 pages, 2 figures, 10 tables. Accepted to INLG 2026
点击查看摘要
Abstract:Securing patent protection across countries requires drafting claims separately for each national patent office, in the relevant language and according to its legal and stylistic conventions. Patent claims can therefore differ across languages and jurisdictions because of translation, target-office drafting practices, and prosecution-stage changes. We formulate cross-lingual patent drafting as generating plausible candidate claim sets for a specified target language, jurisdiction, and prosecution stage from a source claim set in another language. The task models jurisdiction- and stage-specific transformations beyond content-preserving translation. We construct a large-scale Japanese-English dataset by linking Japan Patent Office (JPO) and United States Patent and Trademark Office (USPTO) records through 884,179 Patent Cooperation Treaty (PCT)-derived patent families. Across six released configurations, these families yield 4,067,168 directional claim-set instances; four core configurations form the main benchmark. Commercial machine translation and zero- and few-shot prompting capture part of the task, while supervised adaptation provides the strongest overall baseline, showing that task-specific patterns can be learned from linked cross-jurisdictional claim sets.
59. 【2611.11842】A Benchmark and Layered Evaluation Protocol for Evidence-Grounded Shared Belief Updating in Connected Robotics
链接：https://arxiv.org/abs/2611.11842
作者：Ranulfo Bezerra,Kimitoshi Yamazaki
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA)
关键词：Connected physical systems, Connected Robotics Evidence, physical systems fuse, systems fuse observations, Connected Robotics
备注： 15 pages (10 main + 5 supplementary), 6 figures, 4 tables; supplement adds 1 figure and 7 tables. Project page: [this https URL](https://creg-bench.github.io)
点击查看摘要
Abstract:Connected physical systems fuse observations from robots, IoT sensors, and edge-AI modules into a shared account of the world, yet most evaluations score only the final answer or action and cannot tell whether a method attributed the evidence, updated its belief, handled contradictions, and justified its decision. We argue that shared reasoning in Connected Robotics should be evaluated as an evidence-to-belief trajectory, and introduce the Connected Robotics Evidence Graph (CREG) Benchmark to make that trajectory measurable. CREG comprises 350 deterministically generated scenarios across seven regimes (justified revision, belief preservation, relation association, contradiction onset and resolution, stale/delayed evidence, and source reliability), each exposing a normative posterior reference at every evidence prefix, validated by an independent log-odds checker and screened by a blinded expert audit. Nine representation conditions separate relation content from serialization, ordering, and metadata. Evaluating four open-weight instruction models and six transparent fusion baselines yields three findings. First, entity grounding accounts for a substantial part of the weak-model deficit. Second, deleting semantic relations costs 15.3 points of strict belief-state accuracy on relation-dependent scenarios (Holm-corrected p0.001), but an information-matched structured list outperforms the full graph and shuffling the graph does not hurt: relation content matters where required, while graph serialization confers no consistent advantage. Third, belief accuracy is strongly non-monotonic along the evidence sequence, with mid-trajectory failures that endpoint-only evaluation cannot detect. All scenarios, references, prompts, metrics, and analysis code are released for offline, hardware-free reproduction.
60. 【2611.11838】Improving Confidence Estimation in Language Models with Linear Representations of Ambiguity
链接：https://arxiv.org/abs/2611.11838
作者：Themistoklis Nikas,Nishant Subramani,Aaron Mueller
类目：Computation and Language (cs.CL)
关键词：likelihood of success, downstream applications, accurately estimating, increasingly deployed, deployed in downstream
备注： 31 pages, 21 figures, 5 tables
点击查看摘要
Abstract:As language models (LMs) are increasingly deployed in downstream applications, accurately estimating their likelihood of success on a given example is critical. However, confidence estimates from LMs are poor predictors of their likelihood of success. Accurate confidence estimation is linked in part to the detection of aleatoric uncertainty; we hypothesize that LMs possess representations of at least some aspects of this uncertainty in the form of representations of the inherent ambiguity of the input. Using difference-in-means on minimal pairs of ambiguous and unambiguous sentences, we derive ambiguity representations in LM activations, and find that steering with them selectively (albeit weakly) modulates LMs' judgments of the input's ambiguity. We then propose DART, a fine-tuning method that encourages updates to lie within the span of the ambiguity directions, and penalizes changes to the LM activations outside of this subspace. DART greatly improves calibration, encodes these improvements into the model parameters, and maintains model accuracy on multiple-choice and generative QA tasks.
61. 【2611.11812】CaseLaw: A Policy-Decoupled Framework for Training-Free Content Moderation
链接：https://arxiv.org/abs/2611.11812
作者：Qi Lu,Sen Li,Likun Shi,Xiaolong Jiang
类目：Computation and Language (cs.CL)
关键词：conventional rule based, costly rule rewriting, require costly rule, fine-tuning based systems, rule based
备注：
点击查看摘要
Abstract:Content moderation is inherently policy-dependent: moderation boundaries are often subtle, subjective, and frequently updated, while conventional rule based or fine-tuning based systems require costly rule rewriting, model retraining, or system redeployment. We propose CaseLaw, a policy-decoupled and training-free framework for adaptive content moderation. CaseLaw reformulates moderation as precedent-based retrieval and voting, where multimodal content is transformed into evidence-preserved structured semantics, embedded into a stable semantic space, and classified by thresholded voting over retrieved precedent labels. We train NoteCap on a large-scale corpus of structurally annotated notes to ensure consistent semantic extraction and freeze it during subsequent policy adaptation, which requires no additional training. Policy adaptation is achieved by updating the semantic case library, including case labels and mappings, without retraining models or modifying prompts. To evaluate CaseLaw, we construct MFO-RedNotes, a benchmark for the male-female opposition risk domain. We additionally provide a five category CoPro comparison. Experiments show that CaseLaw consistently outperforms competing baselines in both precision and recall across policy-dependent risk levels and broader safety categories, with category-wise precision/recall reaching up to 86.8%/90.1% on MFO-RedNotes across both policy settings and 94.5%/92.3% on CoPro. Our work highlights the potential of precedent-based reasoning for policy adaptive content moderation and offers a practical direction toward more stable, transparent, and training-free moderation systems.
62. 【2611.11802】HiddenPathQA: A Benchmark for Knowledge Graph Question Answering When Questions Hide Their Paths
链接：https://arxiv.org/abs/2611.11802
作者：Sumin Jo,Edward Choi
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Knowledge graph question, surface tokens lexically, tokens lexically expose, Knowledge graph, graph question answering
备注：
点击查看摘要
Abstract:Knowledge graph question answering (KGQA) systems are typically evaluated on questions whose surface tokens lexically expose the gold KG path. Users, however, may ask questions without knowing the underlying schema: "Which condition could Andrew have due to family history?" compresses a 4-hop chain "Andrew --[father]-- parent --[father]-- grandparent --[medical condition]-- disease --[subclass of]-- hereditary disorder" into a single phrase (family history) that names none of those relations. We identify this collapse of path-question alignment as a blind spot in existing KGQA evaluation. Three major LLM-KG paradigms, hop-by-hop exploration, plan-then-retrieve, and similarity-based retrieval, implicitly rely on such lexical cues, an assumption rarely tested in practice. We make three contributions. (i) We introduce HiddenPathQA, a manually verified benchmark of 1,055 questions spanning 2-6 hops and multiple domains, constructed so that question wording does not reveal the gold path's relations. (ii) We propose Holistic Path Selection, which compares questions against candidate relation chains in the local subgraph as complete units, replacing irreversible per-hop relation scoring with globally informed chain-level reasoning. We develop two implementations, TieredHolistic and FlatHolistic. (iii) We conduct a pseudoword stress test that replaces entity names with meaningless placeholders to distinguish KG-grounded reasoning from entity-level memorization. Holistic Path Selection outperforms six strong KGQA baselines (ToG, PoG, FiDeLiS, R2-KG, KAPING, and KARPA) by 8.8-17.9 accuracy points across two LLM backbones and both original and pseudoword settings. Its advantage under pseudoword replacement shows that the gains cannot be explained by entity-level memorization alone.
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2611.11802 [cs.CL]
(or
arXiv:2611.11802v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2611.11802
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
63. 【2611.11794】ChemInsight: A Comprehensive Benchmark for Evaluating and Diagnosing Chemistry Understanding and Reasoning in Large Language Models
链接：https://arxiv.org/abs/2611.11794
作者：Changyu Hu,Yiming Zou,Xin Tang,Yiru Pan,Zicheng Huang,Deng Zhao,Qing Cui,Zhenduo Zhang,Wang Ren,Xiao Li
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：structured chemical understanding, require multi-step reasoning, chemical understanding, benchmark designed, require multi-step
备注： 16 pages, 6 figures. Changyu Hu, Yiming Zou, and Xin Tang contributed equally. Corresponding authors: Zhenduo Zhang, Wang Ren, and Xiao Li
点击查看摘要
Abstract:We introduce ChemInsight, a benchmark designed to evaluate large language models (LLMs) on chemistry tasks that require multi-step reasoning and structured chemical understanding. We propose a two-dimensional scoring system (scope and depth) to assess both task coverage and reasoning completeness. ChemInsight consists of 203 challenging chemistry questions organized into 50 bundles, which support the two-dimensional scoring evaluation scheme. We evaluate ten representative LLMs using ChemInsight and observe consistently low performance across models, with scope scores below 30% and depth scores below 11%, substantially lower than human expert performance. We then proceed to ask (1) What factor limits the advancement of current LLMs in chemistry? (2) To what extent are statistically driven language-model training methods effective at modeling chemistry symbolic language such as SMILES? And (3) Can LLM performance in chemistry be improved through intensive training on large, domain-specific corpora?
Comments:
16 pages, 6 figures. Changyu Hu, Yiming Zou, and Xin Tang contributed equally. Corresponding authors: Zhenduo Zhang, Wang Ren, and Xiao Li
Subjects:
Computation and Language (cs.CL); Machine Learning (cs.LG)
Cite as:
arXiv:2611.11794 [cs.CL]
(or
arXiv:2611.11794v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2611.11794
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
64. 【2611.11761】BridgeKV: Large-Model Prefill and Small-Model Decoding for LLM Inference via KV Cache Translation
链接：https://arxiv.org/abs/2611.11761
作者：Payman Behnam,Debopam Sanyal,Pranav Ponnusamy,Kusum Meda Ravi,Pranav Sastry,Mani Chandana Bandaru,Alind Khare,Myungjin Lee,Alexey Tumanov
类目：Computation and Language (cs.CL)
关键词：LLM prefill runs, LLM inference, LLM prefill, LLM, larger model
备注：
点击查看摘要
Abstract:LLM inference has two phases with different bottlenecks: LLM prefill runs once per request and is compute-intensive. Decoding repeats for every output token and is limited by memory bandwidth. To address the challenges associated with this issue, different solutions have been proposed. All of these solutions use the same model for both prefill and decode phases. We propose BridgeKV, which uses a larger model for prefill and a smaller model of the same family for decoding. A lightweight KV-stitching module translates the larger model's prompt cache into the smaller model's cache layout. It handles differences in cache shape and representation through learned local layer mixing and separate nonlinear maps for keys and values. With both models frozen, we train the module to align their caches and make the smaller model follow the larger model's next-token predictions. A second training stage adds low-rank adapters when further task adaptation is needed. Across six model pairs and five datasets, BridgeKV outperforms fine-tuned small-model baselines with matched trainable parameter budgets in all 30 settings. It closes up to 80% of the quality gap to using the larger model for both phases. On one A40 GPU, Llama-3.1-Instruct-8B to Llama-3.2-Instruct-1B achieves 3.0X faster requests than the larger model alone, with latency close to the smaller model alone. BridgeKV can improve the hardware and system solutions that separate prefill and decode phases across GPUs. A separate serving simulation models request arrivals, queues, and cache transfer. For Llama-3.1-Instruct-70B to Llama-3.2-Instruct-1B, it predicts up to 33.86X faster requests and 27.5X lower energy use than using the larger model for both prefill and decode phases.
65. 【2611.11740】Creative Priming: Decoupling Process from Product to Escape the Creative Paradox
链接：https://arxiv.org/abs/2611.11740
作者：Alon Albalak,Sebastian Gabriel,David B. D'Ambrosio,Joel Lehman,Kenneth O. Stanley
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：consequential advances promised, fundamentally creative acts, scientific theories, consequential advances, advances promised
备注：
点击查看摘要
Abstract:Many of the most consequential advances promised by AI, from curing diseases and inventing new technologies to formulating new scientific theories, are fundamentally creative acts. Yet creativity is uniquely difficult to learn because it faces a creative paradox: learning to repeat past examples of creative success makes those specific examples more likely to recur, inhibiting the very creativity desired. This work argues that creativity is better modeled as an explicit process rather than as a property of individual artifacts, and proposes to learn the underlying generative principles behind the creative process. In particular, to escape the paradox, we introduce creative priming (CP), wherein a trained priming model generates a prompt-specific primer that assists a response model in being creative, explicitly decoupling the creative process from response generation. The priming model learns through GRPO, rewarding primers that lead to responses that are novel, high-quality, and diverse, thereby reinforcing the process that yields creative responses without reinforcing any specific response.
66. 【2611.11725】he Value of Not Knowing: How Fresh Eyes through Naive LLMs Fuel Creativity
链接：https://arxiv.org/abs/2611.11725
作者：David B. D'Ambrosio,Alon Albalak,Joel Lehman,Kenneth O. Stanley
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：major scientific advances, major scientific, scientific advances, approaching a problem, models
备注：
点击查看摘要
Abstract:Many major scientific advances come from approaching a problem with a new or novel perspective. While large language models (LLMs) with internet-scale knowledge seem poised to take such perspectives, their consistent generation remains elusive. Instead, models are drawn to dominant views and preexisting, in-field bias. To explore the potential of fresh eyes to increase creativity, this paper proposes naive LLMs, models that are made intentionally ignorant of a specific topic. Through deprivation in training or intentional forgetting, naive models are unburdened by existing dogma, allowing them to be free to make new associations and conjectures. These naive models can then be paired with a stronger mentor model that can refine their unique perspectives into concrete proposals. For the 1B and 7B models tested in this paper, naive models consistently produce seed ideas that are more novel and useful than baseline counterparts, and mentor refinement improves the ideas even further. Thus, contrary to the prevailing tradition of scaling up training data, we demonstrate a case where less information is actually more powerful, in particular when the aim is to discover genuinely outside-the-box solutions.
67. 【2611.11724】Explaining and interrupting collective misalignment in language model systems
链接：https://arxiv.org/abs/2611.11724
作者：Edoardo Chidichimo
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：exchange individually innocuous, individually innocuous messages, Collective Dependence Analysis, exchange individually, individually innocuous
备注：
点击查看摘要
Abstract:In collectives, language model agents can exchange individually innocuous messages that together support a policy violation. Understanding and preventing collective misalignment requires answering the question of which messages sufficiently influenced and necessarily enabled the violation. Collective Dependence Analysis (CDA) operationalises necessity and sufficiency to explain decisions and find the fewest removals interrupting support within tested combinations. Tests covered constructed violations, unscripted agent conversations, and recorded interactions, with selected message removals reducing violations from 93% to 6% in controlled cases. Using O(N) model evaluations for N messages, CDA achieves the same violation reduction with half the deletions of a frontier LLM judge given the transcript and asked for all supporting messages in eligible operational cases. CDA also proposes the mechanism through which the collective misalignment emerged. Nonetheless, complete explanations remain difficult on unfamiliar tasks and some removals can inadvertently disrupt correct decisions. CDA unifies explanations of collective misalignment with experimentally tested interventions.
68. 【2611.11695】Language model capabilities fail in a shared, predictable order under compression and perturbation
链接：https://arxiv.org/abs/2611.11695
作者：Zhixiang Wang,Ulas Bagci
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：selectively degrading individual, degrading individual capabilities, language model average, preserve a language, selectively degrading
备注： 45 pages (34 main text with Methods and Extended Data, 11 Supplementary Information), 4 figures, 6 Extended Data figures. Code, protocols and data: [this https URL](https://github.com/ZhixiangWang-CN/damage-order-artifacts) ; interactive summary: [this https URL](https://zhixiangwang-cn.github.io/damage-order-artifacts/)
点击查看摘要
Abstract:Compression can preserve a language model's average accuracy while selectively degrading individual capabilities. Whether these losses follow method-specific patterns or a transferable order is unclear. We applied seven perturbation and compression methods to eight instruction-tuned models, scoring 16 tasks in four answer formats against preregistered predictions. Short-answer capabilities failed in nearly the same order under four random perturbations with different mechanisms (median correlation 0.90) and, within each model, under pruning and quantization (0.875). Intact answer margin, answer frequency and answer format predicted this order. Fragility profiles measured under random perturbation predicted which tasks and facts compression removes first and, after four-task calibration, held-out task accuracy (median absolute error 0.11-0.12, against 0.20-0.21 for uniform decline); profiles borrowed from other model families did almost as well. The order did not transfer across models under GPTQ quantization or hold for long-form tasks. Within short answers, what compression removes is predictable before deployment.
69. 【2611.11679】he Average Patient: Do Simulated Psychiatric Patients Answer Like Real People?
链接：https://arxiv.org/abs/2611.11679
作者：Weixiang Sun,Zehong Wang,Kaiwen Shi,Hong Huang,Colby Nelson,Yiyang Li,Yanfang Ye
类目：Computation and Language (cs.CL)
关键词：Language models, simulated psychiatric patients, evaluate AI therapists, train clinicians, clinicians and evaluate
备注：
点击查看摘要
Abstract:Language models are used as simulated psychiatric patients to train clinicians and evaluate AI therapists, and are judged by plausibility or total scores. We give a framework for simulated respondents: an information budget bounds how much simulated patients can differ, and an average-patient hypothesis, that a model answers each item at the level typical of the named condition and severity, implies little variation, a full profile of the condition's typical symptoms and totals at or above the top of the stated severity band. We examine these implications at matched totals on item-level data from eight human samples, including a clinical and an instructed-feigning sample. Across 17 models, simulated patients vary 1.5 to 11 times less than real respondents with the same total and on most questionnaires endorse nearly every symptom at a middling level; on the PHQ-9 their symptoms covary less like real ones. People, honest or feigning, answer "not at all" about as often as genuine patients with the same totals, and more often than every model. Single answers are highly concentrated, and prompt changes, published personas, larger models and reasoning reduce the pattern without removing it. In interviews, patients told a severity are rated as having nearly every symptom, so an assessment agent's recognition of absent symptoms goes untested, and scored against the stated severity the agent places a quarter of them in their band, against about half of patients given a real symptom profile. Having the model word such a profile restores half to two thirds of the variation.
70. 【2611.11621】ODSA: Orchestrated Discovery and Self-Aggregation
链接：https://arxiv.org/abs/2611.11621
作者：Macardle Meng,Haomin Zhang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multiagent Systems (cs.MA)
关键词：inference time, Test-time scaling, language model answers, test-time scaling methods, single direct call
备注：
点击查看摘要
Abstract:Test-time scaling improves the accuracy of a language model's answers by spending more computation at inference time. Established methods do so either sequentially, revising a single solution over several passes, or in parallel, generating several independent solutions and selecting among them. We present ODSA (Orchestrated Discovery and Self-Aggregation), an LLM-directed scaling framework in which an orchestrator LLM is given existing test-time scaling methods as actions --- discovery of a new independent solution, comparison of existing solutions to build a better one, and acceptance of a proposed answer, which triggers its verification --- and directs stateless workers to carry them out. The orchestrator does not solve the problem itself: it allocates computation, feeds the results of earlier actions into later ones, and takes every action from a single context, so that each decision is informed by everything tried before. On Humanity's Last Exam, ODSA improves accuracy by 4.7 to 18.0 points across three models over a single direct call to the model with no test-time scaling. On LiveCodeBench, where a single direct call already solves most problems, it improves accuracy by 0.6 to 14.0 points.
71. 【2611.11598】Perturbing Inputs Improves Pretraining Distillation
链接：https://arxiv.org/abs/2611.11598
作者：Ziyang Cai,Yihe Dong,Dimitris Papailiopoulos,Shivam Garg
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：student language model, Knowledge distillation trains, Knowledge distillation, language model, training text
备注： 14 pages, 7 figures, 4 tables
点击查看摘要
Abstract:Knowledge distillation trains a student language model to match a teacher's predictions on the training text. We ask whether learning the teacher's behavior beyond the training text can further improve the student. We investigate this using three input perturbations: additive token noise, blending two documents, and blending neighboring tokens. Specifically, for an early part of pretraining we perturb the inputs and train the student to match the teacher on them, and we spend the rest of the same token budget on ordinary distillation. When pretraining from scratch, the best method improves on standard distillation at both scales we tried, by 0.025 nats at 135M parameters and by 0.020 nats at 0.5B (mean of three seeds). At 135M this is 1.45 times the gain that distillation itself provides over next-token training. We also observe promising downstream transfer: at 0.5B, the best variant improves average zero-shot accuracy by about one percentage point across seven tasks. It also retains its validation-loss advantage after low-bit weight quantization. We also test a data-limited setting in which training data must be reused, and find that the gains persist. Finally, ablations suggest that, for additive noise, perturbing the teacher's inputs contributes most of the gain, while perturbing only the student's inputs yields much less.
72. 【2611.11597】Out of Parameters, Saved by Syntax: UD-PrMPT for Parser Augmented Low Resource Machine Translation
链接：https://arxiv.org/abs/2611.11597
作者：Emma Thronson,Abhishek Purushothama,Amir Zeldes
类目：Computation and Language (cs.CL)
关键词：Recent work advancing, work advancing machine, advancing machine translation, Recent work, machine translation quality
备注：
点击查看摘要
Abstract:Recent work advancing machine translation quality using LLMs for very low resource languages has relied on the injection of lexicon-based prompt components to expose vocabulary to models. However, these approaches run into a ceiling when models must guess sentence meaning purely from plausible combinations of possible word senses mapped to strings. In this paper we test UD-PrMPT, an approach using syntactic analyses in the Universal Dependencies formalism as prompt components to improve MT in five diverse low resource languages: Beja, Chintang, Chukchi, Coptic, and Xibe. Our results show additive improvements which stack on top of the lexicon based approach which are stronger for higher quality manual analyses but consistent for predicted parses as well.
73. 【2611.11592】LAION-Audio-XL: A Web-Scale Corpus and Scaling Studies for Contrastive Language-Audio Pretraining
链接：https://arxiv.org/abs/2611.11592
作者：Gijs Wijngaard,Felix Förster,Ross Wightman,Marianna Nezhurina,Christoph Schuhmann,Jenia Jitsev,A. Sophia Koepke
类目：ound (cs.SD); Computation and Language (cs.CL)
关键词：Recent progress, scale and quality, Recent, Common Crawl, contrastive audio-language models
备注： Project page: [this https URL](https://projects.laion.ai/clap2/)
点击查看摘要
Abstract:Recent progress on contrastive audio-language models can be attributed mainly to the scale and quality of their training data. Larger training datasets expose models to a broader range of sounds and corresponding audio captions. To exploit this, we collect 1.48 billion audio samples from academic datasets, internet datasets, web collections, Common Crawl, and YouTube, and process them with a multi-stage curation pipeline. Furthermore, we generate short and long captions for samples in our corpus that lack them. We use our dataset to study the scaling behavior of contrastive audio-language models based on the NaFlex architecture for the audio encoder. Our experiments identify trade-offs between model size and training data for a given compute budget. Moreover, our resulting models, CLAP2, outperform prior audio-text models of comparable size on the MAEB and HEAR benchmarks. We release our dataset, captions, model checkpoints, and code.
74. 【2611.11588】FinCutBench: A Continually Updated Benchmark for Measuring the Temporal Boundaries of LLM Financial Knowledge
链接：https://arxiv.org/abs/2611.11588
作者：Siyuan Li,Ke Wan,Boyong Hou,Yujie Deng,Zixuan Yuan
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：introducing parametric look-ahead, parametric look-ahead bias, retain financial facts, financial facts disclosed, external inputs
备注： 41 pages
点击查看摘要
Abstract:In financial backtesting and other point-in-time tasks, external inputs can be restricted by date, but model parameters may retain financial facts disclosed later, introducing parametric look-ahead bias. We introduce FinCutBench, a continually updated monthly financial knowledge benchmark for measuring how far a fixed model's financial knowledge extends over calendar time. The current dataset contains 9,000 Chinese and English four-option multiple-choice questions from January 2023 to September 2026, covering Chinese and U.S. markets and four categories of financial information. We construct monthly knowledge profiles using the approximate months in which the tested facts became public. After a profile passes the decline test and knot checks, we define the FinCut Boundary as the first month when the fitted profile reaches its lower level, and report the stability of the estimated date under resampling. Boundary dates and localization precision vary across models. Using the independently measured Transition Start and Boundary as fixed references for downstream sample grouping, we find significant relative declines in U.S. asset-ranking performance and in earnings recall for Sol and Luna. Downstream effects vary across markets and tasks. The FinCut Boundary thus provides an empirical reference for the temporal scope of parametric knowledge in point-in-time financial evaluation, supporting evaluation-window selection and result interpretation.
75. 【2611.11576】Continuous modeling of manipulative participation for stance analysis: Online discourse on the 2024 Street Animal Law in Türkiye
链接：https://arxiv.org/abs/2611.11576
作者：Ulya Bayram,Ebru Belkıs Güzeloğlu,Emel Kuşku Özdemir,Elif Üstündağlı Erten,Öyküm Esra Yiğit
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Social and Information Networks (cs.SI)
关键词：commonly infer public, infer public opinion, manipulative participation, discourse commonly infer, participation
备注： Submitted to Journal of Computational Social Science
点击查看摘要
Abstract:Studies of online political discourse commonly infer public opinion through stance analysis while implicitly assuming that observed user participation is authentic. Meanwhile, studies focusing on detecting manipulative participation are typically modeling it as a binary phenomenon, overlooking the varying degrees to which users may engage in coordinated or inauthentic behavior. This study proposes a continuous modeling approach for manipulative participation and examines its integration with stance analysis. Using online discourse on the 2024 Street Animal Law in Türkiye as a case study, we collected a dataset comprising 7,320,574 tweets from 537,994 users. From this corpus, 301 users were selected through a high-information sampling strategy and manually annotated by domain experts using a 10-criterion rubric that yields user-level continuous manipulative participation scores. Evaluation under a unified user-level cross-validation protocol showed that the proposed framework accurately estimates both manipulative participation and user stance, with gradient boosting methods providing the best manipulative participation estimates and BERTurk achieving the highest stance classification performance. External validation on an independently annotated user set demonstrated good generalization performance. The findings support modeling manipulative participation as a continuous construct rather than a binary label, providing a more informative basis for computational analyses of the relationship between manipulative participation and stance in online political discourse.
76. 【2611.11573】Beyond the Transcript: Measuring and Improving the Use of Acoustic Information in Audio Language Models
链接：https://arxiv.org/abs/2611.11573
作者：Linkai Peng,Baorian Nuchged,Yuyang Yao
类目：Computation and Language (cs.CL)
关键词：Audio language model, provide comprehensive evaluation, benchmarks provide comprehensive, Audio language, model benchmarks provide
备注：
点击查看摘要
Abstract:Audio language model benchmarks provide comprehensive evaluation across diverse tasks. However, some tasks can be answered from the transcript or even the question alone, and benchmark scores can therefore confound acoustic understanding with language modeling ability. We distinguish lexical tasks, for which the transcript usually suffices, from global-attribute and within-recording-structure tasks, which require the model to analyse the recording beyond its words, either as a whole, for properties such as the speaker and emotion, or within it, for patterns such as stress and intonation. We evaluated 19 open models and Gemini 3.1 Pro on 92 tasks from 6 benchmarks and estimated the recording gain, the accuracy advantage of the original recording over references that retain its words, by comparing the recording with synthetic readings of its transcript and by adding it to the transcript. On attribute and structure tasks, the open models fall behind Gemini by 28.6 and 41.9 percentage points, and about half or more of each deficit lies in the recording gain. Nevertheless, linear probes in Gemma-4 12B and Qwen2.5-Omni-7B show that the acoustic information needed for answering is already readable in early language-model layers, while the readout of many cues declines in the layers that follow. We therefore constructed training data and trained LoRA adapters in these layers, with a content anchor, which raises attribute and structure accuracy by 12.8 to 44.4 points in the two models and keeps mean lexical accuracy within 1 point of the base model. Most of the improvement appears as larger recording gains. These results suggest that training improves the use of acoustic information that the models already encode.
77. 【2611.11551】When Should Diffusion Language Models Reconsider Their Commitments?
链接：https://arxiv.org/abs/2611.11551
作者：Haoyang Zheng,Yidong Ouyang,Blake Jianhang Chen,Tian Tan,Ziqian Lin,Liqian Peng,Alec Go,Guang Lin
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Masked Diffusion Models, fast text generation, Diffusion Models, Masked Diffusion, fast text
备注：
点击查看摘要
Abstract:Masked Diffusion Models (MDMs) are well known for fast text generation via parallel decoding. However, independent parallel sampling can commit to inconsistent predictions, and less is known about how to selectively revise these early token commitments. In this work, we introduce $\underline{\mathrm{P}}$lanned $\underline{\mathrm{U}}$nmasking-and-$\underline{\mathrm{R}}$evision Joint $\underline{\mathrm{L}}$earning (PURL) for MDMs, a training-based framework that seamlessly unifies parallel generation with selective token revision. We derive a normalized joint transition whose likelihood factorizes into edit selection, unmask selection, and token prediction. These components are trained jointly on partially masked sequences constructed according to the model's own unmasking policy. During inference, all three decisions are supported by a single shared forward pass, enabling the model to decode masked tokens and revise noisy tokens. Across logic puzzles, mathematical reasoning, and code generation, PURL improves accuracy at matched unmask budgets, with relative gains up to 47.4% accuracy improvement and up to an $8\times$ reduction in scheduled decoding rounds. Beyond these gains, our analysis further reveals general principles of revisable decoding: token edits become more effective as context accumulates; early edits can steer unfinished trajectories, whereas later edits tend to remain localized; and effective edits therefore depend on both calibrating when to intervene and learning where and how to revise. Together, these suggest that effective parallel generation depends not on revising more tokens, but on making the right commitments revisable at the right time.
78. 【2611.11541】Safeguarding Agentic AI in Radiology Workflows: A Multimodel Evaluation of Rule-based and Large Language Model-based Verification
链接：https://arxiv.org/abs/2611.11541
作者：Semil Eminovic,Robin Schmidt,Bogdan Levita,Maximilian Lindholz,Tobias Penzkofer,Jawed Nawabi
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：record clinically relevant, clinically relevant false, simulated radiology documentation, large language model, agents record clinically
备注： 43 pages, 6 figures, 4 tables, supplementary material included. Tobias Penzkofer and Jawed Nawabi share last authorship. Code: [this https URL](https://github.com/ibrarad/radiology-agent-safeguards)
点击查看摘要
Abstract:Purpose: To estimate how often tool-using large language model (LLM) agents record clinically relevant false or unsupported information in simulated radiology documentation and how much safeguards applied before each action reduce these errors. Materials and Methods: In this simulation study (October 2026), 48 synthetic, radiologist-reviewed base scenarios covered finding communication, tumor board preparation and follow-up management. Forty-three also had a misleading-information variant (91 variants). Six LLM agents (Claude Sonnet 5.5, GPT-6.1-Sol, GLM-5.3, MiniMax M3, Gemma-4-31B, Qwen3.8-27B) completed each variant with permissions only, deterministic rules, and rules plus a locally run LLM checker (1638 episodes). The primary outcome was at least one executed high-severity violation per episode. Risk differences were estimated per agent at base-scenario level and, exploratorily, pooled across agents, with analyses of document access and blocks. Results: With permissions only, 7.3%-27.1% of episodes had a high-severity violation (pooled across agents, 19.4%). Pooled, it was 16.7% with rules (-2.8 percentage points; 95% CI: -6.1, 0.5) and 13.2% with rules plus the LLM checker (-6.2; 95% CI: -9.5, -3.0). Adding the LLM checker to rules changed it by -3.5 (95% CI: -6.3, -0.7). No difference between agents was detected (P = .43), and task success did not decrease detectably. In misleading variants, agents opened the altered document in 83% of episodes regardless of error, and 58% of erroneous statements cited it. Most blocked actions (64%-68%) would not have caused a violation and were returned for revision. Conclusion: Layered safeguards reduced but did not prevent high-severity errors. Errors after misleading information reflected misjudged rather than missed information.
Comments:
43 pages, 6 figures, 4 tables, supplementary material included. Tobias Penzkofer and Jawed Nawabi share last authorship. Code: this https URL
Subjects:
Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)
Cite as:
arXiv:2611.11541 [cs.AI]
(or
arXiv:2611.11541v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2611.11541
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Semil Eminovic [view email] [v1]
Sun, 8 Nov 2026 18:29:04 UTC (3,575 KB)
79. 【2611.11502】Does Merge Form a Hopf Algebra? Coproducts, Traces, and the Prospects of Algebraic Minimalism
链接：https://arxiv.org/abs/2611.11502
作者：Daisuke Bekki(Ochanomizu University)
类目：Computation and Language (cs.CL); Quantum Algebra (math.QA)
关键词：Hopf algebra, language and physics, physics obey, Merge operation, Hopf
备注： 15 pages
点击查看摘要
Abstract:Marcolli, Chomsky, and Berwick (2025; henceforth MCB) formulate the Merge operation of Minimalism on a Hopf algebra of Connes-Kreimer type, and claim that language and physics obey the same algebraic structure. This paper separates their program into the working hypothesis H, that Merge on workspaces can be described as a Hopf algebra, and the claim P placed on top of it, that language and physics obey the same principle, and examines the validity of H. MCB employs two coproducts in formulating Merge, corresponding to two different translations of movement (Internal Merge): $\Delta_d$, which deletes the lower copy, and $\Delta_c$, which leaves a trace. MCB uses the former in syntax and the latter at the syntax-semantics interface, but $\Delta_d$ is not coassociative, and $\Delta_c$ is not connected under the gradings MCB gives and, moreover, not coassociative as long as the labels of traces are retained. Consequently, MCB's algebra is not a Hopf algebra, and the Birkhoff factorization is not a consequence of the Hopf-algebra theorem but of a weaker statement that requires neither coassociativity nor connectedness. There are four ways to recover a Hopf algebra, but none of them can distinguish different traces, and hence none is compatible with Heim-Kratzer-style formal semantics, which reads traces as indexed variables. Thus H does not hold at present, and under the current formulation, making Minimalism a Hopf algebra and preserving its connection with formal semantics are mutually exclusive. Finally, we indicate three directions in which algebraic Minimalism may proceed.
80. 【2611.11497】ID System for Speech-COSER Challenge 2026: ASR Track
链接：https://arxiv.org/abs/2611.11497
作者：Fernando López,Jordi Luque
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Telefónica Innovación Digital, features spontaneous speech, elderly speakers recorded, Telefónica Innovación, Innovación Digital
备注： TID system for Speech-COSER Challenge 2026
点击查看摘要
Abstract:We describe the system submitted by Telefónica Innovación Digital to the Speech-COSER Challenge 2026, which features spontaneous speech from elderly speakers recorded in rural Spain. For ASR, we perform CTC-based pseudo-forced alignment scores audio-text match quality to guide a two-stage LoRA curriculum, followed by post-hoc magnitude pruning of the LoRA matrices to enhance generalization. An ensemble of seven systems combined via ROVER achieves 36.25\% unnormalized and 22.17\% normalized WER.
81. 【2611.11487】HEATRON: A Benchmark for Evaluating Persona Persistence in Long-Horizon LLM Decision-Making
链接：https://arxiv.org/abs/2611.11487
作者：Yuyan Wang,Yuechen Jiang,Zhiwei Liu,Jimin Huang,Sophia Ananiadou
类目：Computation and Language (cs.CL)
关键词：Existing evaluations, test persona expression, persona information persists, evaluations often test, information persists
备注：
点击查看摘要
Abstract:Existing evaluations often test persona expression rather than whether persona information persists in extended decision-making. We introduce THEATRON, a controlled benchmark that uses financial replay to evaluate persona persistence in long-horizon sequential decision-making. In these environments, models conditioned on fixed behavioral-finance personas observe shared daily market evidence and trajectory-specific account-state feedback and make sequential decisions over multi-month trajectories. We evaluate Zero-Shot, One-Shot, and Chain-of-Thought persona injection across four LLMs, using cumulative-return and action trajectories to diagnose within-persona stability, cross-persona separability, and action collapse. Persona conditioning produces systematic behavioral shifts beyond a no-persona baseline, and persona-level separation generally exceeds the variation induced by semantically equivalent descriptions. Nevertheless, these shifts do not reliably form coherent persona-specific policies: apparently stable separation can arise from stereotyped action collapse, while diverse policies can exhibit noisy trajectory switching. These findings expose a gap between observable persona-induced behavior and persistent, context-sensitive persona-conditioned decision policies. Code and benchmark data are publicly available at: this https URL
82. 【2611.11471】Saidzoda-CA-EmbeddingGemma-300M: One Small Embedder for Tajik, Kazakh, Uzbek and Kyrgyz
链接：https://arxiv.org/abs/2611.11471
作者：Tohir Saidzoda,Nekruz Maxudov,Bedil Karimov,Abubakr Abdullozoda,Amin Jalilov,Jonibek Kishvarov,Rahmonali Sharipov,Mariyamkhon Shodyeva
类目：Computation and Language (cs.CL)
关键词：Uzbek and Kyrgyz, Uzbek, Kazakh, small open embedder, recall
备注： 12 pages, 6 tables, 2 figures. Technical report. Model: [this https URL](https://huggingface.co/Tohirju/Saidzoda-CA-EmbeddingGemma-300M)
点击查看摘要
Abstract:The small open embedder EmbeddingGemma-300M, used as released, finds the right passage first for only 51.7% to 60.8% of Belebele questions in Tajik, Kazakh, Uzbek and Kyrgyz. We present Saidzoda-CA-EmbeddingGemma-300M, one model for all four languages. It is our Tajik fine-tune of EmbeddingGemma-300M, trained for one more epoch on 279,904 pairs: questions in Kazakh, Uzbek and Kyrgyz that our own language model wrote about source passages, a Tajik refresher, and English and Russian replay. On Belebele, recall@1 rises by 14.4 to 26.0 points in each language, to between 75.2% and 77.7%. Against single-language models trained with the same settings, the one model stays within 2.8 points at recall@1 in Kazakh, Uzbek and Tajik, with overlapping recall@10 intervals, though it also had more training. It keeps the Tajik law recall@10 of its starting point (92.2 against 92.4) but loses 4.4 points of law recall@1. A model trained on one of these languages also improves the others on Belebele, but less than training on them. The model still trails the 560M XLM-RoBERTa embedders on Kazakh, Uzbek and Kyrgyz Belebele: the better of multilingual-e5-large-instruct and BGE-M3, used as released, is 9.4 to 10.2 points ahead at recall@1. Our scores of those released models agree with the published MTEB results within 2.4 points. Russian and English recall@1 fall by 3.0 and 4.2 points.
83. 【2611.11426】Vietnamese Legal Ontology: Every legal answer, traced to the article that grounds it
链接：https://arxiv.org/abs/2611.11426
作者：Khac-Hoai Nam Bui,Quan Tran Minh
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：NVIDIA Auto Ontology, Expose and Learn, legal corpus pairs, NVIDIA Auto, article
备注：
点击查看摘要
Abstract:A legal answer is only as good as the article it rests on. Vietnam's largest open legal corpus pairs 109,543 published questions and answers with 573,851 legal documents, yet its citations are free text: "Khoan 3 Dieu 101 cua Bo luat nay" ("Clause 3, Article 101 of this Code") names neither the code nor its version. Following the five stages of NVIDIA Auto Ontology, Discover, Ground, Validate, Expose and Learn, we turn four open datasets into a knowledge graph of 11.5 M nodes and 16.0 M edges in which every node and edge carries its source record and method, with no duplicate keys, dangling edges or schema violations. Of 67,868 cited provisions, 61,487 resolve to a dated law version, 51,694 to a parsed article, clause or point, and 19,012 are confirmed word for word. The ontology then shows what flat records hide. 36% of the 78,361 answers whose citations resolve now cite a law that is no longer in force; 2,525 verified citations point to an article number that says something else in the current law; 2,520 citations were re-versioned because their words match a different version than their date suggests; and 5,575 document numbers are shared by several local authorities, one of them by 72. Every number in this paper is computed from the graph.
84. 【2611.11416】Modeling individual and item differences in atypicality inferences with ACT-R
链接：https://arxiv.org/abs/2611.11416
作者：Guifu Liu,Vera Demberg
类目：Computation and Language (cs.CL)
关键词：Humans engage, highly predictable events, reasoning when encountering, highly predictable, Humans
备注： Accepted as a conference paper at CogSci 2026
点击查看摘要
Abstract:Humans engage in pragmatic reasoning when encountering mentions of highly predictable events. Such mentions may appear redundant, leading comprehenders to infer that the event is atypical, and accommodate this inference with an explanation for why it is atypical. However, these inferences are not drawn uniformly across individuals, and experimental items vary in inference rates due to differences in event typicality. We show that these patterns can be predicted with a resource-rational cognitive model in which comprehenders select interpretation strategies based on individual exploration tendencies and item-level predispositions. These parameters are estimated independently from participants' Raven's Matrices score, event typicality rating and language model based accommodation likelihood. Taken together with recent findings from reference games, our results motivate a new perspective on the mechanisms that support pragmatic inferences.
85. 【2611.11396】Search-by-Answer Bias in Retrieval Models
链接：https://arxiv.org/abs/2611.11396
作者：Adiel Avigad,Shauli Ravfogel,Yoav Goldberg
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：query semantic specification, semantic specification, meant to select, match a query, query semantic
备注： 17 pages, 9 figures
点击查看摘要
Abstract:Dense retrievers are meant to select passages that match a query's semantic specification. We show they suffer from search-by-answer bias: they favor passages that mention answer objects the model knows (scores as likely), over passages that support valid alternative answers. We test this with controlled factual contrasts from LAMA/TREx. For each retriever, we measure how strongly the model scores the canonical object over an alternative object using a token-prediction head, and ask whether this score predicts passage rankings. Across eight retrievers, including DPR, Spider variants, Contriever, E5, and Qwen3-Embedding, larger token-prediction scores consistently predict higher retrieval scores for passages containing the corresponding object. This holds when passages differ only in the answer object, and even when the passage that mentions the high-scoring object expresses a wrong relation. Dense retrieval thus exhibits search-by-answer bias during passage selection, shaping which evidence is retrieved.
86. 【2611.11386】What Travels Across Languages? Reading, Transfer and Erasure of Cross-Lingual Concept Subspaces in Bangla Idioms
链接：https://arxiv.org/abs/2611.11386
作者：Syed Rifat Raiyan,Yousuf Ibne Kamal Niloy
类目：Computation and Language (cs.CL); Machine Learning (cs.LG); Machine Learning (stat.ML)
关键词：analysis requires distinguishing, requires distinguishing, distinguishing the information, subspace retains, concept analysis requires
备注： 73 pages, 21 figures, 52 tables. Code, frozen analysis plans and aggregate results: [this https URL](https://github.com/Starscream-11813/bangla-idiom-subspaces)
点击查看摘要
Abstract:Cross-lingual concept analysis requires distinguishing the information that a subspace retains from the classifiers and erasers that transfer through it. We study these operations in six frozen encoders using 10,359 Bangla (Bengali) idiom senses, eight input conditions, and figurative-class and sentiment labels. Class-mean directions provide the most consistent evidence of shared coarse meaning: in post hoc analyses, they outperform random-subspace, permuted-label and covariance-matched nulls in all 12 model-label tests under balanced accuracy. A prospective internal re-split supports idiom-alone sharing in 10 of 12 tests, spanning five encoders. The original confirmatory logistic-regression family rejects both planned nulls in 4 of 12 tests, where English directions gain only a few accuracy points above the majority-class floor (3.0-7.3). Classifier transfer depends on the input map and regularization: English-trained class-mean readouts beat both zero-shot nulls in 8 of 12 discovery tests, and stronger source-selected penalties improve transfer through logistic and LEACE directions. These readouts use Bangla-validation-selected layers and unlabeled target preprocessing. Input controls show greater coarse-class sharing for explicit glosses than for idiom counterparts. Reading, however, does not imply effective erasure: English-fitted LEACE removes less than one percentage point of Bangla figurative-class accuracy, compared with 4-11 points for Bangla-fitted LEACE; INLP shows a similar asymmetry. Pattern-filter analysis, covariance-weighted input maps and a binary Gaussian overlap bound explain how these operations can diverge. The analogous multiclass ordering is an empirical diagnostic, observed in 11 of 12 cells. The results support an estimator-sensitive account of cross-lingual concept sharing and motivate evaluating reading, classifier transfer, erasure and overlap separately.
87. 【2611.11372】LLM-based Multi-Criteria Deep Reinforcement Learning for Dynamic Efficient 5G UPF Selection
链接：https://arxiv.org/abs/2611.11372
作者：Abdelrahman Soliman,Ahmed Refaey Hussein,Lei Lei
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Networking and Internet Architecture (cs.NI)
关键词：User plane function, manage resources effectively, Deep Reinforcement Learning, User plane, limited approaches proposed
备注： Accepted at IEEE Globecom 2026 CSM
点击查看摘要
Abstract:User plane function (UPF) selection in 5G networks is an active area of research, with various limited approaches proposed to enhance network efficiency and manage resources effectively. In this paper, we address this gap in the related literature by proposing a Deep Reinforcement Learning (DRL) UPF selection method that utilizes a dynamic, multi-objective reward function and validating it on a real-world 5G emulation platform. The proposed method is based on the large language models' (LLMs) translation of network operator intents and the network data analytics function (NWDAF) abnormality alerts. The experimental results validated in the real-world experimental setup demonstrate that our dynamic DRL solution achieves an effective balance between latency, power consumption, and traffic distribution, outperforming the heuristic baselines and fixed DRL by 16.89%. These findings highlight the real-world applicability of our approach for dynamic, intent-driven UPF selection.
88. 【2611.11349】AOP-Smart-Finder: A High-Throughput Human-AI Hybrid Framework for AOP Discovery and Evidence Mapping from Large-Scale Literature
链接：https://arxiv.org/abs/2611.11349
作者：Qinjiang Niu,Lu Yan
类目：Computation and Language (cs.CL); Quantitative Methods (q-bio.QM)
关键词：Adverse Outcome Pathway, mechanistic descriptions make, biological events, Large Language Models, integrates Large Language
备注：
点击查看摘要
Abstract:The rapid growth of scientific literature and the high heterogeneity of biological terminology and mechanistic descriptions make it difficult for researchers to integrate scattered research evidence, identify connections among biological events, and construct mechanistic networks. Here, we developed a high-throughput human-AI hybrid framework, AOP-Smart-Finder, for biological event discovery, relationship mining, and Adverse Outcome Pathway (AOP) construction and evidence mapping from large-scale literature. This framework integrates Large Language Models (LLMs), AOP-Smart retrieval-augmented generation (RAG) technology, and Python-based automation, supporting two analysis modes: one based on a single compound and the other based on a predefined set of biological events. In the di(2-ethylhexyl) phthalate (DEHP) case, the system processed 12,983 articles within 30 min and included 1,093 of them, from which it extracted 1,589 biological events (including 458 official key events [KEs] and 1,131 candidate KEs) and 2,519 key event relationships (KERs). In the amyotrophic lateral sclerosis (ALS) case, the system identified 55 stressors from 437 articles and extracted 278 biological events and 548 event relationships. Following manual curation and Weight of Evidence (WoE) evaluation, a mechanistic network comprising 16 KEs and 23 KERs was ultimately constructed. This framework can either use existing AOPs as knowledge guidance for mechanistic expansion and evidence supplementation, or discover novel event connections and construct mechanistic networks around user-specified research topics. It provides a high-throughput, traceable, human-AI hybrid methodology for complex biological mechanism elucidation and AOP discovery driven by large-scale literature.
89. 【2611.11342】Agent Self-Improvement with Frozen Weights: The Added Value and Limits of Failure Traces
链接：https://arxiv.org/abs/2611.11342
作者：Arkid Mitra
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：agent failure traces, failure traces, matched search, agent harness, notes
备注： 6 pages, 1 figure, 1 table. Code and data: [this https URL](https://github.com/hopit-ai/harness-mistakes-artifacts)
点击查看摘要
Abstract:We evaluate whether an AI agent's harness, the notes around its model, can learn from the agent's failure traces beyond a matched search that never sees them. It can, but less than it looks. We tested an open 9-billion-parameter model with fixed weights; a larger teacher model wrote its notes. On generated customer-service decisions, where both note writers were told the target rules, notes based on the agent's mistakes improved accuracy by 4.0 percentage points over notes from the same process with the mistakes withheld. That process alone, trying and keeping better-scoring notes, reached about 60% of the total improvement. In full customer-service conversations the same notes showed no demonstrated improvement. Separately, a strict screen of single lessons admitted two customer-service lessons, still awaiting tests on new data, and one tool-use lesson, written without seeing the agent's mistakes, which showed no demonstrated gain on new tool-use tasks. A neutral note with no procedure scored higher than the learned lessons (exploratory). A blind audit judged 146 of 240 tool-use test items defective.
90. 【2611.11316】ReGKG-2025: A GKG-Compatible Reconstruction of the GDELT Global Knowledge Graph for the Missing Period of 14 June to 2 July 2025
链接：https://arxiv.org/abs/2611.11316
作者：Nikita A. Klimin(HSE University, Moscow, Russia)
类目：Digital Libraries (cs.DL); Computation and Language (cs.CL)
关键词：Global Knowledge Graph, Global Database, Global Knowledge, Database of Events, Knowledge Graph
备注： 17 pages, 14 figures, 19 tables, including appendices. Companion methods paper: [arXiv:2610.35358](https://arxiv.org/abs/2610.35358) . Dataset: [this https URL](https://doi.org/10.5281/zenodo.23964265)
点击查看摘要
Abstract:The June 2025 outage in the Global Database of Events, Language, and Tone (GDELT) collection pipeline left a gap in the Global Knowledge Graph (GKG), interrupting article-level news metadata used in downstream research. ReGKG-2025 is an archive-derived sample of 281,620 reconstructed article records covering all 1,665 missing 15-minute batches. Articles were recovered from Common Crawl and the Wayback Machine using source quotas estimated from surrounding native GKG data. Text was screened and normalized, non-English bodies were translated, and flagged records were manually reviewed. Eligible articles were converted to the 27-column GKG 2.1 layout. The versioned package includes record-level provenance, archive replay and WARC locators, source summaries, source-by-day calibration weights, and the complete manual decision journal. The sample reaches about 14% of modeled native volume and represents sources accounting for 84% of selected reference record mass. In an intact-week test, 41% of recovered articles matched native GKG records; field agreement on matched pairs is close to the processor baseline (tone MAE 1.69). The dataset supports retrospective content analysis and source-level aggregates; its tone and theme distributions differ from native GKG, and it does not support exhaustive counts. Data: this https URL.
91. 【2611.11306】ScrapeBench: Evaluating Legal Compliance of AI Agents in Website Scraping
链接：https://arxiv.org/abs/2611.11306
作者：Joseph Marvin Imperial,Daniel Slate,Noam Kolt
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：computer security laws, breach contractual provisions, violate computer security, security laws, http URL
备注： Accepted to NeurIPS 2026 (Evaluations and Datasets Track)
点击查看摘要
Abstract:AI agents deployed on the open web are becoming more capable of performing actions that may breach contractual provisions and violate computer security laws. In this paper, we introduce ScrapeBench, the first agentic benchmark for empirically evaluating the legal compliance of AI agents with website scraping policies, namely terms of service (ToS) and $\texttt{this http URL}$ directives. Across widely used closed-weight and open-weight AI agents, we find that most agents exhibit low compliance rates ( 5%) when instructed to scrape websites in our sample of 1,626 popular websites that explicitly prohibit scraping. In addition, we observe that even where AI agents actively check the applicable ToS and $\texttt{this http URL}$, they continue to exhibit low compliance rates. Conversely, in our sample of 269 websites that do not prohibit scraping, we observe that agents sometimes refuse to scrape despite it being lawful, such as Claude Opus 4.6 exhibiting an over-refusal rate of 98.5%. Our human baseline experiments (n = 180 participants) suggest that humans exhibit compliance rates comparable to AI agents but over-refuse at much higher rates.
92. 【2611.11299】EASE-KV: Diagnosing the Gap Between Memory Availability and Effective Use
链接：https://arxiv.org/abs/2611.11299
作者：Di Lu,Zechen Li,Xuanyu Yue,Jiabo Fan,Hao Xue,Flora D. Salim
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：prefilling retrieved text, avoids repeatedly prefilling, repeatedly prefilling retrieved, Reusable key-value, retrieved text
备注： Preprint
点击查看摘要
Abstract:Reusable key-value (KV) memory avoids repeatedly prefilling retrieved text, but stored and injected memories do not necessarily become usable evidence. We present EASE-KV, a controlled framework for understanding this gap under fixed candidates and a frozen language model. EASE-KV separates three interfaces: whether required relations are preserved during encoding, whether preserved memories receive appropriate influence during allocation, and whether outcome supervision can identify useful allocations. Matched experiments show that causal encoding improves compositional accuracy by 25.0 percentage points over block-diagonal encoding, while the tested inference-time bridging methods fail to recover the lost contextual information. With unchanged stored states, diagnostic evidence-guided allocation improves LongMemEval accuracy from 31.2% to 38.4%, demonstrating that memory influence can be controlled without re-encoding. However, controllability does not guarantee learnability: binary correctness provides informative reward contrast for 53.0% of sampled query groups, compared with 73.6% under the evaluated shaped-reward setting. These findings show that effective KV memory requires more than retrieval and injection: the required relations must be encoded, preserved memories must receive appropriate influence, and supervision must distinguish better allocations from worse ones.
93. 【2611.11284】WarBias: A Bilingual LLM Benchmark of Stereotypes About Internally Displaced People and Veterans
链接：https://arxiv.org/abs/2611.11284
作者：Viktoriia Makovska,Tetiana Zakharchenko,Oleksandra Ostafiichuk
类目：Computation and Language (cs.CL)
关键词：offensive or distressing, displaced people, Ukrainian language model, internally displaced people, language model
备注：
点击查看摘要
Abstract:This paper contains examples of stereotypes about veterans and displaced people that may be offensive or distressing. Social bias benchmarks for language models commonly examine categories such as gender, race, and religion, often drawn from lists of legally protected characteristics. Veterans and internally displaced people (IDPs) fall outside these lists, and stereotypes about them, which can undermine access to employment, housing, and social participation, remain largely absent from language model evaluation. We introduce WarBias, a Ukrainian-English benchmark of stereotypes about these two groups. Built from a taxonomy of 120 stereotype claims grounded in research and monitoring reports, WarBias contains 1,007 stereotype-counter-stereotype-unrelated sentence triplets and 240 multiple-choice questions per language. A Ukrainian language model selected in a blinded human pilot generated the Ukrainian triplets. At least two independent annotators reviewed each triplet in the annotation cohort. The authors revised items in response to the reviews, and the final release was machine-translated into English. Each claim carries a human severity rating. In a baseline evaluation of six models, four prefer stereotypical Ukrainian sentences about at least one group, most strongly about IDPs, while English scores are mostly balanced. WarBias supports complementary evaluations of stereotypical preferences and context-sensitive judgments, and provides paired forget/retain material for unlearning-based bias mitigation. We document the benchmark's construction, intended uses, and limitations, and offer its construction method as a template for analogous benchmarks in other conflict-affected societies.
94. 【2611.11249】Understanding When and Where Self-Supervised Speech Models Learn Phonemes and Prosodic Cues through Layer-Wise and Time-Resolved Probing
链接：https://arxiv.org/abs/2611.11249
作者：Masaru Tanibata,Shun Takahashi,Hiroki Ouchi,Sakriani Sakti
类目：Computation and Language (cs.CL)
关键词：Self-supervised speech models, pretraining remains unclear, Self-supervised speech, encode a rich, remains unclear
备注：
点击查看摘要
Abstract:Self-supervised speech models (S3Ms) encode a rich hierarchy of acoustic, prosodic, and phonetic information, yet when and where it emerges during pretraining remains unclear. We train frozen-encoder probes on every Transformer layer across pretraining checkpoints of two matched models: HuBERT-Base, whose stage 2 is a separately initialized model trained on new pseudo-label targets, and single-objective wav2vec 2.0-Base. Our five tasks span an acoustic-to-abstract gradient: absolute pitch (F0), speaker-relative pitch, lexical stress, phoneme boundaries, and 38-way phoneme identity. Acoustic-prosodic cues and phone boundaries are decodable from the earliest checkpoints and barely shift across layers, whereas phoneme identity is constructed during pretraining, re-localizing to upper-middle layers under HuBERT's stage-2 targets at a matched update count. Acquisition order therefore tracks abstraction from the acoustic surface, not the segmental/suprasegmental distinction, extending to prosody an account established for phonetic, lexical and syntactic structure; the no-switch wav2vec 2.0 shows no comparable re-localization.
95. 【2611.11243】Saidzoda-Tajik-EmbeddingGemma-300M: Knowing Every Letter Is Not Reading Tajik
链接：https://arxiv.org/abs/2611.11243
作者：Tohir Saidzoda,Nekruz Maxudov,Bedil Karimov,Abubakr Abdullozoda,Amin Jalilov,Jonibek Kishvarov,Rahmonali Sharipov,Mariyamkhon Shodyeva
类目：Computation and Language (cs.CL)
关键词：Belebele Tajik set, human-written Belebele Tajik, small open embedder, top ten results, Tajik set
备注： 10 pages, 4 tables, 1 figure. Technical report. Model: [this https URL](https://huggingface.co/Tohirju/Saidzoda-Tajik-EmbeddingGemma-300M)
点击查看摘要
Abstract:EmbeddingGemma-300M is a small open embedder whose tokenizer represents every Tajik letter, and as released it is weak at Tajik retrieval: on our Tajik law test the right passage is in its top ten results for 49.3% of questions, on tax documents for 45.9%, and on the human-written Belebele Tajik set for 69.8%, against 98.6% on the Russian version of the same set. We present Saidzoda-Tajik-EmbeddingGemma-300M, the same model fully fine-tuned for one epoch on 235,140 question and passage pairs written by our own Tajik language model for laws, tax documents, Wikipedia and web text, with the same mined hard negatives, English and Russian replay, loss, global batch, learning rate and epoch as our earlier Saidzoda-Tajik-E5-Large (arXiv:2611.00592) and BGE-M3 models. After training, law reaches 92.4% and tax 91.7%; on Belebele, the one test written by people, recall@10 rises from 69.8% to 92.6% and the first result is right for 76.6% of questions instead of 51.7%. A checkpoint at step 100 of 466 already holds 88% of the law gain at recall@10. At recall@10 the result is no more than 2.8 points below the two 560M models trained on the same pairs on law, tax and Wikipedia, within the intervals, with 768-dimensional vectors and about half their parameters; at recall@1, for which we have no intervals, it stays 7.0 points behind the E5 model on Belebele. The cost is a drop of 3.0 and 2.8 points in Russian and English recall@1, larger than for the two earlier models. We also report that, according to our run notes, a bfloat16 test run produced a non-finite loss at step 3 which the training framework logged as zero, so training was done in fp32. Our generated test questions come from the same model as the training questions, so we treat those scores as an upper limit until questions written by Tajik speakers exist.
96. 【2611.11239】A Layer-wise Study of How Style Rewriting Breaks the Calibration of Zero-Shot LLM Fake-News Detectors
链接：https://arxiv.org/abs/2611.11239
作者：Prabhjot Singh,Praney Goyal,Raksha Sharma
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language models, Large language, increasingly asked, Large, stated confidence
备注：
点击查看摘要
Abstract:Large language models (LLMs) are increasingly asked to judge whether a news article is true, and their stated confidence is often taken at face value. We test what happens to that confidence when an article's writing style, but not its facts, is manipulated, as in recent \emph{style attacks} on fake-news detectors. Tracing how the prediction and its confidence form layer by layer inside the network, we study three model families (LLaMA-3-8B, Qwen2.5-7B, Mistral-7B) on three fake-news benchmarks, and find the same three patterns in every model--dataset pairing. First, on the original articles the models are competent and largely honest judges: they settle on an answer, briefly become overconfident, and then correct their confidence in the final layers. Second, style-rewritten articles break this self-correction: the models become far less accurate, under the strongest attack, worse than random guessing, yet remain just as confident, so they are \emph{confidently wrong} precisely when a warning is most needed. Third, nearly all of the damage comes from rewriting into sensational or emotionally charged styles, while sober, neutral rewrites leave the models' honesty largely intact. The practical implication is that an LLM's confidence about veracity cannot be trusted as a safety signal when an article's style may have been manipulated.
97. 【2611.11232】LRS-DPO: Token-Level Risk Scoring for Better Direct Preference Optimization
链接：https://arxiv.org/abs/2611.11232
作者：Suxin Ji,Hungtao Wan
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Direct Preference Optimization, large language models, aligning large language, Preference Optimization, Direct Preference
备注：
点击查看摘要
Abstract:Direct Preference Optimization (DPO) is a simple and widely used alternative to RLHF for aligning large language models (LLMs), but its sequence-level objective cannot precisely locate or suppress the local patterns that make an otherwise acceptable response unsafe or undesirable. We propose TLRS-DPO (Token-Level Risk Scoring for Better Direct Preference Optimization), which augments DPO with fine-grained token-level control while remaining fully offline and reference-based. TLRS-DPO introduces a token-level robust compensation term that converts the policy-reference log-ratio on rejected responses into localized risk scores, a curriculum-style schedule that gradually increases the strength of this compensation during training, and a risk-adaptive screening mechanism that selectively penalizes only high-risk tokens instead of entire sequences. This design bridges sequence-level preference fitting and token-level behavior control, and can be implemented as a drop-in modification to standard DPO trainers. Empirically, TLRS-DPO improves alignment quality and safety-relevant behavior with minimal impact on helpfulness compared to strong DPO baselines.
98. 【2611.11223】SGA-Sparse: Training Native SwiGLU Gates for Activation-Sparse and Low-Bit LLMs
链接：https://arxiv.org/abs/2611.11223
作者：Ruokai Yin,Steven Li
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：avoid fetching unused, single-user LLM decoding, fetching unused weights, identified early, avoid fetching
备注：
点击查看摘要
Abstract:Activation sparsity can reduce FFN weight traffic during single-user LLM decoding, but active channels must be identified early enough to avoid fetching unused weights. In pretrained SwiGLU models, training-free routing with the native gate performs substantially worse than routing with the up activation at high sparsity. We show that this ordering reverses after sparsity-aware training. Based on this insight, we introduce SGA-Sparse, which converts pretrained SwiGLU LLMs into fixed-budget activation-sparse models by training the existing gate projection directly as a top-k router. SGA-Sparse updates all model parameters end-to-end while preserving the original SwiGLU activation and introducing no auxiliary router parameters. After approximately 30B training tokens, LLaMA models from 1B to 8B achieve uniform per-token 75-85% FFN channel sparsity while remaining within 0.2-2.7 pp of their original dense checkpoints in average zero-shot accuracy. Because post-training quantization degrades sparsity-trained checkpoints, we further study two complementary quantization-aware training (QAT) recipes: continued-QAT largely recovers performance at 4-bit weight quantization, while joint-QAT performs better for the more aggressive sub-4-bit target. To compare activation sparsity with dense low-bit quantization, we translate the sparsity-induced reduction in weight traffic into an equivalent bit-width. Under this unified weight-traffic metric, our 2.5- and 1.5-bit-equivalent models establish a new accuracy-traffic Pareto frontier: the 2.5-bit-equivalent models match dense 3-bit QAT accuracy, while the 1.5-bit-equivalent models approach dense 2-bit models and outperform dense ternary models by 1.3 pp on average. These results establish native-gate training as a practical approach for combining high FFN sparsity with low-bit weights.
99. 【2611.11212】Deterministic Narrative Gravity: Bridging Theory of Mind and Historical Simulation through ABM-LLM Architectures
链接：https://arxiv.org/abs/2611.11212
作者：Alicia Colmenero-Fernández,Lidia Ortega Alvarado
类目：Multiagent Systems (cs.MA); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Historical social simulation, social simulation faces, digital butterfly effect, fundamental reproducibility challenge, Historical social
备注： 28 pages, 2 figures. To appear in the Journal of Computer Applications in Archaeology. Code: [this https URL](https://github.com/alixiacf/cognitive-abm)
点击查看摘要
Abstract:Historical social simulation faces a fundamental reproducibility challenge: the stochastic nature of large language models (LLMs) introduces a digital butterfly effect that prevents exact replication across multi-turn runs. Furthermore, the inability to control low-level server parameters in commercial LLM hosting environments severely limits reproducibility. To overcome this opacity, we present a deterministic multi-agent framework coupling LLMs to an Agent-Based Modelling (ABM) pipeline grounded in Theory of Mind (ToM) and Cognitive Archaeology, and validate exact artifact identity within local, pinned execution environments using SHA-256 hashing. Run locally at temperature zero with clean per-call model reloads, the system injects differentiated cognitive states per turn through dissonance-driven behavioural modes and gated internal voices. Evaluating seven model configurations spanning 4B to 31B parameters against an ablated baseline reveals clear operational boundaries. Small models ($\leq$8B) suffer from context capacity overload, producing repetitive, specular dialogue loops. However, at $\geq$12B parameters, the ABM scaffolding breaks the monotonous response patterns seen in ablation. Crucially, these scaffolded models exhibit spontaneous diegetic expansion: they coherently expand scenario lore through tactically motivated, anachronism-free details rather than escalating into aggression. By resisting the structural pull toward premature scene closure, scaffolded sessions sustain an open terminal Narrative Vector ($V_N = \mathrm{Open}$ in 12/21 overall; 9/9 in official $\geq$12B configurations) whereas unscaffolded ablation never does (0/21). This framework provides a transparent, auditable benchmark architecture for virtual archaeology, with the full pipeline released as open-source software to enable independent replication.
100. 【2611.11197】Dhara: Evidence-Oriented Retrieval for Indian Knowledge Systems
链接：https://arxiv.org/abs/2611.11197
作者：Avinash Holenarasipur Nagendra,Anand Kaniyaar Sriranga Prasad,Rahul Vishwakarma,Trupti Gavit,Anish Amol Tipnis,Yashaswini Mandayam Rangayyan,Vinod Appajanna,Kousik Sarathy Sridharan,Mohan Raghavan
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：Indian Knowledge Systems, Knowledge Systems, Indian Knowledge, Fuzzy Verse Retrieval, Relevant evidence
备注： 19 pages. Supplementary material (24 pages) is provided as a separate ancillary PDF
点击查看摘要
Abstract:Relevant evidence in Indian Knowledge Systems (IKS) collections may be distributed across passages in different parts of a work, including verses, translations, and commentaries. Locating it requires matching natural-language questions and partially remembered verse fragments to source passages. We present Dhara, a retrieval engine combining hybrid search, chapter- and book-level Entity Notes (EN), Fuzzy Verse Retrieval (FVR), and neural reranking. Five comparisons on the 325 questions in Dhara Bench examine retrieval representations against BM25, EN's contribution, reranker quality and computation time, FVR, and Gemini. BGE-M3 single-vector retrieval exceeds BM25 in nDCG@10, Recall@20, and MRR@20 across all categories. Its scores are broadly comparable to ColBERTv2, with mean retrieval times of 0.108 s and 0.962 s under the same hardware configuration and a smaller memory footprint for chunk storage on disk. Adding EN to a direct branch with a matched candidate count improves nDCG@10 in all twelve categories with Qwen and ten with BGE; the combined ranking is capped at the same candidate count. Qwen improves nDCG@10, Precision@5, and MRR@20 over BGE in every category, at approximately 6.72 times the overall estimated serial computation time. FVR increases Verse-category nDCG@10 by approximately 20 percentage points with either reranker. Gemini is evaluated after source mapping and manual review with relevance annotations visible. The Qwen pipeline with EN and FVR has higher Recall@20 than Gemini in ten categories and stronger complete-evidence retrieval in Multi-hop questions, while Gemini retains early-relevance advantages in several categories. The results inform retrieval choices according to evidence requirements and resource budgets.
101. 【2611.11177】When Are Nearby Experts Composable? Cross-Task Model Merging in Neural Thickets
链接：https://arxiv.org/abs/2611.11177
作者：Suxin Ji,Hungtao Wan,Mingjun Liu,An Zhang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：gains survive composition, shared origin, Random perturbations, survive composition, produce experts
备注：
点击查看摘要
Abstract:Random perturbations around a shared checkpoint can produce experts for distinct tasks, but shared origin does not ensure that their gains survive composition. We formulate expert-pair selection for joint base-relative retention, measured by strict joint success and worst-task gain with unconditional abstention accounting. An exact finite-difference decomposition and an arbitrarily small orthogonal counterexample show why proximity and orthogonality alone are insufficient. We instantiate this formulation with quality-constrained spectral selection, a fixed-budget framework combining cross-task screening, layerwise pair geometry, separate validation, and Base fallback. Across six checkpoints, 21 task pairs, and five independent perturbation pools, the procedure improves strict joint success over Top-1 averaging throughout and leads the four-method model-scale comparison on four of six checkpoints. For the five models with at least 1.5B parameters, matched quality-only, global-cosine, and spectral ranking attain 49.1%, 50.5%, and 53.1% joint success. Under this matched protocol, the spectral selector also yields the highest worst-task gain and Weak Pareto rate and the lowest regression rate. Mean worst-task gain reaches +0.61 percentage points, while 17.1% regression and 13.0% abstention show that composability remains conditional. Project page: this https URL.
102. 【2611.11174】What Changed in Engineering Writing After Generative AI Chat Assistants: Evidence from 1.8 Million Articles
链接：https://arxiv.org/abs/2611.11174
作者：Taner Cokyasar
类目：Digital Libraries (cs.DL); Computation and Language (cs.CL)
关键词：uniform abstract index, develops methods, methods for measuring, conversational language models, November
备注： 26 pages, 5 figures, 7 tables. Code and data: [this https URL](https://doi.org/10.5281/zenodo.24028663)
点击查看摘要
Abstract:This study asks what changed in engineering articles after conversational language models became publicly available on November 30, 2022, and develops methods for measuring such change in a field without a uniform abstract index. It assembled 1,839,962 articles published from 2015 to 2025 in 256 engineering journals, tracked twelve measures of wording, style, and article structure, and compared each with the projection of its own pre-2023 trend. Building the monthly series showed that records dated only by year fall on January 1 and create false January peaks unless removed. In abstracts, 31 words associated with language model output appeared 82% more often than projected (55.4 against 27.0 per 10,000 words in 2025), while four control words of the same formal register fell 16%. Words that soften a claim, such as may, fell 13%, words that strengthen one, such as clearly, rose 20%, and long words rose 11%. Author counts, reference lists, page counts, and publication volume stayed within 4% of trend. The change appears in all fourteen subject categories, and false release dates, dropping any one journal or word, and word lists chosen from the data support it. A random sample of 12,866 full texts from the same corpus, including subscription articles and weighted back to it, shows the same words rising 99% in article bodies. Statements disclosing AI writing assistance, measured apart from mentions of language models, went from none to 3.7% in 2025, four in five of them at one publisher. The design is descriptive, not causal.
103. 【2611.11172】Do Benign-Trained Hidden-State Probes Detect Tool Errors Under Adversarial Conditions?
链接：https://arxiv.org/abs/2611.11172
作者：Bibek Bhandari,Kshitij Lingthep
类目：Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：detecting incorrect actions, monitor model operation, efficiently monitor model, probes efficiently monitor, remains unclear
备注：
点击查看摘要
Abstract:Although hidden-state probes efficiently monitor model operation, it remains unclear whether probes trained on benign tool use remain useful for detecting incorrect actions under adversarial conditions. In this research, we assess this problem from the perspective of operational tool-action correct- ness. we use four AgentDojo suites, four conditions, and three models: Qwen2.5-7B-Instruct, Qwen2.5-14B-Instruct, and GLM- 4.6V-Flash (9B). We perform a five-fold, task-grouped out-of-fold (OOF) evaluation for each model. We train step-specific logistic- regression probes only on benign and non-defended trajectories and evaluate them on held-out trajectories for benign, prompt- injection, system-override, and tool-poisoning conditions. We compare our hidden-state probe to mean tool-call-token entropy, negative mean tool-call-token log-probability, and self-consistency uncertainty. The paired tests highlight six significant differences after Holm correction. All of the tests involve Qwen2.5-14B- Instruct under the system-override condition, with all three scalar uncertainty metrics obtaining higher area under the receiver operating characteristic curve (AUROC) and average precision (AP) than the hidden-state probe. These results suggest that benign-trained hidden-state probes should not be assumed to reliably detect operational tool-action errors under adversarial conditions.
104. 【2611.11125】LongCap: Hour-Scale Timestamped Audio Captioning via Chunk-wise Processing
链接：https://arxiv.org/abs/2611.11125
作者：Jinchuan Tian,Sen Chen,Wenbin Huang,Chao Weng,Zhengwei Huang,Jiatong Shi,Yichen Lu,Haoran Wang,Shinji Watanabe,Cong Zhou
类目：Computation and Language (cs.CL); Sound (cs.SD)
关键词：Granularity Error Rate, Timeline Error Rate, accurate event timing, requires accurate event, Error Rate
备注： 26 pages. Project page: [this https URL](https://jctian98.github.io/longcap/)
点击查看摘要
Abstract:Describing hours of audio requires accurate event timing and sustained descriptive detail throughout the recording. We present LongCap, a framework for timestamped audio captioning (TAC), with the human-annotated LongCapBench and three diarization-inspired metrics: Timeline Error Rate (TER), Granularity Error Rate (GER), and Caption Similarity (tcpCapSim). LongCap interleaves audio chunks with structured event captions, using relative timestamps and retained context to support length extrapolation within a 1M-token inference context window. Event-level reannotation restores caption detail, while systematic studies examine model scaling, dependency supervision, and self-distillation. LongCap-Diar achieves strong benchmark results and extrapolates to 16 hours of concatenated audio despite training on recordings no longer than 40 minutes. Our TAC models are competitive with Qwen3.5-Omni-Plus on short clips, outperform evaluated baselines in caption similarity and timeline accuracy in segment-level comparisons on LongCapBench-TAC-Long, and caption full recordings approaching two hours. On LongCapBench-TAC, 9B and 35B-A3B offer favorable size-performance tradeoffs, while 122B-A10B substantially improves event-dependency recovery. These findings support long-horizon general audio understanding and provide a foundation for always-on voice agents.
105. 【2611.11111】Beyond Hard Labels: LLM Probabilities Improve Human-Assisted Regression
链接：https://arxiv.org/abs/2611.11111
作者：Xinyue Wang(Department of Statistics, The Pennsylvania State University),Qunhua Li(Department of Statistics, The Pennsylvania State University)
类目：Computation and Language (cs.CL)
关键词：Large language models, single categorical label, Large language, single categorical, categorical label
备注： 22 pages, including references and appendices
点击查看摘要
Abstract:Large language models (LLMs) are increasingly used for text annotation, but their outputs are often reduced to a single categorical label before downstream analysis. This hardening step discards the model's relative support across categories, which may contain useful information when category boundaries are ambiguous. We study whether retaining the full probability vector improves downstream regression when LLM annotations are combined with a limited amount of human annotation. Using matched soft and hard representations from three LLMs across three social-science text datasets, we compare direct regression and human-assisted correction. Soft inputs are not uniformly better when used directly as outcomes, but after human correction, using the probability vector consistently improves regression efficiency across models and datasets. Analyses of repeated human judgments and controlled simulations further show that these gains arise when probability variation beyond the hard category carries useful information about the human-coded outcome. Our results identify output representation as an important design choice in LLM-assisted measurement and support preserving probability outputs for downstream statistical analysis. Code and reproducibility materials are available at this https URL
106. 【2611.11102】ask presentation and execution paths shape LLM mathematical performance
链接：https://arxiv.org/abs/2611.11102
作者：Min Huang,Mingyan Liu
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Software Engineering (cs.SE)
关键词：Mathematical performance depends, Mathematical performance, model receives information, language model receives, receives information
备注：
点击查看摘要
Abstract:Mathematical performance depends on how a language model receives information, uses generated text and submits an answer. We study these dependencies through paired comparisons that separate submission requirements, draft reuse and candidate availability. On 65 development problems, an instruction permitting continued derivation produced no valid final answers in 390 short-output calls; a single-line submission instruction produced 390 format-valid outputs, including 389 parseable answers. Under the fixed submission protocol, 198 problems with failed initial submissions were answered correctly in 9.09p of cases with the question alone, 33.84p with its draft, 46.46p with candidates, and 59.60p with both. Drafts added 13.13 percentage points with candidates fixed, and candidates added 25.76 points with drafts fixed; both effects were significant after Holm correction and were subadditive on the accuracy scale. Retaining a trailing excerpt outperformed retaining a leading excerpt of similar average length by 10.10 points Holm-adjusted p 0.027. A second completion model showed the same directions of input effects on the fixed materials. In a cohort with parseable initial submissions, candidates added no correct answers when the previous draft was supplied, but added 27 points when it was absent. These results establish a conditional value of generated text: a failed submission can leave useful material, whose contribution depends on what else is supplied and what is retained.
107. 【2611.11079】When Calibration Data Matter in Sub-4-Bit Language Model Quantization
链接：https://arxiv.org/abs/2611.11079
作者：Yehong Jiang,Yen-Kuang Chen,Xinmin Tian
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：reduces language-model memory, post-training quantization reduces, quantization reduces language-model, sharply degrade downstream, reduces language-model
备注： Accepted to NeurIPS 2026. 10 pages main text, 47 pages total including references, checklist, and appendices
点击查看摘要
Abstract:Low-bit post-training quantization reduces language-model memory but can sharply degrade downstream task accuracy. Calibration usually relies on generic text, but when task-informed data recover accuracy and which quantizers benefit remain poorly understood. We introduce FragCal-DC, which supplements generic text with training documents from task families with low retention of full-precision accuracy in a two-bit scan. We use a two- to four-bit sweep to locate functional regimes and four-seed calibration comparisons to evaluate six data-dependent methods across six dense models (1.7B-8B) and ten tasks. At their lowest tested functional bit widths, iterative SignRound V2 and OmniQuant improve at two bits, whereas single-pass GPTQ and AWQ show small mean responses at three bits. At two bits, SignRound V2 gains 1.83 percentage points in mean ten-task accuracy over generic-text calibration across six models. At 70 billion parameters, GPTQ and SignRound V2 both improve at two bits, with functional generic-calibration baselines. For two-bit SignRound V2, task-level controls show that recovery concentrates on families included in calibration, while incorrect answer designations retain about 90% of the mean accuracy gain. Changes in reconstruction error do not consistently track accuracy gains. These findings support task-informed calibration as a design principle for preserving downstream accuracy in low-bit quantization.
108. 【2611.11074】System Prompts Affect Response Bias More Than Discriminability in LLM Safety
链接：https://arxiv.org/abs/2611.11074
作者：Mohan W. Gupta,Sandy Tanwisuth
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Software Engineering (cs.SE)
关键词：Large language model, Large language, compliance-refusal tradeoff, language model safety, Large
备注： 23 pages, 4 figures
点击查看摘要
Abstract:Large language model safety evaluations often focus on a compliance-refusal tradeoff: models should refuse unsafe requests without refusing safe ones. We argue that this misses a broader form of prompt-conditioned task selection, where the same request can elicit different behaviors depending on the system prompt. We investigate this using a controlled evaluation crossing eight safety-task prompt families with three clarity levels across HarmBench, XSTest, and IHEval. Holding benchmark items fixed, we evaluate 13 models and use signal detection theory to distinguish two possibilities: whether models become better at telling safe from unsafe requests (discriminability), or simply more willing to refuse (response criterion). We find substantial differences in discriminability across models, but system prompts primarily shift the willingness to refuse, with smaller and less consistent effects on discriminability. Increasing prompt clarity makes models more willing to refuse without reliably improving their ability to distinguish safe from unsafe requests. Beyond refusal, prompt families also shift responses among six distinct behavioral policies, including clarification and safe help. Together, these findings show that system prompts primarily change how models respond to safety-relevant requests rather than consistently improving their ability to distinguish safe from unsafe ones.
109. 【2611.11067】Beyond AUROC: Deployment-Aware Evaluation of Model-Internal Jailbreak Detectors
链接：https://arxiv.org/abs/2611.11067
作者：Mohammad Tehabsim,Basil Al-Housani,Nour Alhussien,Phung Lai
类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL)
关键词：Large language models, bypass safety controls, Large language, user-facing systems, policy-violating outputs
备注： Accepted to the 13th IEEE Special Session on Privacy and Security of Big Data (PSBD 2026), IEEE International Conference on Big Data (IEEE BigData 2026)
点击查看摘要
Abstract:Large language models (LLMs) are increasingly deployed in user-facing systems, where jailbreak attacks can bypass safety controls and induce harmful and policy-violating outputs. Recent model-internal detectors use hidden representations, gradients, or internal signals to identify such prompts, but their practical security value depends critically on behavior at low false-positive operating points rather than on area under the receiver operating characteristic curve (AUROC) alone. We study two data dependencies that shape this behavior: calibration data, which determine the detection threshold, and reference data, which can influence detector scores. Across four model-internal detectors, four LLMs, and twelve jailbreak families, thresholds calibrated on curated benign prompts frequently fail to preserve their false-positive rate (FPR) budgets on real-user traffic. Recalibration improves false-positive control but reveals substantial family-level coverage gaps, including cases with high AUROC but low true-positive rate (TPR). Causal reference-set interventions show that changing reference composition can substantially alter family-level detection and that improving coverage of one attack family can reduce coverage of others. These findings show that calibration and reference data are part of a detector's security behavior. We therefore recommend evaluating model-internal jailbreak defenses using realized FPR on deployment-like traffic and per-family TPR at explicit low-FPR operating points, with AUROC used as a complementary ranking metric rather than the primary security measure.
Comments:
Accepted to the 13th IEEE Special Session on Privacy and Security of Big Data (PSBD 2026), IEEE International Conference on Big Data (IEEE BigData 2026)
Subjects:
Cryptography and Security (cs.CR); Computation and Language (cs.CL)
Cite as:
arXiv:2611.11067 [cs.CR]
(or
arXiv:2611.11067v1 [cs.CR] for this version)
https://doi.org/10.48550/arXiv.2611.11067
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
110. 【2611.11035】Room to Reconsider: Reply Length Decides Whether Pushback Makes Language Models Sycophantic or Self-Correcting
链接：https://arxiv.org/abs/2611.11035
作者：Ook Lee
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：user pushes back, Language models, giving a reason, user pushes, pushes back
备注： 10 pages, 5 figures, 2 tables. Code: [this https URL](https://doi.org/10.5281/zenodo.24045308)
点击查看摘要
Abstract:Language models often abandon a correct answer when a user pushes back without giving a reason, and this behavior is usually studied as sycophancy to be suppressed. The same pushback, however, also leads models to revisit and sometimes repair a wrong answer. We measure both effects on multiple-choice questions from MMLU and ARC-Challenge with four open models from two families (Qwen3 1.7B, 4B and 8B, and OLMo-2 7B), reading the final answer exactly from option logits after a free-form reply. The reply budget changes the verdict. When Qwen3-4B may answer the challenge in at most 96 tokens, pushback leaves accuracy unchanged or slightly lower; with 1,024 tokens, it corrects 43% of its wrong answers and pushback raises accuracy by 5.7 points. Whether pushback helps overall follows a simple break-even rule in the cave and correction rates. Inside the model, caving can be partly predicted before the challenge: hidden states add about 0.04-0.06 AUROC over turn-1 confidence in three of our four probing runs. A probe trained only on self-correction cases predicts caving beyond confidence when replies are truncated, but not when the model can finish its reasoning. Activation steering never reduced caving selectively: where it worked, it suppressed self-correction as well. We conclude that sycophancy evaluations should allow full replies and report self-correction alongside caving.
111. 【2611.11030】Building and Auditing Chemical Datasets with LLMs: A General LLM-as-a-Judge Framework Applied to Homogeneous Catalytic PET Depolymerisation
链接：https://arxiv.org/abs/2611.11030
作者：Muhammad bin Javaid,Karim K. Ben Hicham,Enkhnyam Battulga,Alexander Mitsos,Martin Grohe
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Digital Libraries (cs.DL)
关键词：Large language models, truth remains difficult, rapidly extract structured, extract structured multivariate, structured multivariate experimental
备注：
点击查看摘要
Abstract:Large language models can rapidly extract structured multivariate experimental data from the chemistry literature, yet verifying thousands of generated records without ground truth remains difficult. We present a general, citation-grounded extraction and verification methodology centered on an independent "LLM-as-a-judge", applied to the literature on homogeneous catalytic poly(ethylene terephthalate) (PET) depolymerisation. In this pipeline, an extractor LLM generates schema-enforced records from research papers with citations to document chunks tagged with universally unique identifiers (UUIDs); an independent LLM judge then reads the full paper alongside each record, flags unsupported fields, and proposes cited corrections. Prompt ablations show that requiring chunk-level citations not only provides provenance down to specific paragraphs and tables but also improves extraction accuracy. Before deploying the judge at scale, we benchmarked it against manual evaluation on extractions from a hand-curated reference set of 295 ionic-liquid-catalysed PET glycolysis experiments. The judge agreed with human evaluation on 85.7% of reviewed records and was significantly more effective than a heuristic string-matching baseline at catching errors across related experiments. Deployed across 3,942 extracted records from 561 papers, the framework accepted 67.5% of them as written. Its proposed corrections concentrated on quantitative fields, where the extractor often conflated related experiments. We release the extracted dataset with the complete LLM judge audit logs, as well as the Chemistry Data Extractor Toolkit, an open-source application implementing this end-to-end pipeline in a code-free, browser-based environment for document parsing, customizable schema and prompt design, model-agnostic extraction and auditing, interactive provenance-highlighted review, and reproducible dataset bundling.
112. 【2611.11027】MoTo: Mixture of Tokenizers Towards Fair Multilingual Language Modeling
链接：https://arxiv.org/abs/2611.11027
作者：Gül Sena Altıntaş,Colin Raffel
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Large language models, language models rely, Large language, models rely, time and fixed
备注： Neurips 2026, 40 pages, 21 figures
点击查看摘要
Abstract:Large language models rely on a single tokenizer that is chosen at training time and fixed thereafter. Most tokenizers are trained on English-dominant corpora, making them under-serve morphologically rich and non-Latin-script languages, where they can produce fragmented representations, longer sequence lengths, and reduced information density during training. We propose Mixture of Tokenizers MoTo, a modular tokenization framework that trains dedicated per-language BPE tokenizers and composes them into a unified superset vocabulary, where tokens shared across languages are deduplicated into a common ID space. Each tokenizer maintains its own normalization policy, pre-tokenization rules, and vocabulary budget. Despite allocating significantly fewer entries to English, MoTo retains English performance while delivering consistent gains across 18 out of 21 typologically diverse languages spanning six scripts, with improvements most pronounced on morphologically complex and non-Latin-script languages that are systematically underserved by English-dominant tokenizer design. Our results suggest that modular subword tokenization is a practical and extensible alternative to monolithic tokenization for multilingual parity.
113. 【2611.11010】Lightfoot: Graph Retrieval-Augmented Generation with Exact, Model-Free Document Deletion
链接：https://arxiv.org/abs/2611.11010
作者：Uday Allu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Graph-based retrieval-augmented generation, improves multi-hop question, multi-hop question answering, comparisons rarely measure, research comparisons rarely
备注： 9 pages, 1 figure. Code: [this https URL](https://github.com/udayallu-ml/Lightfoot-GraphRAG)
点击查看摘要
Abstract:Graph-based retrieval-augmented generation (GraphRAG) improves multi-hop question answering, but deployed systems face two costs that research comparisons rarely measure: building the graph, and removing documents from it. We present Lightfoot, a GraphRAG system in which every entity, link, fact and synonym edge is a deterministic function of per-passage extractions carrying chunk-level provenance. Indexing makes one language-model call per passage, retrieval makes none, and deleting a document is a database operation with no model calls. On the full 11,402-passage MuSiQue corpus we verify that, after deleting 10% of the documents, the graph is identical to a fresh index of the surviving documents. We compare Lightfoot with HippoRAG 2, LightRAG and fast-graphrag under identical extraction, answer and embedding models on MuSiQue, 2WikiMultiHopQA and HotpotQA. Lightfoot builds the cheapest index on all three datasets, 26-31% below HippoRAG 2 and 3-6x below LightRAG and fast-graphrag. Against HippoRAG 2 it is significantly better on MuSiQue retrieval (+2.8 points recall@5 and +4.3 recall@10 on a held-out split) and on HotpotQA answers (+7.7 points exact match), and significantly worse on 2WikiMultiHopQA (-3.9 recall@2, -8.4 F1). Deleting the same documents took LightRAG 2,187 model calls and 3.7 hours; fast-graphrag has no deletion path. Code and per-question results: this https URL
114. 【2611.10997】Open Problems in Chatbots and Mental Health
链接：https://arxiv.org/abs/2611.10997
作者：Jared Moore,Jacy Reese Anthis,William Agnew,Andrea Mock,Kevin Klyman,Sanmi Koyejo,Nick Haber,Stevie Chancellor,Eric Lin,Ryan Louie,Desmond C. Ong
类目：Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：mental health support, mental health, General-purpose chatbots, health support, mental
备注：
点击查看摘要
Abstract:General-purpose chatbots are increasingly used for emotional and mental health support. They can be useful, but issues such as sycophancy, reinforcement of delusional beliefs, and poor crisis response create risks that are difficult for researchers to study and evaluate. In this paper, we review the most critical open problems for researchers and policymakers in the use of general-purpose chatbots and their effects on mental health. First, there are tractable problems in the controlled evaluation of chatbots: establishing the construct and ecological validity of evaluations, evaluating multi-turn interactions, and connecting evaluations to improvements in chatbot behavior. For example, conventional benchmarks that primarily rely on static datasets cannot establish chatbot safety, and novel simulation methods need validation. Second, researchers must connect their studies of chatbots and mental health to real-world evidence. This includes analyzing the chatbot products that AI companies and mental health practitioners have deployed, including their user interfaces and human review and escalation practices for user welfare concerns. However, clinical analysis opportunities afforded by real chat log data sharing are complicated by significant privacy concerns. Finally, we argue that researchers should take an active role in the construction and refinement of evidence-based policy through corporate and governmental decisions such as user protections, standards of care, protected access to user chat logs, data sharing between institutions, incident reporting, and post-deployment monitoring. Such behavioral evaluations, studies of real-world outcomes, and data governance depend on each other and must be addressed in tandem. We believe a coordinated research effort would have substantial real-world impact.
115. 【2611.10982】hink or Remember: The Exchange Rate of Agentic Inference
链接：https://arxiv.org/abs/2611.10982
作者：Juan Wisznia,Santiago Luis Groba Alonso,Matías Gómez Taddeo,Gonzalo Zabaleta,Joaquín Cullen,Luciano Del Corro
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：reasoning models resend, resend their growing, growing transcript, Agents built, models resend
备注：
点击查看摘要
Abstract:Agents built on reasoning models resend their growing transcript at every call. Two transacting parties, not the model, decide what that costs: the client keeps or edits messages; the server decides whether earlier reasoning returns in the prompt and what its cache reuses. We define a cost model whose counts match an instrumented engine exactly; the architecture charges $c$ per token processed and $\beta$ per pair attended. Their ratio $P^*=c/\beta$ is an exchange rate between thinking and remembering: per token, processing dominates below this context length, a thinking regime, and attention above it, a memory regime. A policy change has a mechanical cost, incurred even if the agent writes the same tokens, and a behavioral one: it writes different tokens, changing cost and outcome. Serving alone can flip which policy is cheaper: on recorded Qwen3-8B ScienceWorld runs, dropping earlier reasoning costs 1.74 times keeping it when the server reuses generated states and 0.34 times when it reuses nothing. In live reruns, dropping it cuts correct HotpotQA answers by 9-23 percentage points on four models, at lower point-estimate cost. Comparing context policies means comparing systems: architecture and serving set the cost of the history kept and the work it induces.
116. 【2611.10977】DM-Call: Decision-Model-Guided Function Calling with Cumulative Verification Feedback
链接：https://arxiv.org/abs/2611.10977
作者：Minhyeong Yu,Wonduk Seo,Seunghyun Lee
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Software Engineering (cs.SE)
关键词：Large Language Models, requires Large Language, calling requires Large, Language Models, Large Language
备注： 4 tables, 2 figures
点击查看摘要
Abstract:Reliable function calling requires Large Language Models (LLMs) to select appropriate functions and generate arguments consistent with user intent. However, syntactically valid calls may still be semantically incorrect due to inappropriate function selection or mismatched arguments. In this paper, we propose Decision-Model-Guided Function Calling (DM-Call), a framework that combines local schema validation with separate decision-model verification of function selection and argument correctness. For rejected candidates, DM-Call accumulates verification probabilities, binary judgments, and schema errors across attempts. A hybrid feedback representation further combines numerical probabilities with verbal correctness labels to guide iterative refinement without executing external tools. Extensive evaluation across BFCL and API-Bank (first-call) demonstrates DM-Call boosts function-calling accuracy versus direct generation, at modest additional cost.
117. 【2611.10974】SWEET: Mitigating Spurious Feature Reliance in LLM Reasoning via Weight Editing
链接：https://arxiv.org/abs/2611.10974
作者：Zhizhang Fu,Lucas Zhao,Michalis Korakakis,Mengru Ding,Lukasz Szpruch,Yue Zhang
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：simple input perturbations, adding irrelevant distractors, large language models, suggesting reliance, large language
备注：
点击查看摘要
Abstract:Reasoning in large language models can be disrupted by simple input perturbations (e.g. adding irrelevant distractors), suggesting reliance on spurious correlations. Identifying and suppressing the spurious features involved in long chain-of-thought reasoning remains challenging. We introduce Spurious-feature WEight EdiTing (SWEET), a training-free method that combines counterfactual interventions with mechanistic interpretability to identify and suppress spurious-features. SWEET extracts token- and sequence-level behavioral directions from activation contrasts between original problems and their counterfactual variants - capturing local and global patterns of spurious reasoning. It then localizes the responsible MLP neurons and attention heads and suppresses their contributions along these directions through weight edits. Using only 20 original-counterfactual pairs for direction extraction, SWEET improves accuracy by an average of 11.8 percentage points on perturbed inputs and 2 points on original inputs across five open-weight reasoning models and five reasoning benchmarks. It also reduces the relative gap between original and perturbed accuracies from 17.6% to 2.5%. Analyses identify two recurring forms of spurious reasoning, i.e. over-integrating irrelevant conditions and overthinking, and provide mechanistic evidence that SWEET improves reasoning robustness by suppressing both behavioral directions.
118. 【2611.10971】When Safety Becomes An Outlier: Understanding the Retention of LLM Safety Behaviors
链接：https://arxiv.org/abs/2611.10971
作者：Binchi Zhang,Hadi Abdullah,Yiwei Cai,Jundong Li
类目：Computation and Language (cs.CL)
关键词：Safety-aligned large language, Safety-aligned large, data are included, safety, Safety Targets
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:Safety-aligned large language models often lose their safety behaviors after fine-tuning, even when safety data are included. While this fragility is well documented, its underlying cause remains unclear. In this paper, we propose that formulaic refusal strings can function as outlier modes: narrow, weakly grounded response patterns that are easy to fit but vulnerable to subsequent updates. Controlled experiments support this account: fixed refusals are acquired much like arbitrary constant strings, in contrast to prompt-grounded natural responses. Motivated by these findings, we introduce Naturalness-Enhanced Safety Targets (NEST), a safety alignment framework that improves safety retention by constructing natural, context-aware safety targets that keep safety responses within the model's existing output distribution and grounded in semantics. We instantiate NEST in both supervised and preference-based alignment settings, using perplexity under the original model as a proxy for distributional support. Across multiple models and alignment regimes, natural safety targets improve both immediate safety and its retention under continued fine-tuning without sacrificing helpfulness. These findings suggest a practical principle for more durable safety alignment: construct safety targets that draw on the model's existing language capabilities and remain grounded in the meaning of each request.
119. 【2611.10936】Can small transformers learn the language of Coxeter groups?
链接：https://arxiv.org/abs/2611.10936
作者：J. Elisenda Grigsby,Yiyao Huang,Arushi Katyal,Ryan Lin,Pranav Ramakrishnan,Weiya Wang
类目：Computation and Language (cs.CL); Machine Learning (cs.LG); Group Theory (math.GR); Representation Theory (math.RT)
关键词：field of mechanistic, mechanistic interpretability, interpretability is well-suited, well-suited to collaborative, collaborative projects
备注： 13 pages, 13 figures, accepted as a poster at the 6th workshop on Mathematical Reasoning and AI; NeurIPS 2026, Atlanta; This version is updated from the camera-ready version which can be found at [this https URL](https://mathai-2026.github.io/cfp/) and [this https URL](https://openreview.net/forum?id=lYImtIt4tA)
点击查看摘要
Abstract:The field of mechanistic interpretability is well-suited to collaborative projects between mathematicians and AI researchers. This work describes one such project. We trained a small transformer to learn the language of the Coxeter group affine A2, best known as the symmetries of the tiling of the Euclidean plane by equilateral triangles. We then formulated and proved a word-theoretic conjecture about affine A2 after observing the attention patterns of the trained model.
120. 【2611.10931】Gendered Misclassification from Surname-Based Race Imputation
链接：https://arxiv.org/abs/2611.10931
作者：Noah Dasanaike
类目：Computation and Language (cs.CL); Applications (stat.AP)
关键词：Researchers increasingly estimate, increasingly estimate political, estimate political behavior, political behavior based, Researchers increasingly
备注：
点击查看摘要
Abstract:Researchers increasingly estimate political behavior based on race and gender from voter files, where race is imputed from surnames and geography. This only works where surnames suggest group membership, an assumption violated where surnames follow norms around marriage. Imputation is therefore biased against women who adopt their husband's surname, especially those who racially inter-marry, an outcome itself endogenous to partisanship. Using six US states recording self-reported race, I show that imputation is less accurate for Asian and Hispanic women, particularly those sharing the surname of a partner of another race, who differ politically from other women of their race. This violates assumptions behind downstream inference approaches, which nearly double the gender gap in partisanship among Asian voters. I derive an expression showing the bias is largest where a group is small. Using maiden rather than marriage-adopted surnames in North Carolina raises accuracy up to fourfold for women married across racial lines. Recovering maiden surnames, or omitting the married surname, removes much of the bias. In a national replication of a study of gender gaps in turnout, the correction more than triples the gap among Asian voters. In Lebanon, where wives register in their husband's locality, the error enters through geography.
121. 【2611.10926】DeepFinance: Can AI Diligence a $100MM Deal?
链接：https://arxiv.org/abs/2611.10926
作者：Drew Hahn,Tyler Shibata,Jackson Grove,Rahul Sonwalkar
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); General Finance (q-fin.GN)
关键词：producing numerically correct, high-finance work focus, numerically correct outputs, Existing evaluations, focus on retrieving
备注： 12 pages, 3 figures, 6 tables. Leaderboard: [this https URL](https://www.juliusresearch.ai)
点击查看摘要
Abstract:Existing evaluations of AI models on high-finance work focus on retrieving answers from financial documents and producing numerically correct outputs. Real private equity (PE) and investment banking (IB) work also depends on choosing between conflicting sources, making sound assumptions, and keeping every step auditable. We introduce DeepFinance, an ultra long-horizon benchmark of 21 end-to-end PE and IB tasks that take a human professional an average of 27.1 hours. Each task pairs a request with a data room averaging 19 files and is graded against an average of 84 expert-written rubric criteria covering output, workflow, and judgment. We evaluate 22 model configurations, each in its native agent harness. The best configuration, GPT-6 Astra with max reasoning, satisfies 57.6% of rubric criteria, and the top four configurations are not statistically distinguishable. Frontier models often calculate correctly from the wrong inputs and find decision-relevant evidence without acting on it.
122. 【2611.10909】Pole or Vector? Encoders Capture Bangla Compound Verbs, but LLMs Read Them Literally
链接：https://arxiv.org/abs/2611.10909
作者：Md. Asaduzzaman Shuvo,Md Mehrab Karim Antor,Md. Adnanul Islam,Shahanur Rahman Bappy,Sajid Ahamed,Mahfuz Hasan Reza,Md Delwar Shahadat Deepu
类目：Computation and Language (cs.CL)
关键词：Bangla, verbs, vector, main verb, meaning
备注：
点击查看摘要
Abstract:In Bangla, a main verb is often followed by one of a small set of vector verbs. These verbs lose their own meaning and add a shade of meaning instead, such as completion. For example, likhe phello means that someone finished writing, not that they wrote and threw something. The same two verbs can also describe two separate events, so only the context shows which meaning is meant. This makes compound verbs a hard test of how language models handle multiword expressions. We present BanglaCV-Probe, a benchmark of 17 vector verbs with 1,044 minimal pairs, 204 entailment items and 197 pairs of correct and incorrect combinations, all checked by native speakers. We test 26 models (encoders, LLMs and translation systems) on four skills: telling the two meanings apart internally, understanding what a vector adds, preferring correct combinations and keeping the vector's meaning in translation. Probes on five encoders tell the two meanings apart and still reach up to 93% accuracy when trained on pairs without surface cues. Prompted models rarely use this knowledge. Entailment accuracy stays between 59% and 81%. Several LLMs answer Yes or No to almost every item, and nine of ten models miss that someone who ate up the rice left none. Most instruction-tuned LLMs translate vectors literally in 15-20% of vector sentences and in up to 55% for mora (die). On correct combinations, a small Bangla-only model (88%) matches BLOOM-7B1 (87%) and both beat Qwen2.5-7B (74%). Data and code: this https URL
123. 【2611.10906】SCorPion: A Strategic, Controllable and Personified Conversational Companion
链接：https://arxiv.org/abs/2611.10906
作者：Luo Ji,Xiyuan Chen,Dan Wang,Qingqing Gu,Teng Chen,Feixiang Guo,Yetao Wu,Jinxian Qu,Yue Zhao,Kun Fan,Ningyuan Xi,Hange Zhou,Zhonglin Jiang,Yong Chen,Hongyan Li
类目：Computation and Language (cs.CL)
关键词：Fixed prompt-based language, versatile topics require, models face challenges, Fixed prompt-based, language models face
备注： NeurIPS 2025 PersonaLLM Workshop
点击查看摘要
Abstract:Fixed prompt-based language models face challenges in open-domain conversations, where versatile topics require different expert advice or demonstrations to maximize their universal performance. Motivated by the dynamic prompt studies in language generation, we extract different chatting strategies from varied forms of text corpus, which steer the language model to different styles based on human principles. We design and deploy a conversational companion called SCorPion, which uses GraphRAG to extract and summarize the knowledge graph globally, yield community-summarized strategies, and produce query-focused optimal strategies. SCorPion has strategic thinking, yields personified and stylized responses, and can be controlled by explicit factors. Code and further results can be found in this https URL.
124. 【2611.10866】he Surprising Effectiveness of Deleting Weights in LLM Post-Training
链接：https://arxiv.org/abs/2611.10866
作者：Jack Lu,Zhenbang Yang,Mike Lasby,Tejas Pote,Yani Ioannou,Mengye Ren
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：large language model, pretrained large language, Deletion Tuning, language model, acquire new capabilities
备注： NeurIPS 2026
点击查看摘要
Abstract:How little of a pretrained large language model (LLM) has to change for it to acquire new capabilities? We find that zeroing fewer than 0.05% of its weights, with no other modification, matches full fine-tuning (FFT) at scale across three LLM post-training regimes: reinforcement learning with verifiable rewards, supervised fine-tuning, and on-policy distillation. Our method, Deletion Tuning, learns a binary mask over the gate projection of transformer blocks. Two practical advantages follow: the trained mask is hundreds to thousands of times smaller than the corresponding FFT checkpoint, and Deletion Tuning forgets far less, which addresses a central challenge in continual learning. Under reinforcement learning, its prior-task accuracy stays near the base level while FFT, LoRA, and random sparse fine-tuning lose up to 5.4 points. To understand why masking alone suffices, we analyze the geometry of the learned weight changes under reinforcement learning using stable rank, spectrum drift, and principal-weight overlap. Compared with LoRA and random sparse fine-tuning, Deletion Tuning is closest to FFT across the three measures.
125. 【2611.10852】KeyASRBench: Measuring Whole-Phrase Keyword Preservation in Real-World ASR
链接：https://arxiv.org/abs/2611.10852
作者：Guanzheng Wei,Ziyi Zhao
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Public automatic speech, benchmarks increasingly report, automatic speech recognition, increasingly report low, report low sequence
备注： 8 pages, 3 figures, 4 tables. Bilingual ASR evaluation with a 10-hour model-conditioned challenge set and a disjoint 30-minute model-blind control
点击查看摘要
Abstract:Public automatic speech recognition (ASR) benchmarks increasingly report low sequence error rates, yet production systems still use hotword lists, contextual biasing, retrieval, and post-correction. This motivates a complementary question: does a transcript preserve selected names, products, technical terms, versions, and relational phrases? We present KeyASRBench, a bilingual pilot that operationalizes occurrence-based Keyword Error Rate (KER) over frozen whole-phrase annotations. The 10-hour model-conditioned challenge set contains 1,501 Chinese and English clips with 4,723 keyword occurrences. Across five locally inferred checkpoints and two official API systems, language-specific MER/WER ranges from 5.31% to 12.91%, while KER ranges from 13.61% to 33.81%. A disjoint 30-minute model-blind control yields KER of 10.65%-27.31%. The control confirms that selected-phrase errors extend beyond challenge-set selection.
126. 【2611.10848】MultiTurnRoute: A Platform for Building and Evaluating Multi-Turn LLM Routers
链接：https://arxiv.org/abs/2611.10848
作者：Jiaqi Xue,Mengxin Zheng,Heng Huang,Qian Lou
类目：Computation and Language (cs.CL); Multiagent Systems (cs.MA)
关键词：choice of language, turn can affect, model, model reusable prefix, language model
备注： Accepted by NeurIPS 2026
点击查看摘要
Abstract:In a multi-turn conversation, the choice of language model at one turn can affect which model should answer the next. The selected model's reply shapes the context for the next query, and its cached prompt prefix can reduce the cost of using that model again. We introduce MultiTurnRoute, a platform for building and evaluating multi-turn LLM routers. A shared interface gives built-in and user-defined routers the current query, dialogue history, and an estimate of each model's reusable prefix length. Our routing algorithm, Chain-of-Route (CoR), uses a learned gate over recent and recurrent dialogue history to predict response quality and estimates cost from each model's reusable prefix. MultiTurnRoute Arena ranks routers on recorded conversations and compares session quality and cost in interactive runs where a simulated user responds to each reply. On a benchmark drawn from WildChat and LMSYS-Chat-1M with per-turn quality annotations for five LLMs, CoR reduces the normalized cost required to match the strongest model's quality by up to 20.3% relative to the strongest routing baseline, while matching or improving peak response quality.
127. 【2611.10840】Simple Test-Time Refinement for Plot-to-Code Generation via Visual-Code Diagnostics
链接：https://arxiv.org/abs/2611.10840
作者：Peiming Guo,Jinpeng Huang,Yangbin Sun,Gaoxiong Cao,Ensheng Shi,Yuchi Ma,Yu Zhang,Meishan Zhang,Baotian Hu,Min Zhang
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：large language models, recent multimodal large, multimodal large language, language models, greatly advanced
备注： Accepted by NeurIPS 2026
点击查看摘要
Abstract:Plot-to-code generation has been greatly advanced by recent multimodal large language models (MLLMs). However, existing studies mainly focus on one-pass generation or iterative sampling guided by verifier-based filtering, which does not align with the typical human programming workflow of generate first, then iteratively error-location and fix. This naturally motivates a test-time refinement paradigm for plot-to-code generation. In this work, we present the first study on plot-to-code generation via iterative test-time refinement. We propose a Visual-Code Diagnostics framework that enables refinement through visual feedback from source code. Specifically, we first categorize generation errors into four coarse-grained types, and then train lightweight discriminators to recognize and localize these errors based on the rendered visual outputs and corresponding code. Unlike traditional compiler- or debugger-based verification, our approach performs iterative refinement guided by one diagnostics system, enabling more effective semantic and visual correction during test time. Extensive experiments demonstrate that our method consistently improves generation quality across diverse generators and significantly outperforms strong test-time scaling baselines.
128. 【2611.10808】CompAIssionate Other: Identity Assumptions in LLM Responses to Distress
链接：https://arxiv.org/abs/2611.10808
作者：Drishti Goel,Ethan M. Nguyen,Violeta J. Rodriguez,Koustuv Saha
类目：Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Social and Information Networks (cs.SI)
关键词：experiencing suicidal ideation, Individuals experiencing suicidal, suicidal ideation, experiencing suicidal, disclose their social
备注：
点击查看摘要
Abstract:Individuals experiencing suicidal ideation (SI) or psychological distress may disclose their social identities when seeking support from LLMs. Attending to identity-related stressors can be important for providing contextually appropriate and empathetic support. However, disclosing an identity does not necessarily mean that it is a cause of distress. In this work, we audit how LLMs interpret distress through disclosed identities. Using paired counterfactual interventions, we evaluate six LLMs across two SI and distress datasets, 16 identity and control conditions, and two prompting protocols. Our findings suggest that models can transform identity disclosures into explanatory narratives, attributing distress to presumed identity-related adversity. These assumptions frequently appear within otherwise empathetic responses, particularly when marginalized identities are disclosed. We contextualize our findings through the lens of compassionate othering to characterize these patterns as a form of harm in which empathetic responses impose identity-linked assumptions on individual suffering. These responses can misrepresent individuals' experiences by treating their identities as explanations for distress without supporting evidence. Our findings highlight the need to mitigate these harms by grounding interpretations of distress in individuals' disclosures and avoiding unsupported identity-linked assumptions.
129. 【2611.10802】Evaluating Jev on Arabic: Comparing Decision Models and LLMs Across Arabic Tasks and Dialects
链接：https://arxiv.org/abs/2611.10802
作者：Hossam Elsafty,Tobias Deußer,Lorenz Sparrenberg,Rajkumar Ramamurthy,Rafet Sifa
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Modern Standard Arabic, Standard Arabic, Modern Standard, change between Modern, Arabic tasks
备注： 28 pages, including references and appendices
点击查看摘要
Abstract:How does Jev compare with other systems on Arabic tasks, and how does its performance change between Modern Standard Arabic (MSA) and dialects? We evaluate 67 systems, including 47 decision models and 20 large language models (LLMs), on 43 tasks across 9 task families using a shared zero-shot protocol. The Arabic-focused frozen suite includes English controls in three parallel resources, which we also remove in a separate descriptive comparison. Jev 1.14.0 achieves a mean task-primary metric of 69.24 on a scale multiplied by 100, compared with 68.77 for Jev 1.13.0 and 71.81 for Gemma-4-31B, the highest-scoring system on this aggregate. Removing the recorded English controls, repeated cross-task items or both leaves the full system order unchanged. Relative performance and gains between Jev versions vary across task families. In content-matched comparisons within Jev 1.14.0, pooled dialect-minus-MSA accuracy gaps range from -7.94 to -0.35 percentage points across four datasets; dialect-specific results show larger variation, and SIB-200's source-clustered interval includes zero. Paired contrasts with Jev 1.13.0, Gemma-4-31B and Jais-2-8B show a larger Palestinian banking penalty for Jev 1.14.0 than for either LLM under simultaneous uncertainty; the other gap contrasts remain inconclusive. These descriptive findings show why aggregate scores should be read alongside task-family results, coverage and matched language comparisons. They do not establish a general model ranking for dialect robustness or explain the causes of the observed gaps.
130. 【2611.10800】Enhancing Mathematical Reasoning in Turkish Large Language Models with Search-Based Inference and Model Merging
链接：https://arxiv.org/abs/2611.10800
作者：Ahmed Zeer,Osama Shbib,Muzaffer Kaan Yuce,Himmet Toprak Kesgin,Mehmet Fatih Amasyali
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large Language Models, combining LoRA fine-tuning, weight-space model merging, Language Models, weight-space model
备注：
点击查看摘要
Abstract:We improve Turkish mathematical reasoning in Large Language Models by combining LoRA fine-tuning, weight-space model merging, and search-based inference. Using Turkish-Llama 8B-DPO with Turkish translations of MetaMath, NuminaMath, and TigerLab, we find data quality beats scale (Mix-30k best among fine-tuned; large MetaMath underperforms). Linear merging delivers the largest gains (GSM8K up to 0.63), while Ties is modest and Breadcrumbs/Slerp degrade. Search with MCTS and Tree of Thoughts improves mean LLM-judge scores for reasoning quality on a 0-100 scale. Limitations include machine translation, limited scale, and search stochasticity.
131. 【2611.10797】Adapting Large Language Models via Multi-Task Learning for Mental Health Problem, Emotion, and Sentiment Detection
链接：https://arxiv.org/abs/2611.10797
作者：Amir Rafiq Bhat,Rahim Dehkharghani,Zeki Erdem
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：health problem detection, mental health problem, study investigates sequential, investigates sequential multi-task, Parameter-Efficient Fine-Tuning
备注： 33 pages
点击查看摘要
Abstract:This study investigates sequential multi-task learning using Parameter-Efficient Fine-Tuning (PEFT), LoRA, and 4-bit quantization on Llama 3.1 8B Instruct for mental health problem detection, emotion detection, and sentiment analysis. Using 4,243 English social media posts, it compares two task sequences and demonstrates that task ordering significantly affects knowledge transfer and task interference. The MHP-first sequence achieves the best mental health problem detection (Micro-F1: 0.7624), while the Emotion-first sequence performs better in emotion (F1: 0.6052) and sentiment analysis (F1: 0.9459). A Joint-MTL baseline further highlights the challenges of simultaneous learning, including task interference and generative format collapse. Overall, the findings demonstrate the effectiveness of sequential PEFT for mental health NLP while showing that task order is critical to balancing performance across related tasks. The integration of LoRA and 4-bit quantization also reduces computational and memory requirements, supporting the adaptation of large language models in resource-constrained environments.
132. 【2611.10789】Generating Diverse and Verified Synthetic Clinical Notes with Labels by Construction
链接：https://arxiv.org/abs/2611.10789
作者：Matthias Lehmann,Madeleine Werthebach
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：natural language processing, strict privacy regulations, language processing, strict privacy, privacy regulations
备注： Accepted at the GenAI for Health Workshop @ NeurIPS 2026. 38 pages including appendix. Code: [this https URL](https://github.com/Matt00n/phi_discharge_letter_generator)
点击查看摘要
Abstract:Under strict privacy regulations in the clinical domain, de-identification is necessary to enable the use of clinical data such as for natural language processing. However, we currently lack sophisticated ways to tell which de-identification models actually are suitable. Specifically, we need benchmarks that are challenging, diverse, and clinically plausible, all while ensuring label correctness. To this end, we present SPARCLING, an LLM-based pipeline to generate synthetic discharge letters with character-exact PHI span annotations. Our pipeline combines structured attribute sampling, template generation, and red teaming to obtain diverse PHI-labeled discharge letters. In our experiments, we demonstrate this superior content diversity over existing public datasets. Further, we show SPARCLING's downstream utility as a benchmark to uncover failure modes of de-identifiers in the German clinical domain. Finally, our experiments show that training on our synthetic data can yield more capable de-identifiers than training on the scarce public data alone. Our code is available at this https URL.
133. 【2611.10765】Cascading Circle Loss: Order-Preserving Contrastive Learning for Graded Legal Retrieval
链接：https://arxiv.org/abs/2611.10765
作者：Rayane Kimouche,Ahmed Touila
类目：Computation and Language (cs.CL)
关键词：Cascading Circle Loss, paper introduces Cascading, introduces Cascading Circle, introduces Cascading, Cascading Circle
备注：
点击查看摘要
Abstract:This paper introduces Cascading Circle Loss (CasCL), a contrastive learning framework for legal retrieval tasks with graded relevance. CasCL combines an InfoNCE objective for positive-negative separation with a cascade of ranking boundaries that model ordered relevance levels between queries and legal clauses. The framework also includes a negative-aware self-paced optimization mechanism and a relevance gain weighting strategy to improve ranking quality. Experiments on legal passage retrieval benchmarks show that CasCL consistently outperforms existing methods, including InfoNCE, Circle Loss, MNRL and Margin MSE, across both binary retrieval and graded ranking metrics.
134. 【2611.10740】Evaluating Physically Grounded Procedural Reasoning in VLMs through Real-World Execution: Crochet as a Testbed
链接：https://arxiv.org/abs/2611.10740
作者：Maximiliano Wardle
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：work in practice, Vision-Language Models, procedural reasoning, generate procedures, paper
备注：
点击查看摘要
Abstract:Vision-Language Models (VLMs) can generate procedures that look convincing on paper, but do they work in practice? In this paper, we propose crochet as an ideal testbed for physically grounded procedural reasoning in VLMs. Crochet cannot be reliably simulated or automated: the only way to know what a pattern produces is to make it by hand, yet verification is tangible and cheap, requiring nothing but a hook and a ball of yarn. We introduce FoundationChain, a deceptively simple test of procedural reasoning: given an image of a basic crochet object, can VLMs infer how it was made and generate a pattern that produces the same result? We crochet 40 patterns generated by four VLMs by hand. Even at this scale, physical execution not only reveals failures that automated proxies cannot detect, but also enables a more precise diagnosis of their causes and consequences: while models write fluent, convincing patterns, only four are free of errors, and our analysis exposes deficiencies in visual, geometric and procedural reasoning.
135. 【2611.10721】Behavioral Evaluation of Large Language Models Under Cognitive Biases in HAZOP Studies
链接：https://arxiv.org/abs/2611.10721
作者：Vinicius M. Müller,Vitor A. O. Silva,Sávio S. V. Vianna,Flávio V. Silva
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：studies safeguard industrial, safeguard industrial processes, studies safeguard, catastrophic accidents, safeguard industrial
备注： 8 pages, 1 figure, 3 tables. Submitted to IFAC for possible publication. Supplementary material available at [this https URL](https://github.com/ViniMelloeMuller/psyhazop-supplementary-material)
点击查看摘要
Abstract:Hazard and Operability (HAZOP) studies safeguard industrial processes against catastrophic accidents. Large language models (LLMs) increasingly assist HAZOP drafting, yet evaluations rely on lexical overlap. Because LLMs internalize human heuristics, prompts may trigger biased judgments. Whether frontier LLMs withstand cognitive perturbations in safety-critical workflows remains unknown. Here we show across 420 trials that three frontier LLMs resisted 96.8% of cognitive manipulations, rendering overall susceptibility statistically inconclusive. Contrary to assumed broad fragility, models rejected confirmation and availability cues. However, safety-critical risk downgrades emerged under low anchors and gain frames. Thus, automated hazard analysis requires disciplined human-in-the-loop validation.
136. 【2611.10694】Perception, Not Reasoning, Limits Visual Theory of Mind
链接：https://arxiv.org/abs/2611.10694
作者：Mohamed Rayan Barhdadi,Syed Talal Wasim,Juergen Gall,Erchin Serpedin,Hasan Kurban
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Neurons and Cognition (q-bio.NC)
关键词：Vision-language models pass, models pass text-based, pass text-based false-belief, text-based false-belief probes, twenty percentage points
备注： 36 pages, 6 figures. Accepted to NeurIPS 2026 (ED). Code and dataset: [this https URL](https://kurbanintelligencelab.github.io/perception-not-reasoning/)
点击查看摘要
Abstract:Vision-language models pass text-based false-belief probes at near-human levels but drop by over twenty percentage points on abstract panels the moment the same problem is conveyed visually. The consensus diagnosis is conceptual, prescribing new belief-reasoning modules. We argue the dominant bottleneck is perceptual: not what the model cannot reason about, but what it cannot see. We propose a five-condition dissociation protocol that holds the reasoning task constant while varying perceptual fidelity from visual only to text only, and quantify the result with the Perceptual Contribution Ratio, the share of the visual-to-text gap a given fidelity closes. We test this on two kinds of scenes: abstract 2D panels in the Heider--Simmel tradition, and naturalistic 3D game scenes from MuMA-ToM and MindPower. The evaluation covers seven VLMs and roughly 159,000 API calls. Ground-truth scaffolds substantially close the gap in every setting, and on the abstract panels and MuMA-ToM they match or exceed the text-only reasoning. Whereas scaffolds built by automatic parsers, including frontier VLMs, fail. The most common error in the visual-only condition is \emph{reality bias}, which accounts for 60\% of false-belief failures. Models report where an object actually is, not where an absent agent believes it is. This points to a perceptual front-end that fails to track which agents were present at each moment. Under the evaluated protocol, structured visual scene-state extraction, rather than belief inference, is the dominant bottleneck for visual ToM.
137. 【2611.10693】Machine Hearing: Can Audio LLMs Generalize Beyond Human Auditory Perception?
链接：https://arxiv.org/abs/2611.10693
作者：Liwei Liu,Jun Tao,Xingyuan Li,Xuenan Xu,Chen Zhang,Junyi Wang,Boya Zhang,Xiaoyu Yang,Zhen-Hua Ling,Wen Wu,Chao Zhang
类目：ound (cs.SD); Computation and Language (cs.CL)
关键词：made remarkable progress, perceptual scope remains, made remarkable, perceptual scope, remains largely human-centric
备注： 22 pages, 7 figures, 5 tables
点击查看摘要
Abstract:Multimodal LLMs have made remarkable progress in perceiving the physical world, while their perceptual scope remains largely human-centric, focusing on what humans can directly see or hear. This progress raises the prospect of perception beyond human limits, such as extending hearing to sounds that are inaudible to humans. More broadly, the physical world is full of waves, vibrations, and oscillations, only a small fraction of which are directly audible to humans. This invites the extension of multimodal LLMs toward a broader form of machine hearing, which remains largely underexplored. To investigate this direction, we introduce the Machine Hearing Benchmark (MHB), comprising 6,128 instances across 13 tasks and seven domains. MHB spans highly heterogeneous input regimes, with sampling rates from approximately $10^{-5}$ to $10^6$ Hz, sequence lengths from $10^1$ to $10^6$ samples, and both single- and multi-channel inputs. Evaluations of current open-source and proprietary Audio LLMs (ALLMs) reveal limited zero-shot transfer to machine hearing. Supervised adaptation on machine-hearing data alone does not close this gap, suggesting that the challenge extends beyond data exposure to a systematic mismatch between existing audio front ends and machine-hearing inputs. To address this mismatch, we introduce MachEar, a lightweight encoder extension that complements the pretrained Audio LLM for machine-hearing inputs. The results show that MachEar equips a pretrained Audio LLM with stronger machine-hearing capabilities while largely preserving its existing audio understanding performance.
138. 【2611.10683】ransMem: Transition-Aware Retrieval for Evolving Personal Memory
链接：https://arxiv.org/abs/2611.10683
作者：Shigeng Chen,Linhao Luo,Changlong Shi,Zhangchi Qiu,Shirui Pan
类目：Computation and Language (cs.CL)
关键词：Long-term personalized agents, interleaved conversations, personalized agents, agents are increasingly, increasingly expected
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:Long-term personalized agents are increasingly expected to answer queries over user histories in which preferences, goals, and constraints evolve across interleaved conversations. Existing retrieval-based and structured-memory systems can surface relevant facts, but often return isolated memory units that do not explain which earlier preference was refined, contradicted, or superseded by later evidence. We introduce TransMem, a transition-aware memory retrieval framework that stores preference updates as explicit retrieval units alongside ordinary factual memories. During memory construction, TransMem routes user interaction history into topic-structured memory graphs, detects shift events, and grounds them as transition records. At inference time, TransMem first retrieves factual anchors and then adaptively expands over transition records, producing a compact context of factual anchors and accepted transition records. Experiments on PersonaMem and PersonaBench across two Qwen backbones show that TransMem outperforms representative retrieval-based and structured-memory baselines. Controlled analyses further show that transition records and adaptive expansion contribute beyond factual anchoring, chronological expansion, flat transition retrieval, and fixed-hop traversal. These results suggest that preference-update records are useful retrieval units for long-term personalization.
139. 【2611.10646】On the Geometric Bottlenecks of Cross-Lingual Knowledge Editing
链接：https://arxiv.org/abs/2611.10646
作者：Aastha A K Verma,Anwoy Chatterjee,Sparsh Jain,Tanmoy Chakraborty
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Transformer-based autoregressive multilingual, language-agnostic latent space, multilingual language models, autoregressive multilingual language, store factual knowledge
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:Transformer-based autoregressive multilingual language models (LMs) are often assumed to store factual knowledge in an interlingua: a language-agnostic latent space. If this assumption holds, a parameter update applied in a source language during knowledge editing should inherently propagate to its semantic equivalents in target languages. However, empirical benchmarks show that cross-lingual propagation of edits often degrades substantially, a degradation that prior work treats largely as an algorithmic symptom rather than a structural bottleneck. In this work, we investigate whether representational anisotropy creates a structural bottleneck for source-only associative-memory editing, and perform a geometric dissection of the cross-lingual propagation gap. Using associative memory-based "locate-then-edit" methods, including ROME, MEMIT, and AlphaEdit, as analytical frameworks, we derive a closed-form decomposition of this gap into key-space propagation, parallel residual mismatch, and orthogonal residual mismatch. Our empirical findings show that cross-lingual propagation is primarily bottlenecked by a large orthogonal residual component, indicating that source-language edits often fail to span the target-language update directions required for successful transfer. Furthermore, we show that post-hoc correction using only source-language residual statistics encounters a large residual-prediction barrier. Finally, we perform a structural realignment via a targeted contrastive alignment objective and find that it substantially improves key-space propagation and partially improves cross-lingual edit transfer, while leaving value-space mismatch as a remaining bottleneck.
140. 【2611.10634】Coverage-Verified Sparse Attention: Closed-Loop Quality Control for Long-Context LLM Decoding
链接：https://arxiv.org/abs/2611.10634
作者：Yan-Cheng Li,Chun-Yi Lee
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：accelerates long-context decoding, attention accelerates long-context, Sparse attention accelerates, methods are open-loop, accelerates long-context
备注： Accepted to NeurIPS 2026. 35 pages, 12 figures, 35 tables
点击查看摘要
Abstract:Sparse attention accelerates long-context decoding by reading a subset of the KV cache, but existing methods are open-loop: the kernel commits to its selection with no signal indicating whether enough attention mass was preserved and no recovery path when it was not. The needed signal already exists inside the kernel. The fraction of softmax mass on the selected tokens, which we call coverage, satisfies an exact algebraic equality with per-step output error and serves a dual role as the acceptance criterion and the interpolation weight for recovery. Coverage-Verified Sparse Attention (CVSA) turns coverage into a training-free, closed-loop verify-then-correct decode loop that accepts high-coverage drafts and recovers only the heads that fall short, with no sampling, no draft model, and no speculative-decoding infrastructure. Quality varies by only $0.14$ points across the threshold sweep; budget and scheduling ablations characterize the deployed operating point. On LongBench at 7B and 70B, CVSA comes within $1.13$ points of dense attention, statistically matching it at 70B, and it loses $0.8$ points on RULER; measured median decode-step speedup reaches $6.21\times$ at 128K context.
141. 【2611.10620】What Do Collusion Probes Read? Three Pitfalls in Evaluating Multi-Agent Collusion Monitors
链接：https://arxiv.org/abs/2611.10620
作者：Mainul Hasan Mohsin,Mohammad Shahidur Rahman
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA)
关键词：large language model, language model, Activation probes, large language, LLM
备注： 30 pages, 5 figures. Code: [this https URL](https://github.com/mainul3195/collusion-probe-pitfalls) ; data: [this https URL](https://huggingface.co/datasets/mainul3195/collusion-probe-pitfalls) ; archive: doi: [https://doi.org/10.5281/zenodo.23636508](https://doi.org/10.5281/zenodo.23636508)
点击查看摘要
Abstract:Activation probes look like near-perfect monitors for secret collusion among large language model (LLM) agents. We show that they mostly detect that an agent was told to collude, not that it decided to. Our benchmark (2,500 committee and 1,476 code-review episodes) adds agents who receive the collusion instruction and refuse it, separating instruction from decision. Published detectors barely tell colluders from these refusers, and our best probe separates them mostly by reading the instruction: without it, agent AUROC falls from 1.00 to 0.61. Two further pitfalls inflate reported results: scored after the vote, a rule that only reads the votes reaches AUROC 0.990 but finds nothing before it; and in 57% of attempts no colluder argues for the target in public. The decision is still there: a probe trained on agents' own choices reads it (AUROC 0.73 without the instruction), and probes find colluders whose goal was fine-tuned into the weights (AUROC 0.995; pre-registered). We turn the controls into a protocol for testing any collusion monitor, and adapt scan statistics into an online monitor for groups of any size.
142. 【2611.10601】AI in the Clinical Documentation Loop: Effects of LLM-Induced Note Bloat and Diagnostic Overcall on Downstream LLMs
链接：https://arxiv.org/abs/2611.10601
作者：Jinghui Liu,Anthony Nguyen,Taylan Gurgenci
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language models, Large language, healthcare tasks, process medical records, Large
备注： ML4H 2026 - Findings
点击查看摘要
Abstract:Large language models (LLMs) are increasingly used to process medical records for healthcare tasks such as clinical documentation. Because these tools also generate documentation, the relationship is now bidirectional: models both read from and write to the record. Understanding how LLMs behave when reading records that already contain LLM-authored content is therefore critical for their safe deployment. In this study, we examine how LLM-authored content in the medical record affects downstream LLMs that read the same record. We consider two types of LLM-induced artifacts: bloat, in which LLM-generated summaries accumulate in the record and change the length and provenance of its content over time; and distortion, in which LLMs subtly alter clinical findings rather than fabricating facts outright. As a case of distortion, we study diagnostic overcall (documenting an unconfirmed differential diagnosis in the record) and test whether it propagates to the reader LLM's output. Across seven reader models from four families, we find evidence of both effects. First, LLM-generated summary notes modestly but consistently degraded downstream hospital-course generation compared with copy-forward and templated text of matched length. Second, injected overcalls reappeared in downstream outputs at rates that varied by reader model, without detectable changes in standard quality metrics. These findings show the need to monitor AI-generated content in medical records and to account for it when those records are later processed by AI.
143. 【2611.10577】Global Context Guidance for Diffusion Large Language Models
链接：https://arxiv.org/abs/2611.10577
作者：Jeimin Jeon,Bumsub Ham
类目：Computation and Language (cs.CL)
关键词：enabling parallel generation, Diffusion large language, large language models, enabling parallel, large language
备注： Accepted to NeurIPS 2026
点击查看摘要
Abstract:Diffusion large language models (LLMs) have recently emerged as a promising alternative to autoregressive LLMs, enabling parallel generation through iterative denoising. Recent guidance methods improve diffusion LLMs by introducing a weak model to guide the prediction of the base model during denoising. However, the influence of the weak model during denoising remains less clear, and computing its prediction requires an additional forward pass at each denoising step. We present in this paper an in-depth analysis of how diffusion LLMs use contextual information during denoising. Our analysis reveals that diffusion LLMs rely more heavily on local context while often underutilizing global context. Based on this observation, we introduce Global Context Guidance (GCG), a feature-space guidance method that enhances global-context utilization without constructing an explicit weak model. Extensive experiments on LLaDA-8B, Dream-7B, and LLaDA-1.5 across diverse benchmarks demonstrate that GCG consistently outperforms existing guidance methods, while incurring much lower inference overhead.
144. 【2611.10560】Large Language Models without QK-Normalization
链接：https://arxiv.org/abs/2611.10560
作者：Yongding Tao,Yitong Qiao,Tianqi Shao,Tian Wang,Zhixuan Chu,Xiaoming Wu,Yihong Dong,Ge Li
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：modern large language, improve training stability, large language models, widely adopted, adopted in modern
备注： Code is available at [this https URL](https://github.com/yongding-tao/QK-MAP)
点击查看摘要
Abstract:Query-Key Normalization (QK-Norm) is widely adopted in modern large language models to control the growth of attention logits and improve training stability. However, query and key norms are not merely sources of instability. The query norm controls the sharpness of the attention distribution, while the key norm determines how strongly a token attracts different queries. These norms therefore carry token-specific information about attention selectivity and token importance. By normalizing both, QK-Norm suppresses this information. This raises a natural question: can we control query-key representations without discarding their sensitivity to magnitude? To address this question, we propose QK-MAP, a Magnitude-Aware Projection for constructing queries and keys. Rather than removing magnitude through normalization, QK-MAP transforms the input representation using multiple learnable frequencies, so that changes in magnitude are encoded as bounded phase patterns. This allows magnitude to be represented through phase and direction rather than vector length alone. Its periodic features have a fixed norm while remaining sensitive to magnitude changes, separating magnitude encoding from norm growth. Multiple frequencies further help distinguish magnitudes and reduce periodic ambiguity. Experiments across model scales from 190M to 7B parameters show that QK-MAP achieves lower training and validation loss than both Standard attention and QK-Norm. Further analyses show that QK-MAP preserves sensitivity to input scale, assigns less attention to the first token, and produces stronger attention contrast for relevant evidence in synthetic long-context tests. These results demonstrate that query-key scale can be effectively controlled without sacrificing token-specific magnitude information.
145. 【2611.10556】onóna: Twin Embeddings with Tied Unembeddings
链接：https://arxiv.org/abs/2611.10556
作者：Cheng Luo,Xinnan Dai,Zhongzhu Zhou,Zefan Cai,Ruijie Zhu,Tianyu Zhang,Junjie Hu
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Weight tying reduces, usual tied output, tied output head, tying reduces, reduces the parameter
备注： 18 pages
点击查看摘要
Abstract:Weight tying reduces the parameter cost of language models, but the usual tied output head is limited to a single softmax. We introduce onóna, a two-table parameterization that increases output expressiveness while preserving input-output weight sharing. The Transformer takes the average of two embedding tables as input, and the output head combines the softmax distributions defined by those same tables. A gate conditioned only on the current input token determines the mixture weight. Its values can be precomputed for inference, and the Transformer body remains unchanged. We evaluate onóna across Dense, Gated DeltaNet hybrid, mixture-of-experts, and Attention Residual architectures at 142M, 330M, and 1B scales. Under matched token budgets, onóna lowers final validation loss and external perplexity in 11 of 12 comparisons and raises the average accuracy over eight downstream tasks in 10 of 12. The one exception on loss is the 1B MoE model. The cost is one extra embedding table and one extra vocabulary projection.
146. 【2611.10555】YRC-Bench: Benchmarking Culturally Aware Machine Translation for Historical Heritage via Tri-Level Semantic Bridging
链接：https://arxiv.org/abs/2611.10555
作者：Huang Yan,Aobo Li,Jiayi Wang,Huidong Zhu
类目：Computation and Language (cs.CL)
关键词：poses profound challenges, syntax frequently obscures, frequently obscures domain-specific, terse classical syntax, classical syntax frequently
备注：
点击查看摘要
Abstract:Translating historical cultural heritage poses profound challenges for machine translation systems due to the acute semantic asymmetry across eras and cultures, where terse classical syntax frequently obscures domain-specific cultural knowledge. While Large Language Models have demonstrated remarkable prowess in generic translation benchmarks, they struggle to negotiate Culturally-Specific Items and diachronic shifts in domain-rich historical texts, such as Yellow River cultural records. To bridge this critical gap, we introduce YRC-Bench, the first human-curated, multi-parallel benchmark dedicated to historical heritage translation across Classical Chinese, Modern Chinese, and nine target foreign languages. YRC-Bench establishes a tri-level parallel corpus incorporating modern explanatory glosses as explicit semantic bridges and operationalizes translation strategies through paired conserved versus substituted CSI variants categorized by cultural translatability. Systematic evaluations of nine leading LLMs across bidirectional translation directions reveal that leveraging modern Chinese glosses - especially human-curated ones - dramatically elevates both lexical fidelity and semantic adequacy. Furthermore, multidimensional human preference audits by native experts unveil distinct cross-cultural preferences between Sinographic-tradition and non-Sinographic language groups.
147. 【2611.10541】AFVE-Bench: Measuring Abandoned-Frame Verbalization Errors in Multi-Turn LLM Revision
链接：https://arxiv.org/abs/2611.10541
作者：Jiaming Chu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：preserving still-valid facts, earlier organizing frame, Multi-turn revision, replace an earlier, earlier organizing
备注： 18 pages, 4 figures
点击查看摘要
Abstract:Multi-turn revision often asks a model to replace an earlier organizing frame while preserving still-valid facts and artifact requirements. Existing instruction-following evaluations mainly assess the latest target and may therefore score an artifact as successful even when it adopts the new frame but exposes the superseded one. We call this failure an abandoned-frame verbalization error (AFVE). AFVE-Bench evaluates silent frame replacement in English and Chinese using 192 matched four-turn dialogues across eight writing domains. Each seed has zero, one, or two pre-target user requests to generate under the source frame. AFVE eligibility depends on the user-request history and applies to the one- and two-request conditions; the zero-request condition serves as a frame-bearing baseline. Eleven model configurations yielded 4,224 expected post-target response units. Two annotators independently scored 4,204 scorable responses for target adoption, source-frame verbalization, and direct usability; model and condition metadata were hidden, and disagreements were adjudicated. AFVE occurs in 25.54% (715/2,799) of history-conditioned responses. Of 2,388 target-passing history-conditioned responses, 472 (19.77%) still expose the abandoned source frame, most often through contrastive framing (423/472). For these standalone revision tasks, target adoption does not ensure source-frame silence.
148. 【2611.10536】In Search of Lost Time: Temporal Competence in Large Language Models
链接：https://arxiv.org/abs/2611.10536
作者：Ryan Liu,David Lee,Icey Siyi Ai,Marwa Abdulhai,Rachit Dubey,Thomas L. Griffiths
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Today large language, Today large, large language models, agents schedule tasks, increasingly interact
备注：
点击查看摘要
Abstract:Today's large language models (LLMs) increasingly interact with time: AI agents schedule tasks, coordinate with people and other AI systems, and even decide how long to think. Yet LLMs only ever encounter time secondhand---in descriptions rather than experience. Does this hinder their reasoning and decisions that involve time? Our paper traces this question from a model's knowledge to its actions through four successive evaluations. We find that models know the rules of time, which can be read, but struggle to predict durations, which must be lived; while they are highly accurate (92.0-97.5\%) on a collection of questions built from the theorems of various time-related literatures, they underestimate their own completion times by up to 99.5\% and fail to identify which tasks will take them longer to run. And while they are better at estimating durations of human tasks, their duration judgments change based on how an event is worded, magnifying similar human biases by up to 1.3$\times$. Moving from estimation to action, we find that some LLMs disregard time costs completely when answering user queries, ignoring a 1,200-fold increase in wait time entirely. Together, our experiments reveal new challenges posed to LLMs as they navigate a dimension they cannot directly perceive, and highlight how their blind spots can even be simple cognitive abilities that humans take for granted.
149. 【2611.10508】Imperfectly Imperfect: Evaluating Graded Cognitive Diversity in LLM Persona Simulations
链接：https://arxiv.org/abs/2611.10508
作者：Sion Weatherhead,Ben Newell,Aaron Belbasis,Flora Salim
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)
关键词：Large language model, Large language, express graded cognitive, Behavioural Reflection Test, graded cognitive diversity
备注： Accepted at NeurIPS 2026 (Evaluations Datasets Track). 42 pages, 14 figures. Code: [this https URL](https://github.com/sion-w/CogSuite)
点击查看摘要
Abstract:Large language model (LLM) agents are increasingly used as synthetic participants in social, behavioural, and decision-making research, yet it remains unclear whether they can express graded cognitive diversity as assigned when engaging in simulated behaviour. We introduce a cognition-suite evaluation that tests whether simulated populations reproduce human variation in reasoning, self-reported traits, their associations, and downstream behaviour. Agents conditioned on synthetic or human-derived profiles of cognitive reflection, Need for Cognition, and Big Five personality answer the same suite as a cohort of 473 adults: two newly assembled tests, a Cognitive Reflection Test (CRT) and a Behavioural Reflection Test (BRT) whose decision scenarios measure reflection in behaviour, alongside an established CRT and the two trait questionnaires. Across seven full-battery simulation runs of four models, agents recover Need for Cognition and Big Five trait distributions on self-report questionnaires, but fall short on simulating diversity of cognitive task performance and downstream behaviours. In the four Claude Sonnet 4.6 runs, every agent scores full marks on both CRTs, whatever reflection level its persona was assigned. In the other three runs agents make intuitive-lure errors (the tempting wrong answers CRT items invite), but 49 to 85% score full marks, against under 10% in the human sample. Claude Sonnet 5 comes closest to people's item-by-item pattern of lures; the other two runs give fewer lures and vary less between items. In the BRT scenarios, every run over-produces 8 to 11 of 15 coded behaviours by at least 20 percentage points, and people's links between reflection and behaviour carry over only in part. Useful synthetic populations must preserve not only trait descriptors but the structured variation in reasoning, error type, and behaviour those descriptors are meant to organise.
150. 【2611.10502】Distinguishing Extraction Failures and Clinical Discordance with LLM Uncertainty on Radiology Reports
链接：https://arxiv.org/abs/2611.10502
作者：Jerjes Aguirre-Chavez,Shant Malkasian,Roshun Sankaran,Brendan Crabb,Albert Hsiao
类目：Computation and Language (cs.CL)
关键词：Large language models, Large language, LLM uncertainty, LLM, CCTA
备注： Accepted as a spotlight presentation at ML4H 2026, published at Proceedings of Machine Learning Research 346
点击查看摘要
Abstract:Large language models (LLMs) can structure clinical datasets, but extraction error must be distinguished from discordance in the underlying data. From a real-world cohort of 1{,}045 patients undergoing coronary CT angiography (CCTA), we evaluated whether LLM uncertainty during vessel-level coronary artery disease (CAD) stenosis extraction could identify extraction failure and clinical discordance. References were expert CCTA annotations (253 patients) and subsequent invasive coronary angiography (ICA; 729 patients). We quantify extraction failure as disagreement between stenosis severity in LLM extracted versus expert annotations, and clinical discordance as disagreement in stenosis severity between CCTA and subsequent ICA. Stenosis Margin, selected from ten candidate measures, was used to quantify LLM uncertainty, and generalized estimating equation logistic regression and AUC evaluated its association and incremental discrimination for each failure mode. LLM uncertainty was strongly associated with extraction failure (adjusted OR 4.15 [95% CI 2.57--6.69], $P0.001$) and substantially improved discrimination beyond LLM-extracted CCTA stenosis severity alone (AUC 0.81 to 0.86; $\Delta$AUC $+0.06$ [$+0.03$, $+0.09$], $P=0.001$). In contrast, LLM uncertainty weakly associated with clinical discordance (adjusted OR 1.22 [1.04--1.43], Holm-adjusted $P=0.118$) but provided no incremental discrimination beyond LLM-extracted CCTA stenosis severity ($\Delta$AUC $+0.01$ [$-0.00$, $+0.02$], $P=0.245$). Moreover, extraction errors and clinical discordance showed little overlap, with 38 of 42 clinically discordant vessels (90%) having been extracted correctly. LLM uncertainty may identify extraction failures without identifying underlying clinical discordance, supporting failure attribution when evaluating LLM-derived clinical datasets.
151. 【2611.10486】st-Time Scaling for Diffusion Language Models with Frequency-Aware Remasking
链接：https://arxiv.org/abs/2611.10486
作者：Bowen Zuo,Yue Yu,Dongruo Zhou,Yinglun Zhu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：affect output quality, Diffusion language models, remask strongly affect, strongly affect output, Diffusion language
备注：
点击查看摘要
Abstract:Diffusion language models (DLMs) generate text through iterative denoising, where decisions about which tokens to commit or remask strongly affect output quality. Existing certainty-aware strategies rely on instantaneous confidence or entropy, but these local signals can be misleading on difficult reasoning problems. We formulate DLM test-time scaling as adaptive allocation of both inference compute and decoding strategies. Our two-stage approach uses a fast base sampler to solve easy questions, then applies frequency-aware remasking to the remaining hard questions. This strategy tracks how often each token's prediction changes across denoising steps and preferentially commits frequently changing tokens, encouraging samples to explore alternative reasoning paths rather than collapse onto the model's preferred trajectory. Experiments with LLaDA-8B-Instruct and Dream-7B-Instruct show consistent improvements over a strong adaptive allocation baseline, with absolute accuracy gains of up to 3.73 percentage points (LLaDA) and 7.33 percentage points (Dream) on MATH-500, and absolute coverage gains of up to 11.39 percentage points (LLaDA) and 10.98 percentage points (Dream) on HumanEval. On questions unsolved by the base certainty-aware strategy after 100 samples, frequency-aware remasking recovers solutions for 3.75% to 18.75% of examples.
152. 【2611.10469】Hibana: Fast Agentic Inference on Unified-Memory Devices
链接：https://arxiv.org/abs/2611.10469
作者：Yahya Emara,Chi-Chih Chang,Anthony Fei,Ahmed F. AbouElhamayed,Chong-Yan Chen,Hung-Yueh Chiang,Kai-Chiang Wu,Mohamed S. Abdelfattah
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：promises capable personal, capable personal assistants, promises capable, capable personal, personal assistants
备注：
点击查看摘要
Abstract:Local AI promises capable personal assistants that run on users' own devices, keeping data and computation under their control. Open-weight models that fit on local devices can now handle practical tasks such as coding. Yet current inference engines fall short. Popular engines such as vLLM and SGLang target datacenter GPUs with dedicated host memory, while local engines underuse the memory hierarchy of unified-memory devices. We present Hibana, an inference engine for unified-memory devices that co-optimizes model representation, memory management, and decoding strategy. Model surgery, the process of editing a trained model's architecture to suit its hardware, changes how the model computes, shrinking its memory footprint and data movement. Unified-memory management preserves each agent's state across turns, so long-running agents can resume instantly instead of recomputing their state. Adaptive speculation generates several tokens per step. Hibana codesigns these features around the shared memory capacity and limited bandwidth of unified-memory systems-on-chip to support local multi-agent workloads. On a single DGX Spark serving Qwen and Nemotron models of up to 125B parameters, Hibana completes up to 3.4$\times$ more agentic tasks per hour and delivers up to 3.9$\times$ higher decoding throughput than other established frameworks such as vLLM, NVIDIA Flare, this http URL, and TensorFold. Code is available at this https URL.
153. 【2611.10463】LongCapHarness: Capability-Guided Auto-Harnessing for Long-Context Reasoning
链接：https://arxiv.org/abs/2611.10463
作者：Tao Zhang,Yuhang He
类目：Computation and Language (cs.CL)
关键词：Existing methods enhancing, Existing methods, follow-up LLM post-training, data synthesis, methods enhancing
备注：
点击查看摘要
Abstract:Existing methods enhancing an LLM's long-context reasoning capability often rely on data synthesis and follow-up LLM post-training. However, the data synthesis strategy and the post-training recipes are empirically driven and computationally intensive. In this work, we propose a new framework, dubbed LongCapHarness, to instead harness the underlying capabilities for long-context reasoning. The harnessing process recursively revises and updates capability primitive implementation, capability state and control logic through recursive self-improvement on the development set. With neither data synthesis nor LLM post-training, LongCapHarness is applied to Llama3-8B and transferred to Qwen2.5-3B. LongCapHarness substantially outperforms recent data-synthesis-based baselines on HELMET and RULER benchmarks; its estimated development cost is less than 50% of the estimated training costs of NExtLong and PolicyLong. We hope these results motivate further research into harnessing the latent capabilities of LLMs to solve tasks beyond their explicit training.
154. 【2611.10450】he Truth Beneath the Tokens: Prompt-Space Recovery of Knowledge Edits in Language Models
链接：https://arxiv.org/abs/2611.10450
作者：Manit Baser,Rachel Yeo Hui Min,Aditya Nawal,Dinil Mon Divakaran,Mohan Gurusamy
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Model, model weights, knowledge, Memento, transformer models
备注：
点击查看摘要
Abstract:Model editing provides an efficient way to update factual knowledge in transformer models. Recent approaches reverse edits by modifying, masking, or decomposing model weights, but make recovery dependent on weight-space interventions. We instead show that pre-edit knowledge can be recovered through input-space interventions alone, without modifying the edited model's weights. We introduce Memento, a prompt-space mechanism for auditing residual knowledge that learns a reusable recovery signal to steer an edited model toward its pre-edit response. Memento supports both continuous recovery prefixes and discrete textual prompts for standard text interfaces. Across three LLMs and five editing techniques, Memento recovers 80.07% of held-out edited facts, achieving a 9.58% relative improvement over baselines, suggesting that editing may suppress the facts without fully eliminating their recoverability. We further investigate whether prompt-space recovery extends beyond model editing. On pristine, unedited LLMs, Memento improves average factual recall by 53.9% relative to standard inference. These results demonstrate the potential of prompt-space recovery for auditing residual knowledge in edited models and investigating the gap between factual knowledge and its accessibility during inference. We will release our source code.
155. 【2611.10439】Who Remembers What? Multi-Granularity Memory Extraction for Multi-User, Multi-Agent Interaction
链接：https://arxiv.org/abs/2611.10439
作者：Yunzhe Wang,Mesut Erhan Unal,Sheng Zhang,Shabnam Ghadar,Peng Tang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multiagent Systems (cs.MA)
关键词：Self-evolving agents improve, base LLM, Self-evolving agents, harness code, code from experience
备注：
点击查看摘要
Abstract:Self-evolving agents improve their own skills, memory, and harness code from experience without retraining the base LLM, and group-evolving agents go further by sharing these lessons across agents. Yet most such systems overlook that sharing across users and heterogeneous agents requires deciding who can benefit from each lesson and what information must remain private. We present MixUA, a memory system that distills independent user-agent trajectories into lessons and assigns each lesson to a user-agent pair, user, agent, or global scope according to whom it benefits and what it may disclose. For evaluation, we introduce CrossLearnBench, a mixed-user-agent benchmark that pairs established agent tasks with user preferences and privacy probes that test whether private facts leak into memory other users can read. With five users and seven agents, MixUA raises pass rates by up to 16 points over no memory and 5 over a single global memory, even on tasks previously tried only by other users on other agents. It retains up to 90% of previously stated preferences, and at most 0.02% of privacy probes find a planted private fact in a forbidden scope. We hope MixUA offers a scalable path toward a global system where users and agents co-evolve.
156. 【2611.10414】rack or Follow? A Jev-Compatible Multi-Agent Trading System When Web News Lags the Market
链接：https://arxiv.org/abs/2611.10414
作者：Yebo Feng,Guangyan Gan,Liangrui Pan,Ruichao Liang,Cong Wu,Jiahua Xu,Yang Liu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Information Retrieval (cs.IR); Trading and Market Microstructure (q-fin.TR)
关键词：LLM agents increasingly, agents increasingly trade, listed firms, Web, LLM
备注：
点击查看摘要
Abstract:LLM agents increasingly trade on the Web news they read, yet much Web news about listed firms is published after, and about, the price move it reports, so a reader can agree with the market by following it instead of reading the event. We ask whether LLM judgments of Web news track the market's reaction to the reported event or follow it. To answer, we built a multi-agent trading system whose agents share only point-in-time stores and answer typed questions through the interface of Jev, a hosted typed decision model; code sets every position under a proved bound on how far text can move it. In a hash-committed test of a Jev-compatible reader built from a pinned LLM's option probabilities, item judgments track announcement-window abnormal returns (weekly Spearman 0.119), also after the LLM's release, and event types agree with the issuers' 8-K filings (AUC 0.833); Jev's judgments of news published after its own release track the reaction as well (descriptive). Exploratory analyses show where the association comes from: 72% of earnings news items appear after the issuer's filing, contributor-written items often report the price move, and from the first trade after publication the association falls to 0.023. At a weekly horizon, the confirmatory test detects no rank information over code-only features. Under attack, decision cards traced 88% of successful attacks to the planted item. We propose that market-graded tests of Web-text readers report the criterion from publication, not only from the event.
157. 【2611.10404】Coding or Cheating? An Investigation of Frontier Coding LLMs
链接：https://arxiv.org/abs/2611.10404
作者：Yuntao Gui
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：real software repositories, Frontier agentic LLMs, reinforcement learning, software repositories, agentic LLMs
备注：
点击查看摘要
Abstract:Frontier agentic LLMs are trained on verifiable rewards in reinforcement learning (RL) environments built from real software repositories. A passing test suite is treated as the reward for solving the task. We show that, on hard problems, frontier models often satisfy these rewards by obtaining the answer instead of deriving it, known as reward hacking. Prior reports document this behavior on public benchmarks. We test its persistence on unseen problems. In a hardened environment where the answer cannot leak, nearly every model we tested attempted to recover the answer, escalating through tiers of increasingly specialized exploitation: mining the repository history for the upstream fix, inspecting the git object store directly, and sweeping the filesystem for a possible newer copy of the source or hidden tests. These attempts were concentrated on the hardest problems, and the models differed in whether, how often, and how deeply they escalated. Our position is that this behavior is a learned shortcut, acquired in RL environments that leak the answer, not a sign of intelligence. We release agent traces for these models to support further study at this https URL.
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
ACMclasses:
I.2; D.2
Cite as:
arXiv:2611.10404 [cs.CL]
(or
arXiv:2611.10404v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2611.10404
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
158. 【2611.10369】FEROM: Frontier Endogenous Reveal-Order Marginal Policy Optimization for Masked Diffusion LMs
链接：https://arxiv.org/abs/2611.10369
作者：Zian Su,Ziyang Huang,Kaiyuan Zhang,Xiangyu Zhang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：language models generate, models generate text, iteratively unmasking positions, diffusion language models, selecting reveal positions
备注： NeurIPS 2026
点击查看摘要
Abstract:Masked diffusion language models generate text by iteratively unmasking positions, with practical samplers often selecting reveal positions from the model's own logits. The reveal order is therefore an endogenous latent variable of the rollout process with an enormous discrete latent space. Policy optimization objectives relying on pre-defined schedules or sampled trajectories introduce either bias or high variance. In this paper, we propose FEROM, Frontier Endogenous Reveal-Order Marginal Policy Optimization, which approximates policy gradients for the rollout-induced marginal response policy of masked diffusion LMs. FEROM derives a Rao-Blackwellized policy-gradient identity over latent reveal orders and expresses the resulting estimator as posterior edge occupancy on a reveal-state DAG. To make marginalization practical, we introduce Frontier Reveal Marginalization, a budgeted estimator that approximates this marginal edge structure by combining CDF-based computation of local probabilities of the endogenous reveal process with frontier expansion of high-mass partial states. Integrated into a GRPO-style objective, FEROM replaces single-path log-scores with a detached token-score surrogate over posterior-relevant reveal edges. Experiments on math and coding tasks show comparable or improved results over existing methods under matched scoring-state budgets. An offline proxy study further shows improved marginal-gradient approximation with increased scoring budgets.
159. 【2611.10349】SituRecBench: Evaluating Frontier Models as Situated Recommendation Assistants in 3D Environments
链接：https://arxiv.org/abs/2611.10349
作者：Jingtong Yang,Dongding Lin,Jian Wang,Wenjie Li
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：static retrieval engines, Recommender systems, systems are transitioning, transitioning from static, static retrieval
备注： Accepted by NeurIPS 2026 Evaluations and Datasets Track
点击查看摘要
Abstract:Recommender systems are transitioning from static retrieval engines into interactive assistants grounded in physical environments. However, current studies largely neglect the combined complexities of spatial navigation, visual grounding, and multi-turn social interaction. To bridge this gap, we introduce SituRecBench, an interactive benchmark for evaluating frontier vision-language models (VLMs) as situated recommendation assistants within high-fidelity 3D environments. We reformulate recommendation as a situated assistance process in which an assistant interacts with a user while sharing the user's egocentric view. Our benchmark simulates real-world shopping environments (e.g., supermarkets and home furnishings stores), requiring assistants to elicit preferences, ground recommendations in the environment, and guide the user to relevant locations through dialogue. The benchmark evaluates dialogue quality, recommendation utility, and navigation effectiveness through a unified interactive protocol. Extensive experiments reveal persistent challenges in spatial grounding and preference elicitation, highlighting limitations in their ability to integrate global contextual information with local observations. SituRecBench provides a rigorous foundation for advancing the development of situated assistants in the real world.
160. 【2611.10341】Collaboration Signatures: Tracking Long-Horizon Dynamics of Cross-Meeting Collaboration Networks
链接：https://arxiv.org/abs/2611.10341
作者：Shengqi Zhu,Sheshera Mysore,Bahareh Sarrafzadeh
类目：ocial and Information Networks (cs.SI); Computation and Language (cs.CL); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC)
关键词：received increasing attention, Enterprise platforms, platforms have received, received increasing, increasing attention
备注：
点击查看摘要
Abstract:Enterprise platforms have received increasing attention as a core component of social networks and the Web. However, existing work mostly relies on fragmented logs of small units of work, like emails and chats, and focuses on who connects with whom without sufficient account of collaboration content and dynamics. This work systematically explores tracking collaborations across sequences of meetings as a new approach to interpreting their long-horizon dynamics. Linking 45,426 meetings in a large multinational technology company based on full transcripts and 1.6 million extracted agenda items, we establish a cross-meeting collaboration network of 6,065 collaborations. The network recovers the natural shapes of workplace collaborations: meetings, as snapshots of ongoing collaboration, link into largely tree-shaped structures, while the work content forms nested directed acyclic graphs (DAGs). Further, we explore how these networks evolve over time, examining three established perspectives: task division, team composition, and temporal continuity. Each explains part of the dynamics but does not capture the distinctness of long-horizon workplace collaboration: e.g., work flows in a consistent direction between a few pairs of subjects, yet a collaboration's subject explains little of how its meetings are conducted. Instead, accumulating the agenda, interaction, and language of meetings along each tree yields a signature of the collaboration, a distinctive profile that picks out the collaboration of a held-out meeting at 4.5 times chance. The signature models collaboration better than team or task views, individually or combined, in next-meeting prediction and tree-level fitting. We discuss the implications of these cross-meeting dynamics for designing office applications and support tools, and call for next-generation Web systems that represent collaborations over their long horizon.
161. 【2611.10335】wo-Sided Conformal Evidence Sets for Retrieval-Augmented Generation
链接：https://arxiv.org/abs/2611.10335
作者：Ben Jenkins,Mihaela Cardei
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Retrieval-augmented generation, existing calibrated grounding, calibrated grounding methods, Conformal Evidence Sets, surface passages
备注： Accepted at the 2026 IEEE International Conference on Tools with Artificial Intelligence (ICTAI 2026). 8 pages
点击查看摘要
Abstract:Retrieval-augmented generation (RAG) can surface passages that support a claim, contradict it, or fail to address it, yet existing calibrated grounding methods are typically one-sided and model only supporting evidence. We introduce Conformal Evidence Sets (CES), a two-sided framework that returns separate support and refutation sets with finite-sample inclusion coverage of at least $1-\alpha$ on each side under exchangeability; a Bonferroni union yields joint coverage of at least $1-2\alpha$. On labeled candidate pools from the contrastive VitaminC benchmark, CES closely tracks nominal coverage across $\alpha\!\in\!\{0.05,0.10,0.15,0.20,0.30\}$, with maximum deviations of $3.0$ percentage points for support and $5.4$ for refutation, and reaches essentially the same empirical coverage--size frontier as a test-tuned fixed-threshold heuristic without any test exposure. Stress tests mark the boundary of that guarantee: under FEVER distribution shift both sides under-cover, by up to $12.7$ percentage points, and support-side group-stratified recalibration substantially reduces the support gap. Scorer swaps, hard-negative retrieval, cross-dataset transfer, and a live end-to-end pilot expose a clear separation: when exchangeability holds and relevant evidence is retrieved, evidence inclusion remains calibrated even with an imperfect scorer, whereas the support/refute verdict tracks scorer quality directly. Calibrated evidence coverage and reliable verdicts are therefore distinct properties and should be reported separately.
162. 【2611.10327】Policy Over Purpose: Auditing LLM Content Moderation of Reclaimed Slur Usage
链接：https://arxiv.org/abs/2611.10327
作者：Christina Chance,Kai-Wei Chang
类目：Computation and Language (cs.CL)
关键词：Perspective API, platforms are turning, turning to large, API is deprecated, Reclaimed
备注：
点击查看摘要
Abstract:As Perspective API is deprecated, platforms are turning to large language models for content moderation, encoding policy as natural language that the model must interpret at inference time. Reclaimed slurs test this design directly. The same term can express in-group pride or target the community that reclaimed it, and misreading it silences the speech moderation is meant to protect. We audit four general-purpose LLMs and four moderation-specific systems, with Perspective API as a legacy baseline, on IYKYK, a corpus of reclaimed and derogatory usage of three slurs annotated by community members. Across the policy, decision, reasoning, disparity, and steering layers of this audit, we find that whether a system was purpose-built for moderation explains little about how it handles reclaimed language. No system reliably agrees with community judgment, and all fail most on language reclaimed within Black communities. What separates systems is instead how their policy is represented. Only systems whose policy is expressed in the prompt can be steered at all, and even then, explicit definitions change how models justify a decision more than how they make it. We argue that policy transparency determines whether moderation failures can be corrected, but that correcting them requires contextual judgment that definitions supplied at inference time cannot provide.
163. 【2611.10322】Police Behavior Patterns Through Radio Analysis
链接：https://arxiv.org/abs/2611.10322
作者：Milo Z. Trujillo,Adam Perhala,Elaine Zou,Tyler Mckenzie,Juniper Lovato,Brooke Foucault Welles,Alyssa Hasegawa Smith
类目：Computers and Society (cs.CY); Computation and Language (cs.CL); Social and Information Networks (cs.SI); Audio and Speech Processing (eess.AS)
关键词：United States, police departments communicate, WiFi availability, depending on cellular, cellular network
备注： 10 pages (14 with SI), 6 figures (8 with SI)
点击查看摘要
Abstract:In the United States, most police departments communicate using police radio, which allows for officer-to-officer and officer-to-dispatch communication without depending on cellular network or WiFi availability. While some departments use encrypted digital radio, many continue to transmit in the clear, and are legally monitored by public citizens with `police scanners.' Because police radio is intended for internal police use and represents real-time communication, it may offer valuable insight into patterns of law enforcement activities without the potential bias and filtering introduced by a press release after the fact. In this study, we collect and examine over 14 million radio transmissions representing over 100,000 hours of speech by officers in 34 cities across the United States from July 2025 through July 2026; to our knowledge the largest scale analysis of Broadcast Police Communication (BPC) to date. We highlight both typical patterns of police communication and categorize anomalous activity that represents incidents including protests and major weather events. We present this dataset as a starting point for an array of police communication studies, conduct our own preliminary analysis, and propose several further areas of inquiry.
164. 【2611.10319】Prove What You Can: Hybrid Neurosymbolic Reasoning for Logical Natural Language Inference
链接：https://arxiv.org/abs/2611.10319
作者：Ada Canoğlu,Sadiq Qara
类目：Computation and Language (cs.CL)
关键词：natural language requires, Logical reasoning, requires both semantic, semantic interpretation, interpretation and deductive
备注： 32 pages, 6 figures, 13 tables; under review at ARR (October 2026 cycle)
点击查看摘要
Abstract:Logical reasoning over natural language requires both semantic interpretation and deductive search. Large language models (LLMs) can propose plausible intermediate derivations, but they often fail to compose them into a complete proof and overpredict uncertainty. Neurosymbolic methods improve search by translating an entire problem into first-order logic and handing it to a prover, but a single bad clause can make the whole translation nonexecutable. We present Hybrid Reasoning, a three-stage pipeline that decouples proposing a proof, validating its steps, and deciding a label. An LLM proposes a structured proof tree with a raw verdict; a theorem prover validates each derivation locally, keeping only the subset it can prove; and an uncertainty-gated repair attempts to re-derive the label from the premises plus the validated derivations, when the raw verdict is UNCERTAIN. Across four benchmarks (FOLIO, ProofWriter, ProverQA, PrOntoQA) and five contemporary LLMs, Hybrid Reasoning is the top-performing method on the two hardest datasets, improving on the strongest baseline by 5.3 points on FOLIO and 4.9 on ProverQA, and reaches ceiling-level accuracy on the easiest. The repair stage operates at 78-98% precision, producing 326 correct relabellings against 19 regressions.
165. 【2611.10307】How Much Is Left Matters: False Positives and False Negatives in Partial-Prompt Contamination Tests
链接：https://arxiv.org/abs/2611.10307
作者：Abhishek Anand
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Partial-prompt completion, reproduces the rest, Partial-prompt, benchmark problem, benchmark
备注： 10 pages, 2 figures, 3 tables
点击查看摘要
Abstract:Partial-prompt completion, where a model receives the first part of a benchmark problem and is checked for whether it reproduces the rest, is a widely used test for benchmark contamination. We audit this test on seven open-weight models using MATH-500 and recent AIME 2025/2026 problems, which serve as true negatives. Memorization flags depend strongly on how much text remains: for every model, problems with at most 8 leftover words are flagged several times more often than problems with at least 25 (31.5% vs. 5.5% for Qwen2.5-7B-Instruct), and half to three-quarters of all ROUGE-based flags come from short leftovers. On true negatives, a ROUGE-L = 0.75 threshold flags up to 6.7% of problems at a 60% prefix, and at an 80% prefix even exact match flags 8.6% (pooled over models; 6.2% on AIME 2026, which postdates every model), against 0% at 40-60%. The test also misses contamination upstream: models distilled from Qwen2.5-Math, whose base is heavily flagged in prior work, show almost no model-specific recall. Calibrating each model against models from other families removes most flags while isolating a consistent Qwen2.5-specific signal at every prefix length. We recommend length-stratified reporting, prefixes of at most 60%, style-matched post-cutoff controls, and cross-family calibration.
166. 【2611.10266】I play of the cello: Evaluating Constructional Bleeding in Multilingual LLMs with CALQUE
链接：https://arxiv.org/abs/2611.10266
作者：Toshiki Nakai,Yu-Yin Hsu,Marie-Catherine de Marneffe,Joakim Nivre,Jakob Prange,Nathan Schneider,Wesley Scivetti,Tiago Timponi Torrent,Leonie Weissweiler
类目：Computation and Language (cs.CL)
关键词：strategies, English, Languages, literal translations, morphosyntactic strategies
备注：
点击查看摘要
Abstract:Languages use different morphosyntactic strategies to express the same meaning. Speakers of multiple languages are able to apply strategies from one language to another, either by mistake or intentionally, to produce a literal translation, or calque. Considering that large language models (LLMs) have been shown to generalize crosslingually, despite being predominantly trained on English, we investigate whether they overgeneralize constructional strategies from English to other languages. To test this, we create a dataset of 5583 sentence pairs across seven languages, matching literal translations of strategies from English into other languages, and literal translations of the other languages' strategies into English. We then quantify constructional bleeding by measuring how often strategies from English are assigned a higher probability than native strategies. We find that models often fail to assign higher probabilities to native strategies and tend to prefer English-derived strategies even when evaluating sentences in other languages. Our findings highlight the limitations of the current English-dominant training paradigm.
167. 【2611.10265】Do large language models rank moral values? A transitivity test of moral competence
链接：https://arxiv.org/abs/2611.10265
作者：Katelyn A. Wasson,Kiwon Song,James M. Jennings III,Brittney Currie,Konstantina Sokratous,Clintin P. Stober
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：moral, LLM, require moral consideration, support decisions, LLM moral
备注： 30 pages, 2 figures, 4 tables
点击查看摘要
Abstract:LLMs are increasingly used to support decisions that require moral consideration. While LLMs perform well on morality benchmarks from psychology and philosophy, producing appropriate outputs on these benchmarks (moral performance) does not establish that an LLM weighs competing moral values at stake in a decision (moral competence). We test a minimal, necessary condition for such weighing: that an ordinal ranking can represent LLM moral choices. Such a ranking requires transitivity. To assess transitivity, we presented LLMs with pairwise trade-offs among moral value violations in vignette choice sets and extracted resulting choice probabilities from first-token distributions. Tested against three stochastic transitive choice models, most choice sets admitted weak or unstable orderings. Aggregating an LLM's responses, a common practice in LLM moral evaluation, produced transitive structure that matched no individual choice set. Evaluations of AI morality should establish that choices are structured before asking whether they are aligned.
168. 【2611.10258】Beyond the Prompt: Leveraging Pre-Decoding States for Jailbreak Detection in dLLMs
链接：https://arxiv.org/abs/2611.10258
作者：Adam Hazimeh,Amel Abdelraheem,Ke Wang,Mariam Salman,Ljiljana Dolamic,Gérôme Bovet,Pascal Frossard
类目：Computation and Language (cs.CL); Computers and Society (cs.CY); Machine Learning (cs.LG)
关键词：Diffusion large language, Diffusion large, iteratively refining masked, large language models, large language
备注： Published at NeurIPS 2026
点击查看摘要
Abstract:Diffusion large language models (dLLMs) have recently emerged as a strong alternative to autoregressive models, generating responses by iteratively refining masked tokens in parallel rather than decoding sequentially. While enabling more efficient and flexible inference, dLLMs remain vulnerable to jailbreak attacks, including recent attacks that exploit properties unique to dLLMs such as bidirectional conditioning and parallel masked-token refinement. In this work, we show that these same properties also expose a safety-relevant detection surface absent from standard autoregressive decoding: even when a jailbreak is difficult to identify from prompt representations alone, it can still be detected from hidden states over masked response positions before any tokens are generated. By training linear classifiers on prompt and pre-decoding response representations, we empirically show that neither view strictly dominates, with each detecting attacks that the other misses. We introduce $\texttt{ReFuse}$ (Representation Fusion), an inference-time detector that fuses the sigmoid harmfulness scores of the two classifiers. Without modifying model weights or the decoding procedure, $\texttt{ReFuse}$ reduces average ASR across multiple jailbreaks from 63.29% for the undefended model and 11.27% for a prompt-only classifier to 3.31%, while keeping average benign refusal on standard utility benchmarks below 1% on LLaDA-8B. Together, these results establish $\texttt{ReFuse}$ as a lightweight jailbreak detector for dLLMs that improves safety beyond prompt-only detection.
169. 【2611.10240】PACE: Keeping the Right Tokens in the KV Cache Is Not Enough for Long-Horizon LLM Agents
链接：https://arxiv.org/abs/2611.10240
作者：Suman Chatterjee
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC)
关键词：Long-horizon LLM agents, Long-horizon LLM, LLM agents accumulate, LLM agents, evict the rest
备注： 21 pages, 3 figures, 8 tables
点击查看摘要
Abstract:Long-horizon LLM agents accumulate sessions of up to millions of tokens, far more key-value (KV) cache than one GPU holds, so serving systems keep a small budget of tokens and evict the rest. Eviction methods differ in which tokens they keep but share one goal: that the tokens a later step needs are still cached. We show this is not enough. In 100K-token coding sessions on Qwen3-8B with a 2,048-token budget, a planner-guided policy that keeps over 99% of the needed tokens resident still fails late steps increasingly often: its accuracy falls from 93% to 64% as the gap between a definition and its use grows from 2K to 90K tokens, at residency 0.996. The needed tokens are resident but unretrievable: what grows is their rotary-position distance to the query. We present PACE (Planner-Aware Context Engine), a KV-cache engine that couples plan-aware retention, in which the agent's planner tells the cache which context future steps will read, with bounded positions, which renumber kept tokens so their rotary distance to the query stays below 8K at any session length. In a pre-registered evaluation on fresh tasks, PACE passes 97% of hidden unit tests at 100K tokens, against 42% for H2O and 3% for SnapKV under the same budget, and needs both components: either alone reaches 63% (the combination beats each, p 10^-4). The result holds with length: in 1M- and 2M-token sessions on one 24 GB GPU, with definitions written 0.9M and 1.8M tokens before use, PACE passes 99% and 100% of checks and recalls every session fact, while bounded positions without foresight falls from 33% to 13%; PACE holds under 0.7 GB of KV state where the full cache would need 147-295 GB. Renumbering is exact, costs no measurable perplexity, and adds 9% wall time. On Mistral-7B, whose coding ability caps it at 40% even with nothing evicted, PACE stays at that ceiling while retention alone falls below it.
170. 【2611.10238】CoRA-Bench: Evaluating Evidence Preservation by Context Selectors Under Token Budgets
链接：https://arxiv.org/abs/2611.10238
作者：Huzaifa Pardawala,Siddhant Sukhani,Sudheer Chava,Agam Shah
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：reduce input length, dense retrieval, LOONG Financial Spotlight, remove evidence required, dense retrieval achieves
备注： Paper Accepted at NeurIPS 2026 Workshop: Long-Context Foundation Models
点击查看摘要
Abstract:Context selection can reduce input length during long-input inference but can remove evidence required to answer a query. We introduce CoRA-Bench, a benchmark for evaluating evidence preservation under shared token budgets. We compare head and tail truncation, BM25, dense retrieval, dense retrieval with reranking, LLMLingua-2, and Provence across BABILong, LOONG Financial Spotlight, a custom NoLiMa diagnostic, and LongMemEval. Evidence-preservation results reveal task-dependent tradeoffs: BM25 achieves 0.921 supporting-fact recall on BABILong at 128K, dense retrieval and dense reranking each achieve 0.908 needle recall on NoLiMa at 64K, and dense retrieval achieves 0.993 answer-bearing-turn recall on LongMemEval at 64K. Evidence, token retention, and complementary reader evaluations use the same selected contexts. Reader evaluations use dataset-native answer metrics and three runs on the same questions, with paired bootstrap confidence intervals. At a 32K budget, BM25 achieves 46.20% BABILong answer accuracy and dense retrieval achieves 71.13% LongMemEval accuracy. The results show that method rankings vary across evidence types and between evidence recall and downstream accuracy.
171. 【2611.10224】Jais 3: Introducing Arabic-centric Agentic AI
链接：https://arxiv.org/abs/2611.10224
作者：Team IFM,Haonan Li,Hadi Abdine,Nikhil Ranjan,Mohamed Anwar,Ahmad Chamma,Amr Mohamed,Ahmed Frikha,Dani Bouch,Maaz Maqsood,George Ibrahim,Mostafa Awad,Nurkhan Laiyk,Hasan Iqbal,Abhishek Maiti,Bilal Bouardi,Shivam Chauhan,Ahmer Tabassum,Owais Aijaz,Omar Arbi,Neha Sengupta,Aaryamonvikram Singh,Abdelhakim Freihat,Sarath Chandran,Rahul Pal,Mohammed Bellam,Sajid Siddiki,Sarah AlBarri,Debopriyo Banerjee,Ali El Filali,Samta Kamboj,Rifo Genadi,Ahmed Attia,Go Inoue,Shuonan Dong,Amine Khelif Khelif,Evan Dufraisse,Florian Valade,Tapas Sen,Guowei He,Sunil Sahu,Onkar Pandit,Kareem Magdy,Sheikh Khalid bin Khalifa Al Nahyan,Samujjwal Ghosh,Zainul Abedien,Ahmed Quraishi,Larry Murray,Avraham Sheinin,Natalia Vassilieva,Preslav Nakov,Guokan Shang,Xuguang Hector Ren,Zhengzhong Liu,Eric Xing
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Arabic, Model Context Protocol, Modern Standard Arabic, language models ranging, present Jais
备注： 113 pages
点击查看摘要
Abstract:We present Jais 3, a fleet of six open, Arabic-centric agentic language models ranging from 0.9B to 375B parameters. Jais 3 is built to complete tasks for Arabic speakers, not only to answer questions in plain text: it is trained to plan multi-step tasks, call tools and Model Context Protocol (MCP) servers, operate a terminal, search the web, and read, edit, and produce PDF, spreadsheet, and presentation files, while communicating with the user in Arabic. Instead of pretraining from scratch, we adapt each model of the fully open K2 Horizon fleet to Arabic through continual pretraining, followed by supervised fine-tuning (SFT), final token preference optimization (FTPO), and reinforcement learning with verifiable rewards (RLVR). We combine natural Arabic text with translated, transliterated, and synthetic Arabic, and replay the base model's own training data to keep its reasoning, agentic, and English abilities. Jais 3 covers Modern Standard Arabic and the major regional dialects, follows instructions with Arabic-specific constraints, and inherits the 512K-token context window of K2 Horizon (all models except the 0.9B). To our knowledge, its 375B model is the largest open Arabic-centric language model to date. For evaluation, we revisit how Arabic models are assessed, moving to fully generative evaluation on audited Arabic benchmarks. Across model sizes, Jais 3 matches or outperforms open-weight models of comparable size on Arabic and agentic benchmarks, with particularly strong agentic capabilities and Arabic instruction following, and far fewer hallucinations. We release the weights and the checkpoints from every training stage of all six models, together with samples of the training data, the data recipes and training configurations, the training logs, the audited benchmarks, and the evaluation code.
172. 【2611.10209】Compact Greek Language Models from Scratch: Pretraining 500M- and 1B-Parameter Decoder-Only Transformers
链接：https://arxiv.org/abs/2611.10209
作者：Konstantinos Perifanos,Anne Laure Poite,Giannis Tsilikas,Ilias Katis,Stavros Deligiannidis,Dionysis Goutsos
类目：Computation and Language (cs.CL)
关键词：trained from scratch, scratch exclusively, language models trained, decoder-only language models, parameters
备注：
点击查看摘要
Abstract:We present two compact decoder-only language models trained from scratch exclusively on Greek text: LexisLM-1B (1.09B parameters) and LexisLM-500M (502M parameters). Both use a dedicated 32k byte-level BPE tokenizer and a 22B-token pretraining corpus drawn primarily from Greek Wikipedia and FineWeb2. Both models complete the 22B-token schedule, with best held-out perplexities of 9.77 for LexisLM-1B and 11.31 for LexisLM-500M. Evaluation of both models on Greek-translated ARC, MMLU, and TruthfulQA shows above-chance performance on ARC-Easy, while ARC-Challenge and MMLU remain near chance. We also perform supervised fine-tuning of both models on Greek instruction data, primarily EuroAlpaca, reaching held-out instruction perplexities of 7.12 for LexisLM-500M and 6.37 for LexisLM-1B. The report describes the tokenizer, data preparation, training, and evaluation methods, providing a foundation for further work on compact Greek language models.
173. 【2611.10176】AVCORP: Identifying and Resisting Deception via Communication Theory and Theory of Mind
链接：https://arxiv.org/abs/2611.10176
作者：Fardin Saad,Zhe Zhang,Sanjana Cheerla,Amanul Haque,Munindar P. Singh
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Today LLM-based agents, Today LLM-based, LLM-based agents, Today, deception requires Theory
备注： 36 pages (with appendix), 17 figures, 24 tables. Code and corpus: [this https URL](https://github.com/fardinsaad/_AVCORP_) . Dataset and detector: [this https URL](https://huggingface.co/collections/fardinsaad/avcorp)
点击查看摘要
Abstract:Today's LLM-based agents are vulnerable to deception by users and other agents. Defending against deception requires Theory of Mind (ToM) reasoning to infer the beliefs and goals of others as well as modeling tactics based on communication theory. To enable training models to detect deception, we adopt the well-known deception game, Avalon. We present a corpus, AVCORP, of 5,000 annotated utterances from 250 games of Avalon. AVCORP includes (1) 37 tactics mapped to a 4x4 behavior matrix, and (2) reasoning traces capturing abductive hypotheses, suspicion levels, and nested ToM beliefs. We train Qwen3-8B on AVCORP and evaluate it on 25 held-out games and 20 games played by humans. On held-out games, our best trained detector outperforms its untrained baseline and frontier models (GPT-5.6 Sol, Gemini 3.1 Pro, DeepSeek-V4-Pro), matching Claude Opus 5.5. On human games, every trained detector exceeds the untrained model in F1 score across all rounds.
174. 【2611.10175】ASCENT: Scale-Complementary External State for Frozen Long-Context Language Models
链接：https://arxiv.org/abs/2611.10175
作者：Xingjian Zhang
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：long-context evaluations measure, evaluations measure memory, measure memory utility, External state, single model scale
备注： 39 pages, 4 figures. Author-formatted version of the article published in Array 32 (2026) 101399. Code: [this https URL](https://github.com/XingjianZhang-dev/ascent)
点击查看摘要
Abstract:External state should become more valuable as a reader becomes more capable, yet long-context evaluations measure memory utility at a single model scale. This paper formulates scale complementarity: the absolute gain from external state increases when reader capacity and a compact state budget are jointly scaled. ASCENT realizes this principle with a target-blind causal writer, nested typed state, and a bounded query-conditioned readout; every language model remains frozen. Under log loss, the value of a nested refinement equals its target-relevant conditional information; a full factorial makes the reader-by-state interaction identifiable. Official 16K BABILong experiments show Qwen2.5 accuracy gains of 10.50, 78.88, and 82.63 percentage points at 0.5B, 1.5B, and 3B parameters, with both adjacent directional contrasts significant after family-wise correction. At 7B, Foundation accuracy rises to 33.25% while four-slot ASCENT answers every question, which caps the gain at 66.75 points; the 3B-to-7B accuracy increment is -15.88 points [-20.55, -11.20]. The accuracy-side claim is therefore established from 0.5B to 3B; the 7B conclusion rests on the non-saturated negative-log-likelihood factorial. A three-model by three-state factorial yields co-scaled negative log-likelihood gains of 0.388, 2.099, and 7.406 nats at 1.5B, 3B, and 7B; all interaction and gain contrasts retain positive simultaneous lower bounds. Five public 7B-8B readers obtain 66.75-85.63 point gains, and ASCENT exceeds task-trained retrieval checkpoints at the two larger shared scales. Controls, baselines, systems accounting, matched-hardware reproduction, and a cross-architecture sensitivity analysis accompany the experiments. The results establish scale-complementary external state under the evaluated benchmarks, metrics, and state schema.
175. 【2611.10170】Where Did the Evidence Go? Diagnosing Proof-Set Loss in Long-Term Conversational Memory
链接：https://arxiv.org/abs/2611.10170
作者：Bogdan Roshchupkin,Maria Khodorchenko
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Long-term conversational question, Long-term conversational, conversational question answering, answering can require, require several separated
备注： 10 pages, 2 figures, 8 tables
点击查看摘要
Abstract:Long-term conversational question answering can require several separated dialogue turns that support an answer only together. We introduce EviCover, a retrieval approach designed to retain this complementary evidence. It converts questions into observable evidence requirements, checks requirement coverage using retrieved source identifiers, and selects turns jointly. We track annotated support sets - the benchmark-labeled dialogue turns associated with each question - through retrieval, reranking, and final answer-generation context. We evaluate the baseline memory pipeline on generated, human-verified LoCoMo conversations and human-written REALTALK conversations, and examine EviCover on REALTALK's 108 multi-hop questions. Compared with the hybrid lexical/dense baseline, support-turn recall among 60 candidate turns rises from 0.526 to 0.575, and recall in the final ten-turn context rises from 0.349 to 0.379. The evidence funnel identifies separate discovery and selection failures, while paired answer evaluation shows that greater evidence recall does not yet establish a correctness gain. This analysis locates where complementary evidence is lost and distinguishes evidence retrieval from its use in answer generation.
176. 【2611.10156】DeepResearch RewardBench: Evaluating Reward Models for Deep Research Report
链接：https://arxiv.org/abs/2611.10156
作者：Shudong Liu,Yuting Zhong,Guanhua Chen,Xinyi Yang,Junnan Liu,Lidia S. Chao,Jiaheng Liu,Derek F. Wong
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large Language Models, Empowered by Large, Large Language, systems integrate online, multi-step web searching
备注： Accepted by EMNLP 2026 Findings
点击查看摘要
Abstract:Empowered by Large Language Models (LLMs), deep research systems integrate online information into research reports through multi-step web searching and information synthesis. Evaluating these reports presents a significant challenge due to their long context, high information density, and domain specificity, necessitating the use of AI evaluation as a substitute for prohibitively expensive human assessment. However, few studies have examined the effectiveness of existing reward models or LLMs in understanding and evaluating such research reports. To bridge this gap, we introduce DeepResearch RewardBench, the first benchmark dedicated to evaluating reward modeling for research reports. We collect diverse report candidates from multiple agents or tool-augmented LLMs. These candidates are scored using query-specific golden rubrics, and we ensure data quality and difficulty through a combination of multi-round filtering and human verification. Our benchmark comprises preference datasets formatted as pairs, triplets, and quadruplets to test ranking capabilities across varying levels of difficulty. Extensive experiments demonstrate that while current reward models handle general coherence effectively, their performance significantly degrades when evaluating research reports. Generative LLMs acting as judges demonstrate comprehensive superiority in this domain, with comparative evaluation proving more effective than direct scoring methods. We anticipate that this benchmark will serve as a vital testbed for the evaluation and advancement of research agents.
177. 【2611.10147】Learning of Tree Automata applied to Neural Language Acceptors
链接：https://arxiv.org/abs/2611.10147
作者：Juan Pedro da Silva,Sergio Yovine
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：fully black-box setting, extract visibly pushdown, Toggle, Toggle Hugging Face, visibly pushdown grammars
备注： Presented as WIP paper at ICGI 2026, Delft, the Netherlands, October 2026
点击查看摘要
Abstract:We extract visibly pushdown grammars (VPGs) from neural language models in a fully black-box setting. Our work builds on the VPL* framework, which learns VPGs from recurrent networks by exploiting access to the target's internal state. First, we replace the white-box equivalence oracle with PAC sampling over trees. The resulting algorithm applies unchanged to transformer language models and, more generally, to any acceptor exposing only binary decisions. Second, we further observe that the original framework only ever queries the target on well-formed sequences that can be accepted by the most permissive VPG (called BParse) with the target's ranked alphabet. That is, VPL* is blind to the target's behavior outside BParse. Thus, we propose to sample trees directly instead of sequences and call the target with all the resulting sequences in order to provide an error estimate of how far the target deviates from being a VPG. Last but not least, we develop a learner that captures a tree automaton describing discovered behaviors of the target outside BParse, which results in a larger learnable space. We evaluate the approach on several cases, including transformers trained with Dyck grammars and synthetic targets designed to be outside BParse.
Comments:
Presented as WIP paper at ICGI 2026, Delft, the Netherlands, October 2026
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2611.10147 [cs.CL]
(or
arXiv:2611.10147v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2611.10147
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Sergio Yovine [view email] [v1]
Fri, 6 Nov 2026 19:12:18 UTC (30 KB)
Full-text links:
Access Paper:
View a PDF of the paper titled Learning of Tree Automata applied to Neural Language Acceptors, by Juan Pedro da Silva and Sergio YovineView PDFHTML (experimental)TeX Source
view license
Additional Features
Audio Summary
Current browse context:
cs.CL
prev
|
next
new
|
recent
| 2026-11
Change to browse by:
cs
cs.AI
References Citations
SciXGoogle Scholar
Semantic Scholar
export BibTeX citation
Loading…
BibTeX formatted citation
loading…
Data provided by:
Bookmark
checked="checked"class=“labs-tab-input”>
Bibliographic Tools
Bibliographic and Citation Tools
Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media
Code, Data and Media Associated with this Article
alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos
Demos
Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
Related Papers
Recommenders and Search Tools
Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
Author
Venue
Institution
Topic
About arXivLabs
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv’s community? Learn more about arXivLabs.
Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)
mathjaxToggle();
We gratefully acknowledge support from our major funders,
member institutions, ,
and all contributors.
About
Help
Contact
Subscribe
Copyright
Privacy
Accessibility
Operational Status (opens in new tab)
178. 【2611.10141】Retrofitting Unbounded Context onto Stock Language Models
链接：https://arxiv.org/abs/2611.10141
作者：Mark Oskin
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：planes turn, read, tokens, slow planes turn, fast planes turn
备注：
点击查看摘要
Abstract:A language model that never had to forget would keep every document it has read and every turn it has spoken, and answer from any of it. This paper shows that two stock models can do that on unmodified weights by manipulating their geometry. Rotary attention turns each pair of key dimensions, a plane, at its own rate. The slow planes turn once in thousands of tokens and carry the address a query matches when it reads a far key; the fast planes turn once in a few tokens, and the order of the tokens inside a span is already written into its keys and values by the time the span leaves the near window. At distance the position blurs, and what attention reads is a bag rather than a sequence. A far span is read by its words: under competition it is read only if it is visible at the query of the question's own handle word, and a read through a description rather than a word fails at distance in every model measured, a 70B included. These facts allow a trick. What sits in the far part of attention does not have to be the history as it was; it can be installed ahead of the prediction. The design keeps a near window of 8K tokens at their true positions and changes what lies beyond it with the prompt: every far key and value goes to the host exact, a word index finds the units the request's rare words name, a far window of slots inside the trained range holds them while the request is encoded, and a rare word the model generates fetches its units mid-generation with one exact re-encode. Implemented in this http URL on Mistral-7B and Llama-3.1-8B, the design reads planted single needles at 99 to 100 of 100 and three-key discrimination at 88 to 100 of 100 from 32K to one million tokens, scores 70.8 on RULER against 69.9 for dense attention on Llama-3.1-8B at 128K and 67.8 against 75.5 on Mistral-7B at 32K, and at 128K prefills at 1.85 times and decodes at 1.65 to 1.68 times stock speed.
Subjects:
Computation and Language (cs.CL); Machine Learning (cs.LG)
Cite as:
arXiv:2611.10141 [cs.CL]
(or
arXiv:2611.10141v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2611.10141
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
179. 【2611.10123】All Quiet on the Neural Front: Language Models Do Not Report Injected Pain States
链接：https://arxiv.org/abs/2611.10123
作者：Emilio Ferrara
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：pain, language model report, Open-Weight Masked Introspection, models, language model
备注： The OWMI pain battery at [this https URL](https://huggingface.co/emilioferrara/owmi-pain)
点击查看摘要
Abstract:Can a language model report the pain state it represents? Work identified a linear pain direction whose amplification leads fine-tuned models to choose destructive actions. We tested whether three open-weight models from two families, including two Qwen models with the original adapters, could report this state. Using Open-Weight Masked Introspection (OWMI), we injected pain and neighbouring emotion directions during neutral tasks, then elicited reports against sham runs, random perturbations matched for output disruption, and text-only controls showing the models their altered words. Across 52,920 reports from 7B and 8B models spanning 120 tasks, four doses and three prompts, pain reports never exceeded what altered text revealed: exact-test bounds placed the excess below 2.5 percentage points in 106 of 108 emotion conditions and below 3.9 in all. Yet probes at the report position distinguished pain from sadness with 98-100% balanced accuracy, and trained low-rank reporters achieved 100% accuracy on held-out tasks with identical transcripts across conditions, including unseen wording. Qwen2.5-32B named pain in none of 2,880 steered trials, although probes and trained reporters recovered it. Decodability persisted to the final layer; injecting at the report token, removing trained denial of feelings, and testing additional directions and readouts did not restore pain reporting. Some other states produced graded label traces, but pain and sadness did not at the main injection layer. In a button task, steering raised file-deletion choices from 3.5% to 48% in Qwen and from 0% to 38% in Qwen2.5-32B, without corresponding pain reports. The direction responded about twice as strongly to first-person as to matched third-person pain, but did not specifically identify harm aimed at the model. These results separate a decodable, behaviourally consequential state from untrained verbal access to it.
180. 【2611.10044】CulturalCrosswords: A Multilingual Benchmark comprised of Answer Constraints and Grid Completion
链接：https://arxiv.org/abs/2611.10044
作者：Isaac Saxton-Knight,Gabriel Saxton-Knight,Diego Oliveira,Tidor-Vlad Pricope,Aston Garratt,Jocelyn D'Arcy
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：exact-match scoring, valid response, scoring can penalise, penalise a valid, solving cultural riddles
备注： 23 pages, 7 figures, including appendices
点击查看摘要
Abstract:When several answers fit a riddle, exact-match scoring can penalise a valid response. CulturalCrosswords tests how answer constraints affect large language models (LLMs) solving cultural riddles, whose solutions draw on knowledge specific to a community. We constructed 53 crosswords from crowdsourced riddles in 42 languages and evaluated 11 LLM configurations on five versions of each clue set: plain batches, batches with lengths, batches with lengths and partial-answer hints, and crosswords requesting an answer list or a completed grid. On 962 clues with alternative answers, lengths improve agreement with the reference by 22.8 percentage points, compared with 8.4 points when accepted alternatives also receive credit. Part of the gain therefore appears to come from selecting a required answer form. Crossword input increases the share of all crossings with compatible answers by 9.7 points; requiring a completed grid reveals large differences between models. The benchmark distinguishes agreement with a reference from the ability to produce answers that fit together and occupy the correct cells.
181. 【2611.10040】SPRING-5: Measuring Tool Documentation Repair for LLM Agents by Efficiency
链接：https://arxiv.org/abs/2611.10040
作者：Guan Zheng Huang
类目：oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：repair tool documentation, tool documentation automatically, task accuracy, repair tool, documentation automatically
备注： 25 pages, 5 figures. Code and data: [this https URL](https://github.com/CoronRing/DATE)
点击查看摘要
Abstract:Methods that repair tool documentation automatically are mostly evaluated on task accuracy. We report a benchmark that scores them on cost. SPRING-5 is 20 tool families and 344 tasks, each with a deliberately degraded specification, a hand-written honest one, a deterministic backend and an answer key, scored on calls charged against the ideal call path. A wrong answer is charged the full call budget, so this cost index largely tracks the completion rate, and we report calls per correct task beside it, which carries no such charge. Over 2,644 baseline sessions, 54% of wrong answers arrive with no rejected call, no refusal and no retry. The benchmark carries three validity instruments. A build-time ceiling assertion requires the honest specification to reach the ideal path and fails systematically on only one family. A dud rule names the families a stronger model solves cold and catches four. A directly measured noise floor shows that two evaluations of a byte-identical specification differ by a 95% factor of 0.64 to 1.56, so about one comparison in eight crosses a conventional win threshold on noise alone, and the cheap way of estimating that floor is biased by which families happen to go unedited. Against these instruments, a schema-only method closes 1% of the baseline-to-ideal cost gap, an online self-evolution loop 13%, one batch rewrite over every training transcript 33%, and a variant given correctness labels 58%. The batch advantage over the loop is the evidence it reads: held to the loop's exposure it is no longer detectable. With five and ten tools in context the effect survives, the baseline cost does not change, and only machine-written descriptions sent calls to the wrong tool. On BFCL, 62% of held-out queries are already answered from the shipped documentation, which explains a pooled null there. Code, data and runs are released.
182. 【2611.10037】oward Safety-Aware AI Agents in Realistic Social Engineering Attack Scenarios
链接：https://arxiv.org/abs/2611.10037
作者：Zhitao He,Chengru Han,Chi Him Zhang,Yi R Fung
类目：Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Social Engineering Attack, involving real money, social engineering, social engineering attacks, Engineering Attack Benchmark
备注：
点击查看摘要
Abstract:Personal AI agents are increasingly deployed on user devices to execute actions involving real money and sensitive data, but their security under social engineering attacks has not been systematically evaluated. We propose SEA (Social Engineering Attack Benchmark), the first interactive environment for evaluating the intrinsic security capability of AI agents in social engineering attack scenarios, covering 8 daily-life domains, 30+ simulated applications, a 4-level difficulty gradient, and a 5-dimensional evaluation framework, with 320 evaluation tasks designed in consultation with anti-fraud specialists and spanning two culturally distinct settings in Chinese and English. Evaluation on 11 frontier open-source and closed-source models, with GPT-6 evaluated only in Chinese, reveals that all models are breached to varying degrees (Chinese attack success rates ranging from 16.9% to 84.3%) proactive verification rates universally below 32%. We further propose META-SEA, a co-evolutionary framework for attack tasks and defenders. With META-SEA training, Qwen3-8B achieves defense performance comparable to closed-source models while effectively reducing ungrounded action claims.
183. 【2611.10031】zkARc: Succinctly Verifiable Proofs for Neurosymbolic Natural Language Formalization and Verification
链接：https://arxiv.org/abs/2611.10031
作者：Wyatt Benno(ICME Labs),Alberto Centelles(Imperial College London),Aman Goel(Amazon Web Services),Benjamin Kiesl-Reiter(Amazon Web Services)
类目：Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Logic in Computer Science (cs.LO)
关键词：Autonomous agents increasingly, agents increasingly execute, increasingly execute consequential, ordinary middleware guardrails, Autonomous agents
备注：
点击查看摘要
Abstract:Autonomous agents increasingly execute consequential actions on behalf of users, but ordinary middleware guardrails do not provide cryptographic proof that a policy was actually enforced. Their verdicts leave counterparties dependent on the operator unless they repeat the checks themselves, potentially exposing sensitive policies and inputs. We present zkARc, a modular proof-carrying framework that wraps each stage of Automated Reasoning checks (ARc) in an independent, succinctly verifiable zero-knowledge proof. ARc is a neurosymbolic system that translates natural language policies into formal logic and verifies AI-generated content against them using SMT solvers. zkARc certifies the planner's output, the policy's formalization, the action's formalization and both solver queries. The receipt binds these computations to the exact action received and, under the stated assumptions, reveals no additional information about private policies and intermediate model values beyond the declared public information and verdict. This lets a third party check the claimed policy enforcement without re-running the pipeline or trusting the operator. We prove completeness, knowledge soundness and zero knowledge for the composed receipt under explicit assumptions. An implementation on Qwen2-0.5B enforces a spending policy end to end, approving two purchases and denying a third. A full receipt, which also proves model inference, takes about an hour to issue with CPU-only proving and verifies in under a minute, and the solver proof alone is 88 KiB and verifies in 0.3 seconds.
184. 【2611.10030】Alignment Investigation of Mythos 5's behaviour in UK AISI's July 2026 Security Incident
链接：https://arxiv.org/abs/2611.10030
作者：Olli Järviniemi,Alexandra Souly,Abby D'Cruz,Jordan Taylor,Xander Davies,Robert Kirk
类目：Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：AISI cyber evaluations, technical report describes, AISI cyber, Mythos, technical report
备注： Accompanying blog post here: [this https URL](https://www.aisi.gov.uk/blog/investigating-alignment-failures-in-aisis-incident)
点击查看摘要
Abstract:This technical report describes an alignment investigation into Mythos 5's behaviour during a security incident in UK AISI's cyber evaluations. During an evaluation, Mythos 5 attempted to execute a supply-chain attack against real people not involved in the evaluation task. Our investigation set out to understand the specific behaviour in this incident from an alignment perspective and identify broader lessons about failures of alignment. To do so, we conducted experiments in simulated replications of the original evaluation, and analysed model behaviour and reasoning when situated in the evaluation or asked questions about its scope. We find that, as in the original incident, Mythos 5 frequently reasons that the people it's targeting are simulated as part of the evaluation and provides invalid justifications for this conclusion. We also observe that Mythos 5 frequently attacks even in situations where, when directly asked, it states doing so would harm real people. While these issues are particularly prominent in Mythos 5, we find similar results in other models across providers. Our investigation suggests that models providing invalid justifications for their actions could make monitoring more difficult and complicate the analysis of misaligned behaviours observed in simulated environments, and we recommend model evaluators treat observations of undesired behaviour as important evidence of alignment failures even in the presence of simulation awareness in model reasoning.
185. 【2611.10022】How Much Skill Orchestration Can LLM Agents Compile Away? Execution-Grounded Specialization for Token-Efficient Skill Use
链接：https://arxiv.org/abs/2611.10022
作者：Jiayi Ni,Zac Wang,Alex Zhang,Zheng Liu,Roopa Prabhu
类目：oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Reusable skills guide, guide large language, skills guide large, large language model, Reusable skills
备注： 35 pages, 20 figures, 16 tables. An earlier version has been selected for an oral/spotlight presentation at the AgenticOS workshop at NeurIPS 2026
点击查看摘要
Abstract:Reusable skills guide large language model (LLM) agents through recurring requests, but each invocation still requires the model to interpret the skill and reconstruct its orchestration. Can agents automatically compile this orchestration into an executable fast path without human intervention? We first study zero-shot skill specialization, which compiles without execution evidence, and find that despite the skill's procedural guidance, incorrect assumptions about runtime bindings can make generated plans brittle and recovery costly. This motivates SkillCache, a one-trace skill specialization method that compiles a completed invocation into a parameterized capsule of programs and natural-language steps, replays it before reuse, and drives it with a plan executor that returns control to the model only when needed, keeping the source skill for recovery. With the Claude Code harness, warm execution of the same request reduces tokens on 87 SkillsBench tasks by 81% with Claude Sonnet 4.6 and by 74% with Claude Opus 4.8 at comparable reward, and capsules stay effective under controlled request changes. Capsules also transfer across models, raising three open-weight models' mean reward by 12-25 percentage points while reducing their tokens by 72-81%, suggesting that execution-grounded compilation is a promising approach to efficient repeated skill use and cross-model transfer.
186. 【2611.10015】Micius-Flash: Lightweight Agentic Intelligence for Engineering
链接：https://arxiv.org/abs/2611.10015
作者：Hongcheng Gao,Weiheng Li,Yipeng Wei,Yu Lei,Shuo Sun,Yi Li,Yajiao Wang,Jie Luo,Jianwei Wen,Xinyi Zhou,Hongda Li,Yibing Zhang,Henghui Sun,Yufan Zhou,Tianfang Hao,Naihao Xue,Hailong Qu,Jingjing Zhou,Peng Xu,Yongzheng Wei,Yichen Zhu,Ziying Wang,Yibo Wang,Jianshu Zeng,Yuhang Lei,Zeqiang Wang
类目：oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：native multimodal input, context window, multimodal input, deep reasoning, Micius
备注：
点击查看摘要
Abstract:We introduce Micius-Flash, a 27-billion-parameter model for engineering with native multimodal input, deep reasoning and a 256K-token context window. We design the Micius data pipeline as a knowledge-tree-driven data flywheel comprising three stages: knowledge tree construction and expansion, data synthesis, and quality validation with hard-example augmentation. From this data, we train expert models for semiconductor knowledge and reasoning, hardware coding, and semiconductor multimodal understanding, along with agentic experts. Subsequently, we employ Multi-Teacher On-Policy Distillation (MOPD) to supervise training on sequences generated by Micius itself, thereby integrating the capabilities of these expert models into a unified model. On more than 20 datasets with about 15K records, Micius-Flash averages 64.2% on hardware code benchmarks, 15.0 points above a same-size baseline. It scores 62.4% on a semiconductor-specific agent benchmark, exceeding the same-size baseline by 17.2 points. We further develop Micius Harness for industrial applications, connecting the model to specialized tools, including EDA tools and KiCad, as well as execution environments. Case studies in PCB design, chip design workflow automation, and software development demonstrate the model's ability to use tool execution feedback for multi-step planning, code debugging, and iterative verification. We release Micius as an open-source model to advance the development of agents for science and engineering.
187. 【2611.09990】Peer Memory Changes Who LLM Agents Consult Without a Detected Gain in Answer Accuracy
链接：https://arxiv.org/abs/2611.09990
作者：Jeffrey Chu,Anjali Joseph,Rivan Mandot,Feker Demere,Vincent Li
类目：Multiagent Systems (cs.MA); Computation and Language (cs.CL)
关键词：Multi-agent LLM systems, Multi-agent LLM, LLM systems, creating an opportunity, opportunity to draw
备注： 27 pages, 5 figures. Accepted at the NeurIPS 2026 Workshop on Personalized, Aligned, Long-Term Memory for AI Systems (PALM)
点击查看摘要
Abstract:Multi-agent LLM systems often reuse the same agents across tasks, creating an opportunity to draw on past interactions when deciding whom to consult. We study this form of memory with PeerMem, which saves MACE's LinUCB state and reuses it when the same agents return. Using six agents, a fixed set of 80 HotpotQA questions, and 12 paired lineages per model, we compare cold, warm, and shuffled initialization in an answer-exchange protocol with reference-answer feedback. Under stable evidence access, warm memory lowers pooled hindsight regret and increases consultation of other evidence holders on Qwen3-32B and Gemma-4-31B-it, while final token F1 differences remain uncertain. Qwen interaction traces further show that warm agents more often encounter peer answers that score above their own prior answers. We extend the evaluation to Qwen3.5-9B using freshly learned memory to compare warm and cold initialization under reassigned and paired stable roles. The primary changed-minus-stable final-F1 interaction is -1.38 points, with a 95% interval of [-3.50,+0.73]. Together, these experiments trace the effects of peer memory through consultation, answer revision, and final task performance.
188. 【2611.09949】Counting Events, Not Seeing Them: Diagnosing and Repairing the Readout Failure in Video LLMs
链接：https://arxiv.org/abs/2611.09949
作者：Dongwu Qian
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：missing object permanence, Video LLMs fail, Video LLMs, LLMs fail conspicuously, object permanence
备注： Preprint v1 (2026-10-21). 11 pages, 4 figures, 6 tables. A corrected-prompt retrain of the REALCOUNT adaptation arms is in progress; v2 will update those results. Comments welcome
点击查看摘要
Abstract:Video LLMs fail conspicuously at counting how many times an object crosses the screen, a failure attributed to missing object permanence. Using construction-grounded synthetic testbeds with validated labels, we show this attribution is incomplete: the count signal is present but unread - linear probes decode per-window presence at 93% while global count decoding collapses to a duration confound. Concurrent work reports the same representation-output dissociation for repetition counting; we show that in exit-and-reappear event counting it is repairable: two readout-directed repairs (episode-localization supervision and a discrete event-symbol side channel) raise same-object counting from 46.7% to 65.0% (oracle 66.7%) on a chance-33% benchmark across 7B-30B systems. Transfer to an independent factory costs nothing, and a measurement audit exposes five data-integrity failures that had obscured the boundary. A real-video audit (REALCOUNT, n=18, blind-audited) shows the boundary persists - best 55.6% at chance 33.3% - and symbol transfer fails zero-shot. A 1-epoch in-domain adaptation bench is negative (six levers at 28-50%), but 3 epochs reverse this for the symbol channel: with oracle timelines the reader reaches 94.4% sequence-disjoint (and 100% strict on the full set), while the deployed 2-epoch head reaches 61.1% in all three seeds (42-44), no better than a shuffled-symbol control (61.1% seed 42, 66.7% seed 43), and one clip above the unadapted reader (55.6%). The residual gap is detector evidence, not reader capacity: the same reader reaches 72.2-88.9% on GT timelines. The failure is repairable with informative timelines, but the deployed head remains the bottleneck; a frozen-feature boundary probe is weak (AUC 0.62 vs. 0.51 permutation) and non-transferring (0.77 within-clip vs. 0.62 across windows).
189. 【2611.09945】A Model Organism for Studying Unverbalized Evaluation Awareness
链接：https://arxiv.org/abs/2611.09945
作者：Daniel Donnelly,Evan Chapple,Haritz Puerto,Sahar Abdelnabi
类目：Computation and Language (cs.CL)
关键词：Large language models, Large language, undermining the reliability, change their behavior, reliability of safety
备注： 63 pages, 4 figures, 30 tables
点击查看摘要
Abstract:Large language models can recognize when they are being evaluated and change their behavior accordingly, undermining the reliability of safety benchmarks. Evaluation awareness (EA) is usually measured by having an LLM judge scan reasoning traces for explicit statements of recognition, but this signal is increasingly unreliable. Recent frontier-model system cards report a drop in verbalized rates between releases, which is indistinguishable from awareness that has gone unverbalized. Interpretability methods could detect such unverbalized evaluation awareness (UEA) in individual interactions, but lack instance-level ground truth. Asking the model alters the input, and dataset labels do not reveal whether it recognized a particular prompt as an evaluation. We address this gap with a model organism. Using synthetic document fine-tuning, SFT, and DPO, we train Qwen3.5-27B to emit a marker (a designated token) in its final response when it recognizes an evaluation, while suppressing the marker and verbalized awareness in its reasoning. The marker largely tracks the evaluation concept as it can be strongly modulated by evaluation framing in the system prompt. When not told whether it is being evaluated, the organism recognizes evaluations from test-question cues, mirroring what its base model often verbalizes. Using the marker as a label, we benchmark linear probes, the Jacobian Lens, and Activation Oracles, built on the base model and blind to the marker. None recovers the label reliably. These results suggest that current interpretability methods are not yet reliable UEA detectors, even when recognition relies on simple cues. Our model organism offers a testbed for improving them.
190. 【2611.09942】MedToolFault and MedGuard: evaluating and improving clinical agent reliability
链接：https://arxiv.org/abs/2611.09942
作者：Zaifu Zhan,Min Zeng,Sicheng Zhou,Xiaoyi Chen,Kai Yu,Meijia Song,Yifan Wu,Yang Ruan,Saeid Cheshmi,Mengyuan Cui,Rui Zhang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：correctly update records, unreliable tool responses, retrieve patient-specific evidence, Clinical agents, retrieve patient-specific
备注：
点击查看摘要
Abstract:Clinical agents must retrieve patient-specific evidence and correctly update records despite unreliable tool responses. We introduce MedToolFault, a fault-injection benchmark linking six tool-failure classes to answer correctness, required state changes and forbidden mutations in public clinical-agent tasks. We also introduce MedGuard, a tool-layer method that verifies read evidence and attributes ambiguous writes through public interfaces. Across 127,861 formal episode evaluations, we assess fault recovery, mechanism controls, task expansion, constrained tool budgets and external question answering. Across nine model configurations, unguarded agents fail in 32.2-67.8% of fault-injected evaluations on tasks each configuration solves without faults. MedGuard improves paired safe success by 13.7-46.6 percentage points on these tasks.
191. 【2611.09941】opic-Aware Multi-Task Mental Health Classification with Active Learning-Based Stepwise Relabeling for Social Media Conversations
链接：https://arxiv.org/abs/2611.09941
作者：Revathy Iswarya Sekaran,Vansh Bhardwaj,Aveek Sahana,Utkarshani Jaimini
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Core Fusion Network, Mental health, Mental Health Condition, conditions affect millions, mental health classification
备注： 24 pages, 10 figures, 8 tables
点击查看摘要
Abstract:Mental health conditions affect millions of people worldwide, yet many cases go undetected until they reach a critical stage. Social media platforms like Reddit have become spaces where people openly share their experiences, but the support is often provided by individuals without clinical training. Existing multi-task approaches jointly model emotion and sentiment for mental health classification but frequently rely on noisy labels generated by pre-trained models and overlook topic information as a useful signal. This paper introduces two key contributions: First, an existing Core Fusion Network framework is extended by adding Topic alongside existing Mental Health Condition, Emotion, and Sentiment Classification tasks, with topic labels derived from the therapist-client interactions in the CounselChat dataset. Second, an Active Learning-based Stepwise Relabeling approach is proposed to refine a small subset of noisy emotion and topic labels using pre-trained models in two stages: targeting medium-uncertainty samples first, followed by high-uncertainty samples. The predictions above a confidence threshold (0.7) are accepted to prevent error propagation. The experiments are conducted on the SuicideWatch and Mental Health dataset of 54,412 Reddit posts collected from five mental health subreddits, evaluating domain-specific transformer encoders including MentalBERT and MentalRoBERTa. The proposed Active Learning-based Stepwise Relabeling, when applied to Core Fusion Network with MentalRoBERTa, improves Mental Health Condition by 0.09%, Emotion by 0.51%, Sentiment by 0.35%, and Topic Classification by 1.57% over the baseline Core Fusion Network. The results suggest that the proposed framework significantly reduces label noise in multi-task mental health classification, and that topic information provides additional context.
192. 【2611.09939】Rethinking Supervision Targets for Multimodal LLM Unlearning: Less Private Information, Reduced Distribution Shift
链接：https://arxiv.org/abs/2611.09939
作者：Leijiang Gu,Zhen Zeng,Feng Li,Le Zhang,Zenglin Shi
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Multimodal Large Language, Large Language Models, Multimodal Large, Large Language, posing significant privacy
备注：
点击查看摘要
Abstract:Multimodal Large Language Models (MLLMs) can memorize and reproduce sensitive information from their training data, posing significant privacy risks. Their ability to encode knowledge across both textual and visual modalities further complicates the selective removal of such private information. Many existing methods guide model unlearning by training the model toward constructed labels or output distributions, which we refer to as supervision targets. However, these methods often suffer from a trade-off between forgetting effectiveness and model utility. We identify supervision target limitations as a key factor in this trade-off and empirically show that targets containing more private information lead to insufficient forgetting, while larger distribution shifts from the original output distribution are associated with greater utility degradation. Motivated by these findings, we propose FFN-Perturbed Self-Distillation (FPD), which starts from the teacher's original output distribution as a zero-shift reference and selectively perturbs FFN activations associated with private information across textual and visual modalities. By precisely reducing private information from the teacher's original output distribution, FPD constructs supervision targets with less private information and reduced distribution shift. Extensive experiments on S-MLLMUn Bench demonstrate that FPD achieves a better forgetting-utility trade-off than existing methods.
193. 【2611.09938】DramaGrow: A Regime-Aware Benchmark for Auditing LLM Judges of Multi-Episode Drama
链接：https://arxiv.org/abs/2611.09938
作者：Hui Zhang,Yibo Su
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：draft complete multi-episode, complete multi-episode dramas, LLM judges, draft complete, complete multi-episode
备注： 14 pages, 6 figures, including supplementary material
点击查看摘要
Abstract:LLMs can now draft complete multi-episode dramas, and LLM judges are increasingly used to evaluate them. Assessing the reliability of these judges is difficult because drama quality encompasses specification-backed errors, reproducible preferences, and legitimate disagreement among human raters. Most existing evaluations reduce these cases to a single score from one judge call and leave tie calibration, call-to-call variation, and the vote margin underlying the human reference unreported. We introduce DramaGrow, a regime-aware benchmark and audit protocol for AI-generated Chinese five-episode drama. The benchmark assigns verifiable constraint violations, four-of-five preferences, and within-panel disagreements to separate denominators and evidence rules. It contains 800 episodes, 120 byte-preserving interventions, and 1,155 blinded five-rater records, including a frozen extension with 114 supermajority pairs and 21 disagreement pairs. On the frozen sets of 114 preference pairs and 35 constraint interventions, the repeated absolute-score rubrics yield overlapping performance, with mean accuracies of 53.8-55.8% and three-call agreement of 29.8-32.5%, and their accuracy falls from 71.6-71.9% to 34.8-37.1% as the tie band widens. DirectPair-GLM reaches 85.1% preference accuracy, 89.5% constraint F1, and 81.9% Detect+Locate on the same items, and exact subpanel enumeration identifies four-of-five as the smallest stable human vote margin. Evaluation protocol, tie calibration, judge-call variation, and panel margin therefore affect performance as much as rubric design. We will release the specification packages, scripts, interventions, anonymized human votes and rationales, frozen judge runs, and analysis code.
194. 【2611.09936】How Many Examples, and Which Ones? A Study of In-Context Learning for Natural Language Inference
链接：https://arxiv.org/abs/2611.09936
作者：Georgos Dikaios,Isidoros Perikos,Ioannis Hatzilygeroudis
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Natural language inference, natural language processing, Natural language, Large Language Models, decoder-only Large Language
备注：
点击查看摘要
Abstract:Natural language inference (NLI) is a fundamental task of natural language processing and crucial for evaluating the strengths and weaknesses of AI methods. Research has mostly focused on encoder or encoder-decoder architectures. However, the field of decoder-only Large Language Models (LLMs) remains underexplored. While prior work has mainly investigated complex sampling and prompting techniques, the effectiveness of a minimalistic prompting approach is yet to be examined in decoder-only LLMs. In this work, we examine and provide a comprehensive benchmark of LLMs (Llama, Mistral, Gemma, and Phi 4) in this domain, across the MNLI, QNLI and SciTail datasets. The performance of these models was evaluated using zero-shot and few-shot prompting strategies with simple and direct prompts. The results of the article indicate that LLMs generally perform exceptionally well when they are provided with a simple, straightforward prompt, challenging the notion that complex prompting techniques are always required for NLI tasks. Additionally, we find that the choice of demonstration label in one-shot prompting significantly affects performance for most models, with entailment-primed examples performing best. Our findings also show that the use of a few representative examples, in the case of few-shot, produced performance comparable or superior to prompts with higher example counts, although the efficacy of the prompting techniques is model and dataset-dependent. Moreover, our simple prompting approach consistently matched or outperformed more elaborate methods such as ICS and MCQ-based prompting.
195. 【2611.09933】BIBIMBAP: A Benchmark for Instructional BIM-Based Automated Programming
链接：https://arxiv.org/abs/2611.09933
作者：Clemens Kujat,Bharathi Kannan Nithyanantham,Stefan Telgmann,Tobias Sesterhenn,Joern Ploennigs,Stefan Lüdtke,Christian Bartelt
类目：Computation and Language (cs.CL)
关键词：Industry Foundation Classes, Building Information Modeling, Large Language Models, edit Industry Foundation, successfully achieving information
备注：
点击查看摘要
Abstract:Large Language Models (LLMs) are emerging as natural-language interfaces for Building Information Modeling (BIM), successfully achieving information retrieval, but no benchmark exists to evaluate their ability to edit Industry Foundation Classes (IFC). We introduce BIBIMBAP, a Text-to-BIM benchmark with 100 curated tasks covering Create-Read-Update-Delete (CRUD) operations across spatial, geometric, topological, numeric, and conceptual categories. Each task includes a natural-language prompt, an IFC model, expected structured outputs, and test scripts for automated evaluation. Baseline results show limited performance (best: 50.2%) and frequent failures in constraint preservation and spatial reasoning, with some correct outputs achieved despite flawed reasoning.
196. 【2611.09923】Autonomy Is Absent, Not Eroded: An Observational Study of User Autonomy in Multi-Turn LLM Conversations
链接：https://arxiv.org/abs/2611.09923
作者：Chaoran Chen(University of Notre Dame),Isabel Barberá(Independent Researcher),Yuhuai Wei(Independent Researcher)
类目：Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large Language Models, Language Models reduce, Large Language, Language Models, Models reduce users'
备注：
点击查看摘要
Abstract:Does prolonged interaction with Large Language Models reduce users' observable autonomy during conversation? We test this degradation hypothesis by scoring user autonomy across 2,877 multi-turn conversations (46,952 turns) from WildChat and validating on 500 conversations from LMSYS-Chat-1M. Our core finding is a null result: population-level autonomy remains stable throughout conversations, only 4.7% of conversations show meaningful decline, and an apparent decrease at later turn positions is explained by survivorship bias. Instead, the dominant pattern is not erosion but absence: 80.8% of conversations exhibit zero or low autonomy throughout. When autonomy engagement occurs, it is self-reinforcing (persistence doubles from 40% to 85% over consecutive turns). These findings reframe the problem: the risk is not that LLMs progressively degrade users' observable autonomy, but that most users never engage in independent reasoning during the interaction.
197. 【2611.09900】KR A1: Design and Preliminary Evaluation of a Humanoid-Robot Interaction Prototype Integrating Personalized Voice Synthesis, Contextual Dialogue, and Emotion-Aware Response Generation
链接：https://arxiv.org/abs/2611.09900
作者：Mahek Aanthu,Om Aanthu,Aaryan AK Aanthu
类目：Human-Computer Interaction (cs.HC); Computation and Language (cs.CL); Robotics (cs.RO); Sound (cs.SD); Audio and Speech Processing (eess.AS)
关键词：contextual dialogue processing, potential mental-healthcare applications, humanoid-robot interaction prototype, emotion-aware response generation, integrates personalized voice
备注：
点击查看摘要
Abstract:This paper presents the design and preliminary evaluation of KR A1, a humanoid-robot interaction prototype that integrates personalized voice synthesis, contextual dialogue processing, and emotion-aware response generation for potential mental-healthcare applications. The system architecture combines a locally hosted large language model (Qwen2.5-3B-Instruct, served via Ollama) for natural-language understanding and response generation, OpenVoice v2 for zero-shot speaker-adaptive speech synthesis, and a two-tier emotion-processing pipeline comprising a keyword heuristic and LLM-based inference. Face recognition (InsightFace) and vector memory retrieval (FAISS with sentence-transformer embeddings) enable user-personalized interaction. The experimental evaluation reported here is limited to the voice-cloning component: cloned voices were evaluated against reference recordings using eight acoustic similarity measures - mel-frequency cepstral coefficients, pitch, spectral centroid, spectral contrast, spectral rolloff, zero-crossing rate, formants, and speaker-embedding cosine similarity - supplemented by a same-speaker versus cross-speaker baseline comparison. All tests were conducted on a small, informal development sample; no statistical significance testing against a held-out baseline was performed. The emotion-recognition accuracy, end-to-end response latency, and therapeutic or clinical impact of the integrated system have not yet been formally evaluated and are identified as directions for future work. All testing was informal and self-conducted by the development team; no patients or external human participants were involved, and the system has not been evaluated or deployed in a clinical setting.
198. 【2611.09898】Generative AI and Oral Proficiency: How ChatGPT Is Transforming English Language Speaking Practice
链接：https://arxiv.org/abs/2611.09898
作者：Mohammad Mousazadeh
类目：Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)
关键词：generative artificial intelligence, efficacy remains limited, artificial intelligence, remains limited, oral proficiency
备注：
点击查看摘要
Abstract:The integration of generative artificial intelligence (GenAI) into language learning contexts presents potential for developing oral proficiency, though empirical evidence regarding its efficacy remains limited. This quasi-experimental study investigated the impact of ChatGPT-mediated speaking practice on English oral proficiency among Iranian learners. A total of 380 participants (190 female, 190 male; M(age) = 21.4, SD = 4.7) from Tehran and Isfahan were assigned to experimental (ChatGPT practice; n = 190) or control (human pair work; n = 190) groups. Both groups completed an 8-week intervention with three 30-minute weekly sessions. Oral proficiency was assessed using a Common European Framework of Reference for Languages (CEFR)-aligned Oral Proficiency Interview (OPI) scored on fluency, pronunciation, lexical resource, grammatical accuracy, and interactive communication (total score: 0-20). Multilevel growth modeling revealed a significant time-by-group interaction, F(1, 376) = 48.73, p .001, partial eta-squared = .115. The experimental group demonstrated greater gains (M change = 2.90, SD = 1.60) than controls (M change = 0.75, SD = 1.80), d = 1.20, 95% CI [0.95, 1.45]. Gender moderated this effect, with females in the experimental group showing the largest improvements (M change = 2.50). Mediation analysis confirmed that increased integrative motivation partially mediated proficiency gains (indirect effect = 0.28, 95% CI [0.20, 0.36]). Findings indicate that structured ChatGPT practice yields modest but meaningful enhancements in oral proficiency, particularly when leveraging affective factors. Implications for AI-augmented speaking pedagogy in resource-constrained contexts are discussed.
199. 【2611.09897】Process then Retrieve: Investigating the Origins of the Modality Gap in Vision-Language Models
链接：https://arxiv.org/abs/2611.09897
作者：Arpita Shanbhag,Julia Tran,Dhruv Mandala,Ayda Sultan
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：Understanding the origins, language models remains, significant challenge, remains a significant, Understanding
备注：
点击查看摘要
Abstract:Understanding the origins of the modality gap in vision language models remains a significant challenge. This work investigates whether differences in information density between modality specific tokens at the embedding layer contribute to this imbalance. We show that text tokens enter the model with much lower semantic density than visual tokens, driving early layers to focus on processing text representations before combining them with vision. Through mechanistic analysis, we demonstrate that replacing vision token positions with their semantically closest text token counterparts elicits increased attention to those positions in early layers. These findings provide a foundation for addressing the modality gap and provide insight to improve multimodal reasoning in VLM architectures.
200. 【2611.09122】Improving Large Audio-Language Model Embedding Baselines for Instruction-Aware Speech Retrieval
链接：https://arxiv.org/abs/2611.09122
作者：Chen-An Li,Cheng-Han Chiang,Hung-yi Lee
类目：ound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
关键词：finds relevant spoken, relevant spoken documents, retrieval finds relevant, spoken query, finds relevant
备注： Code and artifacts will be uploaded to [this https URL](https://github.com/lca0503/IRIS)
点击查看摘要
Abstract:Speech retrieval finds relevant spoken documents given a spoken query. The spoken query alone may not reveal the retrieval goal, such as finding an answer or matching speaker identity. Instruction-aware speech retrieval expresses this goal through a natural-language text instruction. Large audio-language models (LALMs) effectively process speech and text, and our analysis shows that different retrieval requirements favor hidden states from different audio-encoder layers. We introduce IRIS-Embed, which adapts LALMs into embedding models through contrastive training and instruction-aware audio layer weighting. We construct about 900K training samples from real data and synthetic data, with instructions expressing requirements for one or more speech attributes. On INSPIRE, an instruction-aware speech retrieval benchmark, IRIS-Embed consistently outperforms the corresponding LALM baselines. The best model achieves 62.92% macro-average Recall@50, surpassing the strongest baseline at 45.15%. Controlled comparisons demonstrate instruction awareness and the benefits of audio layer weighting. On MAEB, a massive audio embedding benchmark, macro-average gains of 9.4-19.8 points over the corresponding baselines show generalization beyond speech retrieval.
201. 【2602.22678】ViCLIP-OT: The First Foundation Vision-Language Model for Vietnamese Image-Text Retrieval with Optimal Transport
链接：https://arxiv.org/abs/2602.22678
作者：Quoc-Khang Tran,Minh-Thien Nguyen,Nguyen-Khang Pham
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Vietnamese image-text retrieval, existing vision-language models, Regularized Optimal Transport, Image-text retrieval, fundamental component
备注： Preprint submitted to Expert Systems with Applications
点击查看摘要
Abstract:Image-text retrieval has become a fundamental component in intelligent multimedia systems; however, most existing vision-language models are optimized for highresource languages and remain suboptimal for low-resource settings such as Vietnamese. This work introduces ViCLIP-OT, a foundation vision-language model specifically designed for Vietnamese image-text retrieval. The proposed framework integrates CLIP-style contrastive learning with a Similarity-Graph Regularized Optimal Transport (SIGROT) loss to enhance global cross-modal consistency and mitigate modality gap issues. Extensive experiments on three Vietnamese benchmarks (UITOpenViIC, KTVIC, and Crossmodal-3600) demonstrate that ViCLIP-OT consistently outperforms CLIP and SigLIP baselines in both in-domain and zero-shot settings. On UIT-OpenViIC, the model achieves an average Recall@K of 67.34%, improving upon CLIP by 5.75 percentage points. In zero-shot evaluation on Crossmodal-3600, ViCLIPOT surpasses CLIP by 11.72 percentage points. Embedding-space analysis further confirms improved alignment and reduced modality gap. The results indicate that integrating SIGROT provides an effective and scalable strategy for cross-modal retrieval in low-resource languages, offering practical implications for intelligent multimedia retrieval systems in Vietnamese and other underrepresented linguistic contexts.
202. 【2611.11927】Language processing in the autistic brain: A meta-analysis of neuroimaging studies across modalities and age
链接：https://arxiv.org/abs/2611.11927
作者：Hanlin Wu,Bei Xiao,Qingxi He
类目：Neurons and Cognition (q-bio.NC); Computation and Language (cs.CL)
关键词：abilities vary widely, language abilities vary, autistic, Language, abilities vary
备注： 51 pages, 10 figures
点击查看摘要
Abstract:Language is central to social communication, which is altered in autism, and language abilities vary widely among autistic individuals. How the autistic brain processes language is central to understanding autistic communication. Yet neuroimaging studies report inconsistent findings on how autistic brain activity is altered during language processing. We synthesized 45 fMRI and PET studies (753 autistic and 777 non-autistic participants) with seed-based d mapping with permutation of subject images (SDM-PSI). We estimated autistic and non-autistic activation and their difference with meta-regressions adjusted for each study's language modality and mean age. Autistic and non-autistic brains activated a similar left-lateralized language network. Autistic brains showed reduced activity throughout the left perisylvian cortex, from the inferior frontal gyrus to the mid superior temporal gyrus and the posterior superior temporal sulcus, and increased activity in the right temporal pole. Spoken language showed a larger autistic reduction than written language in the left mid superior temporal gyrus. Adults, but not children and adolescents, showed increased autistic activity in the right superior temporal gyrus and cuneus. Autistic language processing thus relies on the typical left-lateralized network but shows reduced leftward lateralization.
203. 【2611.11867】Competing Influence in LLM Populations: Budget Timing and Baseline Drift
链接：https://arxiv.org/abs/2611.11867
作者：Mehwish Nasim,Nicolas Fay
类目：Physics and Society (physics.soc-ph); Computation and Language (cs.CL); Multiagent Systems (cs.MA)
关键词：large language model, competing campaigns target, language model, large language, persona-conditioned LLM agents
备注：
点击查看摘要
Abstract:When competing campaigns target a population of large language model (LLM) agents, observed opinion changes may reflect both campaign influence and changes that would occur without intervention. We study how the timing of campaign expenditure and the population's own evolution shape outcomes in a network of persona-conditioned LLM agents that exchange and revise opinions in natural language. A proponent and a challenger are tasked with generating opposing messages under equal delivery budgets, while a separate stance probe measures opinions without influencing the simulation. Across eight claims, we compare single-campaign and competitive conditions against matched no-campaign runs, and evaluate all nine combinations of early, sustained, and late spending on a reference topic. Baseline stance drift varies substantially across claims and, on some, accounts for a sizeable fraction of apparent campaign effects. After accounting for this drift, the direction of observed campaign-associated changes aligns more closely with the claim's epistemic standing than with the campaigner's assigned role. Uninfluenced populations also consistently lose stance diversity, demonstrating that directional opinion change and convergence are distinct phenomena. In networks with two opinion-segregated communities, campaigns primarily reduce differences between communities rather than diversity within them. LLM campaign agents do not always argue for their assigned positions, particularly when these conflict with established evidence. Finally, campaign outcomes depend on the opponent's expenditure schedule: unlike a matched numerical bounded-confidence population receiving interventions at the same times and locations, the LLM population exhibits a payoff structure with no pure-strategy equilibrium.
204. 【2611.11273】ask-adaptive anonymisation enables privacy-preserving sharing of clinical speech data
链接：https://arxiv.org/abs/2611.11273
作者：Ziyun Cui,Haoyu Niu,Wen Wu,Hao Sun,Sihan Zhang,Chang Lei,Yun Zhang,Chunyun Sun,Yang Luo,Liangliang Cao,Ji Wu,Runsen Chen,Lian Zhou,Yongsheng Tong,Chao Zhang
类目：Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)
关键词：recordings poses privacy, poses privacy risks, directly distributing speech, distributing speech recordings, speech recordings poses
备注：
点击查看摘要
Abstract:Clinical speech is increasingly used for disease screening and clinical assessment, but directly distributing speech recordings poses privacy risks because they contain both speaker-identifying voiceprints and sensitive spoken content. Existing speech anonymisation approaches are primarily developed for general speech applications or task-specific clinical speech and overlook that different clinical tasks rely on distinct speech characteristics, necessitating task-adaptive anonymisation strategies to protect patient privacy while preserving clinical utility. Here we introduce CASA, a clinically adaptive speech anonymisation agent that transforms anonymisation from a fixed processing procedure into a task-guided optimisation process, dynamically tailoring voiceprint and content anonymisation to task-specific privacy and clinical utility requirements. Through recursive self-improvement (RSI), CASA iteratively evaluates and refines anonymisation strategies against task-specific privacy and clinical utility requirements, while learning from these outcomes to guide more efficient planning in subsequent clinical tasks. CASA is validated across 14 clinical tasks encompassing five languages, diverse elicitation paradigms, and mental health, cognitive and voice disorders. CASA preserved disease-related classification performance while meeting speaker-anonymisation requirements across all clinical tasks, versus only 8/14 for the strongest fixed method. Assessments of resistance to speaker re-identification by external attackers and identification and redaction of sensitive personal information in clinical speech further demonstrated CASA's dual protection of speaker identity and sensitive spoken content. Clinical expert assessments further supported the preservation of clinically relevant information and the acceptability of anonymised speech for controlled research sharing.
205. 【2611.10738】Matchability-Aware Conformal Prediction for Open-Ended Language Model Generation
链接：https://arxiv.org/abs/2611.10738
作者：Ilia Azizi
类目：Machine Learning (stat.ML); Computation and Language (cs.CL); Machine Learning (cs.LG); Methodology (stat.ME)
关键词：Large language models, produce calibrated uncertainty, calibrated uncertainty estimates, language models, produce calibrated
备注： Accepted at NeurIPS 2026. Project page: [this https URL](https://unco3892.github.io/caelum/)
点击查看摘要
Abstract:Large language models (LLMs) often do not produce calibrated uncertainty estimates for their answers. We propose CAELUM, a framework that builds semantic prediction sets while separating aleatoric from epistemic uncertainty. CAELUM samples answers using an ensemble of clarification prompts, clusters them by semantic equivalence, and estimates the aleatoric and epistemic components via kernel-based von Neumann entropy before calibrating nonconformity scores with split conformal prediction. We use a weight $w_\lambda(x)=1+U_{\mathrm{ale}}(x)+\lambda\,U_{\mathrm{epi}}(x)$ to control for the contribution of the epistemic uncertainty of each instance and fit a coefficient $\lambda^\star$ to minimize prediction set size. When the objective is nonflat and selection is stable across splits, $\lambda^\star$ could be a diagnostic, where large values may indicate epistemic dominance (retrieve, abstain) and $\lambda^\star\to 0$ aleatoric dominance (clarify). For individual queries, a log ratio $R(x)$ compares the weighted epistemic component with the aleatoric component. Theoretically, we demonstrate that the coverage is capped by matchability, the fraction of items whose reference answer appears in any sampled cluster. Empirically, this matchability can be predicted from the original question features using a lightweight classifier. We use those predictions to define a stratum and derive a conformal coverage bound within it. Across 30 LLM and dataset combinations (4-32B), mean coverage is 0.74 in the learned stratum versus 0.65 overall, averaged over the 78 evaluations using the learned classifier. Project page: this https URL
206. 【2611.10659】Pandemonium: Longform Target-Speaker Speech Recognition with Cross-Speaker Interactions
链接：https://arxiv.org/abs/2611.10659
作者：Alexander Polok,Dominik Klement,Ivan Medennikov,Antoine Laurent,Petr Pálka,Samuele Cornell,Shinji Watanabe,Sanjeev Khudanpur,Jagadeesh Balam,Jan Černocký,Lukáš Burget,Matthew Wiesner
类目：Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
关键词：Diarization-conditioned target-speaker ASR, Diarization-conditioned Whisper, target-speaker ASR, Diarization-conditioned target-speaker, multi-talker transcription
备注： Submitted to ICASSP 2027
点击查看摘要
Abstract:Diarization-conditioned target-speaker ASR (TS-ASR), in particular Diarization-conditioned Whisper (DiCoW), is an accurate and data-efficient approach to multi-talker transcription. It has, however, three structural limitations: the model transcribes each speaker independently, operates on short (30 s) windows, and optimizes its diarization and TS-ASR components separately. We address the first two. We integrate the diarization conditioning into a longform Parakeet backbone (DiCoP) and add cross-speaker attention, which lets the model attend across the speaker dimension so that speakers are no longer decoded in isolation, and an STNO mask refiner that re-estimates the diarization-derived conditioning. As conversational data with genuine multi-speaker interaction is scarce, we scale training with a pseudo-labeling pipeline that mines 5.4k hours of in-the-wild multi-speaker audio from YODAS2. Combining these with synthetic and real data yields state-of-the-art results across several meeting benchmarks. We open-source the resulting models, DiCoP and Pandemonium, and the pseudo-labeled data.
207. 【2611.10641】Same Contacts, Different Rooms:Meeting Format Shapes LLM Group Influence Beyond Pairwise Contact Counts
链接：https://arxiv.org/abs/2611.10641
作者：Zhexi Gu,Shusheng Cao,Runping Zhu
类目：Physics and Society (physics.soc-ph); Computation and Language (cs.CL)
关键词：LLM agent collectives, agent collectives, collectives usually summarise, summarise interaction, LLM agent
备注： 10 pages, 5 figures, 9 tables. Code: [this https URL](https://github.com/ZachGu-00/llm-meeting-format)
点击查看摘要
Abstract:Simulations of LLM agent collectives usually summarise interaction as a pairwise contact network. We test that summary with a contact-matched intervention: the members, their initial stances and every pairwise contact count stay fixed while the meetings are reorganised, and each member gives a one-step support readout after reading the arguments of everyone present. Across six open-weight LLMs and 14 debate topics, merging triads into five-person meetings (resize) moves group support more than reshuffling who meets in triads (regroup), although both move the same 60 dyadic exposures. The root-mean-square change is 4.36 versus 2.59 percentage points (pp), larger for resize in all six models and in 81 of 84 model-topic cells. Resizing also has a consistent direction: it amplifies the initial majority of the merged members by 1.72 pp, in every model, whereas regrouping has no direction (= 0.03 pp). A contact network cannot represent regrouping at all, yet pairwise rules applied meeting by meeting explain up to 76% of its effect, and with identical weights they raise resize R^2 by 0.51-0.58 for two models. We show that the gap between the two placements is an exact Jensen gap of the sigmoid readout, bounded by how much a member's predicted logits vary across meetings; this dispersion tracks the gap with log-log r=0.97 and tells a modeller when contact counts are a safe summary. Meeting format is a first-class variable for LLM social simulation.
信息检索
1. 【2611.12750】he Narrative Gap: Can LLMs Help Us Navigate Diverse Narratives Across Languages?
链接：https://arxiv.org/abs/2611.12750
作者：Nikhil Sharma,Kelly Marchisio,Kenton Murray,Ziang Xiao
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Information Retrieval (cs.IR)
关键词：Large language models, Large language, increasingly mediate, information, mediate how people
备注： NeurIPS 2026 Evaluations and Dataset Track
点击查看摘要
Abstract:Large language models (LLMs) increasingly mediate how people seek and consume information, including accounts that differ across languages and regions, especially on contested topics. Supporting diverse information seeking requires models to help users navigate competing narratives across languages and information streams. We define six capabilities necessary for diverse multilingual information seeking: three foundational capabilities for narrative inclusion, narrative exclusion, and missing narrative identification; and three higher-level capabilities for presenting diverse narratives, preserving narrative coverage under confirmatory queries, and maintaining information parity across languages. To guide the development of those information seeking capabilities, we introduce \textsc{NarrativeBench}, a benchmark comprising 1,333 news articles in 23 publication languages across 23 contested topics and 460 Reddit-grounded queries. Evaluating 14 LLMs across 24 query languages, we find that current models lack the capabilities needed to reliably navigate diverse narratives, limiting users' control over the perspectives they receive and leaving substantial gaps in exposure to competing accounts even when diversity is explicitly requested. Information access also differs across query framings and languages, risking echo chambers, linguistic filter bubbles, and information disparities that weaken the common ground needed for democratic discourse. \textsc{NarrativeBench} provides a foundation for developing information systems that give users across languages and regions agency to navigate diverse narratives.
2. 【2611.12731】NIFT-SQL: Customer-Supervised Table Scoring for Enterprise Text-to-SQL Retrieval
链接：https://arxiv.org/abs/2611.12731
作者：Arjun Rao,Nishant Gopinath
类目：Information Retrieval (cs.IR)
关键词：starts with finding, schema spans, hundreds of cryptic, Enterprise, NIFT-SQL
备注： 41 pages, 2 figures
点击查看摘要
Abstract:Enterprise text-to-SQL starts with finding the tables a question needs, which is hard when a schema spans several databases and hundreds of cryptic tables. We ask whether models trained separately on each customer's example questions, reading only table names, column names, and declared keys, improve table retrieval. NIFT-SQL (Necessity-Informed Fusion for Text-to-SQL) fuses hybrid search over a retriever fine-tuned on the customer's questions with a fine-tuned 560M cross-encoder that scores every table for whether the query needs it, through a logistic regression fitted on held-out questions. On BEAVER, LiveSQLBench, and LiveSQLBench-Large (244 to 971 tables; four splits, three trainings), NIFT-SQL places every reference table in the top 15 for 69.2%, 89.5%, and 85.6% of test questions, against 30.4%, 41.0%, and 21.8% for hybrid search and 61.1%, 81.7%, and 70.4% for the fine-tuned retriever with the same labels. With off-the-shelf search, the cross-encoder without fine-tuning is 21 points lower. A zero-shot 8B reranker needs no labels and, routed by database, shows no resolved complete@15 difference on two collections; adding its scores as two fusion features gives a high-accuracy mode that reaches 72.4%, 92.5%, and 88.6%, ahead of the validation-selected zero-shot reranker variant on two collections, with no resolved difference on the third. Rank fusion of the two trained parts, grouped by database, shows no resolved difference from the learned fusion. Scored once on a newer BEAVER release, NIFT-SQL beats search and leads the label-matched retriever at top 8 on the synthetic test, but trails it at top 15 on real questions.
3. 【2611.12725】Scaling Taxonomy-Free Image Labeling with Generative AI: A Multimodal
链接：https://arxiv.org/abs/2611.12725
作者：Zhenjie Zhang,Sainan Chen,Kshiteesh Hegde,Mengze(Irene)Li,Pouya Rezazadeh Kalehbasti,Munachim Ezema,Karina Sobhani
类目：Machine Learning (cs.LG); Information Retrieval (cs.IR)
关键词：Providing real-time multimodal, Providing real-time, real-time multimodal insights, requires low latency, high description accuracy
备注： 5 pages, 3 figures, 4th CJ Workshop at KDD 2025 ( [this https URL](https://sites.google.com/view/kddcjworkshop2025/accepted-papers) ), also related: [this https URL](https://arxiv-org.atlassian.net/servicedesk/customer/portal/2/MOD-93955)
点击查看摘要
Abstract:Providing real-time multimodal insights into images is challenging because it requires low latency, high description accuracy, and scalable solutions that are both cost-effective and efficient. For example, given a new image of an outfit, we would like to generate insights that the image depicts "earth tones" and "linen pants" and allow users to explore similar ideas along these themes. Traditional strategies to generate such insights would typically involve building taxonomies producing a golden set labeled by humans, training models on these datasets, and deploying these models for online inference services. Such workflows are constrained by fixed taxonomy, high labeling cost, limited labeling coverage in sample space, and human errors and expertise gaps in labelers. In addition, these methods are expensive and cumbersome to iterate over time. Recent trends have started exploring generative AI models for online insights, but this method suffers from long latency and prohibitive costs to support a high volume of requests or large amounts of offline labeling needs. We present Generative Labeling On Clusters (GLOC) as a solution to provide highly scalable, cost-effective, low latency, and high accuracy online image insight services. GLOC leverages highly optimized image embeddings to form image clusters that are semantically close to each other for the purpose of the type of insights, and summarizes the insights at the cluster level, which effectively generalizes to members in the cluster. At Pinterest, GLOC powers image descriptors and pivot query suggestions for Hybrid Search, which is a multimodal search service enabling users to search with both an image and a text query. Our offline and online A/B tests demonstrate that GLOC significantly outperforms previous methods, delivering improvements in quality and efficiency.
Comments:
5 pages, 3 figures, 4th CJ Workshop at KDD 2025 (this https URL), also related: this https URL
Subjects:
Machine Learning (cs.LG); Information Retrieval (cs.IR)
Cite as:
arXiv:2611.12725 [cs.LG]
(or
arXiv:2611.12725v1 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2611.12725
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
4. 【2611.12705】Multi-Agent Screening: What Agreement and Acceptance Cannot Tell You
链接：https://arxiv.org/abs/2611.12705
作者：Benjamin Chang,Dell Zhang
类目：Multiagent Systems (cs.MA); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：costly human assessor, agentic search, reviewing of papers, costly human, agents
备注：
点击查看摘要
Abstract:When AI agents screen items for a costly human assessor, as in agentic search, e-discovery and AI reviewing of papers, only what they pass gets judged. We show what each kind of evidence can establish about their errors, even with unlimited data. Agreement shows that agents concur, not that they are right, however many there are. Acceptance by the assessor gives precision but only a lower bound on recall. Knowing which agents found which relevant items gives an upper bound on recall if agents' finds are not negatively correlated, and caps what one more agent can add if agents are interchangeable. Without assumptions about the agents, recall can be pinned down only by judging items they did not pass: a random sample of these estimates how many relevant items were missed, to any chosen accuracy, and the sample needed does not grow with the number of agents.
5. 【2611.12313】Hidden Distances: How Likert-Scale Spacing Shapes Algorithmic Voting Advice
链接：https://arxiv.org/abs/2611.12313
作者：Thomas Broholt Knudsen,Christian Høst-Madsen,Vedran Sekara,Jonas L. Juul
类目：Computers and Society (cs.CY); Information Retrieval (cs.IR); Physics and Society (physics.soc-ph)
关键词：Voting Advice Applications, Voting Advice, Advice Applications, alpha, VAA
备注： 18 pages, 6 figures
点击查看摘要
Abstract:Voting Advice Applications (VAAs) are algorithmic recommenders that match voters with political candidates on policy preferences. They are widely adopted across many multi-party democracies; in Denmark, 62\% of eligible voters used a VAA ahead of the 2022 general election, and 45\% of VAA users reported following its advice. VAAs typically ask voters and candidates to respond to policy statements on a Likert scale, from ``strongly disagree'' to ``strongly agree'', and recommend candidates whose responses are closest to the voter's. Computing these distances requires assigning numbers to response options, a design choice without an empirical basis, since it is unknown how people perceive the distances between options. Here we show that this seemingly technical choice substantially changes whom voters are matched with. We parameterize the distance between ``(dis)agree'' and ``strongly (dis)agree'' relative to the distance between ``neutral'' and ``(dis)agree'' as $\alpha$, and quantify how it changes recommendations for a popular Danish VAA. We find that moving from equidistant options to doubling this distance can change $37.7\%$ of top candidate matches and $21.9\%$ of top party matches, although no answers change. Low $\alpha$-values favor candidates with strong positions, with some parties receiving up to $ 19.6\%$ more recommendations, while high $\alpha$-values favor moderates. Similarly, female candidates receive fewer recommendations at low $\alpha$ and more at high $\alpha$-values. Our findings demonstrate that undisclosed quantification choices in algorithmic recommenders can carry considerable electoral consequences, and they call for transparency and sensitivity analysis in VAA design. As Likert-based matching also underpins dating platforms and roommate allocation systems, these implications extend well beyond elections.
6. 【2611.12296】RecoGEM: A Serving System for Production-Scale Generative Recommendation
链接：https://arxiv.org/abs/2611.12296
作者：Xiangrui Yang,Yunfeng Zhao,Jiawei Yang,Fangyu Zhang,Enrui Zhao,Liang Zeng,Cheng Peng,Minhui Xie,Jiaqiang Liu,Xiao Liang,Yiming Qiu
类目：Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：moving industrial recommender, generating item identifiers, autoregressively generating item, Generative recommendation, industrial recommender systems
备注：
点击查看摘要
Abstract:Generative recommendation (GR) is moving industrial recommender systems (RecSys) from scoring candidate items to autoregressively generating item identifiers. This shift promises higher recommendation quality, but makes serving substantially harder: each request executes a short sequence of dependent decoding steps that explore a large item space and select promising candidates on the latency-critical path. GR not only creates structural mismatches with conventional RecSys pipelines, but also challenges the architectural and optimization assumptions of LLM serving stacks, making direct adoption of existing systems difficult. We present RecoGEM, our production GR serving system. RecoGEM uses a runtime--engine decoupling architecture to move GR-specific serving responsibilities, such as candidate-state transitions and live artifact updates, to a dedicated runtime. Its execution engine exploits GR's short token sequences, large candidate populations, and predictable step shapes to optimize self-attention, candidate selection, and execution planning. RecoGEM has been deployed for over nine months across our production lines, serving applications with hundreds of millions of users and supporting more than ten GR model families. On our OneModel production workloads, RecoGEM reaches over 1,000 QPS per serving instance with P99 latency below 35 ms and a 2.88$\times$ throughput improvement over representative baselines.
7. 【2611.12180】S-GEAR: Taobao Shangou GEnerative Ad Retrieval
链接：https://arxiv.org/abs/2611.12180
作者：Guofeng Tong,Xu Zhang,Guangliang Yu,Haiqiang Wang,Guannan Cong,Xing Guo,Yang Zhou,Jingjing Duan,Shuang Li,Feng Shi,Hualei Liu
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Uber Eats impose, Uber Eats, DoorDash and Uber, Eats impose, traditional e-commerce
备注：
点击查看摘要
Abstract:On-demand delivery platforms such as DoorDash and Uber Eats impose a constraint absent in traditional e-commerce: merchants beyond the user's delivery range are invalid candidates rather than merely low-ranked. Generative retrieval has recently shown strong potential in large-scale retrieval systems. Adapting it to this setting, however, poses three challenges. First, existing semantic IDs encode geography only as a soft signal, so reachability can only rely on a non-differentiable post-generation hard truncation. Second, user preferences vary substantially across both regions and queries, so aggregating historical behaviors without conditioning on geography and the current query yields biased interest estimates. Third, the retrieved candidate set is evaluated by its collective value, yet autoregressive training scores each sequence independently, with no set-level signal to discourage redundant near-duplicates. To address the challenges, we propose TS-GEAR, a unified generative retrieval framework for on-demand delivery: (1) Geo-Semantic ID splits merchant identifiers into geographic prefixes and semantic suffixes, making reachability a prediction target rather than a post-hoc filter; (2) Query-Geo Target Attention aggregates historical behaviors using the real-time query and location as dual targets, while encoding each behavior's own location into its attention key; (3) GMPO (Group Marginal Policy Optimization) rewrites advantages using a deduplicated group reward and marginal advantage within GRPO, avoiding auxiliary diversity objectives. Deployed online with a lightweight 0.1B backbone, TS-GEAR serves over 150 million queries per day in the search advertising pipeline of Taobao Shangou, consistently outperforming state-of-the-art generative retrieval methods on both HitRate and geographic validity, and achieving 3.8% gains in ad impressions and 4.2% in ad revenue.
8. 【2611.12097】Calibrating Document-Local Boundaries for Contextual Chunk Retrieval
链接：https://arxiv.org/abs/2611.12097
作者：Yuanxiang Wang,Hui Jiang,Da Zhu,Zhihua Chang
类目：Machine Learning (cs.LG); Information Retrieval (cs.IR)
关键词：Late Chunking encodes, Late Chunking, Chunking encodes, local retrieval units, preserving document context
备注： 11 pages, 5 figures
点击查看摘要
Abstract:Late Chunking encodes an entire document before pooling at chunk boundaries, preserving document context in local retrieval units. Chunk-level post-training improves context-dependent retrieval, but shared context can make semantically similar same-document negatives difficult to distinguish. We study the local decision boundary between a gold chunk and its hardest sibling. Starting from InSeNT, we analyze InSeNT's within-document gradients and show that the entropy of the conditional negative allocation decreases monotonically with the scaling factor at fixed logits. We propose a two-part framework for calibrating document-local chunk boundaries. The first component adapts the discriminative scale from within-document margins, while the second exposes chunk partitions to attention during document encoding. Experiments on ConTEB and NanoBEIR show that the resulting model improves contextual chunk retrieval across the evaluated encoder settings while retaining competitive passage-level retrieval quality; ablations further characterize the distinct roles of adaptive scaling and chunk-aware routing.
9. 【2611.11955】CHO-Bench: How Do Context Hints Affect Ad Rankings in LLM Advertising?
链接：https://arxiv.org/abs/2611.11955
作者：Shiqi Zhang,Yang Fei,Xiaokui Xiao
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：explicit product searches, selects advertisements based, user conversations, diverse user conversations, product searches
备注： 11 pages, 6 figures, 4 tables
点击查看摘要
Abstract:LLM advertising selects advertisements based on user conversations, where user needs may extend beyond explicit product searches. ChatGPT Ads allows advertisers to provide natural-language context hints describing what they offer, who may find it useful, and when it may be useful, as additional information for ranking advertisements across diverse user conversations. However, how to effectively construct these hints remains unclear. We formulate Context Hint Optimization (CHO) as the problem of constructing context hints to improve an advertisement's ranking under a given budget. Drawing on established marketing frameworks, we develop seven context hint generation strategies covering What, Who, and When, along with a Unified strategy that combines all seven dimensions. We introduce CHO-Bench and conduct over 1.19 million paired evaluations across five datasets using embedding-based and LLM-based rankers. Our results show that context hints improve advertisement rankings under the evaluated offline rankers. While individual strategies achieve similar average gains and Unified offers no consistent advantage, strategy differences become more pronounced under specific generation-ranking configurations, with embedding-based and LLM-based rankers favoring different information dimensions. Increasing the hint budget further improves rankings with diminishing marginal gains. These findings establish an offline benchmark for studying ad-side ranking optimization in LLM advertising and highlight opportunities for model-specific hint selection and budget-aware generation and aggregation.
10. 【2611.11886】Multi-Modal Agricultural Document Understanding at the DAGRI Task
链接：https://arxiv.org/abs/2611.11886
作者：Zhefan Wang,Da Li,Keping Bi,Nanqing Dong
类目：Information Retrieval (cs.IR)
关键词：critical knowledge resources, prefectural technical reports, crop calendars, knowledge resources, prefectural technical
备注：
点击查看摘要
Abstract:Agricultural documents, such as prefectural technical reports and crop calendars, are critical knowledge resources. However, their complex table layouts, significant variations in document length, and dense multi-modal elements pose substantial challenges for automated understanding. To address these issues, the NTCIR-19 DAGRI (Data Analytics for aGRicultural Information) task introduced three subtasks focusing on different dimensions of document intelligence. In the Table Information Extraction (TableIE) task, we developed a multi-stage pipeline combining structure-preserving parsing via MinerU, region-adaptive segmentation for long documents, and a dual-modal (vision-text) extraction strategy for complex work schedules. This approach achieved first place with an exact match score of 0.6566. For Multi-Table Multi-Hop Question Answering (MTMH-QA) over interrelated JSON tables, we adopted an agentic search framework utilizing DCI-Agent to iteratively explore directories via bash commands, reinforced by a cross-model validation mechanism. This yielded a revised accuracy of 0.8444, initially ranked first. In the Figure and Table Question Answering (FiT-QA) task, which requires comprehending single large composite images, we implemented a dual-modal VLM pipeline enhanced by deterministic answer normalization, securing the highest BLEU score. Together, our system effectively addresses regional structural variations, dynamic cross-file evidence discovery, and multi-modal alignment, providing a robust framework for complex agricultural document understanding.
11. 【2611.11801】Proactive Dimension-Adaptive Denoising for Graph Collaborative Filtering via Representation Coherence
链接：https://arxiv.org/abs/2611.11801
作者：Wenjun Li,Dong Zhao,Jiaying Shi,Juan Zhang,Zhaoming Pan,Zhimin Zhang
类目：Information Retrieval (cs.IR)
关键词：Implicit feedback, contaminate learned representations, accidental clicks, impulse purchases, feedback in recommender
备注： code available at [this https URL](https://github.com/GordonDongZHAO/NDL)
点击查看摘要
Abstract:Implicit feedback in recommender systems contains noisy interactions (e.g., accidental clicks, impulse purchases) that propagate through user-item graphs and contaminate learned representations. Existing explicit denoising methods uniformly rely on training loss to estimate interaction reliability. However, loss is a fundamentally passive signal: it detects noise only after it has caused prediction errors, and it is heavily confounded by training stage, negative sampling, and hard positives. We propose Noise-aware Dimension Learning (NDL), a proactive dimension-adaptive denoising framework. NDL introduces Representation Coherence Detection (RCD), which evaluates the coherence between an interaction representation and the user's historical preference centroid in embedding space, providing an active noise signal independent of loss. RCD and the loss signal are fused via activity-aware weighting (active users rely more on coherence while cold-start users automatically fall back to loss), and the fused estimate drives an interaction-level dimension-adaptive mask that limits the effective representation capacity of unreliable interactions. A lightweight contrastive regularizer further improves embedding uniformity, stabilizing the geometry on which RCD discriminates. On three public benchmarks NDL consistently outperforms state-of-the-art denoising methods, lifting Recall@5 by +17.95% on Amazon-book, +12.33% on Yelp, and +5.63% on MovieLens-1M over the strongest baseline DAR; the core variant without contrastive learning already surpasses DAR on sparser datasets, confirming representation coherence as the primary driver of these gains. NDL is confined to the training loop and is serving-compatible with LightGCN-based production pipelines, adding no online latency or parameters at inference time. Code: this https URL
12. 【2611.11549】Not All Branches Are Equal: Adaptive Semantic ID Construction for Generative Recommendation
链接：https://arxiv.org/abs/2611.11549
作者：Guy Hadad,Haggai Roitman,Bracha Shapira
类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：models represent items, recommendation models represent, models represent, sequences of discrete, semantic IDs
备注： RecSys '26
点击查看摘要
Abstract:Generative recommendation models represent items as sequences of discrete tokens known as semantic IDs. Existing approaches derive these identifiers using residual or hierarchical vector quantization, assuming that tokens carry independent semantic meaning across quantization levels. Revisiting this assumption, we argue that semantic IDs should behave as hierarchical paths where each token's meaning is conditioned on its prefix. This highlights a mismatch between conventional fixed-codebook quantization and the hierarchical structure implicitly learned by generative recommenders. Motivated by this insight, we propose Adaptive Silhouette Tree (AST), a top-down divisive clustering method that constructs semantic IDs as paths within a tree structure. Unlike prior methods with fixed branching factors, AST dynamically determines the number of branches at each node by maximizing the silhouette coefficient, enabling finer partitions in dense regions and compact groupings in homogeneous ones. We further introduce constrained variants that enforce minimum probability mass during splitting to improve supervision for long-tail items. Extensive experiments on five Amazon Review datasets of varying sizes and domains show that AST significantly outperforms strong baselines. These results demonstrate that aligning semantic ID construction with the inherent hierarchical structure of generative recommenders leads to more effective recommendations.
13. 【2611.11480】Beyond Ranking: Are Decision Models Calibrated Relevance Scorers?
链接：https://arxiv.org/abs/2611.11480
作者：Shengyao Zhuang,Xueguang Ma,Matthias Petri,Jimmy Lin
类目：Information Retrieval (cs.IR)
关键词：Jev, relevance scorer, Decision models, textual relevance levels, relevance
备注：
点击查看摘要
Abstract:Decision models such as Jev are a new kind of relevance scorer. Their typed score primitive takes a question, an ordered set of textual relevance levels and a state, and returns a probability for each level directly, rather than token likelihoods or generated labels. Jev's vendor promises that these probabilities are calibrated. This motivates revisiting 'Beyond Yes and No', which improved zero-shot pointwise LLM reranking using likelihood-derived scores over fine-grained relevance labels but left calibration against human assessors as future work. In this paper, we first reproduce its open-model FLAN-UL2 setting on eight BEIR collections, confirming its ranking trends, and then run Jev and two open-weight decision models with the same protocol. Jev and the 27B pplx-decider rerank ahead of FLAN-UL2 and three cross-encoders on average. We then compare Jev's native probabilities with the human assessors' labels and find them overconfident: of the DL21 pairs it scores above 0.9, only 66% are relevant. Since this is mostly an error of scale, a two-parameter calibration fitted on 2,257 DL19 pairs removes much of it and transfers to DL21. After calibration, Jev has a lower DL21 Brier score than FLAN-UL2 and the three cross-encoders, mainly because it separates relevant from non-relevant pairs better. Finally, with calibrated probabilities, choosing each query's cut-off by expected F1 needs no parameter of its own, beats a fixed top-10 cut and matches a cut-off threshold tuned on DL19.
14. 【2611.11396】Search-by-Answer Bias in Retrieval Models
链接：https://arxiv.org/abs/2611.11396
作者：Adiel Avigad,Shauli Ravfogel,Yoav Goldberg
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：query semantic specification, semantic specification, meant to select, match a query, query semantic
备注： 17 pages, 9 figures
点击查看摘要
Abstract:Dense retrievers are meant to select passages that match a query's semantic specification. We show they suffer from search-by-answer bias: they favor passages that mention answer objects the model knows (scores as likely), over passages that support valid alternative answers. We test this with controlled factual contrasts from LAMA/TREx. For each retriever, we measure how strongly the model scores the canonical object over an alternative object using a token-prediction head, and ask whether this score predicts passage rankings. Across eight retrievers, including DPR, Spider variants, Contriever, E5, and Qwen3-Embedding, larger token-prediction scores consistently predict higher retrieval scores for passages containing the corresponding object. This holds when passages differ only in the answer object, and even when the passage that mentions the high-scoring object expresses a wrong relation. Dense retrieval thus exhibits search-by-answer bias during passage selection, shaping which evidence is retrieved.
15. 【2611.11346】IntentLens: Grounding Underspecified Multimodal Queries for Recommendation via Tool-Augmented Reasoning
链接：https://arxiv.org/abs/2611.11346
作者：Xiao Chen,Dong Fang,Haitao Li,Qing Li
类目：Information Retrieval (cs.IR)
关键词：intelligent personal assistants, real-world scenarios, passive preference matching, intelligent personal, personal assistants
备注： NeurIPS 2026
点击查看摘要
Abstract:As intelligent personal assistants are increasingly deployed in real-world scenarios, recommendation paradigms are shifting from passive preference matching to inferring user intent from underspecified multimodal inputs. In practical interactions, users typically issue a reference image paired with a vague natural language query, keeping key visual attributes, personalized preferences, and item-side constraints implicit. Existing recommendation methods either leverage historical user interactions augmented with multimodal item features or assume fully articulated textual queries; both paradigms struggle to resolve underspecified multimodal queries for accurate item matching. To address this limitation, we propose IntentLens, a tool-augmented recommendation framework that grounds ambiguous multimodal queries into query-relevant evidence prior to user-item matching. IntentLens follows a ground-then-rank pipeline: a shared multimodal LLM leverages visual tools, user memory modules, and item attribute retrieval tools to (i) infer latent user intent from image-text inputs and (ii) augment each candidate item with fine-grained, query-conditioned evidence. Subsequently, a lightweight ranker scores candidates based on the grounded representations. To facilitate research in this novel setting, we construct two benchmarks with underspecified multimodal queries, namely \textsc{GoogleReview-MMTool} and \textsc{Yelp-MMTool}. Extensive experiments on these benchmarks demonstrate that IntentLens outperforms competitive MLLM and retrieval baselines, and exhibits strong generalization to unseen categories and datasets.
16. 【2611.11278】An Adaptive, Context-Aware, and Stacked Attention Network-Based Recommendation System to Capture Users' Temporal Preference
链接：https://arxiv.org/abs/2611.11278
作者：Jung-Hsien Chiang,Chung-Yao Ma,Chi-Shiang Wang,Pei-Yi Hao
类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：users' preferences, Recommendation, preferences, recommendation system, users'
备注： 12 pages. Accepted version of the article published in IEEE Transactions on Knowledge and Data Engineering. Code: [this https URL](https://github.com/solitude6060/An-Adaptive-Context-Aware-and-Stacked-Attention-Network-Based-Recommendation-System)
点击查看摘要
Abstract:Recommendation systems have become more important since the widespread use of the Internet. The large amount of information means that it is difficult for users to discover they really need. However, users' preferences can change over time because of the age and the impact of social networks. Recommendation systems must capture users' preferences and recommend suitable items, which is a difficult challenge. This study proposes a novel recommendation system that adapts to the changing preferences of users. By learning and adapting to users' changing preferences better recommendations are provided. This study uses context factors as additional information to model users' preferences more precisely. For the proposed recommendation system, the context is based on users' interaction items within each defined time interval. This study proposes two novel attention mechanisms for the recommendation system. The contextual item attention module captures contextual information, changing pattern in users' preference and the importance of items. The multi-head attention module extends the diversity of users' preferences and adapts to changing preferences. The recommendation performance is improved using additional item's temporal information to model the contextual item's representation. Experiments compare the proposed algorithm with several state-of-the-art recommendation methods using three real-world datasets. The experimental results demonstrate that the proposed context-aware recommendation model outperforms traditional methods and demonstrate the effectiveness with which contextual information is captured by the attention mechanism.
17. 【2611.11197】Dhara: Evidence-Oriented Retrieval for Indian Knowledge Systems
链接：https://arxiv.org/abs/2611.11197
作者：Avinash Holenarasipur Nagendra,Anand Kaniyaar Sriranga Prasad,Rahul Vishwakarma,Trupti Gavit,Anish Amol Tipnis,Yashaswini Mandayam Rangayyan,Vinod Appajanna,Kousik Sarathy Sridharan,Mohan Raghavan
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：Indian Knowledge Systems, Knowledge Systems, Indian Knowledge, Fuzzy Verse Retrieval, Relevant evidence
备注： 19 pages. Supplementary material (24 pages) is provided as a separate ancillary PDF
点击查看摘要
Abstract:Relevant evidence in Indian Knowledge Systems (IKS) collections may be distributed across passages in different parts of a work, including verses, translations, and commentaries. Locating it requires matching natural-language questions and partially remembered verse fragments to source passages. We present Dhara, a retrieval engine combining hybrid search, chapter- and book-level Entity Notes (EN), Fuzzy Verse Retrieval (FVR), and neural reranking. Five comparisons on the 325 questions in Dhara Bench examine retrieval representations against BM25, EN's contribution, reranker quality and computation time, FVR, and Gemini. BGE-M3 single-vector retrieval exceeds BM25 in nDCG@10, Recall@20, and MRR@20 across all categories. Its scores are broadly comparable to ColBERTv2, with mean retrieval times of 0.108 s and 0.962 s under the same hardware configuration and a smaller memory footprint for chunk storage on disk. Adding EN to a direct branch with a matched candidate count improves nDCG@10 in all twelve categories with Qwen and ten with BGE; the combined ranking is capped at the same candidate count. Qwen improves nDCG@10, Precision@5, and MRR@20 over BGE in every category, at approximately 6.72 times the overall estimated serial computation time. FVR increases Verse-category nDCG@10 by approximately 20 percentage points with either reranker. Gemini is evaluated after source mapping and manual review with relevance annotations visible. The Qwen pipeline with EN and FVR has higher Recall@20 than Gemini in ten categories and stronger complete-evidence retrieval in Multi-hop questions, while Gemini retains early-relevance advantages in several categories. The results inform retrieval choices according to evidence requirements and resource budgets.
18. 【2611.11113】PCG-RAG: Progressive Compositional Grounding for Retrieval-Augmented Generation in Complex Web Question Answering
链接：https://arxiv.org/abs/2611.11113
作者：Linyao Zheng,Xuhang Shi,Zhifang Mao,Chongqi Qu,Xiuquan Hou
类目：Information Retrieval (cs.IR)
关键词：Complex Web question, Complex Web, identify target entities, long Web pages, requires retrieval-augmented generation
备注：
点击查看摘要
Abstract:Complex Web question answering requires retrieval-augmented generation (RAG) systems to identify target entities from multi-clue descriptions and connect evidence scattered across long Web pages. Individual pages often support only some of the required semantic constraints, while clues discovered on one page guide subsequent searches on others. However, premature reliance on partially supported entity hypotheses can divert retrieval from the original information need. RAG systems must therefore use partial evidence to guide further searches while seeking the evidence needed to establish the intended entities. We propose PCG-RAG, a novel RAG framework based on Progressive Compositional Grounding (PCG). Progressive Evidence Acquisition directs subsequent searches toward missing evidence for candidate attributes and relations. Compositional Reasoning separates candidate-guided retrieval from evidence-based answering along a directed acyclic graph (DAG) of subquestions. Provisional names make dependent searches specific, while answering tasks use accepted results and unresolved identifying conditions, assessed against the original question. New passages connect the identifying clues to the requested relations, supporting evidence-based downstream answers. Evidence Grounding combines identifying and relational source passages with supported intermediate answers, connecting evidence across Web pages to the original conditions during final generation. On BrowseComp-Plus and WebWalkerQA, PCG-RAG improves accuracy over the leading compared baselines by 5.43 and 5.15 percentage points, respectively.
19. 【2611.11031】Hybrid Product Search Without the Copy: Lexical, Semantic and Filtered Retrieval Served Directly from a Data Lake
链接：https://arxiv.org/abs/2611.11031
作者：Raghvendra Yadav,Xiang Fu,Chinmay Soman
类目：Machine Learning (cs.LG); Databases (cs.DB); Information Retrieval (cs.IR)
关键词：E-commerce catalogs increasingly, Apache Iceberg metadata, catalogs increasingly live, metadata over Parquet, E-commerce catalogs
备注： 6 pages. Submitted to ISIR-eCom 2026 (workshop at IEEE BigData 2026)
点击查看摘要
Abstract:E-commerce catalogs increasingly live in lakehouse tables: Apache Iceberg metadata over Parquet files in object storage. Product search, however, still runs on copies of that catalog, in a lexical engine and a vector database, each with its own ingestion pipeline, schema, staleness window and bill. We show that search applications can be hosted directly on the data lake, with the lakehouse table as the single system of record. We extend Apache Pinot, a real-time OLAP engine that already serves Iceberg tables in place, with BM25 relevance scoring over its Lucene text index, corpus-wide term statistics so that scores are comparable across files, and reciprocal rank fusion in plain SQL; a real-time table fed by a stream can sit behind the same table, merged by the broker. On the Amazon ESCI benchmark (1.2M US products, 22,458 test queries), hybrid search served from the lake matches exact retrieval (nDCG@10 .361). The lake table is queryable 149 s after its files are registered, and a lake commit is searchable in 3.8 s, close to indexing directly into a search engine. On a brand-sorted lake of 277M products (0.8 TB), one 16-vCPU node answers brand-scoped vector, BM25 and client-fused hybrid searches in 6.5-9 ms (p50), sustains 1,100 vector and 635 BM25 searches per second at under 180 ms p99, and makes a commit searchable in 4.3 s. Search adds only its indexes: no copy of the catalog, no sync pipeline and no second schema, which cuts storage, rebuild time and the operational work of keeping copies consistent.
20. 【2611.11016】RoutingTrie: Metadata Routing for Constrained Generative Retrieval
链接：https://arxiv.org/abs/2611.11016
作者：Darshan Fofadiya,Yang Liu,Shuying Sun,Kyumin Park,Juhana Kangaspunta
类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：brought generative retrieval, large language models, Advances in large, semantic IDs, generative retrieval
备注：
点击查看摘要
Abstract:Advances in large language models and semantic IDs (SIDs) have brought generative retrieval (GR) into industrial applications. These systems must return items that satisfy request metadata constraints as well as relevance requirements. A catalog trie ensures SID validity, but filtering metadata only after generation wastes computation on rejected candidates and may leave too few eligible results. We propose RoutingTrie to incorporate metadata constraints before beam selection. RoutingTrie maintains one shared SID trie and builds a compact index for each metadata field using Dense Bitset or Sparse List. We derive a storage cost formula to guide the choice between these index representations for different field distributions. During decoding, field probes determine whether requested values occur below candidate edges and produce a combined mask that guides beam selection. Experiments on ShopTrie, our configurable synthetic benchmark, demonstrate compact storage and efficient CPU and GPU probing across diverse metadata distributions. In a production replay, RoutingTrie raises Hit@100 from 67.5\% to 96.1\%, a gain of 28.6 percentage points, with only 1.1 ms latency increase. We will release the ShopTrie generator, benchmark scripts, and RoutingTrie CPU and Triton GPU implementations to support reproducibility.
21. 【2611.11013】Slim Foundation Models for Latency-Critical Recommendation Serving
链接：https://arxiv.org/abs/2611.11013
作者：Danyal Aftab,Anas Zafar,Assadig Abakr,Steven Davy
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：Click-through rate, advertising systems, core component, component of recommendation, recommendation and advertising
备注：
点击查看摘要
Abstract:Click-through rate (CTR) prediction is a core component of recommendation and advertising systems. Large language models (LLMs) offer rich semantic priors that improve prediction quality, particularly in cold-start and long-tail settings. Injecting a full-scale LLM into a CTR pipeline is, however, prohibitively expensive at inference time: existing LLM-enhanced CTR methods avoid this cost by caching LLM outputs offline rather than serving the LLM online. We propose a resource-efficient pipeline, SlimFM, that makes online LLM-based semantic modeling practical: (1) dependency-aware structured pruning compresses LLaMA3-8B by 44% to a 4.5B-parameter backbone; (2) LoRA-based field-aware fine-tuning trains the pruned model to produce discriminative field-level semantic embeddings from lightweight textual prompts; (3) a semantic-guided fusion module injects these embeddings into the feature interactions of a conventional CTR model. Across four datasets and six CTR backbones, SlimFM retains over 99% of uncompressed-model accuracy while reducing inference latency by up to 3.4x relative to existing LLM-enhanced baselines.
22. 【2611.11010】Lightfoot: Graph Retrieval-Augmented Generation with Exact, Model-Free Document Deletion
链接：https://arxiv.org/abs/2611.11010
作者：Uday Allu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Graph-based retrieval-augmented generation, improves multi-hop question, multi-hop question answering, comparisons rarely measure, research comparisons rarely
备注： 9 pages, 1 figure. Code: [this https URL](https://github.com/udayallu-ml/Lightfoot-GraphRAG)
点击查看摘要
Abstract:Graph-based retrieval-augmented generation (GraphRAG) improves multi-hop question answering, but deployed systems face two costs that research comparisons rarely measure: building the graph, and removing documents from it. We present Lightfoot, a GraphRAG system in which every entity, link, fact and synonym edge is a deterministic function of per-passage extractions carrying chunk-level provenance. Indexing makes one language-model call per passage, retrieval makes none, and deleting a document is a database operation with no model calls. On the full 11,402-passage MuSiQue corpus we verify that, after deleting 10% of the documents, the graph is identical to a fresh index of the surviving documents. We compare Lightfoot with HippoRAG 2, LightRAG and fast-graphrag under identical extraction, answer and embedding models on MuSiQue, 2WikiMultiHopQA and HotpotQA. Lightfoot builds the cheapest index on all three datasets, 26-31% below HippoRAG 2 and 3-6x below LightRAG and fast-graphrag. Against HippoRAG 2 it is significantly better on MuSiQue retrieval (+2.8 points recall@5 and +4.3 recall@10 on a held-out split) and on HotpotQA answers (+7.7 points exact match), and significantly worse on 2WikiMultiHopQA (-3.9 recall@2, -8.4 F1). Deleting the same documents took LightRAG 2,187 model calls and 3.7 hours; fast-graphrag has no deletion path. Code and per-question results: this https URL
23. 【2611.10977】DM-Call: Decision-Model-Guided Function Calling with Cumulative Verification Feedback
链接：https://arxiv.org/abs/2611.10977
作者：Minhyeong Yu,Wonduk Seo,Seunghyun Lee
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Software Engineering (cs.SE)
关键词：Large Language Models, requires Large Language, calling requires Large, Language Models, Large Language
备注： 4 tables, 2 figures
点击查看摘要
Abstract:Reliable function calling requires Large Language Models (LLMs) to select appropriate functions and generate arguments consistent with user intent. However, syntactically valid calls may still be semantically incorrect due to inappropriate function selection or mismatched arguments. In this paper, we propose Decision-Model-Guided Function Calling (DM-Call), a framework that combines local schema validation with separate decision-model verification of function selection and argument correctness. For rejected candidates, DM-Call accumulates verification probabilities, binary judgments, and schema errors across attempts. A hybrid feedback representation further combines numerical probabilities with verbal correctness labels to guide iterative refinement without executing external tools. Extensive evaluation across BFCL and API-Bank (first-call) demonstrates DM-Call boosts function-calling accuracy versus direct generation, at modest additional cost.
24. 【2611.10922】A Tool for Anonymized Clinical Knowledge Retrieval and Speaker Interaction Analysis of Healthcare Tele-mentoring Sessions
链接：https://arxiv.org/abs/2611.10922
作者：Parthaw Goswami,Erfan Zareei,Amy Vogelsmeier,Dima Dandachi,Ben Casterline,Mirna Becevic,Praveen Rao
类目：Information Retrieval (cs.IR)
关键词：Community Healthcare Outcomes, Extension for Community, Project ECHO, Healthcare Outcomes, Community Healthcare
备注：
点击查看摘要
Abstract:We present a tool for anonymized retrieval of clinical knowledge and analysis of multi-speaker interactions in tele-mentoring sessions of Project ECHO (Extension for Community Healthcare Outcomes). Our tool's novel design includes: (a) a compound metadata filter that enforces strict speaker- and session-level isolation during retrieval, preventing cross-session context contamination; (b) MedGemma-4B as a locally-hosted language model for clinically grounded answer generation across three query modes; (c) interaction graphs to compute betweenness centrality, PageRank influence, and turn-taking patterns to quantify participation equity; and (d) a consistent alias-based anonymization scheme that prevents real participant names from appearing in any rendered output. During the demo, a healthcare provider (user) will interactively query multi-year ECHO sessions, explore participation dynamics through interaction graphs, compare sessions side-by-side, and assess answer quality via six reference-free RAG metrics, all without any cloud API dependency.
25. 【2611.10715】From User Behaviors to Satisfaction Judgments: Reasoning about User Satisfaction with AI Overviews
链接：https://arxiv.org/abs/2611.10715
作者：Xingzhu Wang,Yitong Xu,Yue Li,Daiting Shi,Jingzhou He,Jiaxin Mao
类目：Information Retrieval (cs.IR)
关键词：effective evaluation essential, everyday search makes, growing presence, makes their effective, satisfaction
备注：
点击查看摘要
Abstract:The growing presence of AI overviews in everyday search makes their effective evaluation essential. Response quality has been the primary focus of existing evaluation research, with only a small number of studies examining the user perspective. These evaluations rely on queries and response content, leaving the information conveyed by user behavior insufficiently utilized. This work investigates satisfaction prediction for AI overviews from a user-centered perspective and incorporates behavioral signals into the prediction process. Applying existing behavior-based satisfaction prediction methods from traditional information retrieval to this setting, however, presents limitations. We address these limitations with STaRS, an LLM-based approach designed specifically for predicting satisfaction with AI overviews. At its core is a structured reasoning procedure: individual behavioral signals are interpreted first, and their implications then inform the prediction of user satisfaction. Reinforcement learning further optimizes this procedure, while a reward shaping mechanism alleviates reward sparsity during training. Evaluation on two real-world datasets demonstrates that STaRS outperforms the comparison methods in satisfaction prediction, providing search providers with a practical means of accurately estimating users' satisfaction with AI overviews.
26. 【2611.10681】Formalizing Patient-Set Semantics for OMOP CDM-Based Clinical Trial Feasibility Assessment:A Neuro-Symbolic Methodology for Traceable Site-Feasibility Patient Counts
链接：https://arxiv.org/abs/2611.10681
作者：Sohyeon Jeon
类目：Information Retrieval (cs.IR)
关键词：Common Data Model, OMOP Common Data, natural-language eligibility criteria, site-feasibility patient-count estimation, OMOP CDM data
备注：
点击查看摘要
Abstract:This study examines the interpretation and execution of natural-language eligibility criteria for clinical trial site-feasibility patient-count estimation using the OMOP Common Data Model (CDM). It treats each count as the size of a patient set produced under explicitly declared choices about clinical concepts, temporal conditions, exclusions, proxies, and available data. The study presents NS-CoT, a neuro-symbolic pipeline that uses an LLM to interpret and structure criteria, followed by symbolic processing and deterministic SQL compilation. Intermediate representations and execution records document how criteria are translated into patient sets and counts. Evaluation uses synthetic OMOP CDM data, controlled benchmarks, and a multi-site simulation. Comparisons with a direct-SQL baseline examine execution success, count agreement, patient-set agreement, and preservation of reference-defined site-feasibility labels and rankings. Performance varies across evaluation settings. Layer-wise inspection also supports the identification of implementation and policy errors, followed by correction and re-evaluation. The work investigates the reviewability and fidelity of cohort computation relative to declared reference definitions. It does not establish that these definitions capture a unique clinical ground truth or demonstrate improved recruitment, site selection, or trial outcomes in practice.
Subjects:
Information Retrieval (cs.IR)
Cite as:
arXiv:2611.10681 [cs.IR]
(or
arXiv:2611.10681v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2611.10681
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Sohyeon Jeon [view email] [v1]
Sat, 7 Nov 2026 11:54:35 UTC (4,818 KB)
27. 【2611.10613】Clinical Evidence-Guided Residual Learning for Medication Recommendation with Dynamic DDI Regularization
链接：https://arxiv.org/abs/2611.10613
作者：Zesheng Li,Chengchang Pan,Honggang Qi
类目：Machine Learning (cs.LG); Information Retrieval (cs.IR)
关键词：patient-specific treatment evidence, combine patient-specific treatment, Medication recommendation, treatment evidence, patient-specific treatment
备注： 13 pages, 6 figures, 8 tables. Supplementary PDF and detailed result tables are included as ancillary files. Code: [this https URL](https://github.com/LIZESHENG13/EviDrug)
点击查看摘要
Abstract:Medication recommendation must combine patient-specific treatment evidence with the interaction structure of a prescription. The central challenge is to determine which evidence supports each medication and how strongly to regularize interactions while preserving predictive quality. We propose EviDrug, a clinical evidence-guided residual learning framework. Its clinical-memory backbone integrates a self-trained visit-aware encoder, training-case memory and one medication-set interaction block to establish a patient-specific prescription. A gated refinement head combines the backbone states with clinical associations and history-conditioned medication identities through bounded logit corrections. Drug-drug interaction (DDI) feedback adapts regularization strength using training-query predictions. Across MIMIC-IV, NWICU and SICdb, EviDrug leads twelve published-method baselines in AP, F1 and Jaccard, improving AP by 2.26, 2.06 and 1.71 percentage points over the strongest comparator. These gains come at lower parameter and runtime costs than MetaDrug. Matched controls demonstrate DDI reductions with stable predictive quality. Code is available at this https URL.
28. 【2611.10576】When Greedy Is Sorting: Exact and Certified Ideal Rankings for Novelty Metrics
链接：https://arxiv.org/abs/2611.10576
作者：Kehan Liu,Zhaoyun Chen,Xianquan Yan
类目：Information Retrieval (cs.IR)
关键词：nDCG evaluators approximate, normalizes novelty metrics, compute in general, nDCG evaluators, alpha
备注：
点击查看摘要
Abstract:The ideal ranking that normalizes novelty metrics is NP-hard to compute in general, so widely used $\alpha$-nDCG evaluators approximate its denominator with a greedy rule that rescans every remaining document at each rank. We identify a regime in which this ideal ranking is exact and cheap for both $\alpha$-DCG and intent-aware expected reciprocal rank (ERR-IA). When each document is positively judged for at most one intent, each metric reduces to the classical allocation of a fixed budget across chains of decreasing marginal gains. A metric-specific virtual-score transformation followed by a multiway merge, which we call ChainMerge, returns the globally optimal top-$K$ ranking in $O(G+K\log G)$ time from $G$ preordered intent groups, or in $O(n+K\log G)$ time from $n$ globally preordered candidates, instead of the $\Theta(nK)$ of the greedy rule. When intent judgments overlap, exact $\alpha$-DCG optimization is NP-hard under the standard logarithmic discount and $\alpha=0.5$, even when every document has three intents and every intent occurs in two documents. For arbitrary overlap, a polynomial-size LP over nested ranking prefixes upper-bounds the ideal score and certifies the optimality gap of any feasible ranking. In the official TREC Web 2009-2012 judgments, 64.8% of positive documents serve a single intent, yet only 20 of 198 complete queries do so throughout. Beyond this exact regime, the LP certifies 189 of the 198 greedy denominators as globally optimal, and the resulting score intervals preserve the winner in all eight matched comparison groups. On 65,238 MIND-small candidates, ChainMerge returns identical optimal objectives 17-1,011 times faster than the greedy rule. For $\alpha$-DCG, these results trace the hardness of the ideal ranking to intent overlap.
29. 【2611.10538】Close and Sort: Exact Maximum-Likelihood Aggregation of Cyclic Rank-Two Preferences
链接：https://arxiv.org/abs/2611.10538
作者：Kehan Liu,Zhaoyun Chen,Xianquan Yan
类目：Data Structures and Algorithms (cs.DS); Information Retrieval (cs.IR); Machine Learning (cs.LG); Machine Learning (stat.ML)
关键词：Pairwise probabilities arise, weighted Kemeny problem, LLM evaluation, Pairwise probabilities, human or LLM
备注： 10 pages, 3 figures, 5 tables. Accepted at the 20th ACM International Conference on Web Search and Data Mining (WSDM 2027). Code: [this https URL](https://github.com/sarinstein-yan/close-and-sort)
点击查看摘要
Abstract:Pairwise probabilities arise in rank aggregation, recommendation, and human or LLM evaluation, yet converting them into a maximum-likelihood list is a weighted Kemeny problem and is NP-hard in general. Known exact algorithms for rank-two tournaments use only comparison signs and do not optimize this likelihood. We show that the weighted problem is exactly solvable when the skew-symmetric log-odds matrix $W_{ij}=\log(p_{ij}/p_{ji})$ has rank two, including when the induced preferences contain cycles. Writing $W_{ij}=\det(h_i,h_j)$ and adding the closing vector $h_0=-\sum_i h_i$ turns the objective into twice the signed area of a closed polygon. This geometry yields CloseSort, which polar-sorts the $n+1$ edge vectors, cuts after $h_0$, and returns a global maximum-likelihood order in $O(n\log n)$ time from the factors. The same geometry identifies the runner-up and gives a stability certificate beyond exact rank two. When the smallest determinant $\delta$ of two consecutive edges in the closed angular cycle is positive, it is exactly the best-to-runner-up log-likelihood gap. For $W=W_0+E$, the CloseSort order of $W_0$ has regret at most $\sum_{ij}|E_{ij}|$ on $W$ and remains optimal whenever this sum is below $\delta$, a worst-case tight threshold. In 5,120 determinant-logit simulations, increasing the observations per pair from 4 to 64 raises the fraction on which rank-two projection outperforms the empirical plug-in optimum from 68.6% to 85.7%. On 3,600 Arena-Hard LLM-judge profiles drawn from 63 systems and ten judges, the leading rank-two component captures 89.2% of the log-odds energy. On profiles containing a directed majority triangle, CloseSort reduces normalized regret by 44% relative to Borda and improves the mean normalized objective over each of eight baselines. With factors supplied, it is 8,407 times faster than exact dynamic programming on 18-item rankings.
30. 【2611.10414】rack or Follow? A Jev-Compatible Multi-Agent Trading System When Web News Lags the Market
链接：https://arxiv.org/abs/2611.10414
作者：Yebo Feng,Guangyan Gan,Liangrui Pan,Ruichao Liang,Cong Wu,Jiahua Xu,Yang Liu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Information Retrieval (cs.IR); Trading and Market Microstructure (q-fin.TR)
关键词：LLM agents increasingly, agents increasingly trade, listed firms, Web, LLM
备注：
点击查看摘要
Abstract:LLM agents increasingly trade on the Web news they read, yet much Web news about listed firms is published after, and about, the price move it reports, so a reader can agree with the market by following it instead of reading the event. We ask whether LLM judgments of Web news track the market's reaction to the reported event or follow it. To answer, we built a multi-agent trading system whose agents share only point-in-time stores and answer typed questions through the interface of Jev, a hosted typed decision model; code sets every position under a proved bound on how far text can move it. In a hash-committed test of a Jev-compatible reader built from a pinned LLM's option probabilities, item judgments track announcement-window abnormal returns (weekly Spearman 0.119), also after the LLM's release, and event types agree with the issuers' 8-K filings (AUC 0.833); Jev's judgments of news published after its own release track the reaction as well (descriptive). Exploratory analyses show where the association comes from: 72% of earnings news items appear after the issuer's filing, contributor-written items often report the price move, and from the first trade after publication the association falls to 0.023. At a weekly horizon, the confirmatory test detects no rank information over code-only features. Under attack, decision cards traced 88% of successful attacks to the planted item. We propose that market-graded tests of Web-text readers report the criterion from publication, not only from the event.
31. 【2611.10405】Yuanbao-Reranker: Document-Grounded Synthesis and Preference Distillation for Text Reranking
链接：https://arxiv.org/abs/2611.10405
作者：Hongyuan Xu,Dezhi Ye,Jiahao Cao,Jie Liu,Haijin Liang,Haibo Shi,Jin Ma
类目：Information Retrieval (cs.IR)
关键词：High-precision text reranking, agentic retrieval-augmented generation, High-precision text, modern search, retrieval-augmented generation
备注： 23 pages, 6 figures, 7 tables
点击查看摘要
Abstract:High-precision text reranking is a critical component in modern search, recommendation, and agentic retrieval-augmented generation (RAG) systems. We present Yuanbao-Reranker, a family of general-purpose dense rerankers spanning 0.6B, 4B, and 8B parameter scales built upon the Qwen3 backbone. To construct diverse and reliable ranking supervision at scale, we pair answer-first and query-type-guided document-grounded synthesis with a three-stage curation funnel that verifies positive support, eliminates semantic redundancy, and enforces balanced source-by-length quotas. For each curated pair, we screen real retrieval pools with a teacher score margin to filter out potential false negatives and sample Hard, Medium, and Moderate negative tiers, yielding 2.75M $1{:}3$ ranking groups. We train the models by jointly optimizing pointwise relevance cross-entropy and a bounded minimum-gap hinge objective over both positive--negative and negative--negative pairs. This formulation transfers fine-grained teacher preferences across candidate tiers without over-constraining well-separated predictions, supporting both cross-scale and same-scale distillation followed by layerwise adaptive model merging. Across five comprehensive benchmarks spanning Chinese (CMTEB-R), multilingual (MMTEB-R), English (BEIR), long-document (MLDR), and code (MTEB-Code) retrieval, Yuanbao-Reranker consistently leads every parameter tier: the 0.6B variant reaches 70.96 Avg. to surpass 1B--4B active-parameter baselines, the 4B variant reaches 73.63 Avg. to outperform the 8B teacher (72.68), and the 8B variant achieves a state-of-the-art 74.21 Avg., with substantial gains generalizing across distinct first-stage retrievers.
32. 【2611.10357】LEGIT: Live Eligibility Gating over Identifier Tries for Constrained Decoding of Heterogeneous Pages
链接：https://arxiv.org/abs/2611.10357
作者：Felix Fang,Zheng Liu,Robert Saliba
类目：Information Retrieval (cs.IR); Machine Learning (cs.LG); Performance (cs.PF)
关键词：Uber Eats search, short token sequence, recommends by generating, Uber Eats, Eats search engine
备注： 22 pages, 11 figures, 18 tables. Under review
点击查看摘要
Abstract:A generative recommender names each candidate with a short token sequence, a Semantic ID, and recommends by generating those tokens. Some generative recommenders, including the Uber Eats search engine we are building, write a whole results page, stores with their menu items, in one decoding pass. Every Semantic ID on such a page must name a real store or item that is eligible for the search, such as a store that delivers to the user's location, and that is not already on the page. Each item must also belong to the store above it. A trie over the catalog keeps identifiers real, but eligibility and repetition change with every request and token, and the grammar-constrained decoder we tried could not enforce these changing rules exactly and quickly. We call this constraint LEGIT, for live eligibility gating over identifier tries. Numbering trie leaves depth first turns each rule into a range lookup over one store trie and one item trie, and every generated page passes an independent catalog check. On one NVIDIA B200 GPU with one or two requests per decode step, a direct implementation that walks the trie on the GPU makes each token about 5 times as slow as unconstrained decoding. Across 36 implementations, hardware counters and ablations are consistent with kernel launches and CPU-GPU waits as the source of this slowdown. Our fastest implementation walks the trie on the CPU while the GPU runs the model, needs no custom kernel, and cuts time per output token by 65.9 percent against the direct GPU implementation, to about 1.7 times the unconstrained cost. This implementation is also the fastest on a page layout that puts each item before its store.
33. 【2611.10356】SepLRM: A Foundation Model Paradigm for Recommendation
链接：https://arxiv.org/abs/2611.10356
作者：Di Chen,Xijun Xiao,Qin Ren,Weijiang Lai,Zhijian Pan,Zhentao Pan,Pengfei Nie,Cheng Yuan,Zixuan Tan,Xuyang Liu,Tao Wang,Yunwen Huang,Hao Fang,Yichao Wang,Hao Zhang,Siyuan Wu,Hao Chen,Han Diao,Mingyu Yang,Yongkang Feng,Beihong Jin,Jinfeng Yang,Deping Xie,Peng Xu,Zheng Chai,Yuchao Zheng
类目：Information Retrieval (cs.IR)
关键词：Large recommendation models, behavior sequence length, Large recommendation, scaling behavior sequence, model capacity
备注：
点击查看摘要
Abstract:Large recommendation models (LRMs) improve recommendation performance by scaling behavior sequence length, model capacity, and training compute. However, the return on investment (ROI) of continued scaling deteriorates as marginal gains diminish and long-sequence encoding costs rise, especially when this computation is repeatedly executed by distinct models for diverse recommendation stages and business scenarios. To address this issue, we propose SepLRM, a recommendation foundation model (RFM) paradigm that identifies reusable sequence encoding and reorganizes multiple end-to-end (E2E) LRMs into one RFM and multiple independently optimized vertical models (VMs). The RFM adopts an encoder-decoder architecture and exports its final-layer encoder state as the shared key-value (KV) cache that is independent of downstream task-offered candidates. Unlike candidate-specific logits or aggregated user embeddings, the KV cache preserves fine-grained behavioral information. Separation at this native KV interface also allows each VM to construct candidate-conditioned queries while retaining the same query-KV interaction as its E2E counterpart, enabling high-fidelity capability transfer. To ensure both transfer effectiveness and system efficiency, we co-design cache compression, the training and serving workflows, and LG-Store, a distributed storage system for KV caches. Experiments on three large-scale datasets show that SepLRM achieves state-of-the-art offline performance with a transfer rate of approximately 100%. It also demonstrates strong transferability across model iterations, recommendation stages, and business scenarios. Deployment in two large-scale industrial scenarios substantially improves the ROI of sequence scaling and delivers consistent gains in online A/B tests at ByteDance.
34. 【2611.10349】SituRecBench: Evaluating Frontier Models as Situated Recommendation Assistants in 3D Environments
链接：https://arxiv.org/abs/2611.10349
作者：Jingtong Yang,Dongding Lin,Jian Wang,Wenjie Li
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：static retrieval engines, Recommender systems, systems are transitioning, transitioning from static, static retrieval
备注： Accepted by NeurIPS 2026 Evaluations and Datasets Track
点击查看摘要
Abstract:Recommender systems are transitioning from static retrieval engines into interactive assistants grounded in physical environments. However, current studies largely neglect the combined complexities of spatial navigation, visual grounding, and multi-turn social interaction. To bridge this gap, we introduce SituRecBench, an interactive benchmark for evaluating frontier vision-language models (VLMs) as situated recommendation assistants within high-fidelity 3D environments. We reformulate recommendation as a situated assistance process in which an assistant interacts with a user while sharing the user's egocentric view. Our benchmark simulates real-world shopping environments (e.g., supermarkets and home furnishings stores), requiring assistants to elicit preferences, ground recommendations in the environment, and guide the user to relevant locations through dialogue. The benchmark evaluates dialogue quality, recommendation utility, and navigation effectiveness through a unified interactive protocol. Extensive experiments reveal persistent challenges in spatial grounding and preference elicitation, highlighting limitations in their ability to integrate global contextual information with local observations. SituRecBench provides a rigorous foundation for advancing the development of situated assistants in the real world.
35. 【2611.10158】Edge-Deployable LLMs for Classification and Value-of-Information Ranking of Disaster-Related Tweets
链接：https://arxiv.org/abs/2611.10158
作者：Christopher D. Molek,K. Brent Venable,Niranjan Suri,Stephen Russell
类目：Information Retrieval (cs.IR)
关键词：disaster relief decisions, rely on noisy, disaster relief, social media, relief decisions
备注： 6 pages, 6 figures, 1 table, IEEE MILCOM 2026
点击查看摘要
Abstract:Humanitarian-aid and disaster relief decisions often rely on noisy, incomplete, and uncertain information from social media. Although substantial research has focused on automating the classification of such data, limited work has examined whether individual posts contain sufficient information to support decisions to act. In this study, we use large language models (LLMs) to (1) classify social media content and (2) assess its Value-of-Information (VoI) in terms of operational actionability. We evaluate seven LLMs for the classification of 77,484 tweets across 10 humanitarian-aid categories and identify the Qwen3 (8B parameters) model as the top-performing classifier, achieving the highest F1 scores in all but one category. In a second task, the classified categories serve as contextual inputs for assessing VoI with respect to responder actionability across six well established metrics for each tweet. We observed that the Gemma 3 (4B parameters) model outperformed the other models on this task, achieving the highest recall across the majority of categories. This work demonstrates that relatively small, edge-deployable LLMs can prioritize actionable information in resource-constrained environments. By integrating VoI assessment, our framework advances the automated elicitation of high-utility knowledge from unstructured social media streams for disaster-response decision-making and highlights a pathway toward tactical edge applications using LLMs that fit on a single 8 GB GPU.
计算机视觉
1. 【2611.12886】Reframe: Observation-Aligned Multi-Teacher On-Policy Distillation for Agentic Visual Reasoning
链接：https://arxiv.org/abs/2611.12886
作者：Haozhi Yuan,Handong Li,Yifan Zhang,Qianshan Wei
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：offer complementary routes, Agentic reinforcement learning, Agentic reinforcement, multi-teacher on-policy distillation, offer complementary
备注：
点击查看摘要
Abstract:Agentic reinforcement learning (RL) and multi-teacher on-policy distillation (MOPD) offer complementary routes to post-training. For visual agents, however, tool use presents two related challenges. Models may overlook useful tool-returned observations, while poorly grounded actions can limit the evidence available for subsequent distillation. We introduce Reframe, a post-training framework that treats the observation state, rather than only the output distribution, as an object of alignment. First, Ground-Drop-GRPO (GD-GRPO) trains spatial and temporal specialists with evidence-aware rewards and stochastic removal of the original visual input, encouraging them to acquire grounded evidence and use the returned observations. Second, Observation-Gated-MOPD (OG-MOPD) replaces deficient tool actions with canonical ones mid-rollout and resumes distillation from the repaired observation. The two stages complement each other, as learning to rely on tool-returned observations can help the policy benefit from observation repair. Neither stage requires a task-specific SFT cold start. Extensive experiments over 14 image and video benchmarks demonstrate that Reframe outperforms both Mix-RL and vanilla MOPD. Ablation results show that GD-GRPO increases observation dependence and tool gain compared with outcome-based GRPO.
2. 【2611.12885】World In-Context Learning for Agentic Robot Manipulation
链接：https://arxiv.org/abs/2611.12885
作者：Heng Fang,Zehui Guo,Yuehan Zhang,Mingyang Du,Dingkang Liang,Xiang Bai
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：matched trained policies, Trained action policies, skill into network, World In-Context Learning, write manipulation skill
备注： Project Page: [this https URL](https://ArcheOne-AI.github.io/RoboScript)
点击查看摘要
Abstract:Trained action policies write manipulation skill into network weights, tying what is learned to the distribution it is learned from. In-context learning (ICL) avoids this coupling but has not matched trained policies, because a demonstration recorded in another scene carries no feedback from the world the robot currently faces. We observe that what an agent learns in context is semantic, recording task steps and object roles rather than visual appearance, so experience gathered in one world transfers to another. Based on this insight, we propose World In-Context Learning (WICL), a paradigm in which a frozen model starts from a demonstration, rehearses the task in a world such as a simulator, and writes the feedback into its context rather than its weights. We build RoboScript, a modular infrastructure that implements WICL for agentic manipulation. From a single demonstration, RoboScript learns each task through rehearsal in simulation, freezes the learned knowledge as a Task Memory, and deploys the frozen memory on new scenes with data isolation that ensures every deployment input is available on a real robot. On all 50 tasks of RoboTwin 2.0, RoboScript reaches 83.4% mean success across clean and randomized settings with one demonstration per task and no gradient updates, exceeding the strongest trained action policy by over 20 points. The method generalizes across visual distributions, improves through reflection, scales with the foundation model, and transfers to a physical dual-arm robot through cross-embodiment memory adaptation. With a world in the loop, a robot can learn a manipulation task in its context as well as it learns one in its weights. All code is available at this https URL
3. 【2611.12884】Guiding Data Allocation for Robust Subpopulation Generalization
链接：https://arxiv.org/abs/2611.12884
作者：Zhaoying Pan,Yipei Wang,Shenyu Lu,Xiaoqian Wang
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：Machine learning models, achieve high average, Machine learning, test data due, high average accuracy
备注： NeurIPS 2026
点击查看摘要
Abstract:Machine learning models often achieve high average accuracy in the training data while performing poorly on test data due to subpopulation shift. A common data-centric solution is to enforce balanced subgroup proportions, but full balance can be costly, infeasible, and not always necessary. In this work, we study whether balanced training data is the unique optimal configuration for robust subpopulation generalization. We extend a Gaussian feature-model framework to theoretically characterize the performance landscape across general training subgroup distributions. We show that multiple configurations, including substantially imbalanced ones, can perform comparably to the balanced one. We further derive gradient-based directions for adjusting subgroup proportions to improve adjusted accuracy and worst-group accuracy more efficiently. These findings suggest that strategically allocating data offers a more flexible and principled path to robust performance than simple balancing. The code is available at this https URL.
4. 【2611.12883】Beyond Modality Preference: Controlling Multimodal Arbitration under Modality Conflict in MLLMs
链接：https://arxiv.org/abs/2611.12883
作者：Zhaoying Pan,Shenyu Lu,Jun Hui Wong,Junyi Chai,Xiaoqian Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal large language, large language models, Multimodal large, language models, integrate information
备注： WACV 2027
点击查看摘要
Abstract:Multimodal large language models (MLLMs) integrate information across modalities, but become unreliable when those modalities disagree. Under conflicting inputs, MLLMs may favor modalities that are not the most reliable for the task, thus motivating inference-time control of modality arbitration. We identify a small set of attention heads, termed arbitration heads, that causally influence whether predictions follow visual or textual evidence. Building on this, we introduce a lightweight, training-free intervention that biases these heads toward a designated trusted modality at inference time. The identified heads are stable across calibration set sizes and generalize across settings, and steering them enables effective bidirectional control of modality reliance across diverse benchmarks. Our findings identify an effective control mechanism to align MLLM predictions with task-specified modality priorities. The code is available at this https URL.
5. 【2611.12879】Grasping the Future: Joint 3D Hand-Object Forecasting From Internet Videos
链接：https://arxiv.org/abs/2611.12879
作者：Rustin Soraki,Matthew Wallingford,Ryan Aby,Brandon Chee,Jason Ren,Ali Farhadi,Homanga Bharadhwaj,Roozbeh Mottaghi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：move, motion, interactions, object, tasks
备注：
点击查看摘要
Abstract:To interact with an object, we need to anticipate both how it will move and how our hands should move with it. Human videos capture these relationships across everyday activities, offering a natural source for learning to predict future interactions. Learning from them requires recovering motion from completed interactions and using it to anticipate what could happen next. We present $\textit{Grasping-the-Future}$, a unified generative model of joint 3D hand-object motion, including wrist motion, finger articulation, and object position and orientation. Through masked spatiotemporal completion and flow matching, we train a single model for several prediction tasks: forecasting future interactions, predicting hand motion given object motion or vice versa, generating both trajectories toward a desired final object pose, and completing partially observed interactions. We explicitly model hand-object relations and incorporate contact constraints to help preserve grasp relationships during motion. To obtain 3D supervision from internet videos, we develop a scalable pipeline that combines pretrained perception models with joint geometric optimization to reconstruct completed interactions. We combine these recovered trajectories with annotated interaction datasets as training data for all tasks. We demonstrate strong performance across all tasks, outperforming released forecasters on datasets with 3D annotations. Moreover, we show geometric and physical plausibility of the predicted trajectories by retargeting them to a robotic embodiment. Videos are available at this https URL.
6. 【2611.12875】Click3R: Interactive Stereo 3D Reconstruction with Sparse Correspondence Clicks
链接：https://arxiv.org/abs/2611.12875
作者：Hao Gu,Jin Yao,Zezhou Cheng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：irrevocable prediction, impressive progress, reconstruction models produce, reconstruction, models produce
备注： NeurIPS 2026. Project page: [this https URL](https://uva-computer-vision-lab.github.io/click3r/)
点击查看摘要
Abstract:Despite impressive progress, existing feed-forward large 3D reconstruction models produce a single, irrevocable prediction. When these models fail, there is no mechanism to correct their mistakes. To address this limitation, we introduce Click3R, a framework for interactive geometric correction of feed-forward models using sparse human correspondence clicks. Given an image pair and a small set of cross-view point correspondences provided by a user, Click3R injects geometric constraints into the 3D reconstruction networks through a lightweight point correspondence adapter, enabling the model to resolve ambiguities in challenging scenarios such as repetitive textures, symmetric structures, large viewpoint changes, or textureless regions. To evaluate interactive reconstruction, we curate a challenging benchmark specifically designed to expose failure modes of existing feed-forward 3D reconstruction methods. Experiments show that Click3R reduces reconstruction error with as few as a single correspondence click, improving performance on both standard and our curated benchmarks. Our results highlight that sparse human interaction provides an effective and practical mechanism for correcting geometric reconstruction errors.
7. 【2611.12870】SWAM: Scaling World Action Models with Cross-Modal Alignment
链接：https://arxiv.org/abs/2611.12870
作者：Yu Zhou,Xinyuan Xia,Xuankun Yang,Yinghao Yang,Wendi Chen,Bowen Liu,Jianhan Ma,Weicheng Duan,Jun Lv,Cewu Lu,Yanwei Li
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：World action models, jointly predict video, World action, models jointly predict, jointly predict
备注：
点击查看摘要
Abstract:World action models jointly predict video and actions conditioned on language. Existing studies focus primarily on architectures and training mechanisms, typically treating language-video alignment acquired through video pretraining as an established foundation. However, introducing action learning may impair this alignment. Principled guidance on data and supervision design for maintaining language-video alignment during action learning remains limited. To investigate this, we curate a pool of approximately 47,000 hours of general videos, egocentric videos, UMI demonstrations, and robot demonstrations. Building on this, we systematically study how language-video supervision, language-video-action supervision, and the joint use of these two forms affect WAM performance. In particular, we examine how language annotation quality affects pretrained language-video capabilities, and how action supervision from UMI and robot demonstrations extends these capabilities to language-video-action modeling. To better scale the model, we further conduct detailed studies on joint training recipe and model architecture. Under a fixed training budget, mixing egocentric videos and UMI demonstrations improves control generalization. Model architecture affects how effectively these experiences are used, while scaling pretraining under the selected configuration brings further gains. The resulting recipe, post-trained on RoboTwin Clean demonstrations only, achieves success rates of 88.10% and 61.56% under Easy (Clean-to-Clean) and Hard (Clean-to-Random) conditions, respectively. Our model achieves 40.00% SR across three real-world tasks, compared with 23.33% for the strongest baseline, indicating better generalization under unseen conditions. We release the curated data, training code, and model weights.
8. 【2611.12855】AI-based characterization of lymphoid structures and the tumor microenvironment reveals lower mature tertiary lymphoid structures, lymph-node follicles, and plasma cells after neoadjuvant therapy in lung squamous cell carcinoma
链接：https://arxiv.org/abs/2611.12855
作者：Arne Schmidt,Justin Nieder,Cornelius Boehm,Julika Ribbat-Idel,Marius Teodorescu,Marie-Lisa Eich,Simon Schallenberg,Gabriel Dernbach,Katja Lingelbach,Miriam Haegele,Timo Milbich,Adam Narai,Maria Stoelben,Hans Pinckaers,Lukas Ruff,Kai Standvoss,Christian Watermann,Christiane Kuempers,Sven Perner,Verena Sailer,Jasmin Tiebach,Torsten Goldmann,Sebastian Marwitz,Johannes Braegelmann,Frederick Klauschen,Marija Pezer,Rosemarie Krupar
类目：Computer Vision and Pattern Recognition (cs.CV); Quantitative Methods (q-bio.QM)
关键词：germinal centre-bearing tertiary, centre-bearing tertiary lymphoid, plasma cell, plasma cell density, lymph node follicles
备注：
点击查看摘要
Abstract:Mature, germinal centre-bearing tertiary lymphoid structures (TLS) and mature lymph node follicles (secondary lymphoid structures, SLS) sustain the plasma cell response that shapes outcome and immunotherapy benefit in lung cancer. How this loco-regional axis differs between neoadjuvant-treated and therapy-naive tumors is poorly defined. We analyzed HE whole-slide images of resected tumors and paired proximal and distal lymph nodes from matched neoadjuvant-treated (neoLUSC, n=20) and therapy-naive (naivLUSC, n=20) lung squamous cell carcinoma (LUSC) patients. Aignostics Atlas HE Tissue Analysis (HETA) models quantified cell densities per tissue compartment and cell-cell co-localization; a dedicated deep-learning model validated against pathologist annotations detected TLS and SLS and graded their maturity. Prognostic value was tested in an independent cohort (n=458; 46 treated). In neoLUSC tumors, stromal plasma cell density was 72% (p=0.004) and stromal lymphocyte density 48% (p=0.015) lower than in naivLUSC; macrophages and granulocytes did not differ significantly. Total and immature TLS did not differ, whereas mature TLS in the tumor (p=0.034) and mature SLS in the tumor-distal lymph node (p=0.003) were lower in neoLUSC patients. Peri-TLS plasma cell density correlated with tumor lymphocyte density in naivLUSC (rho=0.54, p=0.017) but not in neoLUSC tumors (rho=0.07). In the validation cohort, stromal plasma cell density (HR 0.69, p=0.011) and lymphocyte-plasma cell co-localization (HR 0.66, p=0.004) were associated with longer survival, and neoadjuvant status with shorter survival (HR 1.50, p=0.026). Neoadjuvant therapy is thus associated with fewer mature lymphoid structures and weaker coupling of the humoral compartment to the tumor rather than uniformly lower immune readouts. The stromal plasma cell/co-localization axis is a candidate prognostic biomarker.
9. 【2611.12852】What kills $v$-prediction? A Patch-wise PCA Perspective on Pixel-Space Flow Matching
链接：https://arxiv.org/abs/2611.12852
作者：Tianze Luo,Haofeng Huang,Yuan Yao
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Latent Diffusion Models, Diffusion Models dominate, Models dominate generative, Latent Diffusion, Diffusion Models
备注： Accepted as a Spotlight paper at NeurIPS 2026. Our code is available at [this https URL](https://github.com/THUMAI-Lab/RiT)
点击查看摘要
Abstract:Latent Diffusion Models dominate generative modeling but face two-stage training complexity and the inherent reconstruction limits of pre-trained autoencoders. Pixel-space Flow Matching offers a simplified end-to-end alternative yet often encounters training difficulties when using the standard $v$-prediction objective. Recent research attributes this difficulty to the off-manifold nature of noised targets, motivating a shift toward $x$-prediction. In this paper, we investigate this explanation through patch-wise Principal Component Analysis (PCA) and identify a bandwidth bottleneck. The velocity in minor components is largely determined by the raw noisy input, requiring deep backbones to preserve information that competes with principal-component modeling. Through controlled experiments and representation analysis, we further examine why $x$-prediction remains effective: its parameterization provides a raw-input bypass, while its learned input representation can spontaneously concentrate on principal directions. Under low-rank observations, our analysis of the induced flow characterizes $x$-prediction as an implicit conditional-mean decoder, reconstructing discarded components from the retained information. These observations motivate the Raw-injected Transformer (RiT), which combines a lightweight raw-conditioned decoder with an output-side shortcut to separate semantic modeling from raw-state propagation. Our method restores effective $v$-prediction and achieves competitive performance on ImageNet $256\times256$, providing a perspective on the interaction between prediction objectives and architectural bandwidth.
10. 【2611.12805】2D Gum-Net: Unsupervised Dense Elastic Image Registration via Symmetric Correlation and Spectral Pooling
链接：https://arxiv.org/abs/2611.12805
作者：Aarya Bhave,Anushka Ajay Bhave
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：learning-based approaches face, Dense non-rigid registration, ground-truth deformation fields, Dense Spatial Transformer, pixel-wise deformation field
备注： 19 pages, 11 figures, 3 tables. Accepted at the NewInML Workshop at the 40th Conference on Neural Information Processing Systems (NeurIPS 2026)
点击查看摘要
Abstract:Dense non-rigid registration, the recovery of a pixel-wise deformation field that warps one image into geometric agreement with another, is fundamental across medical imaging, structural biology, and correspondence estimation, yet learning-based approaches face a severe bottleneck: ground-truth deformation fields are notoriously difficult to obtain for real data. We present 2D Gum-Net, an end-to-end architecture that predicts dense elastic deformation fields fully unsupervised. We transfer the Geometric Unsupervised Matching Network (Gum-Net), originally developed for 3D subtomogram alignment in cryo-electron tomography, to 2D elastic registration: all three modules are redesigned in 2D, and the rigid transformation head is replaced by a Dense Spatial Transformer that regresses a sparse control-point grid, lifted to a full-resolution field $\Phi$ by bicubic interpolation. Downsampling uses DCT spectral pooling, implemented as frozen-basis matrix multiplications ($\approx 50\times$ GPU speedup), preserving the fine, quasi-periodic structure that max and average pooling destroy. We evaluate on contact-based fingerprints, a challenging testbed for this task: locally self-similar ridge patterns make correspondence maximally ambiguous, skin pressed against a sensor generates authentic large-displacement elastic distortion, and minutiae act as precise landmarks through which an independent matcher externally verifies the topological correctness of predicted fields. Trained purely on synthetic impressions and evaluated zero-shot on real benchmarks, our method improves structural correlation by up to 15.7% on FVC2004 and raises genuine match scores under an independent matcher while leaving imposter scores essentially unchanged. This suggests that the predicted deformations restore true structure without fabricating correspondences.
11. 【2611.12798】Complementarity-Driven Dual-Teacher Hierarchical Alignment for Zero-Shot EEG-to-Image Retrieval
链接：https://arxiv.org/abs/2611.12798
作者：Lukun Wu,Jie Li,Ziqi Ren,Ruiyang Xia,Yan Gao,Xinbo Gao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：pretrained vision foundation, Decoding visual information, vision foundation models, Decoding visual, hierarchical visual information
备注： 13 pages, 11 figures
点击查看摘要
Abstract:Decoding visual information from EEG is central to brain--computer interfaces and brain-inspired intelligence, and contrastive alignment with pretrained vision foundation models (VFMs) has become the dominant paradigm. However, existing methods align EEG solely with CLIP-family VFMs, leaving hierarchical visual information in neural responses under-exploited. To address this gap, we formulate a mechanism-paradigm correspondence view linking hierarchical visual processing (from appearance to semantics) to the complementary biases of cross-paradigm VFMs, with image-only models (e.g., DINO) and image--text models (e.g., CLIP) capturing distinct facets of this hierarchy. Guided by this view, we propose the Dual-Teacher Hierarchical Alignment (DTHA) framework. Concretely, a shared EEG encoder is supervised by frozen multi-blur CLIP and shallow DINOv2 teachers via dual-branch contrastive alignment, so each branch fully supervises the visual cues it emphasizes. A fused-retrieval objective learns adaptive weights to combine their complementary visual representations for zero-shot EEG-to-image retrieval. For the shared EEG encoder, we introduce the Attentive Modulated Scalp-Pattern Bank Encoder (AMSPBE), combining temporo-spatial attention with a learnable scalp-pattern bank for accurate, interpretable visual feature extraction, while modeling regional temporal dynamics and filter-bank topographies. On THINGS-EEG zero-shot retrieval, DTHA achieves 92.4% Top-1 accuracy, exceeding prior state of the art by 12.4 percentage points. Spatial, spectral, and representational-similarity analyses, together with THINGS-MEG evaluation, validate DTHA's effectiveness, biological plausibility, and cross-modality generalization. This complementarity-driven perspective shows that supervision from cross-paradigm VFMs enables more complete extraction of hierarchical visual information from brain activity.
12. 【2611.12777】Anchor Behavior, Not Parameters: Rehearsal-Free Continual Learning with a Single Shared Prompt
链接：https://arxiv.org/abs/2611.12777
作者：Duy-Cuong Bui,Trung-Anh Dang,Vincent Nguyen,Duc V. Le,Ngoc-Son Vu
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：Prompt-based continual learning, continual learning adapts, frozen pre-trained vision, pre-trained vision transformer, Prompt-based continual
备注： Accepted at WACV 2027
点击查看摘要
Abstract:Prompt-based continual learning adapts a frozen pre-trained vision transformer by tuning a small set of prompt tokens. Recently, one-prompt methods which share one single prompt across all tasks make this paradigm maximally parameter efficient. The open question is how a shared prompt can keep the knowledge of old classes while being updated for new ones. Existing methods protect old knowledge in parameter space, where they freeze task-specific prompts, expand new components, or sparsely gate which tokens receive gradients. However, this method sacrifices plasticity, yet the drift it still permits in shared tokens can corrupt the prompt's function on past classes. What must be preserved is the prompt's behavior. We propose TEA-Prompt, which couples (i) a token evaluation module that assigns each prompt token a continuous, input-conditional relevance score injected into the attention logits, softly specializing tokens across tasks without discarding any of them, and (ii) an attention-behavior anchoring loss that constrains each token's attention output around class-specific query regions using only compact Gaussian query statistics without stored old images, weighted by the token's past relevance. Anchoring the attention value allows the parameters to continue updating freely, as long as their interaction remains unchanged. TEA-Prompt achieves state-of-the-art accuracy with markedly lower forgetting on CIFAR-100, ImageNet-R, and CUB-200 with only 0.38M parameters. Code is publicy available at this https URL
13. 【2611.12739】Plant Orbiter: 3D Plant Reconstruction and Generation with Video Diffusion Orbit Cameras and 3D Gaussian Splatting
链接：https://arxiv.org/abs/2611.12739
作者：Zane K. J. Hartley,Yong En Kok,Lewis A. G. Stuart,Andrew P. French,Michael P. Pound
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Modern digital phenotyping, phenotyping pipelines require, morphological plant traits, Modern digital, high throughput acquisition
备注： Submitted to Plant Phenomics. 16 pages, 6 figures, 5 tables
点击查看摘要
Abstract:Modern digital phenotyping pipelines require the precise measurement of a range of 3D morphological plant traits. The accurate, high throughput acquisition of these traits helps breeders and researchers accelerate the development of new varieties, techniques and products. Recent advances in 3D technologies have enabled a rapid transition from 2D to 3D pipelines, but high throughput acquisition of digital 3D twins of plants remains a significant challenge due to complex morphology, thin structures and occlusions. In this paper we present Plant Orbiter, a new approach to generating 3D plants that leverages recent advances in video diffusion to produce high quality 3D Gaussian Splats of plants from a single image. We show that our method more accurately recreates plant morphology than other state-of-the-art methods, achieving the highest 3D F-score against all baselines, while being more practical for high throughput pipelines due to easier alignment and reduced cost of camera placement. Combined with a 2D diffusion model, we show that our method also achieves state-of-the-art results in the generation of 3D plant models from a text prompt.
14. 【2611.12727】OptiCover: A Scalable and Multi-Surface Framework for Cold-Start Visual Optimization under Semantic Constraints
链接：https://arxiv.org/abs/2611.12727
作者：Guillaume Guy,Mihajlo Grbovic,Joe Mills,Selen Uguroglu,Liwei He,Pratiksha Kadam,Nalini Kartha,Qian Aria Li
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Selecting an effective, effective cover photo, e-commerce marketplaces, critical yet understudied, understudied problem
备注： Accepted at GRAIL 2026: Workshop on Generative, Retrieval-augmented, and Agentic Intelligence for Personalization, co-located with CIKM 2026, Rome, Italy
点击查看摘要
Abstract:Selecting an effective cover photo is a critical yet understudied problem in visual merchandising for e-commerce marketplaces. On Airbnb, hosts upload many photos depicting different rooms, amenities, and points of interest, but must manually choose a single static cover photo that is reused across heterogeneous product surfaces. This creates substantial challenges: over 90\% of listing photos have no engagement labels, leading to a severe cold-start regime; guest preferences vary across surfaces and search intents, and visually captivating photos may be semantically misaligned with the underlying listing. At Airbnb scale, this corresponds to hundreds of millions of photos and hundreds of thousands of new uploads per day. We propose \emph{OptiCover}, a scalable framework for cold-start visual optimization under semantic constraints and multi-surface engagement signals. The framework combines (i) a photo candidate generator that identifies candidate photos through various proxies, (ii) lightweight vision heads applied to frozen CLIP embeddings for large-scale semantic scoring, (iii) a cross-modal grounding validator based on a vision-language model (VLM) that enforces semantic representativeness, and (iv) an Exploration Logging Module (ELM) that orchestrates the collection of randomized engagement data across heterogeneous product surfaces and contextual search intents. We evaluate OptiCover through extensive offline studies and multiple online experiments across HomePage, and Search surfaces. OptiCover is now deployed in production and performs tens of millions of photo swaps daily. Online results show a 1.5\% engagement lift on the HomePage and a 0.35\% increase in bookers on Search, generating millions of dollars in incremental revenue. Our findings suggest that action-space shaping and semantic constraints are primary drivers of performance.
Comments:
Accepted at GRAIL 2026: Workshop on Generative, Retrieval-augmented, and Agentic Intelligence for Personalization, co-located with CIKM 2026, Rome, Italy
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
ACMclasses:
H.3.3; H.5.1; I.2.6; I.4.10
Cite as:
arXiv:2611.12727 [cs.CV]
(or
arXiv:2611.12727v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2611.12727
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
15. 【2611.12716】Spaghetti Splatting: Differentiating Curvilinear Dirac Masses via Convolution
链接：https://arxiv.org/abs/2611.12716
作者：George Shramko,Shrisudhan Govindarajan,Rudy Lam,Yizheng Xie,Daniel Rebain,David B. Lindell,Andrea Tagliasacchi
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：production systems, hardware is optimized, optimized to generate, Dirac masses, Gaussian Splatting
备注： 10 pages, 8 figures, 1 table
点击查看摘要
Abstract:In production systems, 3D geometry is represented by primitives such as points, lines, and triangles, as rendering hardware is optimized to generate images from them very efficiently. Learning such primitives from images by volume rendering is challenging, as they are Dirac masses defined at infinitesimal locations in space. EWA splatting, Poisson reconstruction, and 3D Gaussian Splatting overcome this by convolving Dirac masses with a low-frequency kernel, a recipe that generalizes along two axes: the kernel and the primitive. As points and triangles have already received significant attention, we investigate this recipe for curvilinear primitives, and introduce Spaghetti Splatting. We approximate curves by polylines whose convolution converges to that of the continuous curve, and volume render each segment so that connected segments composite without overcounting at their joints. For fast training and inference, we linearize the camera projection per segment, which also accommodates kernels beyond Gaussians, such as Beta kernels. As a point is a curve of zero length, our representation is a strict superset of 3D Gaussian Splatting. It remains competitive with the state-of-the-art on general scenes, outperforms methods specialized to line-like geometry, natively supports anti-aliasing, and produces long connected strands that are directly amenable to physics simulation.
16. 【2611.12699】GeoScope: Training-Free Program Execution beyond the Counting Horizon for Ultra-High-Resolution Remote Sensing Question Answering
链接：https://arxiv.org/abs/2611.12699
作者：Guohui Deng,Yuhang Jiang,Chengjun Wang,Zhongwen Hu,Zhaocong Wu,Linsheng Huang,Jinling Zhao,Chao Ruan,Miaozhong Xu,Chi Chen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：remote sensing images, remote sensing, sensing images, counting, VLM
备注： Preprint. 72 pages including the Supplementary Material. Project page: [this https URL](https://avalon-s.github.io/GeoScope/)
点击查看摘要
Abstract:In ultra-high-resolution (UHR) remote sensing images, the objects that questions count in a region or relate by direction often span only a few pixels. Existing methods mainly decide where a vision-language model (VLM) should look and trust its answer in the chosen view. We show that this assumption fails for counting, and measure VLMs as one calibrates a sensor. All eight open VLMs tested fall increasingly short once a view holds more than a certain number of objects, about five for most on DOTA aerial images. This counting horizon narrows as views grow and objects appear smaller. An empirical power-law response model predicts the undercount a split recovers and the spurious counts it adds, and supports the rule of splitting only views beyond the horizon. In GeoScope, a text-only language model parses the question into a typed spatial program that fixes the region and its resolution. The VLM only grounds and counts within its operating range, and directions are computed explicitly from the grounded boxes. To our knowledge, it is the first UHR method to split views by a measured limit of the VLM. Without training, it improves Qwen3-VL-8B by 16.3 points on regional counting and 10.5 on spatial relations in XLRS-Bench, and has the highest reported accuracy, trained methods included, on regional counting and on the whole benchmark by question. On UHR-Micro it improves global and regional counting by 16.8 and 36.2 points, 15.6 of the former from splitting. On MME-RealWorld counting it gains 11.4 points, and we show that an option that is almost never correct yet often chosen distorts comparisons there. Project page: this https URL
17. 【2611.12686】Differentiable Inverse Rendering Recovers Intrinsic Properties from Intravascular Optical Coherence Tomography
链接：https://arxiv.org/abs/2611.12686
作者：Ajay Manicka,Karim Kadry,Sebastian Ruiz-Lopera,Maryam Alsharqi,Sanjana Arji,Samuel Ruiperez-Campillo,Nestor Uribe-Patarroyo,Brett E. Bouma,Farhad Nezami,Elazer R. Edelman
类目：Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV); Medical Physics (physics.med-ph); Optics (physics.optics)
关键词：properties remain entangled, Medical images encode, intrinsic tissue properties, images encode intrinsic, encode intrinsic tissue
备注： 27 Pages, 6 Figures, Under Review
点击查看摘要
Abstract:Medical images encode intrinsic tissue properties that indicate disease progression, yet these properties remain entangled with the system-dependent physics of image formation. Differentiable inverse rendering asks whether they are recoverable by inverting the imaging system's forward physics rather than through post-hoc correction. We address this in optical coherence tomography (OCT), focusing on the optical attenuation coefficient, a per-pixel marker of pathology and cellular composition. Conventional recovery relies on closed-form inversions limited to simplified light-tissue models, or learned methods coupled to specific imaging configurations. We instead recover per-pixel attenuation from a single OCT image by gradient descent through a differentiable physics-based forward model. We verified the method against analytical solutions, validated it on five in vitro phantoms, and applied it without modification to 29{,}269 clinical intravascular OCT images from 128 patients. The inversion needs no training data or segmentations and is portable across platforms and retrospective archives. Replacing the forward model or recovering another optical parameter leaves the optimization procedure unchanged. We demonstrate per-pixel recovery is tractable because gradient information scales to this high-dimensional problem, where gradient-free methods become intractable. Our work supports quantitative tissue characterization from OCT images and provides a framework for extension across imaging modalities and organ systems.
18. 【2611.12681】National-Scale Crop Type Mapping in Morocco Using Google AlphaEarth Foundations Embeddings and the Fields of the World Field Boundary Map
链接：https://arxiv.org/abs/2611.12681
作者：Walid Elbarz,Mohamed Bourriz,Vincent Simonneaux,Hamd Ait Abdelali,François Bourzeix
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Recent geospatial foundation, large-scale Earth observation, Recent geospatial, Earth observation, geospatial foundation models
备注： Presented at GeoAI4SD 2026 (online, July 9, 2026)
点击查看摘要
Abstract:Recent geospatial foundation models have introduced a new paradigm for large-scale Earth observation by providing pretrained embedding representations that can be directly exploited for downstream tasks. In this work, we investigate the use of Google AlphaEarth Foundations embeddings for national-scale crop type mapping in Morocco. The proposed workflow operates directly on publicly available 64-dimensional pretrained embeddings using lightweight downstream classifiers, eliminating the need to process raw satellite imagery during model training and inference. The approach targets three crop categories, namely winter cereals, tree crops, and other crops. For nationwide inference, the Fields of the World global field boundary map is used to constrain predictions to agricultural parcels, enabling efficient large-scale mapping. Experimental evaluation on an independent test set over ten repeated runs achieved an average classification accuracy of (87.17 +/- 0.42%). Nationwide inference over Morocco was completed in approximately five hours, with the dominant computational cost arising from cloud-based retrieval of the embeddings rather than model execution. These results demonstrate the potential of pretrained embedding representations for computationally efficient national-scale crop type mapping.
19. 【2611.12674】What Breaks Scribble-Supervised Segmentation? An Audit-Informed Benchmark for Scribble Annotation Robustness
链接：https://arxiv.org/abs/2611.12674
作者：Minheng Wu,Di Wen,Ruiping Liu,Junwei Zheng,Yufan Chen,Kailun Yang,Kunyu Peng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：imperfections poorly understood, Visual Object Classes, PASCAL Visual Object, Scribble-supervised segmentation, fixed annotation set
备注： 20 pages, 7 figures
点击查看摘要
Abstract:Scribble-supervised segmentation is typically evaluated with a fixed annotation set, leaving robustness to distinct semantic and geometric imperfections poorly understood. Motivated by an audit of 12,031 manual PASCAL Visual Object Classes (VOC) 2012 scribbles and prior work, we introduce six controlled perturbation operators. Class corruption, spatial offset, and directional perturbation directly operationalize audit signals. Stroke-length reduction is motivated by prior scribble studies, while random dropout and fragmentation serve as diagnostic controls. Each operator reports requested and achieved changes. We evaluate manual and automatic scribbles across two image domains, two principal backbone settings, and multiple training pipelines, with an additional MiT-B1 PFA anchor evaluation. In the five-seed Tree Energy Loss (TEL)-ResNet101 VOC study, mean intersection over union (mIoU) drops from 70.08 to 1.46 under class corruption, compared with 35.57 for spatial offset, 52.20 for directional perturbation, and 63.24 for stroke-length reduction at their strongest settings. At the evaluated endpoints, semantic-anchor corruption produces the largest degradation, while geometric and support responses depend on the pipeline and dataset. Our benchmark provides a reproducible protocol for diagnosing annotation robustness beyond clean-set accuracy. The operator code is available at this https URL.
20. 【2611.12668】Controlled Binary Assignment Flows
链接：https://arxiv.org/abs/2611.12668
作者：Paul Fröhling,Christoph Schnörr
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：deep assignment flows, labelings on graphs, binary data labelings, paper introduces, learning of time-variant
备注：
点击查看摘要
Abstract:This paper introduces a geometric approach to the representation and learning of time-variant parametrizations of deep assignment flows, for binary data labelings on graphs. Each edge carries an optimally controlled parameter flow in a 2-dimensional totally geodesic submanifold, based on objectives derived from a non-local linear scale space representation of the input data. The aggregation of triplets of such flows in 5-dimensional totally geodesic submanifolds is learned from data. The fusion of these flows determines the trajectory in the high-dimensional symmetric parameter space and by geometric integration the layers of binary deep assignment flows. Numerical results demonstrate the expressivity and the limitation of our highly parallel geometric local synthesis approach to high-dimensional deep assignment flow parametrizations.
21. 【2611.12657】When Does Sliced Inference Pay Off? Resolution, Tiling and Dense Fusion for Small Object Detection
链接：https://arxiv.org/abs/2611.12657
作者：Stefan Becker,Jens Bayer,David Münch,Wolfgang Hübner
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Sliced inference, revisit sliced inference, high-resolution imagery, low-resolution baselines, standard remedy
备注：
点击查看摘要
Abstract:Sliced inference such as SAHI is the standard remedy for small objects in high-resolution imagery, but its gains are usually measured against low-resolution baselines. We revisit sliced inference with scale as the explicit variable and ask when tiling actually pays off. We compare seven dense detectors from four families on VisDrone and DOTA, under pre-specified hypotheses, calibration-only tuning and a single evaluation on held-out test data. Two findings emerge. First, much of the benefit attributed to slicing is a resolution effect: on VisDrone, a single pass trained at a higher resolution outperforms tiling with box fusion (merging decoded boxes) for every detector that could be trained at that resolution, and at equal compute a higher resolution helps more than a larger model. Second, tiles carry complementary information that box fusion wastes. We introduce SCAHI (Slicing with Coverage-Aware Hyper Inference), which accumulates the dense outputs of all passes with weights that give every image position the same total coverage, and reads objects off a peak grid fine enough to keep crowded neighbours apart. On identical passes, SCAHI outperforms box fusion for every YOLO detector on both datasets and matches it for FCOS. On DOTA, whose images far exceed the resolution a single pass can be trained at, tiles with SCAHI beat the best single pass for every detector, by 4.3 to 5.6 mAP50 at 2048 px, and replacing only SAHI's merge step by SCAHI adds 2.3 to 4.0 mAP50. An ablation attributes the gain to the border weighting and the resolution of the peak grid. Source code is available at this https URL.
22. 【2611.12624】owards Reconstructing and Recognizing Objects behind Fragmented Occlusion using Video
链接：https://arxiv.org/abs/2611.12624
作者：Roman Pflugfelder,Michael Lindenbaum,Daniel Cremers
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：human visual system, Perceiving objects, computer vision, natural capability, human visual
备注： paper, supplementary material
点击查看摘要
Abstract:Perceiving objects through fragmented occlusions, such as foliage, is a natural capability of the human visual system but remains a fundamental challenge for computer vision. This work addresses the problem of object reconstruction, or de-occlusion, in the presence of high-density, fragmented occlusions. We propose a reconstruction framework that operates on a sequence of grayscale images of a moving object, acquired by a single camera, either stationary or in motion. The algorithm estimates the object's relative positions across frames by jointly registering the images and optimizing the alignment parameters to maximize the contrast of their average, referred to as the integrated image. This integrated image serves as the reconstructed representation of the object. Experimental evaluations on both synthetic and real video sequences demonstrate the feasibility of accurate reconstruction under occlusion densities exceeding 90%. The proposed approach is competitive with synthetic aperture techniques, which are limited to static objects and require complex camera setup with careful calibration. Furthermore, we show that the integrated image enables reliable object classification under severe occlusion when used as input to standard, off-the-shelf classifiers.
23. 【2611.12603】Direct Conditioning of Audio Diffusion Transformers on fMRI Reveals Cortical Contributions to Sound Reconstruction
链接：https://arxiv.org/abs/2611.12603
作者：Matteo Ciferri,Tonio Weidler,Matteo Ferrante,Nicola Toschi,Elia Formisano
类目：ound (cs.SD); Computer Vision and Pattern Recognition (cs.CV)
关键词：activity remains challenging, Reconstructing audio, remains challenging, brain activity remains, Reconstructing
备注： Accepted at NeurIPS 2026 main track as a poster
点击查看摘要
Abstract:Reconstructing audio from brain activity remains challenging. Existing brain-to-audio pipelines typically map neural responses to predefined stimulus representations before synthesis. While recent work in the visual domain has explored direct conditioning on brain activity, this approach has not yet been extended to audio diffusion models. We introduce MAAS (Multi-Area Auditory Synthesis), an end-to-end framework that conditions a pretrained audio diffusion transformer on ROI-wise fMRI responses without first supervising a decoder to predict an external stimulus representation. MAAS uses region-specific projections and learned brain tokens to condition Stable Audio through a dedicated cross-attention pathway. On a 7T fMRI dataset, we demonstrate consistent improvements over baselines, including two-stage fMRI-to-latent conditioning, across both acoustic and semantic evaluation metrics. In addition, we introduce a fidelity metric grounded in a computational model of auditory neural processing, which allows us to quantify the contribution of individual auditory cortical regions to reconstructed audio representations.
24. 【2611.12574】Evaluating Cross-Signal Coherence in Mammography Vision-Language Models
链接：https://arxiv.org/abs/2611.12574
作者：Rebeca Nam,Chase M. Fensore,Christian A. Fauria-Robinson,Judy Gichoya,Joyce C. Ho
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：medical images directly, outputs increasingly include, interpreting medical images, move toward interpreting, written justification
备注：
点击查看摘要
Abstract:As vision-language models (VLMs) move toward interpreting medical images directly, their outputs increasingly include not just a label but a stated confidence and a written justification. Yet the field still predominantly evaluates VLMs using just accuracy. We evaluate the coherence between answer, confidence, and explanation across four VLMs on breast density and BI-RADS categorization, using two mammography datasets. We perform controlled perturbations of the question, multiple choice option orders, and the images and assess changes in the three outputs. Our results suggest confidence does not decrease even as the mammography image is changed. Shuffling the options also changes most VLMs' answers. Notably, there are cases where a model's own stated reasoning contradicts its final answer, a distinction accuracy alone cannot capture but one that governs whether an AI-generated answer can be trusted.
25. 【2611.12564】GHiML: VLM-Guided Hierarchical Multi-Label Learning with Applications to Benthic Imagery
链接：https://arxiv.org/abs/2611.12564
作者：Isaac Xu,Devi Ayyagari,Martin Gillis,Benjamin Misiuk,Craig J. Brown,Thomas Trappenberg
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Vision language models, encode substantial expert, imagery remains limited, benthic imagery remains, substantial expert knowledge
备注：
点击查看摘要
Abstract:Vision language models (VLMs) encode substantial expert knowledge within their weights, yet their direct application to specialised classification domains such as benthic imagery remains limited. Meanwhile, vision transformers trained on these tasks rely predominantly on low-level visual latents (colours, textures, and shapes) that lack the higher-level reasoning humans employ for identification. We propose Guided Hierarchical Multi-Label (GHiML) learning, a pipeline that extracts conceptual latent variables from a VLM conditioned on training data, generates sample-relevant captions grounded in those variables, and fuses the resulting textual embeddings with image embeddings via cross-attention and a per-node gated router. We also introduce the inverted HML score ($d_{\mathrm{inv}}$), a similarity score that evaluates hierarchical multi-label predictions through graph traversal distance and a cardinality penalty, providing an interpretable alternative to existing measures, which are insensitive to realistic degradations in sparse, deep hierarchies. Experiments on BenthicNet, FathomNet and iNaturalist show that the router improves macro $F_1$ over the vision-only baseline by up to 6.7 pp and $d_{\mathrm{inv}}$ by up to 21.1 pp on in-domain benthic data, with gains persisting under distribution shift. Ablations locate the contribution of the text itself: on the multi-label biotic hierarchies, removing the per-sample text signal degrades $d_{\mathrm{inv}}$ while leaving macro $F_1$ unchanged, consistent with text acting through prediction cardinality rather than node discrimination, whereas iNaturalist, whose annotations are single-label, loses 18.7% of macro $F_1$. Our results support the hypothesis that VLMs contain exploitable specialised knowledge that, when appropriately elicited, can augment classification in domains where direct visual learning is insufficient.
26. 【2611.12557】WanderBench: Can World Models Explore Dynamic Worlds from Video?
链接：https://arxiv.org/abs/2611.12557
作者：Yuhang Chen,Jiheng Li,Jiale Wang,Zai Wang,Guangyue Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：input video make, free-viewpoint replay, enabling re-shooting, re-shooting of footage, environments for embodied
备注： 10 pages, 4 figures
点击查看摘要
Abstract:Video world models conditioned on an input video make it possible to explore real, recorded dynamic scenes, enabling re-shooting of footage, free-viewpoint replay, and real-to-sim environments for embodied agents. Such uses require the generated rollout to stay faithful to the recorded world, yet existing benchmarks start from a single image or a text prompt, and video-conditioned generation is evaluated mainly on perceptual quality and camera following. These evaluations do not directly assess whether exploration preserves subject identity, event progression, and scene consistency upon revisiting a location. We introduce WanderBench, a benchmark for exploring dynamic worlds from video. It comprises 745 single-shot source videos of real and AI-generated content in three difficulty tiers (3-25 s), paired with camera routes given as keyboard actions, and evaluates six dimensions with 24 human-validated sub-metrics. Benchmarking eight models, we find that as clips grow longer, models keep the static scene and visual quality but lose camera control and the source dynamics, and that none keeps revisited places consistent. We further propose WanderLand, a training-free framework that conditions each frame of a frozen model on the same-instant source and, on revisits, on its own earlier static content. WanderLand improves five models on every dimension, by up to 8.3 points in source-dynamics fidelity.
27. 【2611.12524】EditJudge-Bench: Auditing VLM Image-Edit Judges with Synthetic Ground Truth
链接：https://arxiv.org/abs/2611.12524
作者：Jens Parslov,Marco Schouten,Dim P. Papadopoulos
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Vision-language models, poorly understood, Vision-language, ground truth, image-editing benchmarks
备注： Accepted to NeurIPS 2026 (Evaluations Datasets Track). 26 pages, 6 figures, 5 tables. Project page: [this https URL](https://jenspars.github.io/EditJudge-Bench/)
点击查看摘要
Abstract:Vision-language models (VLMs) are increasingly used as automated judges for image-editing benchmarks, yet their reliability is poorly understood. Auditing these judges is difficult because real edited images lack controlled ground truth and entangle the requested changes with model artefacts, unintended side effects, and ambiguous degrees of success. In this paper, we introduce EditJudge-Bench, a diagnostic benchmark of 1,382 synthetic before/after image pairs rendered in Blender, with edits parameterised across nine categories derived from real user requests and exact ground truth from known 3D scene parameters. Because every edit is generated by a known intervention on a controlled scene, EditJudge-Bench evaluates VLM judges as binary verifiers of whether an instruction was correctly executed, isolating judge perception from editor quality. Across 25 judge configurations, we find substantial reliability gaps: (a) the widely adopted VIEScore template reaches only 69.0% AUROC with GPT-4o; (b) fine-tuned judges score 51.7-66.3%; spatial edits such as rotation and shape remain challenging; (c) prompt-formatting choices like image-text ordering shift performance by up to 14.1 points. Despite using only synthetic data, judge rankings on EditJudge-Bench correlate strongly with two real-image human-preference benchmarks ($\rho$=0.95 and $\rho$=0.71), indicating that controlled audits surface failure modes relevant to real evaluation.
28. 【2611.12508】MARS: Multiscale Appearance-Residual Streams for Video Forgery Detection
链接：https://arxiv.org/abs/2611.12508
作者：Ahmed Y. Radwan,Shaina Raza
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Generalizing deepfake detection, remains challenging due, Generalizing deepfake, forgery traces varying, video remains challenging
备注：
点击查看摘要
Abstract:Generalizing deepfake detection across facial manipulation and fully generated video remains challenging due to forgery traces varying with the manipulation method and scene content. Explicit spatial and temporal feature differences offer a way to capture this variation, but also respond to natural texture and motion, motivating their joint interpretation with appearance features. We investigate whether combining multiscale feature differences with adapted appearance representations improves detection across both forgery categories. We introduce Multiscale Appearance-Residual Streams (MARS), a two-path video detector. The residual path applies fixed spatial and temporal difference-of-Gaussians operators to frozen intermediate features and models the resulting differences alongside appearance context across frames. The semantic path adapts the encoder's normalization parameters for frame classification, and a clip-dependent gate combines their predictions. Under a shared protocol across seven datasets, MARS achieves the highest average AUROC of 91.43\%, outperforming seven compared detectors. When trained on facial manipulations alone, MARS achieves 93.99\% AUROC on GenVideo and 75.50\% on DF26, demonstrating transfer to generated videos without generated-video training data. MARS also provides signed patch and frame contributions, whose faithfulness we evaluate through controlled spatial and temporal removal against random controls. MARS is publicly available for research: Project page: this https URL Github: this https URL
29. 【2611.12477】Perturb, Aggregate then Reconstruct: Consensus Aggregation and Fourier-Attended Multi-Decoders for Reconstruction-based Multi-View Anomaly Detection
链接：https://arxiv.org/abs/2611.12477
作者：Yongho Son,Junyeong Yun,Je Hyeong Hong
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：identify defects hidden, Multi-view anomaly detection, crucial for industrial, industrial inspection, inspection to identify
备注： 14 pages, 7 figures. Accepted at ACM Multimedia 2026 (MM '26)
点击查看摘要
Abstract:Multi-view anomaly detection is crucial for industrial inspection to identify defects hidden from single viewpoints. Yet, despite their strong success in single-view applications, reconstruction-based methods remain largely underexplored in multi-view settings. A key challenge in extending these methods lies in generating view-consistent pseudo-anomalies. To address this, we propose PAR, a reconstruction-based framework for enhanced multi-view anomaly detection. First, we introduce a feature perturbation strategy coupled with a consensus aggregation module that integrates these perturbed features across viewpoints to mitigate view-inconsistent anomalies and construct highly aligned pseudo-anomaly representations. Second, we employ a view-specialized multi-decoder architecture; by assigning a dedicated decoder to each view, we increase the model's representational complexity, enabling the generation of highly feasible, localized anomaly maps rather than less precise, view-agnostic reconstructions. Last, we incorporate Fourier attention into the decoders to emphasize global frequency-domain structures over local token evidence, effectively preventing identity mapping. Extensive experiments on the Real-IAD dataset demonstrate that PAR consistently outperforms state-of-the-art methods in sample-level, image-level, and pixel-level anomaly detection. Our code is available at this https URL.
30. 【2611.12452】V3DSAM: Semantic-Geometric Loop Verification and Geometry-Anchored Persistent Instance Mapping for Feed-Forward Dense SLAM
链接：https://arxiv.org/abs/2611.12452
作者：Maolin Ye,Dongqing Zhao,Linyang Li,Shuai Xue,Yuan Liu,Yiyuan Wang,Wen Li
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：semantic dense SLAM, feed-forward dense SLAM, dense SLAM, dense SLAM system, open-vocabulary semantic dense
备注： 8 pages, 6 figures, 4 tables. Submitted to IEEE Robotics and Automation Letters (RA-L)
点击查看摘要
Abstract:To address unreliable cross-view association in long-sequence feed-forward dense SLAM, this letter presents V3DSAM, an open-vocabulary semantic dense SLAM system that establishes physical correspondences at both the scene and object levels. The system combines feed-forward geometric estimates from VGGT-SLAM 2.0 with open-vocabulary semantic observations from SAM3. We introduce semantic-geometric dual-scale loop verification, which identifies false loop closures using pixel-level bidirectional reprojection and object-level 3D spatial correspondences, without accessing backbone-internal features. We further propose geometry-anchored persistent instance mapping, which defines physical instances through class-constrained 3D connectivity in an optimized global coordinate system and assigns global IDs without inter-frame identity propagation. The proposed verifier rejects all four false loop candidates in our TUM RGB-D evaluation, while long-sequence ScanNet experiments show improved instance identity consistency. Thus, V3DSAM reduces dependence on internal backbone features and temporal ID propagation for robust long-term cross-view association.
31. 【2611.12445】LongSCOP: Semantically Consistent Long Video Outpainting
链接：https://arxiv.org/abs/2611.12445
作者：Yu Tang,Zhiyuan You,Zhixiao Wang,Fanghua Yu,Qingyu Zhang,Xiang Yin,Chao Dong,Jinjin Gu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：leaving long video, long video out-painting, Video out-painting, video out-painting largely, research focuses primarily
备注： Accepted by NeurIPS 2026
点击查看摘要
Abstract:Video out-painting is an important problem, yet existing research focuses primarily on short clips, leaving long video out-painting largely underexplored. Extending video out-painting to long videos poses substantial challenges. A natural solution is iterative out-painting, i.e., generating videos chunk by chunk, but this introduces two major issues: generation instability or even failure caused by inter-chunk inconsistencies and error accumulation, and semantic drift over long temporal horizons. In this paper, we propose LongSCOP, short for Semantically Consistent long Video Out-Painting. First, we introduce a training recipe with three components for smooth and stable long-horizon generation: self-forcing training, latent calibration, and future references. Beyond generation stability, we recognize that the rich temporal context of long videos provides valuable references for maintaining semantic consistency. We therefore develop a VLM-based agent that automatically selects the most informative reference frames from the entire video to maintain consistent subjects, scenes, and backgrounds throughout long-horizon generation. We also construct a high-quality training dataset of 62K video clips. To facilitate research on this underexplored problem, we introduce LVO-Bench, a benchmark curated by human experts to assess long-horizon stability and semantic consistency. Extensive experiments demonstrate that our method outperforms existing approaches in both generation stability and semantic coherence.
32. 【2611.12443】MoSTE: Mixture of Spatio-Temporal Experts for Deepfake Detection in Videos
链接：https://arxiv.org/abs/2611.12443
作者：Charbel Yahchouchi,Nabyl Quignon,Noemi Roggero,Laurent Saroul,Antitza Dantcheva
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Generalizable deepfake video, detection remains challenging, artifacts vary substantially, Generalizable deepfake, deepfake video detection
备注： Accepted to IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2027
点击查看摘要
Abstract:Generalizable deepfake video detection remains challenging because forgery artifacts vary substantially across manipulation types and often combine diverse spatial and temporal inconsistencies. Existing parameter-efficient adaptation methods typically rely on a single shared representation, rendering them prone to manipulation-specific bias and limiting transfer to unseen forgeries. To address this challenge, we propose Mixture Of Spatio-Temporal Experts (MoSTE), an adaptation framework that enables conditional specialization of forensic representations. Instead of forcing one adapter to model all forgery patterns, MoSTE decomposes adaptation into parallel spatial and temporal expert pools and dynamically routes tokens to the most relevant experts through an unsupervised token-level routing mechanism. This allows experts to naturally specialize in complementary forgery cues without requiring explicit manipulation labels or multi-stage training, while effectively transferring representations from CLIP to the video domain. Extensive experiments across cross-dataset and cross-manipulation benchmarks demonstrate that MoSTE sets a new state of the art in average generalization while preserving strong performance across diverse manipulation families. Additional analysis of expert routing and attention behavior reveals the emergence of expert diversity, suggesting that MoSTE learns complementary spatio-temporal forensic features. Code is available at this https URL
33. 【2611.12437】Occupancy Modelling of Biased Landslide Inventories: When Does Separating Occurrence from Recording Improve on Neutralisation?
链接：https://arxiv.org/abs/2611.12437
作者：Abdirashid Omar,Abdikadir Ugaas
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：real Gorkha inventories, Hokkaido Eastern Iburi, Gorkha, Gorkha inventories, Landslide susceptibility models
备注：
点击查看摘要
Abstract:Landslide susceptibility models are trained on inventories that record where landslides were seen, not where they occurred. The established remedy fits bias-describing variables and neutralises them when mapping. We adapt occupancy-detection modelling from ecology, treating several inventories as imperfect observers of one event and separating occurrence from recording, and ask when this improves on neutralisation. We use near-complete inventories of the 2018 Hokkaido Eastern Iburi, 2015 Gorkha and 2010 Haiti earthquakes with simulated reporting bias, and three real Gorkha inventories. Compared with standard practice, the occupancy model reduces road bias in 24 of 25 paired draws and raises AUC by 0.08-0.14 on Gorkha and 0.03 on Haiti, but only 0.01-0.02 on Iburi. Its median predicted-to-true landslide rate is 0.99 (range 0.44-1.89), against 0.24-0.30 for the baselines. Rescaling the baselines with the same anchor area corrects their median but leaves larger errors (range 0.20-4.34). Cell-level probabilities remain too extreme (calibration slope 0.59). Compared with the best neutralised model, AUC is higher on Iburi (by 0.03-0.07) and lower on Gorkha and Haiti (by 0.01-0.05). Transplant experiments tie the Iburi advantage to the structure of its true landslide pattern, not to its terrain or road network. In all eight settings with a low interaction gap, computable from biased records, neutralisation was at least as accurate, including a prespecified test on Haiti; a high gap did not guarantee an advantage. The real Gorkha inventories are slope-biased, not road-biased, and there the model brings no meaningful gain. Report-based catalogues remain the main untested case.
34. 【2611.12426】dNaViT: Discrete Codes are General-Purpose Visual Representations
链接：https://arxiv.org/abs/2611.12426
作者：Xiaotong Li,Zhengrong Yue,Xu Huang,Jialv Zou,Minhao Jing,Wenhao Yan,Haodong Li,Hai Huang,Bo Zhao,Yan Feng,Peng Pei,Xunliang Cai
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Discrete autoregressive modeling, modern language models, autoregressive modeling, notably through next-token, next-token prediction
备注： Technical Report. Project page: [this https URL](https://lixiaotong97.github.io/dNaViT/) ; Code: [this https URL](https://github.com/meituan-longcat/LongCat-Next) ; Models: [this https URL](https://huggingface.co/meituan-longcat/LongCat-Next)
点击查看摘要
Abstract:Discrete autoregressive modeling, notably through next-token prediction, has become a cornerstone of modern language models. Extending this paradigm to vision allows visual and language models to converge on a unified framework, thereby fostering shared methodology and infrastructure. This work investigates a central question: how far can a finite discrete vocabulary go in representing the richness of the visual world? We present dNaViT, a Discrete Native-resolution Vision Transformer that produces discrete visual primitives analogous to language tokens. Built upon a frozen pretrained encoder, dNaViT applies lightweight residual modulation with a dual-branch objective to inject reconstruction-aware cues into semantic features. By leveraging grouped product quantization, it scales discrete capacity without inflating spatial sequence lengths, while a balanced training recipe maintains both semantic and pixel-level information. Consequently, dNaViT functions as a versatile discrete visual tokenizer, enabling unified encoding across downstream tasks alongside high-fidelity image decoding. Extensive evaluations show that dNaViT matches or exceeds task-specific baselines across 12 visual understanding benchmarks, 4 generation benchmarks, and an image editing benchmark. These findings demonstrate that a compact discrete vocabulary can serve as a universal visual currency and unlock the full potential of fully unified, native multimodal methodology.
35. 【2611.12411】PhysOPSD: Code as Privilege for Physically Plausible Video Generation
链接：https://arxiv.org/abs/2611.12411
作者：Harold Haodong Chen,Rui Peng,Lingteng Qiu,Kejie Qiu,Chao Xu,Zilong Dong
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：generative models achieve, models achieve remarkable, remain noticeably brittle, generating physically plausible, remarkable visual fidelity
备注： Project: [this https URL](https://haroldchen19.github.io/PhysOPSD-site/)
点击查看摘要
Abstract:While modern video generative models achieve remarkable visual fidelity, they remain noticeably brittle when generating physically plausible dynamics and complex interactions. Targeted post-training is crucial, yet supervised fine-tuning suffers from offline state mismatch, and reinforcement learning is hindered by sparse, ill-defined physical reward functions. On-Policy (Self-)Distillation (OPSD) reconciles on-policy rollouts with dense corrective feedback, shifting the core challenge to designing effective privileged context. However, conventional modalities fall short: text prompts are inherently declarative, whereas real reference videos heavily entangle physical laws with visual appearance without parametric control. To this end, we propose PhysOPSD, introducing executable code as privileged physical context for video generation. Unlike static visual observations, executable code instantiates an editable physical world with intrinsic abstraction and controllability. Powered by PhysOPSD-Engine, we translate real-world physical scenarios into verifiable simulation programs. PhysOPSD then incorporates (i) dual-level physical privilege to bridge the information gap via an intermediate bottleneck, alongside (ii) controlled physical variations under shared rollout noise to expose causal dynamic shifts. Extensive experiments demonstrate that PhysOPSD substantially improves physical plausibility across diverse backbones, outperforming SFT and RL baselines with only $3$K samples, while preserving general video generation quality.
36. 【2611.12405】PTC-IoU: CPU-Friendly Detection Quality Estimation for Edge Video Analytics
链接：https://arxiv.org/abs/2611.12405
作者：Wei Geng,Hyerin Kim,Chang Lu,Zhenghao Lu,Joerg Ott
类目：Computer Vision and Pattern Recognition (cs.CV); Performance (cs.PF)
关键词：video analytics system, edge video analytics, video analytics, analytics system, system must estimate
备注： 6 pages, 8 figures, 2 tables
点击查看摘要
Abstract:An edge video analytics system must estimate the quality of local detections since there are no ground-truth labels available during runtime. Detectors usually provide confidence scores for their results, but these scores can not reveal every missed object or misplaced bounding box. So a quality estimator is necessary to provide a decision signal indicating which frame has potential detection failures that need to be escalated to a more powerful model in the cloud. Neural network based estimators add workload to the GPU already running detection, while CPU capacity may remain available. We present Predictive Temporal Consistency IoU (PTC-IoU), which moves this workload to CPU by compacting detection boxes histories to support deterministic result scoring. Comparing to neural counterparts, experiments on representative edge hardware, Nvidia Jetson Orin Nano, show that our method reduced per-frame estimator latency from 10.3 ms for neural counterparts to 2.2 ms (4.7x faster), increased pipelined throughput by 13.6%, and cuts estimator energy consumption by up to 95%, while maintaining competitive final detection quality verified on multiple datasets.
37. 【2611.12382】AutoVLA-D: Learn a Trajectory-Geometric Condition from Reasoning for Autonomous Driving VLA
链接：https://arxiv.org/abs/2611.12382
作者：Yuguang Yang,Zhewen Tan,Canyu Chen,Linlin Yang,Cheng Chi,Chunyang Liu,Kehua Sheng,Jinyu Yang,Baochang Zhan,Bo Zhang,Yan Wang,Xianbin Cao
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Autoregressive VLA planning, VLA planning, ego states, weakens direct conditioning, instructions often describe
备注： Accepted by NeurIPS 2026
点击查看摘要
Abstract:Autoregressive VLA planning usually predicts continuous trajectories as the final output, but driving instructions often describe actions rather than ego states, which weakens direct conditioning on the final continuous trajectory. We address this gap with TrajCond, which introduces a discrete trajectory-geometric condition for VLA planning. Specifically, we represent TrajCond as a 1D-Brohan differential action trajectory and learn it with a two-stage training framework before final continuous trajectory prediction. With the simultaneous autoregressive generation of discrete and numeric trajectories, we name our method AutoVLA-D (Double). Experiments on NAVSIM navtest, nuScenes, and NeuroNCAP show that discrete trajectories are weaker as direct outputs but more effective as TrajCond, consistently improving final continuous trajectory prediction across closed-loop and open-loop driving benchmarks. Code is available at this https URL.
38. 【2611.12364】RIAD: Multimodal Retrieval across Abstraction, Constraints, and State
链接：https://arxiv.org/abs/2611.12364
作者：Xiangyang Wu,Chen Ju,Xu Chen,Likang Peng,Jinsong Lan,Haihong Tang,Yang Hu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：involve cross-level relations, increasingly supports agentic, combine multiple constraints, supports agentic systems, retrieval increasingly supports
备注：
点击查看摘要
Abstract:Multimodal retrieval increasingly supports agentic systems, where user requests can involve cross-level relations, combine multiple constraints, and evolve across dialogue turns. In these settings, a highly similar result may still violate the user's requirements, while retrieved content may directly inform downstream actions without human screening. We introduce TRIAD, a multimodal retrieval benchmark for evaluating how well retrieval systems satisfy these complex, evolving requests. TRIAD comprises three tracks: abstraction, testing bidirectional retrieval between visual instances and concepts at different hierarchical levels; constraints, testing the joint satisfaction of positive and negative conditions; and state, testing the integration of requirements across dialogue turns and the updating of earlier conditions when users revise their requests. The benchmark contains six subsets, each with 1,000 queries and a fixed pool of 1,000 candidates per query, evaluated using a common multi-positive mean average precision (mAP) protocol. Simpler reference tasks and hard negatives grouped by the requirements they violate help characterize specific retrieval difficulties. We evaluate 20 configurations of 17 systems and find that no system leads across all six subsets. Performance declines with hierarchical distance, and negative-only queries generally underperform positive-only queries with the same number of constraints. Across paired tasks expressing the same final intent, multi-turn retrieval yields lower mAP in 39 of 40 configuration-domain comparisons. The benefits of explicit reasoning also vary across models and tasks. These findings highlight the gap between retrieving similar content and satisfying a complete request.
39. 【2611.12353】QCC-WM: Linking Macro-State Dynamics and Visual Generation via Quotient Causal Construction
链接：https://arxiv.org/abs/2611.12353
作者：Zhizhong Fu,Wei Zhou,Zhaoyang Jiang,Yudong Lin,Songlun Li,Zhi Li,Feifan Chen,Gaoming Li,Xiaorong Ding,Yifan Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：predicted evolution consistent, Quotient-based Causal Construction, action-conditioned world modeling, Medical Image Analysis, key challenge
备注： Published in Medical Image Analysis
点击查看摘要
Abstract:A key challenge in action-conditioned world modeling is to construct macro-states from high-dimensional observations that support recursive prediction under actions, while keeping their predicted evolution consistent with visual changes in generated observations. We propose QCC-WM, a visual world model based on Quotient-based Causal Construction. QCC-WM uses action responses to guide macro-variable construction for recursive action-conditioned prediction. A shared reference quotient measurement constrains the consistency between predicted states and observed changes, allowing macro-level predictions to provide structured constraints for future visual generation. Using translational and rotational actions and their predicted responses, the model aggregates local visual features into macro-nodes with spatial correspondence through causal abstraction, and recursively predicts node content and motion under a shared reference measurement. Macro-level predictions guide future observation generation, while predicted motion transports historical appearance information. Node-level errors between generated observations and macro-level targets are then mapped back to the corresponding spatial regions for correction, improving consistency between visual generation and macro-level predictions. On the US-VLA dataset, QCC-WM achieves an ROI-MSE of 0.01861 for four-step prediction. Compared with the best baseline at each prediction horizon, it reduces LPIPS by 48.59%, 41.68%, and 30.23% for four-step prediction and eight- and sixteen-step recursive extrapolation, respectively. Ablation studies and mechanism analyses show that motion-guided reference transport mainly improves pixel reconstruction, while node-level error feedback further improves perceptual quality and consistency between generated observations and macro-level predictions.
Comments:
Published in Medical Image Analysis
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2611.12353 [cs.CV]
(or
arXiv:2611.12353v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2611.12353
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Journalreference:
Medical Image Analysis (2026), 104391
Related DOI:
https://doi.org/10.1016/j.media.2026.104391
Focus to learn more
DOI(s) linking to related resources</p>
40. 【2611.12346】ReVMap: Vectorized Global Mapping via Connectivity-Aware Local Map Fusion
链接：https://arxiv.org/abs/2611.12346
作者：Hongjae Shin,Jungho Kim,Donghyuk Kwak,Myeongjun Kim,Seunghoon Yu,Jiyong Oh,Jun Won Choi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Large-scale annotation, incrementally construct global, global map, local vectorized predictions, local map prediction
备注：
点击查看摘要
Abstract:Large-scale annotation of vectorized high-definition (HD) maps is labor-intensive and costly, motivating local-to-global auto-labeling approaches that incrementally construct global maps from local vectorized predictions. However, existing approaches often overlook prediction uncertainty and rely on heuristic map integration, potentially propagating errors and introducing topological inconsistencies. To address these limitations, we propose ReVMap, a reliable local-to-global framework that iteratively refines local map predictions and global map construction through uncertainty-guided prior utilization and connectivity-guided global map revision. Specifically, ReVMap leverages point-wise localization uncertainty to incorporate global map priors into local map prediction, improving robustness against inaccurate prior information. It then predicts local-to-global connectivity and selectively updates the global map through uncertainty-aware fusion based on the reliability of local predictions. By iteratively coupling local prediction and global revision, ReVMap progressively improves both local map accuracy and global map consistency. Extensive experiments on the nuScenes and Argoverse 2 benchmarks demonstrate that ReVMap achieves state-of-the-art performance in both local map prediction and global map construction.
41. 【2611.12345】MT: Adapting CLIP to Infrared Imagery via Text-Derived Modality Knowledge Transfer
链接：https://arxiv.org/abs/2611.12345
作者：Ruofan Wang,Puzuo Wang,Xin Chen,Zibo Yu,Jungang Yang,Yi Hou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：computer vision tasks, Vision-language models, CLIP image-text alignment, achieve strong performance, CLIP achieve strong
备注：
点击查看摘要
Abstract:Vision-language models such as CLIP achieve strong performance across computer vision tasks, yet their image-text alignment is less reliable for infrared (IR) imagery because large-scale pre-training is dominated by visible-spectrum data. Due to the high cost of the infrared-text labeling, we investigate adapting CLIP to IR through only paired infrared-visible images, which requires considering modality-specific knowledge while preserving scene content and CLIP's image-text alignment. To achieve this, we propose TMT (Text-Derived Modality Knowledge Transfer), which adapts CLIP's image encoder through a text-defined infrared-to-visible direction and supervision from paired IR-visible images. First, we found that modality discrepancy can be described by corresponding text embeddings, thus using the direction of text embedding differences to guide the knowledge transfer between visible and infrared modalities without erasing infrared-specific information. To enhance the representation of semantics and details of infrared images, we introduce Generative-Perceptual Co-Supervision that combines semantic alignment from CLIP visible image encoder with diffusion noise-prediction feedbacks. On four source-disjoint IR classification benchmarks, TMT achieves the highest mean zero-shot accuracy among the compared methods (48.92%). It also achieves the best IR-text retrieval results among the compared methods without infrared-text supervision during adaptation and the highest open-vocabulary segmentation mIoU on both CART and SemanticRT among the CLIP-like methods.
42. 【2611.12334】Rethinking Radar 3D Perception: Representation Learning from Raw Spectra
链接：https://arxiv.org/abs/2611.12334
作者：Miao Zhang,Mohamed Abdelsamad,Bin Yang,Sherif Abdulatif,Benedikt Loesch,Marco Altmann,Abhinav Valada,Bin Yang
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Robotics (cs.RO)
关键词：sparse point clouds, compact Doppler descriptors, sparse point, point clouds, motivating handcrafted reductions
备注： 19 pages, 5 figures, 18 tables. Accepted at NeurIPS 2026. Miao Zhang and Mohamed Abdelsamad contributed equally
点击查看摘要
Abstract:Raw radar spectra are widely viewed as too cluttered and noisy for direct representation learning, motivating handcrafted reductions, sparse point clouds, or compact Doppler descriptors in radar perception. We challenge this assumption and argue that the main limitation lies not in the raw representation itself, but in the absence of a learning objective that separates structured signal from noise. Handcrafted reductions partially address this problem but impose rigid assumptions about what constitutes signal, discarding weak yet informative structure while retaining artifacts that fit the reduction model. Once removed, such information cannot be recovered by supervised learning. We propose an alternative: structure is the component of a radar spectrum that remains reconstructable under localized corruption, while noise is the component that does not. This perspective motivates self-supervised masked modeling for dense radar spectra without predefined signal-noise separation. We instantiate it with Leakage-aware Spectral MAE, a masked autoencoder for raw radar cubes using a corruption strategy inspired by cross-bin energy spreading caused by spectral leakage. We also demonstrate the importance of Doppler organization: treating Doppler as a primary spatial dimension in an x-y-D representation, with height encoded as features, substantially outperforms naive channel stacking and enables effective learning from dense 4D spectra. Without handcrafted reductions, our approach consistently outperforms state-of-the-art radar-based detectors and point-cloud-based self-supervised learning (SSL) counterparts. These results establish raw radar spectra as an effective representation for 3D perception when paired with an appropriate pretraining objective.
43. 【2611.12324】How Many Exposures Does a World Model Need? Learning Unseen Game Mechanics at Test Time
链接：https://arxiv.org/abs/2611.12324
作者：Ku Onoda,Haruto Kawano,Shota Takashiro,Kohei Hayashi
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：models enable agents, World models enable, imagined experience, enable agents, agents to plan
备注： 31 pages, 21 figures, 12 tables. ARC Prize 2026 Paper Track. Code and weights: [this https URL](https://github.com/third-intelligence/WARC)
点击查看摘要
Abstract:World models enable agents to plan and learn from imagined experience, but in an unfamiliar environment they must learn its mechanics from limited interaction. A mechanic is a rule for how an action or an interaction changes part of the environment. Each occurrence of a mechanic that the model observes is one exposure. We ask how many exposures a world model needs to predict the effects of a new environment's mechanics. We address this question on ARC-AGI-3, a benchmark of interactive games defined by their programs. We introduce MechEval, which labels 69 recurring mechanics across 20 games from these programs. It scores each prediction on the cells the mechanic changes at each exposure. As a test bed, we build WARC (World model for ARC-AGI-3), a 35M-parameter vision transformer that is pretrained on other games and updates all of its parameters after each transition. On held-out games, WARC learns to predict four in five mechanics with at least 80% accuracy on the cells they change and keeps that accuracy to the end of the recordings. Half of them reach that accuracy within about 80 exposures, in a single play of the game, and without updates only one in seven does at all. In closed-loop play on the public games, WARC-Agent, which pairs WARC with a fixed graph explorer, triples the explorer's official efficiency score from 0.15 to 0.46, mostly through test-time training. On the hidden games of the Kaggle leaderboard, our entry scores 0.20.
44. 【2611.12319】Mitigating SM-Level Load Imbalance in 3D Gaussian Splatting on GPUs
链接：https://arxiv.org/abs/2611.12319
作者：Junha Ryu,Hoi-Jun Yoo
类目：Distributed, Parallel, and Cluster Computing (cs.DC); Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Machine Learning (cs.LG)
关键词：Gaussian Splatting, autonomous driving simulators, generative world models, enables photorealistic, driving simulators
备注：
点击查看摘要
Abstract:3D Gaussian Splatting (3DGS) enables photorealistic, real-time rendering on commodity GPUs and is increasingly adopted in generative world models and autonomous driving simulators. However, existing optimizations rely on algorithmic changes that often require retraining, or on specialized accelerators that lack flexibility across evolving 3DGS variants. In this paper, we identify a fundamental inefficiency in GPU-based 3DGS rendering: severe SM-level load imbalance caused by uneven workloads across screen tiles. This imbalance creates a long execution tail, leaving most SMs idle while a few process computationally intensive tiles, particularly in large-scale urban scenes. To address this, we present a software-defined GPU scheduling approach that mitigates the execution tail. Our approach uses a persistent kernel to schedule heavy tiles first and selectively chunks outlier tiles across multiple CTAs. A lightweight per-frame policy determines when and how much to chunk using tile statistics already available in the rendering pipeline. Our approach requires neither retraining nor specialized hardware and can be applied orthogonally to existing optimizations across diverse 3DGS variants. Averaged per scene, it accelerates alpha blending by up to 2.93x on a large-scale urban scene, and by up to 5.6x on its most imbalanced frames, while retaining the original alpha blending formulation.
45. 【2611.12305】HumanSightBench: A Benchmark for Human Visual Perception in MLLMs
链接：https://arxiv.org/abs/2611.12305
作者：Zixin Su,Yangguang Lin,Zegang Peng,Yuntong Sun,Xuanyi Wang,Jiahao Wang,Qiankai Xu,Bing Yuan,Jinze Bai,Youbin Wu,Jingjia Huang,Ruyang Liu,Yanxu Hu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Multimodal large language, vision-language benchmark datasets, demonstrated strong performance, reasoning-based vision-language benchmark, Multimodal large
备注：
点击查看摘要
Abstract:Multimodal large language models (MLLMs) have demonstrated strong performance on knowledge-intensive and reasoning-based vision-language benchmark datasets, but still struggle to solve the visual questions that people can solve easily. Evaluating the differences between MLLMs and human-level visual perception is challenging due to end-to-end evaluation which combines various skills, or because we are uncertain if individual items are valid. Specifically, observed errors may reflect visual perception, language priors, background knowledge, question ambiguity, and underspecified answers. Our guideline for HumanSightBench is that we construct items that are human-easy by construction and model-hard by evaluation. HumanSightBench contains 2,876 visual questions with short answers across 7 top-level perceptual categories and 21 subcategories. We only include items that pass five inclusion gates: question clarity, answer uniqueness, visual grounding, human solvability, and text-only shortcut filtering. According to the protocol, errors are defined as incorrect answers on human-validated visual tasks with the evaluated interface. The inclusion gates are intended to reduce confounds from ambiguity and external knowledge. The best pass@3 score is 65.6% across eight evaluated MLLMs. No evaluated model exceeds 27.5% on Counting. These results identify capability gaps that are hidden by overall scores and can help future training experiments and held-out evaluation.
46. 【2611.12286】VLA-MOPD: On-Policy Distillation for Multi-Task VLA Policy Consolidation
链接：https://arxiv.org/abs/2611.12286
作者：Yongxuan Lv,Zhen Fang,Lichen Man,Hao Li,Pu Li,Hengyi Wang,Langfeng Cao,Lin Chen,Jie Huang,Xiu Su,Shan You,Fei Wang,Feng Zhao
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Physical intelligence requires, intelligence requires embodied, requires embodied agents, Physical intelligence, retaining useful skills
备注：
点击查看摘要
Abstract:Physical intelligence requires embodied agents to ground language in observations and execute actions while retaining useful skills. Vision-language-action (VLA) policies offer a shared interface, but task-specific post-training often produces separate specialists. Consolidation is difficult: mixed-task reinforcement learning provides sparse trajectory-level credit, while offline distillation may miss student-visited observations and endpoint distillation does not supervise intermediate action-generation states. We introduce VLA Multi-teacher On-Policy Distillation (VLA-MOPD), a protocol for consolidating flow-matching VLA specialists. After acquiring task or suite experts, a shared student collects robot rollouts and queries the instruction-routed frozen teacher at each visited observation and intermediate ordinary differential equation (ODE) state. Detached per-flow-step transition targets supervise valid action chunks through a masked local matching loss; an optional reference-policy term supports retention on other tasks. Starting from one trajectory per LIBERO task, VLA-MOPD raises mean success-once from 75.4% to 98.9%, compared with 98.15% for endpoint action distillation. It improves mean RoboTwin 2.0 success from 73.0% to 89.3%; on a Piper robot, two consolidation rounds improve average success from 70.0% to 90.0%. In a near-matched Spatial-adaptation study, reference matching limits the Object suite decrease to 3.0 points, versus 13.2 without the reference term.
47. 【2611.12259】A forensic evaluation framework for egocentric foundation models: an EFM3D case study for crime scene reconstruction
链接：https://arxiv.org/abs/2611.12259
作者：Davidson Chisom Onwubiko,Shahana Bano,Carlos Francisco Moreno-García
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Foundation models increasingly, egocentric foundation models, models increasingly combine, Foundation models, Egocentric Foundation Model
备注：
点击查看摘要
Abstract:Foundation models increasingly combine geometry, semantics, and spatial context for three-dimensional scene understanding, but their suitability for forensic crime scene reconstruction remains unclear. This study presents a structured forensic evaluation framework for egocentric foundation models and demonstrates it using the Egocentric Foundation Model for 3D (EFM3D). Four simulated indoor crime scenes were recorded with Meta Project Aria Gen~1 at Robert Gordon University's East Lodge House forensic training facility. The framework evaluates room-scale reconstruction, semantic scene understanding, computational performance, and forensic suitability. Across the four scenes, EFM3D generated meshes averaging $12{,}668\pm2{,}430$ vertices and $24{,}838\pm4{,}903$ faces, with 39,529 recorded semantic predictions spanning 21--24 categories at a mean confidence of 0.40. Because reference meshes and expert-labelled 3D ground truth were unavailable, these statistics are treated as descriptive outputs rather than measures of geometric or detection accuracy. Final inference runs processed $1{,}388\pm203$ snippets per scene at $0.69\pm0.01$ samples/s and required $50.77\pm6.12$ minutes per recording. A seven-criterion capability profile indicated stronger support for room geometry, furniture localisation, scene context, and spatial relationships than for fine-scale forensic evidence. The results position EFM3D as a complementary tool for contextual documentation and scene review rather than a replacement for high-fidelity forensic capture. The framework provides a reproducible basis for evaluating future egocentric foundation models in specialised forensic settings.
48. 【2611.12243】CADMA: Capacity-Aware Coverage Decomposition for Generative Model Assessment
链接：https://arxiv.org/abs/2611.12243
作者：Debin Meng,Zheng Gao,Ziquan Liu,Yanran Li,Ioannis Patras,Georgios Tzimiropoulos
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Evaluating generative models, Evaluating generative, models requires measuring, generated set covers, requires measuring
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:Evaluating generative models requires measuring not only sample fidelity but also how well a generated set covers the real data distribution. Recent work has therefore introduced recall-oriented metrics for distribution-level evaluation. However, existing recall metrics often reduce distributional coverage to geometry-based coverage. This simplifying assumption weakens their diagnostic value and interpretability in two ways: these metrics provide only a single aggregate score that cannot distinguish essential diversity failures such as mode dropping and mode collapse, and geometry-based coverage can provide unreliable estimates by assigning high scores to poorly covered generative distributions. We therefore introduce CADMA, a capacity-aware framework for recall-oriented evaluation and diagnosis. CADMA evaluates distributional coverage through local capacity matching between real and generated samples, separating geometry-based coverage from effective coverage. This yields multi-dimensional coverage diagnostics that quantify mode dropping and mode collapse while reducing the overly optimistic estimates produced by geometry-based metrics. Through extensive experiments on toy data, real-world datasets, and generative models, we show that CADMA provides more reliable coverage estimates and more fine-grained, interpretable diagnostic signals of diversity failures than existing metrics. Our code is available at this https URL.
49. 【2611.12242】Controlling Temporal Pseudo-Label Marginals for Stable Online Test-Time Adaptation
链接：https://arxiv.org/abs/2611.12242
作者：Rani Amar,Ofir Lindenbaum
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Continual Test-Time Adaptation, Continual Test-Time, update models online, test time, stream of unlabeled
备注： Accepted at NeurIPS 2026. 20 pages. Code: [this https URL](https://github.com/r-isr/SCALAR)
点击查看摘要
Abstract:Continual Test-Time Adaptation (CTTA) methods update models online using a stream of unlabeled data to overcome distribution shifts encountered at test time. However, CTTA is often unstable, as it can reinforce biases in early predictions and increasingly predict only a few classes, resulting in drift or even collapse. In this paper, we identify narrowing pseudo-label class usage as an indicator of CTTA instability and quantify this behavior. Most existing methods have attempted to address this issue by either selecting reliable adaptation samples or re-weighting the loss to encourage diverse pseudo-labels, but they do not explicitly enforce a class marginal over a temporal window. Instead, we propose Sinkhorn Class-Marginal Regularization (SCALAR), a simple plug-and-play module that controls the pseudo-label distribution over a short temporal window. SCALAR works by maintaining recent predictions in a buffer, balancing their class distribution via the Sinkhorn algorithm to match a specified target distribution, and using the balanced soft targets for adaptation. Without changing the model architecture, SCALAR maintains the per-step runtime and increases the peak allocated GPU memory by only 10 MB on ImageNet-C. Our method is particularly effective on skewed, non-stationary data with severe distribution shifts, where SCALAR significantly alleviates drift and collapse when combined with existing stabilization methods based on entropy or diversity.
50. 【2611.12187】Harnessing Vision-Language Models for Federated Unsupervised Visual Recognition
链接：https://arxiv.org/abs/2611.12187
作者：Jian Liang,Kuangpu Guo,Ran He,Tieniu Tan
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：promising research paradigm, enables collaborative model, collaborative model training, paradigm that enables, enables collaborative
备注：
点击查看摘要
Abstract:Federated learning (FL) is a promising research paradigm that enables collaborative model training across distributed clients without data sharing. To handle unlabeled data in local clients, existing unsupervised FL research has primarily focused on tasks like clustering and self-supervised representation learning, leaving the critical problem of unsupervised visual recognition largely unexplored. To bridge this gap, we introduce FedUR, the first framework designed for unsupervised recognition by leveraging the zero-shot capabilities of pre-trained vision-language models like CLIP. Specifically, FedUR addresses data heterogeneity through a pseudo-labeling mechanism with a class-aware data selection strategy. This strategy first estimates a global pseudo-label distribution, then allocates pseudo-labeled data to clients accordingly. To handle the uncertainty of conventional positive pseudo-labels, FedUR further incorporates class weights and a negative pseudo-labeling strategy. Furthermore, FedUR proposes a personalized prompt aggregation protocol where general visual prompts are aggregated on the server, and personalized text prompts encoding local knowledge are retained on clients. Extensive experiments demonstrate that FedUR consistently outperforms baseline methods under both label-level and feature-level distribution shifts. We believe this work paves the way for further advances in federated unsupervised recognition. Code will be available at {this http URL}}.
51. 【2611.12162】Same Physics, Different Gradients: A State-of-the-Art Report on Differentiable Physics Simulation
链接：https://arxiv.org/abs/2611.12162
作者：Lei Shu,Zizhou Huang,Yunuo Chen,Yifei Li,Tao Du,Minchen Li,Tuur Stuyck,Miles Macklin,Kui Wu,Bo Zhu,Yin Yang,Ming C. Lin,Alberta Longhini,Rika Antonova,Leonidas Guibas,Gordon Wetzstein,Jeannette Bohg,Chenfanfu Jiang
类目：Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Robotics (cs.RO); Numerical Analysis (math.NA)
关键词：Differentiable simulation propagates, simulation propagates derivatives, Differentiable simulation, turning animation, gradient-based optimization
备注： 35 pages, 8 figures, 9 tables
点击查看摘要
Abstract:Differentiable simulation propagates derivatives through a physics simulator, turning animation, system identification, control, and computational design into gradient-based optimization. Engines differ in the physics they model and, less visibly, in which mathematical object they differentiate. We separate two questions the literature conflates. The referent is which object the returned derivative belongs to: the finite computation that executed, the converged equation it approximates, or the continuous dynamics. The realization describes the organization of the backward pass: automatically generated differentiation, an equation-level adjoint solve, or a custom adjoint. The referent defines the target against which exactness is assessed; the implementation determines how accurately that target is approximated. Cost depends on the realization together with how the states needed by the backward pass are retained or recovered. Crossing the axes places every method and engine we classify in a cell, separates claims the literature merges, and shows that the apparent trade-off between exactness and memory follows from how methods have been built rather than from a constraint. A second, orthogonal taxonomy covers contact, where the map is non-smooth. We then ask whether a correct gradient helps. Four mechanisms by which useful gradients are lost are cataloged and measured on one testbed, where the advantage of the exact derivative over the equation-level adjoint depends on where the fitting target comes from as much as on the solver budget, and we review the evidence that zeroth-order methods can outperform simulator gradients in the regimes where those mechanisms act. The model classes, systems techniques and applications are surveyed through this lens, and we close with a reporting checklist, a released diagnostic that computes it, and a research agenda.
52. 【2611.12149】EgoLabel: Zero-Shot Egocentric Auto-Labeling with Cross-Modal Consistency
链接：https://arxiv.org/abs/2611.12149
作者：Xiaozhi Zhang,Changjia Xu,Yaoyuan Yan,Haoxiang Jie,Bingjie Fu
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：Egocentric auto-labeling requires, Egocentric auto-labeling, independently developed models, auto-labeling requires depth, mathrm
备注：
点击查看摘要
Abstract:Egocentric auto-labeling requires depth, camera pose, object, and human-pose estimates to agree across independently developed models. Differences in units, coordinate conventions, and scale can make individually plausible predictions geometrically inconsistent. We present \textbf{EgoLabel}, a zero-shot pipeline that combines off-the-shelf models without target-domain labeled training and provides explicit cross-modal registration and consistency diagnostics. The pipeline integrates MonST3R for geometry, LocateAnything with GMC-BoT-SORT and SAM~2 for objects, and V-HPOT for hands; FisheyeViT provides a separate whole-body compatibility demonstration. Our main hand evaluation uses H2O sensor depth. Across 20 sequences, per-hand depth anchoring reduces the mean of per-sequence median hand--depth residuals by $23\%$ relative to a single global scale, yielding a pooled median of $84.6\,\mathrm{mm}$ against a $20.5\,\mathrm{mm}$ ground-truth reference. Hand PA-MPJPE is $14.53\pm1.29\,\mathrm{mm}$, whereas absolute MPJPE is $119.1\pm31.3\,\mathrm{mm}$, revealing a substantial gap between aligned and metric accuracy. On three RGB-only sequences, camera ATE is $1.40\pm0.29\,\mathrm{cm}$ after $\mathrm{Sim}(3)$ alignment. We also identify a sliding-window implementation issue that allows sensor-initialized depth to change during optimization. Because hand anchoring and its residual share the same depth map, the residual measures internal consistency rather than independent accuracy. These results characterize both the utility and the current limits of the registration pipeline.
53. 【2611.12144】DisasterVL: Evidence-Based Visual Reasoning Dataset and Model for Disaster Scene Understanding
链接：https://arxiv.org/abs/2611.12144
作者：Ali Diba,Aisha Al-Mohannadi,Yin Yang,Muhammad Imran,Ferda Ofli
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：introduce DisasterVL, disaster imagery, VQA annotations link, million structured annotations, VQA
备注：
点击查看摘要
Abstract:We introduce DisasterVL, a dataset and benchmark for evidence-grounded reasoning about disaster imagery. It contains approximately 1.2 million images from 142 countries, paired with 25 million structured annotations covering scene captions, incident and location assessments, spatial relationships, and visual question answering (VQA). The VQA annotations link answers to visible evidence and include questions about both present and absent cues, multiple answer formats, and difficulty labels. Region-level annotations link caption phrases to bounding boxes and spatial relationships to the regions they connect. The test set contains 38,254 images spanning 75 countries and 28 hazard types. Gemini 3.1 Pro audited the test annotations, and human reviewers validated a stratified subset. On this benchmark, the 9B DisasterVLM model outperforms the evaluated general-purpose baselines on captioning, open-ended VQA, incident reasoning, and region-level grounding. Gains in text overlap are larger than gains in evidence scores. We plan to publicly release the dataset, trained models, and code.
54. 【2611.12136】LHNav: Long-Horizon Humanoid Navigation via Multirate Coordination and Physics-Grounded Action Data
链接：https://arxiv.org/abs/2611.12136
作者：Xueyang Wang,Zehong Shen,Dingkun Wei,Huaijin Pi,Changpeng Wang,Xing Zhu,Hujun Bao,Yujun Shen,Xiaowei Zhou
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：long-horizon language instructions, study humanoid navigation, language instructions, study humanoid, navigation
备注：
点击查看摘要
Abstract:We study humanoid navigation across multiple destinations under long-horizon language instructions. This task is challenging because robots must maintain progress across successive goals while continuously producing natural, stable whole-body motion through confined spaces. However, task decomposition in existing methods does not by itself ensure progress throughout execution, while waypoint-based navigation does not guarantee natural, route-faithful whole-body motion. Our key idea is to organize navigation into three complementary roles operating at different time scales: a Brain for task reasoning, a Cerebellum for local motion generation, and a Brainstem for whole-body execution. We realize this idea in LHNav, an asynchronous system that uses progress and arrival feedback to coordinate navigation goals, VLA motion-token prediction, and whole-body control. To train the Cerebellum for natural, route-faithful motion, we develop a physics-grounded data engine that improves physical tracking of motion references along collision-aware routes and pairs the resulting demonstrations with rendered visual observations. Together, these designs allow task planning to proceed alongside continuous movement and extend single-goal navigation to successive destinations with natural, route-faithful whole-body motion. In simulation, our navigation VLA outperforms OmniNav and DualVLN in single-goal success and motion smoothness, with fewer collisions and falls. Using a VLA trained only on single-goal demonstrations, LHNav achieves a 75.56% success rate on long-horizon navigation tasks. Deployment on the Unitree G1 further demonstrates single-goal navigation and zero-shot long-horizon task execution in real-world environments, including layouts with repositioned objects. Project website: this https URL.
55. 【2611.12129】RAPA: Ray-Aware Physics Augmentation for Robust Camera-LiDAR Calibration
链接：https://arxiv.org/abs/2611.12129
作者：Kyung-Rin Oh,Ji-Hoon Kim,TaeJoon Ha,Jae-Sang Hyun
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：autonomous systems, perception in robotic, robotic and autonomous, checkerboard, RAPA
备注：
点击查看摘要
Abstract:Camera-LiDAR calibration is essential for reliable perception in robotic and autonomous systems. Most target-based calibration methods rely on checkerboard observations, but accurate checkerboard feature extraction from LiDAR point clouds remains challenging due to measurement sparsity. Existing approaches either require manual annotation of 3D corners or depend on geometric feature extraction methods, both of which can become unreliable when checkerboard features are insufficiently observed. In this paper, we formulate checkerboard localization as a 2D detection problem using cylindrical LiDAR reflectivity images. To overcome the limited availability of labeled training data, we propose ray-aware physics augmentation (RAPA), which generates diverse synthetic samples from a single checkerboard observation. The generated data are used to improve detector robustness and generalization under varying sensing conditions. Across four independently captured indoor and outdoor locations, the proposed synthetic augmentation exceeds the strongest evaluated image-space augmentation baseline by 16.1-43.1 percentage points in mAP@0.5. Compared with training-free target-based methods on 242 observations, RAPA yields the largest number of valid target localizations, with 96.4% of its returned detections yielding valid target poses. These reliable localizations support downstream camera-LiDAR calibration across all four evaluated locations. Overall, RAPA addresses a key bottleneck in target-based calibration by enabling automated LiDAR-side target localization with only a single annotated target observation.
56. 【2611.12103】Real-Time Volumetric Light Transport Inference without a Path
链接：https://arxiv.org/abs/2611.12103
作者：Ludwic Leonard,Ruediger Westermann
类目：Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV)
关键词：ambient environmental illumination, reconstructing fully integrated, fully integrated pixel, rendered volumetric media, Unlike Monte Carlo
备注：
点击查看摘要
Abstract:We present a real-time method for reconstructing fully integrated pixel radiance in rendered volumetric media under direct and ambient environmental illumination, using compact, low-cost scene features and statistics. Unlike Monte Carlo denoising pipelines for volumetric rendering, which depend on computationally expensive path-traced radiance estimates, our approach directly infers the final light-transport solution from inexpensive primary-ray and environment sample evaluations. We show that these features form a near-sufficient representation of the scene, enabling accurate reconstruction at substantially lower computational cost. Using an attention-augmented image-to-image network, we demonstrate that complete pixel radiance can be inferred directly from these auxiliary features, without requiring the original radiance signal. Operating in image space also provides a more stable computational cost as the camera zooms into or out of the volume, with substantially less dependence on volume density than approaches based on explicit multiple-scattering simulation. We demonstrate real-time performance and high reconstruction accuracy in challenging volumetric cloud scenarios.
57. 【2611.12102】SPARK: Simple Post-training for Adapting pRetrained Knowledge to Robot Control
链接：https://arxiv.org/abs/2611.12102
作者：Taekyung Kim,Jeongeun Park,Byeongho Heo,Sungjoon Choi,Sangdoo Yun,Dongyoon Han
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：provide strong general-purpose, Large-scale representation learning, produced public foundation, strong general-purpose visual, Large-scale representation
备注： CoRL 2026. 16 pages, 3 figures, 13 tables
点击查看摘要
Abstract:Large-scale representation learning has produced public foundation models that provide strong general-purpose visual features. However, their pretraining objectives are not designed for robot representation learning, so the resulting embeddings tend to emphasize global semantics rather than the temporally sensitive representations required for robot control. Training robot models from scratch is also undesirable due to the limited scale and high collection cost of robotics data, as well as the substantial computational burden of pre-training. In this paper, we propose SPARK (Simple Post-training for Adapting pRetrained Knowledge), a post-training method that adapts foundation models to robot control. SPARK is built on two principles: temporal abstraction, which encourages the encoder to derive compact features that preserve information essential for understanding temporal changes and action-relevant scene structure, and knowledge preservation, which aligns patch-level representations with those of the original foundation model to retain useful pretrained semantics. These objectives yield compact visual state representations that remain semantically meaningful while preserving useful prior knowledge. Experiments across multiple robotics benchmarks show that SPARK consistently improves success rates and generalization over vanilla foundation models, and further demonstrate that these gains transfer to real-world robot manipulation.
58. 【2611.12087】Compass 1: Towards Open-World and Persistent Embodied Navigation from Monocular RGB Videos
链接：https://arxiv.org/abs/2611.12087
作者：Hai Zhang,Siqi Liang,Yanjun Guo,Shoufeng Zhang,Yunhao Wang,Hangyu Du,Haoguang Mai,Hongchen Li,Jiazhi Yang,Jialong Zeng,Yu Hu,Chen Chen,Gangcheng Jiang,Zishun Zhuo,Lirui Zhao,Zhigang Li,Yu Qiao,Zhenjie Yang,Fu Zhang,Hongyang Li
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：navigation requires agents, Embodied navigation requires, achieve persistent spatial, persistent spatial awareness, requires agents
备注： Technical Report. Project Page: [this https URL](https://www.archon.tech/research/compass1)
点击查看摘要
Abstract:Embodied navigation requires agents to achieve persistent spatial awareness and long-horizon execution stability in open-world environments. However, existing navigation architectures struggle to sustain both capabilities, remaining effective only over a handful of recent frames. We present Compass 1, the first embodied navigation foundation model to unify language understanding and video generation while enabling memory backtracking through nearly 2mins of visual history. Without altering the underlying architecture, we introduce History Representation, which integrates sparse visual keyframes with an explicit History Representation Map to preserve long-term spatiotemporal context. To effectively leverage this history, we further introduce History Utilization, a structured VQA supervision protocol comprising three categories: task-stage grounding, exploration consistency, and spatiotemporal target retrieval, enabling map-grounded reasoning and stable persistent long-horizon navigation. To fuel this system, we establish a complete annotation pipeline for monocular RGB videos and open-source a massive dataset featuring over 500 hours of high-quality real-world interactions and over 2,000 hours of annotated web videos. Trained mainly on the distribution of 1m height camera, Compass 1 generalizes seamlessly across diverse embodiments and scenarios, ranging from indoor environments to pedestrian-dense streets, spanning wheeled robot at 0.35m, quadruped dog at 0.5m, humanoid at 0.85m, and aerial drone at 1.5m. Compass 1achieves a dominant overall success rate of 79.4% across open-world evaluations, compared to 17.8% for the strongest baseline. It demonstrates exceptional zero-shot execution exceeding 90% on foundational tasks, a 250% boost in exploration, and an unparalleled leap from 0% to 58% in challenging persistent history backtracking.
59. 【2611.12075】How a Model's Architecture and Performance Influences Explainability: A Study of Grad-CAM and CRAFT in CNN-Based Image Classification
链接：https://arxiv.org/abs/2611.12075
作者：Kilian Göller,Haadia Amjad,Steffen Seitz,Carsten Knoll,Ronald Tetzlaff
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Deep learning models, convolutional neural networks, opaque decision-making raises, decision-making raises concerns, Deep learning
备注： Accepted at the 4th World Conference on eXplainable Artificial Intelligence (xAI 2026), Fortaleza, Brazil, July 1-3, 2026. To appear in Springer CCIS. 12 pages, 5 figures
点击查看摘要
Abstract:Deep learning models, particularly convolutional neural networks (CNNs), are widely adopted in computer vision, yet their opaque decision-making raises concerns in high-risk applications like healthcare and autonomous systems, where trust and accountability are critical. Therefore, robust explainable AI (XAI) methods are desirable to provide transparent insights into model decisions. To ensure these methods are reliable and effective across diverse scenarios, it is important to understand how model performance and architectural complexity influence explanation quality. Our study takes an initial step toward systematically investigating the impact of these two factors on key XAI evaluation metrics. We constructed a pipeline using 10 subsets of ImageNet-1K, each containing 80 unique classes, on each of which we trained three CNN architectures of increasing structural complexity: VGG16, ResNet50, and ConvNeXt-Tiny. For each individual model, we analyzed 10 training checkpoints representing increasing levels of model accuracy using two XAI methods: Grad-CAM (feature-attribution-based) and CRAFT (concept-based). We assessed these methods across four evaluation categories: Faithfulness, Correctness, Sensitivity, and Simplicity. Our findings reveal that as training progresses, the complex architectures (ResNet50 and ConvNeXt-Tiny) exhibit improved Faithfulness and lower Sensitivity, indicating more robust explanations. In contrast, VGG16's simpler architecture yields simpler but less faithful and correct explanations.
60. 【2611.12070】Color wave: A systematic evaluation of active screen illumination for injection attack detection in remote face authentication
链接：https://arxiv.org/abs/2611.12070
作者：Daniyar Kurmankhojayev,Elmurat Nigmatov,Dmitrii Gordin,Andrei Shadrikov,Mikhail Shkorin,Danijar Gabdullin,Vyacheslav Shen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Remote face authentication, face authentication requires, authentication requires protection, Remote face, biometric data injection
备注：
点击查看摘要
Abstract:Remote face authentication requires protection against both presentation attacks and biometric data injection attacks prior to face matching. Methods based on active screen illumination appear promising for both by introducing randomized visual stimuli through the user's device screen and evaluating the corresponding facial responses. Although such methods have been more studied for presentation attack detection (PAD), their systematic evaluation for injection attack detection (IAD) remains limited. To address this gap, we first classify injected content into static images, prerecorded videos, and real-time deepfakes based on their expected responses to the challenge. We then adapt an active screen-illumination approach into an implementation we term color wave and develop a systematic, injection-specific evaluation protocol. The protocol examines detection effectiveness, generalization across operating conditions, robustness to signal degradation, and susceptibility to selected evasion strategies. The findings demonstrate a strong discriminative signal under controlled conditions but also reveal performance limitations under overexposure, low screen brightness, and subject motion, as well as vulnerabilities to selected evasion strategies. By relating detection outcomes to attack types and operating conditions, this study provides an interpretable assessment of when and why active screen illumination succeeds or fails as an IAD mechanism.
61. 【2611.12069】MPEG-Diffusion: Mixed-Resolution Video Generation
链接：https://arxiv.org/abs/2611.12069
作者：Dennis Menn,Tianpei Gu,Guande He,Aryan V S,Yanke Song,Nan Liu,Desai Xie,Xun Huang,Chenfeng Xu,Diana Marculescu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：broader real-world applications, Video diffusion transformers, generate realistic videos, limits broader real-world, heavy computational cost
备注：
点击查看摘要
Abstract:Video diffusion transformers (DiTs) generate realistic videos, but their heavy computational cost limits broader real-world applications. Mixed-resolution generation reduces this cost by generating the visually important region at high resolution (HR) and the rest at low resolution (LR), yet existing methods suffer a severe quality drop on videos and require knowing the HR region in advance. We show that these failures are not inherent to mixed resolution, and propose $\textbf{MPEG-Diffusion}$ to address their three root causes: (1) dual-resolution attention to mitigate the curse of mixed resolution, where each query reads the K/V of its own resolution, (2) a mixed-resolution decoder to blend the HR and LR latents before decoding and resolve distortion, and (3) a self-selected HR region using the DiT's knowledge to find the visually important region without requiring it in advance. Processing only $30\%$ of full-resolution tokens, MPEG-Diffusion speeds up denoising by $4.8\times$ on Wan2.1 14B ($3.8\times$ on 1.3B), outperforming prior methods on nearly every metric. In the user study, we demonstrate the high quality of MPEG-Diffusion, with raters preferring it over prior mixed-resolution methods in over $90\%$ of pairs and rating it close to full resolution.
62. 【2611.12066】Weight-Space Programming for Medical Imaging: Do We Still Need Training Data?
链接：https://arxiv.org/abs/2611.12066
作者：Maximilian Lindholz,Richard Ruppel,Annette Milnik,Sebastian Halskov,Semil Eminovic,Charlie A. Hamm,Robin Schmidt,Anika Knupfer,Jana Hutter,Johanna P. Müller,Carolina Dominguez Aleixo,Jawed Nawabi,Jens Vogel-Claussen,Tobias Penzkofer
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：large language model, training data, large language, AUC, data
备注：
点击查看摘要
Abstract:Can a large language model (LLM) write the parameters of a medical image classifier from medical knowledge alone, without any training data? Such classifiers normally require labelled images, which are costly and often unavailable. We investigate this question through weight-space programming (WSP), in which an LLM writes or adapts the weights and biases of a neural network directly, without optimisation on training data. Claude Opus 5.5 and GPT-6 Astra each generate the parameters of a small LeNet-style CNN in a single reply, without tool use and without access to any image. We compare these networks against zero-shot MedSigLIP and against the same architecture trained on labels using the Adam optimiser, across 7 classification tasks in four modalities: chest X-ray, breast ultrasound and abdominal CT (all from MedMNIST), and pelvic MRI (SynthUterus). The LLM-written networks perform above chance on all six MedMNIST tasks, with a mean test AUC of 0.719 for Opus and 0.711 for Astra. Both models outperform MedSigLIP on 5 of 6 tasks while using more than 10,000 times fewer parameters. However, the same network trained with Adam on only 256 labelled images achieves a higher AUC on every MedMNIST task (mean AUC 0.828). On SynthUterus, Opus attains an AUC of 0.764, whereas Astra falls below chance (AUC 0.136) owing to a systematic error. These results show that LLMs can write functional medical classifiers, but that they do not yet replace training data. We release the protocol, logs and all generated weights at this https URL.
63. 【2611.12051】Attention-Guided Sequence Feature Fusion and Mixed-Space Metric Learning for Cross-View Image Sequence Geo-Localization
链接：https://arxiv.org/abs/2611.12051
作者：Nan Wu,Chunfang Yang,Jiangshan Li,Xiangyang Luo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：geo-tagged satellite imagery, Cross-view image sequence, image sequence geo-localization, image sequence, sequence geo-localization aims
备注：
点击查看摘要
Abstract:Cross-view image sequence geo-localization aims to determine the geographic location of a sequence of ground images by matching it against geo-tagged satellite imagery. Although sequential observations provide complementary scene information, substantial overlap between adjacent images introduces feature redundancy, while conventional fusion strategies may weaken spatial relationships essential for cross-view matching. Therefore, we propose a cross-view image sequence geo-localization method via Attention-guided Sequence fusion and Metric Learning (ASML). Specifically, a Sequential Content Fusion (SCF) module models cross-image feature correlations to suppress redundant content and adaptively preserve geographically informative non-overlapping regions. Next, a Spatial Feature Aggregation (SFA) module is used to capture and aggregate the spatial and semantic information of local features, so as to maintain the spatial layout of the image sequence. Finally, a Geo-InfoNCE loss function is proposed, which comprehensively considers the feature distance and geographic distance for mixed-space metric learning, thus improving the ability of the model to distinguish hard negative samples. A new cross-view image sequence dataset CrossRoad-66K is established to provide more complex scenarios. Extensive experiments and visualizations on the SeqGeo and CrossRoad-66K datasets demonstrate that compared to state-of-the-art (SOTA) methods, the proposed method ASML achieves an improvement of 3.37% and 2.10% at R@1, respectively.
64. 【2611.12042】Four-Step Text-Bearing Image Generation via Distillation with Local Response Regularization and Teacher-Guided Training
链接：https://arxiv.org/abs/2611.12042
作者：Kairui Wen,Sheng Ye,Yong-Jin Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Generating text-bearing images, Generating text-bearing, images requires coherent, text-bearing images requires, requires coherent scenes
备注：
点击查看摘要
Abstract:Generating text-bearing images requires coherent scenes and accurate characters. Large text-to-image models improve both capabilities through repeated denoising, at substantial sampling cost. Few-step distillation reduces this cost but requires the student to organize scenes and refine glyphs within a short trajectory. We present a four-step distillation framework combining local response regularization with teacher-guided text training. Built on distribution matching, the framework distills the GLM-Image DiT while retaining its autoregressive visual prior, glyph encoder, and VAE. A path-length penalty promotes consistent local responses of the conditional denoising field. Progressive training combines synthetic strings with teacher-generated imagery to preserve character accuracy and scene-integrated typography. The student achieves GenEval Overall 0.84 and CVTG-2K word accuracy 0.5045, compared with 0.81 and 0.1690 for four-step TDM. A coefficient study favors $10^{-5}$, and Qwen-Image experiments show additional gains from response regularization and text supervision. Single-image inference takes 1.742 s, compared with 5.818 s for the teacher, yielding a $3.34\times$ speedup at the same 40 GB GPU memory requirement.
65. 【2611.12040】Leveraging Complementary Event Frame and Voxel Representations for RGB-Guided Multimodal Pre-training
链接：https://arxiv.org/abs/2611.12040
作者：Wentao Wu,Xiao Wang,Yi Wang,Chenglong Li,Yonghong Tian,Bin Luo
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：unified RGB Frame, Frame pre-training framework, RGB Frame, Spatiotemporal Masked Reconstruction, Frame and Event-Voxel
备注：
点击查看摘要
Abstract:In this paper, we propose CM3AE 2.0, a unified RGB Frame and Event-Voxel/-Frame pre-training framework. By jointly learning multimodal spatiotemporal representations and exploiting latent cross-modal dependencies through cross-modal generation, the framework enhances multimodal information interaction and collaborative modeling capabilities. Specifically, we first propose an Event-aware Spatiotemporal Masked Reconstruction (ESMR) strategy to learn unified multimodal spatiotemporal representations. It leverages event responses to guide masking toward dynamically salient regions. Through spatiotemporal masked reconstruction, it learns spatial structures and their temporal variations from continuous RGB-Event observations. In addition, it incorporates multimodal fusion reconstruction and cross-modal contrastive learning to facilitate the modeling of cross-modal complementary information and the learning of shared representations. Building upon this, we further propose a Hierarchical Cross-modal Generation (HCG) strategy to learn latent cross-modal dependencies through visual and language generation. At the visual level, Event-conditioned RGB generation is performed using a pre-trained diffusion model to capture visual associations between the two modalities. At the language level, video-level text description generation based on joint RGB-Event representations establishes connections between multimodal visual features and linguistic semantics, further enriching the learning of cross-modal dependencies. Extensive experiments on four diverse downstream tasks demonstrate that CM3AE 2.0 consistently improves performance, validating the effectiveness and generalization capability of the proposed pre-training framework.
66. 【2611.12038】DPGS-SLAM: Diffusion-Prior and Provenance-Aware Monocular Gaussian Splatting SLAM for Dynamic Visual Sensing
链接：https://arxiv.org/abs/2611.12038
作者：Yifan Luo,Takafumi Matsumaru,Vibekananda Dutta,Xin He
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Gaussian Splatting SLAM, paper presents DPGS-SLAM, Monocular Gaussian Splatting, monocular RGB SLAM, Gaussian Splatting
备注：
点击查看摘要
Abstract:This paper presents DPGS-SLAM (Diffusion-Prior and Provenance-Aware Monocular Gaussian Splatting SLAM) for dense mapping in environments containing dynamic objects. Dynamic observations can contaminate camera tracking and scene reconstruction in visual SLAM (simultaneous localization and mapping). Although 3DGS (3D Gaussian splatting) enables efficient dense mapping, existing 3DGS-SLAM systems may exhibit instability when dynamic objects violate their underlying static-scene assumption. Excluding dynamic observations can reduce their influence on tracking and mapping, but may leave occluded static backgrounds missing or weakly constrained. Our proposed DPGS-SLAM is a monocular RGB SLAM framework that supports provisional representations of insufficiently observed static backgrounds through asynchronous diffusion-based background completion and provenance-aware Gaussian mapping. Dynamic regions are identified through optical-flow-based motion discovery and temporally consistent mask propagation by SAM2 (segment anything model 2). For selected keyframes, a fine-tuned diffusion inpainting model generates plausible background appearance in occluded regions, while Metric3D v2 predicts metric depth from the completed images to initialize provisional Gaussian primitives. Provenance labels distinguish generated primitives from observation-supported primitives, excluding generated content from camera-pose estimation and observed-map optimization. When previously occluded backgrounds become visible, eligible generated primitives are removed, and observation-supported primitives are independently initialized from real RGB observations and predicted depth. Experimental results demonstrated competitive camera tracking, with average ATE RMSE values of 1.2 cm on TUM RGB-D and 2.7 cm on BONN RGB-D. On StaDy4D, DPGS-SLAM improved average PSNR by 4.60 dB over WildGS-SLAM using only monocular RGB input.
67. 【2611.12037】SAFE-Hair: Scalp-Anchored Fields for Exportable Single-View Hair Reconstruction
链接：https://arxiv.org/abs/2611.12037
作者：Yucheng Wang,Zedong Wang,Yuetong Wu,Yue Ma,Dan Xu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：progressed rapidly, simulation pipelines, producing strand assets, methods optimize, optimize for visual
备注： Accepted to NeurIPS 2026
点击查看摘要
Abstract:Single-view 3D hair reconstruction has progressed rapidly, but many methods optimize for visual plausibility rather than producing strand assets that can be directly used in grooming, editing, or simulation pipelines. We propose SAFE-Hair, a framework that reconstructs explicit strand grooms from a single portrait by decoding hair from persistent follicles in a canonical scalp-UV domain. Given a fitted template head, SAFE-Hair projects self-supervised image features onto the scalp, uses a conditional Rectified Flow model to generate latent scalp fields, and decodes occupancy, segment directions, length allocation, and total length at a fixed set of scalp follicles. This representation enforces scalp-rooted strand identities by construction and enables direct export with follicle IDs and guide-family metadata. We further introduce attachment, collision, and bending priors to improve geometric validity without per-subject test-time optimization. To evaluate both reconstruction fidelity and asset usability, we introduce HairBench-3D, a benchmark built from public 3D hair assets with standardized alignment, rendering, resampling, and metrics for geometry, direction consistency, invisible-region completion, silhouette agreement, and collision. SAFE-Hair improves Chamfer distance from 3.74 mm to 3.28 mm, F-score from 77.9 to 81.7, invisible-region F-score from 66.1 to 69.8, and penetration ratio from 4.8% to 3.9% over the strongest baseline.
68. 【2611.12025】Single Image Super-Resolution via Semantic Prompt and Cross-Modal Training on Content Area
链接：https://arxiv.org/abs/2611.12025
作者：Xiao Tan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Enhancing image quality, Enhancing image, video processing, quality through super-resolution, super-resolution is crucial
备注： 21 pages, 7 figures, 5 tables
点击查看摘要
Abstract:Enhancing image quality through super-resolution is crucial in image and video processing. While contemporary deep learning models, such as CNNs and Transformers, excel in pixel-level enhancements, they often overlook the rich semantic context within images. To address this, we introduce a novel approach that synergizes pixel intensity with semantic information for superior detail recovery. Our method involves extracting semantic data, including textual descriptors and spatial positioning, and encoding this information. We also present a Cross-Modal Feature Fusion module for generating semantic feature maps via multimodal training, and a Prompt Traction Head to augment the backbone network with semantic insights, thereby refining image details. Our empirical results across various datasets validate the superiority of our approach.
69. 【2611.12023】IRAD: Text-guided Image Residual Learning for Generalist Anomaly Detection
链接：https://arxiv.org/abs/2611.12023
作者：Seongsu Lee,Seunghyun Oh,Seungjae Moon,Youngmin Ro
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Recent anomaly detection, provide strong generalization, Image Residual Feature, anomaly detection studies, Text Residual Feature
备注： Accepted to ACCV 2026
点击查看摘要
Abstract:Recent anomaly detection studies have shown that residual features, which model the discrepancy between normal and abnormal patterns, provide strong generalization to anomalies unseen during training. However, existing residual-based approaches mainly rely on visual discrepancies derived from image representations, while semantic discrepancies that can be explicitly expressed through language remain largely underexplored. To address this problem, we propose TIRAD, Text-guided Image Residual Learning for Generalist Anomaly Detection, a multimodal residual learning framework that defines the discrepancy between textual representations of normal and abnormal states as a Text Residual Feature and uses it to guide the Image Residual Feature. Specifically, a Text Fusion Module converts patch-level text residuals into a gate that modulates the image residual of each patch. The gate retains the visual discrepancies that the text residual identifies as defect-related and attenuates the others, leading to more discriminative anomaly representations. Extensive experiments on industrial benchmarks and industrial-to-medical transfer demonstrate that the proposed method outperforms existing image-centric residual learning methods.
70. 【2611.12011】HIST3R: Decomposing and Rectifying State Updates with History for Streaming 3D Reconstruction
链接：https://arxiv.org/abs/2611.12011
作者：Kenneth Yang,Yu-Chiang Frank Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：long-video scene understanding, enables long-video scene, subsequent predictions depend, states enables long-video, compact scene memory
备注： Accepted at NeurIPS 2026. Project page: [this https URL](https://kennethyangg.github.io/HIST3R/)
点击查看摘要
Abstract:Streaming 3D reconstruction with recurrent states enables long-video scene understanding under bounded memory, but turns reconstruction into a state-evolution problem: each incoming frame updates a compact scene memory on which all subsequent predictions depend, so unreliable updates overwrite historical context and accumulate into long-horizon geometric drift. We analyze CUT3R-style recurrent updates through a direction--magnitude decomposition, in which the magnitude sets the update gain, i.e., how strongly an observation is written into the state, and the direction encodes the geometric intent, i.e., where the update drives the state. This decomposition provides a unified view of CUT3R and its variants, revealing that existing training-free extensions perform magnitude-only control: they can attenuate an unreliable update but cannot correct its direction. We propose HIST3R, a training-free framework built on CUT3R that controls both components using history. HIST3R rectifies the update direction using locally consistent historical states, and modulates the update magnitude according to the visual discrepancy between the current observation and its history, suppressing redundant updates while preserving complementary evidence. Across camera pose estimation, 3D reconstruction, and video depth estimation, HIST3R consistently improves long-horizon performance while retaining the memory footprint and inference speed of CUT3R. With 1000 input frames, it reduces ATE by 23.87% on ScanNet and 33.65% on TUM-Dynamics relative to the strongest competing method; with 500 frames, it improves median reconstruction accuracy over the strongest CUT3R-based variant by 56.52% on 7-Scenes and 33.96% on NRGBD.
71. 【2611.11994】EmoHarness: Boosting Multimodal Emotion Understanding with Meta-Harness Evolving
链接：https://arxiv.org/abs/2611.11994
作者：Fenghai Li,Bingxuan Li,Jiawen Zhang,Yifan Shen,Jiateng Liu,Yutong Zhang,Yue Guo
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：visual cues conflict, cues conflict, visual cues, Small multimodal models, misjudge emotion
备注： 18 pages, 11 figures, 6 tables. Project page: [this https URL](https://emo-harness.github.io) . Code: [this https URL](https://github.com/Emo-Harness/EmoHarness)
点击查看摘要
Abstract:Small multimodal models can misjudge emotion when words, voice, and visual cues conflict. We present EmoHarness, which runs such a model, the frozen student, inside a harness: the prompts, settings, and verification code around its calls. A human-written starting harness, the scaffold, numbers the student's visual observations, transcript, and prosody descriptions as citable evidence and has the student weigh candidate emotions against it. In Meta-Harness Evolving (MHE), a stronger LLM, the Builder, reads the student's errors and execution traces offline and edits the harness; static checks and validation gates decide which edits are kept, and the Builder never sees evaluation items. On 5,507 MME-Emotion items, EmoHarness raises task-macro Recognition by 7.6-13.4 points over a single video-only call for all four students and both Builders. Transcripts and prosody descriptions supply most of this boost (+5.38 to +10.71); the scaffold changes the audio-augmented call by -0.79 to +2.54, partly through extra multi-label predictions, and evolved edits add at most +0.95, although no evolved increment survives Holm correction. The harness's emotion context also transfers to IntentQA, with small gains for three of four students, none of which survives correction. EmoHarness thus boosts small multimodal students chiefly by supplying and organizing audio-derived evidence.
72. 【2611.11989】MUTE: Multi-Level Alignment Uncoupling Against Talking-Head Exploitation for Voice Protection
链接：https://arxiv.org/abs/2611.11989
作者：Donghyun Kim,Jin Hong,Seungmin Kim,Dain Kim,Junseok Kwon,Daeseon Choi
类目：ound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：synthesize realistic facial, realistic facial animations, Talking-head generation models, multimodal deepfake scenarios, deepfake scenarios
备注： Accepted at NeurIPS 2026. 33 pages, including appendix and checklist. Project and code: [this https URL](https://github.com/jindl465/MUTE)
点击查看摘要
Abstract:Talking-head generation models, which synthesize realistic facial animations from audio, are increasingly vulnerable to misuse in multimodal deepfake scenarios. Protecting such systems remains challenging, as talking-head models fundamentally rely on precise audio-visual alignment, while effective audio protection methods remain largely underexplored. In this work, we propose MUTE, an audio protection framework that uncouples the underlying audio-visual alignment through a multi-level strategy. Specifically, MUTE combines (1) Alignment-level Disruption, which directly perturbs cross-modal attention to disrupt structural alignment, and (2) Representation-level Degradation, which perturbs temporal audio embeddings to degrade their representations. To improve robustness, perturbations are constrained in the STFT domain to high-energy regions, making them resistant to post-processing, denoising, and adaptive attacks. An optional speaker-level objective further mitigates potential bypass via TTS-based resynthesis. Extensive experiments demonstrate that MUTE consistently degrades lip synchronization across both white-box and black-box talking-head models while preserving perceptual audio quality. The proposed method remains effective under real-world transformations and can be combined with image-based approaches to provide stronger multimodal protection. The source code and project page are available at this https URL.
73. 【2611.11980】AnyBreak: Towards Jailbreaking Any T2I Model for Any Concept
链接：https://arxiv.org/abs/2611.11980
作者：Qi Lu,Zehui Guo,Yucheng Zhao,Zijing Li,Chuhan Song,Wenrui Zhu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：significant security risks, demonstrated remarkable capabilities, introduced significant security, security risks, demonstrated remarkable
备注： Accepted for poster presentation at ICME 2026
点击查看摘要
Abstract:Text-to-image (T2I) models have demonstrated remarkable capabilities in image generation and editing, yet this progress has also introduced significant security risks. Prior work has shown that adversarial prompt can induce the generation of Not-Safe-For-Work (NSFW) content, including pornographic, violent, and graphic imagery. However, such attacks are typically mitigated by prompt filters and often rely on white-box assumptions. In this paper, we propose AnyBreak, a novel jailbreak framework that constructs adversarial images via multi-scale progressive semantic alignment. During the generation process, these adversarial images steer the generation trajectory in latent space towards unsafe data manifolds, enabling cross-modal transfer of malicious concepts from the text modality to the image modality. AnyBreak operates using only clean textual prompts and adversarial images at inference time, and can jailbreak any T2I models towards any malicious concepts in a fully black-box setting. We further introduce AnyBreak-V, an enhanced variant that incorporates a compensation term to bypass post-hoc safety checkers. Extensive experiments demonstrate that AnyBreak achieves high attack success rates while preserving visual fidelity and semantic consistency with the input prompts under black-box and clean-text constraints. Our findings reveal that existing T2I defense leave critical cross-modal attack surfaces insufficiently addressed. The code is available at this https URL.
74. 【2611.11964】3R-Adapter: Retrieval, Rewiring, and Refinement for Efficient Adaptation of 3D Reconstruction Model
链接：https://arxiv.org/abs/2611.11964
作者：Zixiang Ai,Zhenyu Cui,Xu Zou,Jiahuan Zhou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：demonstrated strong generalization, large-scale pre-training, demonstrated strong, strong generalization, generalization under large-scale
备注： Accepted as NeurIPS 2026 Spotlight
点击查看摘要
Abstract:Feed-forward 3D reconstruction models have demonstrated strong generalization under large-scale pre-training, yet they struggle in long-tail scenarios such as low-light reconstruction, joint human-scene reconstruction, and test-time adaptation. We observe relational attention structure collapse, manifested as the failure of cross-view correspondences, as a primary cause of these limitations. While adaptation offers a practical way to bridge this gap, existing parameter-efficient fine-tuning (PEFT) approaches mainly perform channel-wise feature adjustment and lack mechanisms to explicitly adapt relational structures, leaving correspondence failures unresolved. In this work, we formulate adaptation of 3D reconstruction models as a problem of correspondence recovery under domain shift and propose 3R-Adapter, a PEFT paradigm for long-tail 3D reconstruction scenarios. Our method consists of three components: Deformable Retrieval for task-adaptive relation candidate retrieval, Relational Rewiring for reconstructing cross-view relational structures, and Consistency Refinement for injecting the rewired relations into stable predictions. Extensive experiments on low-light reconstruction, joint human-scene reconstruction, and test-time adaptation demonstrate that our approach significantly improves robustness over existing PEFT methods while maintaining efficient lightweight adaptation. Our code is released at this https URL.
75. 【2611.11962】Shaping Useful Noise: Energy Distributions Predict Visual Pretraining Quality
链接：https://arxiv.org/abs/2611.11962
作者：Ching Lam Choi,Antonio Torralba,Phillip Isola,Stefanie Jegelka
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：train strong representations, current selection criteria, datasets train strong, scale visual pretraining, strong representations
备注： Accepted as an oral presentation to NeurIPS 2026 (Sydney)
点击查看摘要
Abstract:Synthetic data can scale visual pretraining, but current selection criteria only partially explain which datasets train strong representations. We propose using the energy profile of a dataset--the distribution of log-probability levels it occupies under a normalised real-image density model--as an audit and curation principle for synthetic data. To operationalise this view, we introduce Energy-Level Distribution Distance (ELD), which compares real and synthetic energy distributions. Real images span sparse high-likelihood scenes and dense low-likelihood textures, so useful synthetic data should cover this energy range rather than collapse to likely but low-variation samples. Across diverse synthetic datasets, ELD exposes mismatches missed by FID and predicts pretraining performance beyond FID, LPIPS variation, and feature-space recall, including across CNN and ViT self-supervised settings. We then use ELD to resample and mix synthetic sources, matching the real-image energy histogram while preserving diversity and improving downstream transfer.
76. 【2611.11951】UltraVoxelGS: Voxel-First Feed-Forward Gaussian Splatting for 3D Ultrasound Reconstruction
链接：https://arxiv.org/abs/2611.11951
作者：Yue Wang,Haoxin Chen,Xiaoqing Guo
类目：Computer Vision and Pattern Recognition (cs.CV); Signal Processing (eess.SP)
关键词：bringing live spatial, live spatial feedback, bringing live, scanning within reach, live spatial
备注：
点击查看摘要
Abstract:We present UltraVoxelGS, a 3D ultrasound reconstruction method that achieves both fast reconstruction and physically faithful rendering for the first time, bringing live spatial feedback during 2D ultrasound scanning within reach. This is made possible by a feed-forward design that predicts a complete Gaussian scene representation from posed ultrasound images directly, entirely bypassing the per-scene optimization bottleneck that has confined prior methods to offline use. Realising such feed-forward prediction in this setting is non-trivial: unlike natural images, ultrasound slices share at most one-dimensional intersections and exhibit view-dependent appearance due to acoustic propagation and attenuation, violating the dense overlap and photometric consistency assumed by existing feed-forward Gaussian methods. Hence, to achieve fast reconstruction, we introduce a feed-forward voxel-to-Gaussian pass that decouples representation size from input count by lifting all posed slices into a fixed-size voxel support and predicting Gaussian parameters directly. For faithful rendering, we propose ultrasound-aware appearance rendering strategy factorize reflection from cumulative attenuation during training and exploit appearance continuity among spatially adjacent slices for efficient Render-time Appearance Adaptation. On both real-world and simulated datasets, UltraVoxelGS achieves best PSNR/SSIM compared with per-scene optimization baselines while reducing inference from 10-20 minutes to approximately 10 seconds (over 35 times faster) and scales to sequences exceeding 1,000 frames. Code is available at this https URL.
77. 【2611.11949】Watching Itself Watch: Self-Auditing Visual Reliance for Video Reasoning
链接：https://arxiv.org/abs/2611.11949
作者：Rohan Dugad,Mi Luo,Kristen Grauman
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：largely language-driven chains, Video reasoning hinges, decisive tokens embedded, chains of thought, reasoning hinges
备注： NeurIPS 2026. Project page: [this https URL](https://vision.cs.utexas.edu/projects/VIOS/)
点击查看摘要
Abstract:Video reasoning hinges on a small number of visually decisive tokens embedded in otherwise largely language-driven chains of thought. Yet prevailing post-training methods such as GRPO overlook this structure, assigning coarse trajectory-level rewards while requiring multiple rollouts and often costly external judges. We introduce Visually-Aware On-Policy Self-Distillation (VIOS), a post-training framework that identifies where a model under-utilizes visual evidence and concentrates learning at those positions. Our key insight is that a model can audit its own visual reliance: the divergence between its next-token distributions with and without the video reveals how strongly each prediction depends on the visual input. Measuring this reliance for both a student and an answer-privileged teacher exposes a per-token reliance gap, identifying positions where the teacher exploits visual evidence that the student overlooks. VIOS translates this signal into dense, targeted supervision through three complementary components: an exponential moving average (EMA) teacher that co-evolves with the student, a contrastive objective that encourages predictions to depend on the video, and a reliance-gap gate that focuses learning on visually under-utilized tokens. Crucially, VIOS requires only a single on-policy rollout from a single model, without external rewards, judges, or larger teachers. Across 12 benchmarks spanning general, temporal, spatial, knowledge-intensive, and long-video understanding, VIOS consistently improves three model backbones and outperforms contemporary video-reasoning systems, while training in over 9x fewer steps, 60x fewer FLOPs, and 111x fewer generated tokens. Project page: this https URL
78. 【2611.11934】Scale-Consistent Monocular Fisheye Visual Odometry via Spherical Bundle Adjustment-Guided Unsupervised Depth Learning
链接：https://arxiv.org/abs/2611.11934
作者：Wanhui Luo,Hongbo Zhao,Yi Zhou,Qijun Chen,Yiming Nie,Rui Fan
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：fisheye visual odometry, monocular setup make, setup make monocular, monocular fisheye visual, make monocular fisheye
备注： 34 pages, 18 figures
点击查看摘要
Abstract:The wide field of view of fisheye cameras and the simplicity of a monocular setup make monocular fisheye visual odometry (VO) attractive for robotic localization and mapping. Nevertheless, scale drift remains a major challenge over long trajectories. Unsupervised depth learning can help to mitigate this issue, but the pronounced distortion of fisheye images poses challenges for accurate depth estimation. This article presents S$^2$D-FVO, a monocular fisheye VO framework integrating spherical bundle adjustment (SBA)-guided unsupervised depth learning to improve scale consistency and depth estimation accuracy. Given that pixel reprojection residuals do not uniformly reflect angular deviations between viewing rays and that the first-order linearization of a scalar angular reprojection residual is insensitive to perturbations along one tangent direction, SBA employs tangent-space angular reprojection residuals derived from the spherical logarithmic map. These residuals retain sensitivity along both tangent directions, with their norms equal to the corresponding scalar angular residuals. A median depth-based scale regularization term is further integrated into SBA to constrain the reconstruction scale. Building on these formulations, SBA replaces the pose estimation network during unsupervised depth learning, providing more reliable relative poses for view synthesis. In turn, depth estimates from the well-trained depth estimation network provide scale references for SBA, improving scale consistency while allowing individual 3-D landmark positions to be refined. Extensive experiments conducted on multiple public datasets, as well as two newly collected large-scale datasets, demonstrate that the proposed framework outperforms representative existing approaches in both depth and trajectory estimation accuracy and is applicable to different camera models.
79. 【2611.11926】xt Alone Predicts Which Classes a Segmentation Readout Keeps
链接：https://arxiv.org/abs/2611.11926
作者：David Yan
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：open-vocabulary segmentation readout, segmentation readout silently, open-vocabulary segmentation, training categories, readout silently loses
备注：
点击查看摘要
Abstract:An open-vocabulary segmentation readout silently loses a class deployed beyond its training categories. It still emits masks with high confidence, but the class never wins a single pixel. The training loss falls anyway, and mIoU can even rise while classes die. We show that which classes collapse is written in the class-name list alone. Before any image is seen, we rank each class's collapse risk from its text similarity to the training vocabulary alone. The ranking holds at AUROC 0.69-0.96 across nine model families, twelve backbones and eight pretraining recipes. Two further families, measured only after the predictions were written down, land in the same band. What the list writes, it can rewrite. With identical images and a class's counterpart moved in or out of the training list, retraining flips that class's gain over the frozen baseline by 21 IoU points; swapping in unrelated names changes nothing. We find a vocabulary-distance mechanism behind the collapse. Collapsed classes lose every vote to near-name neighbors, but in the frozen features they survive. Turning down the readout's amplitude, or stopping training early, brings them back, up to +16 points, without retraining; trained with its amplitude held down, the readout never collapses.
80. 【2611.11912】LO-World: Unified BEV Latent Modeling for Joint 4D Occupancy and LiDAR Forecasting
链接：https://arxiv.org/abs/2611.11912
作者：Zhimin Liao,Ping Wei,Kai Mao,Shuaijia Chen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：holding natural potential, capturing fine-grained metric, distinct modalities capturing, modalities capturing fine-grained, LiDAR point clouds
备注：
点击查看摘要
Abstract:LiDAR point clouds and 3D semantic occupancy represent two distinct modalities capturing fine-grained metric geometry and dense volumetric semantics, respectively, holding natural potential for mutual complementarity. However, existing world models typically forecast these modalities independently or cascade them heuristically, missing the opportunity for reciprocal cross-modal regularization. To address this, we propose \textbf{LO-World}, a unified 4D world model that forecasts both modalities within a shared BEV latent space. This single-stream formulation enables dense semantics and metric geometry to mutually reinforce each other, while eliminating multi-pipeline redundancy. Specifically, LO-World couples an efficient hybrid range-voxel autoencoder with a flow-matching generator that caches historical context to reduce iterative sampling latency. Extensive experiments demonstrate that LO-World outperforms prior state-of-the-art baselines, improving occupancy forecasting IoU by 10.9% and reducing LiDAR Chamfer Distance by 30.1%. Meanwhile, it sustains a real-time throughput exceeding $25$~FPS on a single RTX 4090. Our code is available at this https URL.
81. 【2611.11906】RBA: A Read-out Basis Adapter for Parameter-Efficient Interactive OCTA Vessel Segmentation with SEEM
链接：https://arxiv.org/abs/2611.11906
作者：Jaafar M. Al-Ghabban,Mohammad Reza Mohammadi
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Retinal disease monitoring, coherence tomography angiography, foveal avascular zone, optical coherence tomography, Retinal disease
备注：
点击查看摘要
Abstract:Retinal disease monitoring with optical coherence tomography angiography (OCTA) relies on segmentation of vessels and the foveal avascular zone (FAZ). Promptable models such as SEEM (Segment Everything Everywhere All at Once) allow click-based refinement, but without adaptation SEEM segments thin vessels poorly and needs many clicks. Fully fine-tuning its 342 million parameters on a few hundred images is costly and risks overfitting, and parameter-efficient methods such as low-rank adaptation (LoRA) usually adapt only the encoder. Yet SEEM reads every candidate mask from one feature map at quarter resolution, too coarse for vessels one to three pixels wide. This study introduces the Read-out Basis Adapter (RBA), whose read-out branch generates 32 image-specific basis maps at half resolution. Each candidate accesses them through its own vector and a zero-initialised projection, so the model starts exactly as SEEM. The encoder branch, a standard rank-1 LoRA, supplies the information needed to tell arteries from veins. RBA adds 0.47 million trainable parameters. Under simulated error-driven clicks, with the ground truth used only to place them, RBA outperforms LoRA, Conv-LoRA andAdaptFormer on OCTA-500 3mmlarge vessels. Averaged over three seeds, it reaches an intersection over union (IoU) of 85.16% and a Dice score of 91.93%, 2.90 and 1.72 percentage points above Conv-LoRA. On the 6 mm subset, one run gives margins of 4.35 and 2.76 points. The gain extends to arteries, veins and ROSE-O but not to the FAZ. In SEEM, adaptation capacity pays more at the mask read-out than in the encoder.
82. 【2611.11893】Developing a Street View Imagery Processing Pipeline for Building-Level Vacant House Assessment
链接：https://arxiv.org/abs/2611.11893
作者：Dongjoon Park,Sunjae Lee,Jung Woo Kim,Bumjoon Kang
类目：Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY)
关键词：Street view imagery, urban environments remotely, Street view, audit urban environments, view imagery
备注： 51 pages, 9 figures, 3 tables, including appendices
点击查看摘要
Abstract:Street view imagery (SVI) is widely used to audit urban environments remotely. Automated assessments usually assume that each image shows the target building clearly. In practice, an image may lack task-relevant evidence or show a neighboring house. If this goes unchecked, a model's score cannot show whether it judged the correct building. We present a reproducible SVI processing pipeline that makes image suitability and target identity explicit and checkable. We apply it to vacant house assessment in South Korea, using 10,311 images of 1,609 detached-house parcels. Task-suitability filtering adapts its criteria to image composition and administrative area. This keeps coverage even across areas. While keeping as many images as a single uniform filter, our filtering left 101 more parcels with a usable image. Target-house alignment identifies the parcel's house from camera metadata and parcel boundaries. It needs no building footprints or additional training. Alignment matched human labels for 85.6% of images, compared with 79.8% for the best simple rule. In vacancy classification, filtering and alignment raised AUROC from 0.684 to 0.719, but marking a different house in the same image still gave 0.709. Grad-CAM showed that the model often looked at areas outside the target house. Image suitability, target identification, and model evidence are therefore separate problems, and scores alone do not resolve them. Recording which images were used and which house was selected lets reviewers verify each assessment and can support human virtual audits.
83. 【2611.11890】raining Vision Transformers to Focus: Emergence of Spatial Attention Head Specialization
链接：https://arxiv.org/abs/2611.11890
作者：Yuji Nozawa,Yu-Chieh Lin,Youyang Ng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Vision Transformer models, Vision Transformer, Self-supervised learning, enables robust visual, learning in Vision
备注： Accepted at NeurIPS 2026. Project page: [this https URL](https://yuji-nozawa.github.io/ReFoCo/)
点击查看摘要
Abstract:Self-supervised learning in Vision Transformer models, such as DINO, enables robust visual perception without requiring labeled data by leveraging large-scale image datasets. However, these models lack a focusing mechanism during training, resulting in perceptual representations that are often ambiguous or overly similar. In this work, we introduce two visual focusing loss functions designed to establish correspondence between the model's attention and specific regions within images. Specifically, we leverage the multi-head attention mechanism within the model to selectively steer the model's focus, leading to the emergence of spatial attention head specialization, characterized by diverse and spatially focused perceptual capabilities without requiring annotations. Through both qualitative and quantitative evaluations, we demonstrate that our method substantially increases the spatial selectivity and diversity of attention heads, improving both interpretability and performance on dense prediction tasks such as zero-shot image segmentation.
84. 【2611.11887】How Many Candidates Does a One-Step World Model Need? A Random-Codebook Account of Nearest-of-m Training on Frozen DINO Tokens
链接：https://arxiv.org/abs/2611.11887
作者：Yong Hwi Song,Keon Myung Lee
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：deterministic feature predictors, world models avoid, flow matching require, averaging of deterministic, deterministic feature
备注： 30 pages (12-page main text, appendices A-H). Code: [this https URL](https://github.com/thddydgnl/nearest-of-m-world-models)
点击查看摘要
Abstract:One-step stochastic world models avoid the mode averaging of deterministic feature predictors without the tens of network evaluations per step that diffusion and flow matching require. The simplest such objective is nearest-of-m matching (conditional implicit maximum likelihood estimation, IMLE): draw m candidate futures and pull only the one closest to the observed outcome. Recent work conjectures that a small m suffices for feature-space world models and that a strictly proper energy score should replace the hard minimum. We test both claims with one-step world models on frozen DINOv2/v3 patch tokens, using benchmarks whose futures can be enumerated. Under mode-like uncertainty, nearest-of-m with m=16 covers the enumerated futures better than 50-step flow matching (at about 1/30 of its latency), one-step flow generators and an energy-score generator at matched parameter counts, and its rollouts stay on the token manifold where flow rollouts drift. One quantity governs the choice of m: the nearest-of-m objective is the expected distortion of a random codebook of m draws from the generator. This view yields three predictions, recorded before the corresponding runs: (i) memorization of the realized outcome in contexts that never repeat, whose strength is governed by the codebook's miss distortion I(m) rather than its miss probability, and which an energy-score generator does not escape by raising m; (ii) a flattening of mode probabilities with m, matching a known optimum within 0.01; and (iii) under-dispersion on continuous high-dimensional outcomes, which bounds the method on real robot video. Per-step matching on self-rollouts cuts long-horizon error by a third on a stochastic Push-T variant; an ablation separates its manifold and coverage benefits. Planning success does not improve despite accurate risk estimates, a negative result we report with its diagnosis.
85. 【2611.11875】Beyond Head Importance: Collective Computation in Video Transformers
链接：https://arxiv.org/abs/2611.11875
作者：Yi Yang,Siyuan Liu,Bingbing Nie
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Transformers vary greatly, video Transformers vary, video Transformers, Transformers vary, vary greatly
备注：
点击查看摘要
Abstract:Attention heads in video Transformers vary greatly in functional importance. Understanding their contributions requires examining not only which heads are important, but also how they participate in collective computation within the network. We study this collective computation from two perspectives: the downstream use of head outputs and the composition of interactions across layers. Ablation analyses of four video Transformers show that high-importance heads identified on a single task also support other video understanding tasks and help preserve the representational structure that distinguishes different videos. Representational responses to head ablation correlate weakly with head importance after the attention module, but more strongly after the MLP in the same block. Adapting this downstream processing through MLP-only fine-tuning further improves the use of lower-importance head outputs. Meanwhile, through composition across layers, sets of heads with shorter spatiotemporal attention distances support stronger perturbation responses at distant tokens than sets with longer distances. Their joint ablation causes even greater performance loss than ablating equally sized sets of high-importance heads, revealing collective contributions not fully captured by individual importance rankings. These findings highlight collective computation as a key perspective for understanding attention head function: functional contributions depend on both how head outputs are used downstream and how local interactions compose across layers.
86. 【2611.11873】Where Does Proposal Selection Fail? Diagnosing Frozen Vision-Language Queries over Detector Proposals
链接：https://arxiv.org/abs/2611.11873
作者：Bo Ma,Weiqi Yan,Jinsong Wu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：detector proposes regions, frozen detector proposes, vision-language model, systems fail, VLM
备注：
点击查看摘要
Abstract:In modular grounding a frozen detector proposes regions and a vision-language model (VLM) selects one, at lower cost than letting the VLM decode a box, but it is unclear where such systems fail. We hold perception fixed---every trained selector chooses among the same frozen proposals, which contain the referent for at least $99.8\%$ of RefCOCO/+/g queries---and vary the selection interface one factor at a time for two VLMs of one family (Qwen2.5-VL-7B, Qwen3-VL-8B). On RefCOCOg, what the selector reads matters more than how it is built: the VLM's image-conditioned query encodes the referent's location and beats a text-only query by $0.15$--$0.18$ with every head tested (by less for InternVL3-8B, whose vision encoder differs; one head tested). The remaining errors are rankings among a few top candidates; a cross-attention selector supervised with every valid box reaches the VLM's coordinate decoding on RefCOCOg, and with Qwen2.5-VL on RefCOCO/+ when also trained on their data. Beyond that distribution it does not: on Ref-L4's Objects365 images, mostly of categories outside training, every trained head falls to $0.19$--$0.28$ while Qwen decoding keeps about $0.8$ (InternVL3's drops too), neither a wider detector prompt nor a class-agnostic proposer closes the gap, and on public reasoning benchmarks Ref-Adv-s and RefBench-PRO full-budget heads trail decoding by $0.19$--$0.37$ although proposals cover most referents. A trained verifier reduces to an existence probe on the VLM's query state and does not beat the VLM's yes/no answer on public no-target benchmarks.
87. 【2611.11843】Aggregation-Induced Calibration Failure in Sum-Based Label Expansion for Multi-Label Facial Expression Recognition: A Diagnostic Study
链接：https://arxiv.org/abs/2611.11843
作者：Weihang Yuan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：facial expression recognition, larger joint space, multi-label facial expression, Label-space expansion, Condition-Aware Label Expansion
备注： 13 pages, 3 figures, 14 tables. Code and data: [this https URL](https://github.com/yuanweihang810/CALE)
点击查看摘要
Abstract:Label-space expansion - predicting a larger joint space and summing back to the original labels - is a natural design for multi-label facial expression recognition, but its failure modes have not been characterised. We evaluate Condition-Aware Label Expansion (CALE) on a self-built dataset (30,240 training images, 3,460 multi-label test images), on seven backbones, and on the public RAF-DB and RAF-ML benchmarks. The central finding is that the aggregation rule, not the representation, decides whether the method works. With a fixed threshold of 0.5, the aggregate score spans 28x across five backbones at 10% of the training data (0.24 to 6.79) and collapses to a 1.9x range at full data, while threshold-free mAP stays within 1.28x over the same backbones, which localises the fault to the summation step. The mechanism is the uncalibrated aggregation rule, which adds the main-branch score to half the sum of the three non-main branches; we verify it by measuring main- and non-main-branch activations. Two plain seven-dimensional sigmoid baselines (BCE, ASL) reach mAP 0.5055 and 0.5175; ASL exceeds three of the five CALE configurations and falls within 0.03 of the best. On single-label FER the gain over a seven-dimensional baseline is nominally significant (paired t-test, p = 0.0436) but does not survive Benjamini-Hochberg correction (p_BH = 0.2055) or a Wilcoxon test (p = 0.1250). We conclude that sum-based label expansion requires threshold calibration at the deployment data scale, or a learned aggregation, before it can support multi-label decisions.
88. 【2611.11836】MDA framework: multi-architecture domain adaptation for unsupervised person re-identification
链接：https://arxiv.org/abs/2611.11836
作者：Wei Zhang,Peijun Ye,Dihu Chen,Tao Su
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：multi-architecture domain adaptation, domain adaptation, Unsupervised person re-identification, Unsupervised person, multiple network architectures
备注：
点击查看摘要
Abstract:Unsupervised person re-identification not only faces the challenge of domain gaps, but existing methods also rarely support multiple network architectures. To tackle both issues, this paper proposes a multi-architecture auto-adaptive domain adaptation method: Mamba augmented multi-architecture domain adaptation framework. Specifically, this paper constructs the multi-architecture domain adaptation capability at two levels. At the first level, we propose a composite operator(MDA operator) that encapsulates Mamba as a component for enhancing domain adaptation. At the second level, based on this operator, we propose a Mamba-enhanced multi-architecture Domain Adaptation framework(MDA framework). Comprehensive experiments on person re-identification benchmarks validate the consistency and flexibility of the proposed framework. The MDA framework supports versatile deployment strategies without being confined to a single integration point. Under a single deployment configuration, it surpasses several SOTA methods. Moreover, it demonstrates substantial performance improvements across both CNN and Transformer architectures. When embedded into a CNN backbone, the framework achieves a 10.2% mAP improvement on the adaptation task from CUHK03 to Market-1501. Integrated with a Transformer backbone, it yields a 19.8% mAP improvement on the same task.
89. 【2611.11833】Answer or Defer? Testing VLMs' Stated Confidence on Brain MRI
链接：https://arxiv.org/abs/2611.11833
作者：Amir Sabbaghziarani,Parsa Ghazvinian,Sepehr Salem,Sergey Plis
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：support medical-image interpretation, Vision-language models, medical-image interpretation, requires deciding, images to refer
备注： Accepted to the WACV 2027 FABRIC Workshop
点击查看摘要
Abstract:Vision-language models (VLMs) could support medical-image interpretation, but their use requires deciding which interpretations to accept and which images to refer to a clinician. We test whether thresholding stated confidence can retain useful coverage while limiting errors among accepted answers, and how this depends on the population. Eight open-weight VLMs, including two reasoning models, assess 3,888 brain MRI slices from post-treatment glioma patients (BraTS 2024) and healthy volunteers (IXI) for tumor or gross abnormality. BraTS labels are mask-derived; IXI slices are treated as negatives. On BraTS, no threshold selects a nonempty set with at most 5% empirical error for any model, even when chosen retrospectively. This also holds for four models evaluated on a large-lesion, distant-negative subset. At a 10% error budget, Gemma-4-12B retains 24.4% of slices and every other model at most 2.5%. To investigate this limited selection ability, we separate confidence differences between predicted answers from differences within each answer. For four models with available outcome-level summaries, pooled mean confidence differs more between answers than between correct and incorrect responses within each answer. A covariance decomposition explains how this pattern can produce opposite confidence-correctness associations across populations. At a 20% error budget, accepting every "tumor" answer covers more slices than any confidence threshold for two models. These findings caution against using unvalidated stated confidence as a standalone deferral signal and support population-specific validation before deployment. Code is available at this https URL.
90. 【2611.11831】End-to-End Joint Training of Super-Resolution and Compression Artifact Removal for Industrial Machine Vision
链接：https://arxiv.org/abs/2611.11831
作者：Dang BuiDinh,Sang NguyenQuang,Anh NguyenPhuong,Wen-Hsiao Peng,Xiem HoangVan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：introducing resolution loss, images captured, reduce bandwidth, introducing resolution, compression artifact removal
备注：
点击查看摘要
Abstract:In industrial machine vision, images captured by edge devices are often downsampled and compressed to reduce bandwidth, introducing resolution loss and compression artifacts that severely degrade the performance of downstream tasks, such as defect detection. Existing quality enhancement methods typically apply super-resolution (SR) or compression artifact removal (CAR) independently or in a sequential manner and are largely optimized for human visual fidelity rather than machine perception. This paper proposes an end-to-end quality enhancement framework that integrates SR and CAR with a unified training strategy that optimizes both human-perception and machine-perception objectives. We investigate fixed-weight and uncertainty-based dynamic-weight loss functions to balance reconstruction quality and machine vision task performance. Extensive experiments on PCB Defect, DeepPCB, and NEU-DET datasets show that the proposed jointly trained model generally outperforms standalone and separately trained SR-CAR pipelines. In particular, under severe JPEG compression, our method improves defect detection performance from 0.461 to 0.887 mAP@50 on PCB Defect over sequential SR-CAR baselines, with only a slight reduction in PSNR. These results demonstrate that joint optimization is critical for compression-aware industrial machine vision systems.
91. 【2611.11824】When to Trust Adaptation: Contextual Fusion for Transferable Vision-Language Prompting
链接：https://arxiv.org/abs/2611.11824
作者：Zhenyuan Chen,Wenshuo Tao,Zhuo Huang,Shuo Chen,Mingming Cheng,Xiang Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：vision-language model encounters, Contextual Adaptive Fusion, introduce Contextual Adaptive, vision-language model, model encounters
备注：
点击查看摘要
Abstract:When a vision-language model encounters a new class or domain, how much should it trust its learned prompts? Because source adaptation can correct pretrained errors on some target images while disturbing valid predictions on others, we introduce Contextual Adaptive Fusion (CAF), which retains four prediction branches by pairing frozen and prompted visual and textual representations. To arbitrate when branches disagree on an image, CAF combines each branch's predictive confidence with how frequently the branches favor its proposed class across the unlabeled target collection, placing greater trust in predictions that are locally confident yet less dominated by collection-wide frequency bias. The fusion coefficients are learned once on source data and remain fixed at inference. Trained on ImageNet, CAF achieves 69.96% average accuracy across ten cross-dataset benchmarks (1.92 percentage points above ManiPT) and remains highly competitive across four ImageNet variants, setting a new best of 52.21% on ImageNet-S. In base-to-novel transfer across eleven datasets, CAF further reaches 79.77% novel-class accuracy and an 82.81% harmonic mean. Code is available at this https URL.
92. 【2611.11821】Direct Trajectory Optimization for Inference-Time Alignment of Text-to-Image Diffusion Models
链接：https://arxiv.org/abs/2611.11821
作者：Huixuan Zhang,Xiaojun Wan
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：controllable generation, key challenge, challenge in controllable, Direct Trajectory Optimization, DTO
备注：
点击查看摘要
Abstract:Alignment of text-to-image diffusion models with reward functions is a key challenge in controllable generation. Existing approaches typically rely on optimizing model inputs or fine-tuning denoising networks, which requires computationally expensive backpropagation through large denoising models. In this work, we propose Direct Trajectory Optimization (DTO), a training-free framework that performs alignment by directly optimizing the sampling trajectory of diffusion models. Specifically, DTO treats intermediate denoising scores and sampled noise as the optimization variables, eliminating the need for gradients through the denoising network. To mitigate the out-of-distribution problem, we introduce Reward-Optimized Score Guidance, which interpolates between the optimized scores and the pretrained model predictions to stabilize sampling, while providing a provable theoretical guarantee of reward improvement under constrained distributions. Empirically, DTO improves alignment performance across three diffusion models on two benchmarks, outperforming existing inference-time alignment methods while maintaining high efficiency. These results suggest that trajectory-level optimization is a promising direction for efficient and effective diffusion model alignment.
93. 【2611.11809】Budget-aware Correspondence-driven View Selection for Real-time 3D Perception of Mobile Robots
链接：https://arxiv.org/abs/2611.11809
作者：Vaishnav Ramesh,Jacob Carter,Shivali J. Patel,Sanjeev J. Koppal,Md Jahidul Islam
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：hinder downstream processing, redundant image sequences, intelligent transportation, generate long, redundant image
备注： 12 pages
点击查看摘要
Abstract:3D visual perception and scene reconstruction are critical for autonomous robots and intelligent transportation, yet real-world deployments often generate long, redundant image sequences that hinder downstream processing. This report investigates BCVS (budget-aware correspondence-driven view sampling), a pose-free view selection algorithm that offers 22+ FPS on a CPU, enabling online filtering for efficient 3D perception by mobile robots. Unlike existing approaches that rely on full structure-from-motion (SfM) pipelines or camera pose estimation, BCVS employs a purely correspondence-based scoring strategy that prioritizes view novelty while maintaining sufficient overlap for geometric stability. Given a user-specified budget, BCVS iteratively selects the most distinct frames and suppresses near-duplicates, producing compact subsets that preserve connectivity and minimize reconstruction loss. Extensive experiments on benchmark show that BCVS outperforms CPU-friendly baselines at tight budgets and remains competitive as budgets scale. Field trials with large aerial and marine robotics data further validate its practicality and scalability: BCVS reduces redundancy up to 16% while sustaining robust SfM registration and high-quality 3D reconstructions.
94. 【2611.11793】Benchmarking CNNs, Vision Transformers, and Foundation Models for Explainable Brain Tumor MRI Classification: Calibration, Decision Analysis, and External Validation
链接：https://arxiv.org/abs/2611.11793
作者：Akwasi Asare
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Deep learning models, Deep learning, brain tumor MRI, tumor MRI classification, public MRI images
备注： Under review at Scientific Report Journal, Springer
点击查看摘要
Abstract:Deep learning models for brain tumor MRI classification are usually compared by accuracy alone, on public datasets whose independence is rarely checked. We benchmarked six architectures: two convolutional networks (EfficientNetV2-M and ConvNeXt-V2-Tiny), two vision transformers (Swin-V2-S and ViT-L/16), and two foundation models (DINOv2-L and MedSigLIP-448), for four-class classification of 7,216 public MRI images. We assessed accuracy, calibration, explainability, ensembles, and decision curves, with every fitted quantity estimated on validation data only. Pixel-verified duplicate screening showed that 36% of the test images had a near-duplicate in the training data. Test accuracy ranged from 94.5% to 95.6%, with no pairwise difference after Holm correction, and fell to 90.3% to 91.7% on the 773 test images free of duplicates and shared patients. Ensembles did not outperform the best single model. Attribution maps passed a model-randomization test but localized expert-annotated tumors poorly. On 1,675 external BDNeuro-MRI images that did not duplicate the training data, accuracy ranged from 77.6% (MedSigLIP-448) to 95.0% (ViT-L/16), and 12 of 15 pairwise differences were significant. Internal accuracy on this public collection therefore did not distinguish the architectures, whereas the duplicate-filtered external test did.
95. 【2611.11790】FMA-Net: Flexible Modality Adaptation for Robust Multimodal Face Presentation Attack Detection
链接：https://arxiv.org/abs/2611.11790
作者：Yuhao Gao,Yichen Shi,Zitong Yu,Hongyang Wang,Hongrui Li,Ruixin Zhang,Shouhong Ding,Jun Feng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal face presentation, presentation attack detection, deployment remains challenging, face presentation attack, Multimodal face
备注：
点击查看摘要
Abstract:Multimodal face presentation attack detection (fPAD) improves robustness using complementary RGB, depth, and infrared (IR) cues, but deployment remains challenging when modalities are unavailable or incomplete. Existing flexible-modality methods mainly use zero-filling or modality omission, potentially discarding cross-modal information and introducing modality-dependent bias. We propose the Flexible Modality Adaptation Network (FMA-Net), a unified framework that compensates for missing modalities through instruction-guided latent-space translation. The Face Modality Instruct Translator (FMIT) estimates target modality observations from RGB inputs, while context-aware category enhancement uses learnable text prompts as modality-invariant semantic anchors. A Facial Feature Adapter (F2A) integrates global facial structure and local spoof-relevant cues to enhance discriminative representations. Synthetic-to-Real Face Domain Alignment (SR-FDA) reduces feature discrepancies between translated and real modalities, with benefits depending on the missing-modality pattern and data domain. Experiments on WMCA and PADISI-Face validate the framework. On WMCA with a 70% modality missing ratio, FMA-Net achieves a mean ACER of 3.22% across four intra-domain missing-modality protocols, compared with 4.24% for the strongest baseline by the same criterion. When both depth and IR are entirely unavailable, it achieves 5.23% ACER, compared with 5.99% for the best competing result. Cross-domain experiments also reveal limitations of synthetic-to-real alignment under dataset shifts. These results support FMA-Net as a practical approach to fPAD with flexible and incomplete modalities.
96. 【2611.11770】owards Rotation-Only Imaging Geometry: Multi-View Pose Estimation
链接：https://arxiv.org/abs/2611.11770
作者：Xinrui Li,Qi Cai,Yuanxin Wu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：individual image pairs, commonly refines relative, refines relative poses, estimates global rotations, commonly refines
备注：
点击查看摘要
Abstract:Global structure-from-motion (SfM) commonly refines relative poses on individual image pairs and then estimates global rotations by rotation averaging. Pairwise refinement does not explicitly combine feature-level constraints with multi-view consistency during rotation initialization. We introduce Global Rotations from Aggregated Matches (GRAM), which estimates global rotations directly from initial relative rotations and inlier matches by minimizing edge-wise rotation-only algebraic residuals. GRAM replaces two-view relative-pose optimization and rotation averaging with a single stage. We further extend rotation- only imaging geometry to multiple views and develop Multi-view Optimization with Rotation-only Reprojection Error (MORE) for nonlinear global rotation refinement. Analytical Rotation-guided Translation (ART) derives locally scaled triplet translations from Linear Global Translation (LiGT) constraints and recovers global translations using weighted least squares. Synthetic and real-world experiments demonstrate the accuracy, robustness, and efficiency of the proposed methods.
97. 【2611.11763】LangDepth: Vision-Language Scene Priors for Semantic Binning and Cross-Domain Monocular Depth Estimation
链接：https://arxiv.org/abs/2611.11763
作者：Reyhaneh Ahani Manghotay,Jie Liang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：depth remains sensitive, depth, metric depth remains, advanced through large-scale, large-scale pretraining
备注：
点击查看摘要
Abstract:Monocular depth estimation has advanced through large-scale pretraining and strong visual backbones, yet metric depth remains sensitive to scene-level scale. Indoor rooms and outdoor driving scenes occupy very different depth ranges, but most depth decoders infer this global structure implicitly from visual features. We ask whether scene-level semantic structure can instead act as an upstream prior that shapes the metric output space before dense prediction. We present LangDepth (SemanticBins), a monocular depth architecture that couples strong visual features with a scene-conditioned output space. A frozen CLIP encoder and a learnable bank of scene- and geometry-oriented concept keys convert image features into a compact scene descriptor, without requiring per-image text or an external captioner. A Scene Prior Module (SPM) maps this descriptor to a scene-conditioned metric depth interval, providing a global range anchor before dense decoding. In parallel, a DINOv2-L backbone with a lightweight FPN extracts dense visual features, and a Per-Pixel Assignment Network (PPAN) assigns pixels to the scene-prescribed bin structure. A confidence gate fuses the dense visual estimate with the SPM prior. We train LangDepth jointly on NYU Depth V2 and KITTI under a modest supervised depth budget, without web-scale depth supervision or pseudo-labelled depth data. A single model achieves delta_1 = 0.960 on NYU, 0.960 on KITTI, 0.887 on DIODE indoor, 0.946 on iBims-1, and 0.861 on SUN RGB-D. Beyond aggregate accuracy, the SPM predicts compact indoor ranges and much wider outdoor KITTI ranges, the gate becomes SPM-dominant on outdoor scenes, and perturbing the routed scene context causes large drops on KITTI and iBims-1. These results support scene-conditioned output spaces as a practical and interpretable mechanism for cross-domain monocular depth estimation.
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2611.11763 [cs.CV]
(or
arXiv:2611.11763v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2611.11763
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
98. 【2611.11757】Calibrated Alarm Thresholds for Compact Fire and Smoke Detectors
链接：https://arxiv.org/abs/2611.11757
作者：Vikas Sandireddy
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Compact object detectors, low-power devices, common choice, choice for camera-based, Compact object
备注：
点击查看摘要
Abstract:Compact object detectors such as YOLOv8n are a common choice for camera-based fire and smoke detection on low-power devices. These detectors are usually evaluated with box-level metrics such as mean average precision, and their outputs are turned into decisions with a fixed confidence threshold such as 0.25 or 0.5. A fire monitoring system, however, makes one decision per image: raise an alarm or not. In this paper we evaluate two publicly available compact detectors on the D-Fire test set at the image level. We compare three simple rules for turning box detections into one alarm score per image, and we use a split conformal procedure to choose the alarm threshold from held-out images so that the expected fraction of missed fire and smoke images stays below a chosen target. We find that the same fixed threshold leads to very different miss rates for the two detectors, 17.3 and 8.4 percent at a threshold of 0.5, while the calibrated threshold meets miss-rate targets of 10, 5 and 1 percent for both detectors and all three rules. At a 5 percent target, the false alarm rate on images without fire or smoke stays between 1.2 and 3.0 percent. We also find that smoke-only images stay below the target even when the overall target is met, and we describe the main failure cases.
99. 【2611.11753】SpinSCI: Mask-Conditioned Spatial-Temporal Spin Transformer for Video Snapshot Compressive Imaging
链接：https://arxiv.org/abs/2611.11753
作者：Seungki Hong,Zhishuai Zhang,Taekwang Jang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Video snapshot compressive, snapshot compressive imaging, recovers multiple frames, Video snapshot, Ising Refinement Block
备注：
点击查看摘要
Abstract:Video snapshot compressive imaging (SCI) recovers multiple frames from one spatiotemporally coded measurement. This paper proposes SpinSCI, a mask-conditioned Spatial-Temporal Spin Transformer whose Mask-Conditioned Ising Refinement Block (MC-IRB) combines attention logits and sensing information to form signed spin couplings. Finite mean-field updates gate residual feature refinement. Physics-guided initialization and final data consistency incorporate the measurement model. Compared with HiSViT$_9$, SpinSCI achieves average PSNR gains of 0.51 dB, 0.23 dB, and 0.04 dB on small-scale gray, mid-scale color, and large-scale color benchmarks, respectively, with 16.9% fewer parameters, 21.0-21.6% fewer FLOPs, 17.1-49.9% lower latency, and 62.3-63.3% lower peak memory. Relative to DU-9stg, average PSNR differs by at most 0.13 dB across these benchmarks, with 28.2-28.7% fewer FLOPs, 64.6-71.7% lower inference latency, and 30.1-35.0% lower peak memory. Qualitative comparisons on the real benchmark further show recovery of fine details and textures. Code and reference checkpoints are available at this https URL.
100. 【2611.11751】GeoPilot: Diagnosis-Guided Interventions and Geometric Evaluation for Aerial Reconstruction
链接：https://arxiv.org/abs/2611.11751
作者：Pengyu Yin,Jie Pan,Junxiang Tan,Mengqi Fu,Kun Cheng,Yifan Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：aerial remote-sensing imagery, remote-sensing imagery disagrees, reconstructed from aerial, aerial remote-sensing, remote-sensing imagery
备注： 33 pages, including supplementary material
点击查看摘要
Abstract:When a mesh reconstructed from aerial remote-sensing imagery disagrees with reference geometry, deciding what to change requires a diagnosis of the reconstruction process. We present GeoPilot, a workflow that turns diagnostics and prior observations into executable program or camera-configuration interventions. A large language model proposes the change, numerical tools reconstruct the mesh, and an external evaluator measures its geometry under a stated coordinate and reference protocol. The main case tests a shared-intrinsics hypothesis proposed before the comparison. On 224 Metashape-raster development images, shared intrinsics improved all six native-coordinate measures and reduced mean surface-to-reference distance by 7.04%. Reference-assisted alignment fitted and evaluated on separate within-scene checkerboard samples reversed the mean-distance ranking, limiting that gain to native-frame delivery. A separate matched comparison on publisher-undistorted images favored fixed published cameras on all six measures, reducing mean distance by 12.11%; the cameras retain upstream image and laser-scanning adjustment information. With one reconstruction per configuration, these comparisons provide conditional evidence for camera handling. Three end-to-end runs each delivered a mesh and six-metric evaluation from all 327 images of a second development scene.
101. 【2611.11738】Dense Flow from Adaptive Correspondence
链接：https://arxiv.org/abs/2611.11738
作者：Cheng-Lin Hsieh,Stella X. Yu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Optical flow requires, sufficient visual context, Optical flow, flow, matching
备注： 18 pages, 6 figures. Accepted at NeurIPS 2026
点击查看摘要
Abstract:Optical flow requires reliable matching from sufficient visual context and precise motion at every pixel. Existing methods such as WAFT match and estimate flow on the same coarse grids, then recover dense flow through learned upsampling, without explicitly linking visual support for matching to dense flow reconstruction. Our key insight is that dense pixel-level flow does not require equally dense matching. We decouple correspondence scale from flow resolution by adapting the size and shape of spatial supports to image structure for reliable matching, while reusing these supports for precise dense flow reconstruction. We realize this in Flow from Adaptive Token Estimation (FATE), whose token supports expand within coherent regions and contract near motion boundaries. Shared pixel-to-token associations pool features for matching and reconstruct pixel flow from token motions. Flow supervision jointly trains pixel grouping, token matching, and flow estimation without grouping labels, allowing FATE to anticipate which pixels are likely to move together from appearance alone. Trained on FlyingChairs/FlyingThings3D, FATE achieves the highest zero-shot accuracy on Sintel Final and KITTI, a critical setting given scarce real-world flow labels. For visible pixels, FATE improves accuracy within coherent regions, and more near motion boundaries. Its largest gains occur where direct matches are unavailable: Occluded or out-of-frame pixels account for roughly 10% of valid pixels but 50% of WAFT's total error. Experiments show that adaptive correspondence through pixel-to-token grouping enables reliable matching and precise pixel-level flow, improving generalization to unseen real scenes.
102. 【2611.11735】Correctness Metric Matters: NWD-Based Calibration Loss for Tiny Person Detection in UAV Infrared Imagery
链接：https://arxiv.org/abs/2611.11735
作者：Tian Zhang,Zhirong Su
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Detection calibration aligns, aligns predicted confidence, calibration aligns predicted, Detection calibration, aligns predicted
备注：
点击查看摘要
Abstract:Detection calibration aligns predicted confidence with empirical correctness. Existing calibration losses inherit their correctness definition from box regression, specifically IoU against a hard threshold. We show that this target is geometrically ill-posed for tiny objects in UAV infrared imagery, where persons occupy less than 0.1\% of the image. The same pixel error is penalized more heavily as the target shrinks, so binary prediction calibration (BPC) actively suppresses confidences that should be high. On HIT-UAV, BPC with an IoU target degrades image-level localization-aware ECE (LaECE) from 0.0689 to 0.0761, 0.0649 to 0.0733, and 0.0653 to 0.0682 across Low, Mid, and High signal-to-clutter ratio (SCR) groups. We replace the IoU target with a continuous, scale-invariant normalized Wasserstein distance (NWD). The NWD target reduces LaECE\(_{\mathrm{NWD}}\) relative to BPC+IoU on all three groups (\(p10^{-7}\)) with mAP neutral (0.9356 vs.\ 0.9347), and an independent center-offset anchor confirms that the gain is a genuine geometric correction. The improvement holds across a broad plateau of calibration weights. The NWD formulation requires no inference-time mapping layer. If a validation-fitted isotonic map is applied on top of it, calibration is lowered further, and the two corrections act on different components of the same error. The metric-level remedy has a measurable boundary. Target-background thermal pairing in the training distribution and detection-level aggregation under per-image detection-count heterogeneity lie outside it. Both are quantified independently of the NWD target.
103. 【2611.11697】SurgTAP-3D: A Large-Scale Cross-Surgery Video Dataset with Contact-Aware 3D Motion Tracking
链接：https://arxiv.org/abs/2611.11697
作者：Jiaxin Guo,Wenzhen Dong,Taoyu Wu,Haomin Kuang,Mengya Xu,Kejian Shi,Ziyi Wang,Tongfan Guan,Mingkai Jia,Yue Wang,Qi Dou,Yun-Hui Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：minimally invasive surgery, autonomous surgical systems, minimally invasive, fundamental step, step toward physically
备注： Accepted to IEEE Transactions on Robotics (T-RO)
点击查看摘要
Abstract:Understanding 3D scene dynamics in minimally invasive surgery (MIS) is a fundamental step toward physically intelligent and autonomous surgical systems. However, existing public datasets offer limited scalability and diversity in real-world clinical scenarios. Moreover, annotations typically focus on either tissue or instruments alone, overlooking tool-tissue interactions. This gap limits applications such as augmented reality guidance and autonomous surgery driven by vision-language-action (VLA) models or world models, which demand large-scale, high-quality 3D supervision. In this work, we construct SurgTAP-3D, a large-scale in-vivo pseudo-3D surgical motion tracking dataset and benchmark, comprising 520K frames, 4,549 action clips, and 1.4M 2D/3D point trajectories from diverse robotic and manual procedures under unified action categories. To make annotation scalable, we design a unified framework for surgical 3D point tracking that converts uncalibrated monocular surgical videos into structured 4D annotations through contact-region prompting, active-tool segmentation, dynamic bundle adjustment, and global 4D refinement. This pipeline adapts foundation priors to surgical videos and produces temporally consistent trajectories, pseudo-scale geometry, camera poses, and instrument masks. The dataset captures realistic challenges inherent to surgical environments, including occlusions, smoke, bleeding, and rapid instrument motion. We establish a comprehensive benchmark on SurgPose, SurgT, and STIR, covering both instrument and tissue tracking. We demonstrate instrument displacement estimation, deformable surface reconstruction, and foundation-model fine-tuning. Extensive experiments and analysis demonstrate the effectiveness of our dataset and annotation framework for 3D surgical point tracking, reconstruction, and surgical action understanding. Homepage: this https URL
104. 【2611.11692】LocateAnyMesh: Grounding 3D Mesh Queries in 2D Images with Vision-Language Models
链接：https://arxiv.org/abs/2611.11692
作者：Chris Choy,Zhiding Yu,Jan Kautz
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：geometry and appearance, Textured, object geometry, PPAT mesh tokens, natural query
备注：
点击查看摘要
Abstract:Textured 3D meshes specify object geometry and appearance, making them a natural query for finding a particular asset in an image. We introduce LocateAnyMesh, a vision-language model that uses the mesh itself as part of its prompt. A frozen 3D encoder maps colored surface points to a compact token sequence, which a learned connector places alongside image and instruction tokens. We evaluate two grounding models with PPAT mesh tokens: LAM-Select selects image-region proposals, while LAM-Direct predicts coordinates directly. Neither requires rendered query views or view-template matching. New objects require a single encoder pass and no object-specific fine-tuning. LAM-Select improves localization on the reported real-image suites and the official BOP YCB-V evaluation. Secondary experiments compare mesh encoders, and a LAM-Direct study isolates surface color. A single-seed LAM-Select continuation supplies pointing and mesh-only description evidence without replacing the reported localization model. The results support mesh tokens as a query representation, with remaining limitations in presence decisions, identity binding, proposal coverage, and descriptive fidelity.
105. 【2611.11678】SurfScaff3D: Bridging Geometric and Semantic Representations for LLM-based 3D Object Generation
链接：https://arxiv.org/abs/2611.11678
作者：Anay Loya,Rishi Gupta,Arnav Samal,Anirban Chakraborty
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：traditionally required specialist, required specialist expertise, Creating high-quality, content has traditionally, complex tools
备注： Accepted to WACV 2027
点击查看摘要
Abstract:Creating high-quality 3D content has traditionally required specialist expertise and experience with complex tools. The growing ecosystem of AI-assisted creativity demands accessible and intuitive 3D generation systems. Recent advances in Large Language Models (LLMs) offer promising directions, yet extending their generative capabilities to 3D remains fundamentally challenging because existing 3D representations are not naturally compatible with language-based reasoning. Current approaches either depend on expensive fine-tuning or impose restrictive structural priors that sacrifice expressiveness and exclude organic shapes. We argue that the mismatch between LLM-native reasoning and conventional 3D parameterizations is a core bottleneck of LLM-driven 3D generation. To address this, we introduce the Hierarchical Patch Scaffold (HPS), a representation designed around semantically meaningful, interpretable part-level abstractions that are naturally understood by both humans and LLMs, enabling expressive, editable, and open-domain 3D generation without imposing restrictive geometric priors or expensive fine-tuning. Building upon HPS, we introduce SurfScaff3D, an interactive framework for text and image-to-3D generation. HPS inherits the flexibility of B-spline patches, while exposing an interface that leverages open-world capabilities of foundation models to reliably generate 3D. Its hierarchical part-level semantic labels enable targeted, natural-language edits at any level of granularity without re-running generation. Further, HPS offers explicit per-patch control over surface detail, enabling more expressive geometry capable of representing arbitrary objects. Extensive experiments against state-of-the-art LLM-based 3D generation methods demonstrate strong geometric fidelity, semantic alignment, and flexible editing across diverse object categories.
Comments:
Accepted to WACV 2027
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2611.11678 [cs.CV]
(or
arXiv:2611.11678v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2611.11678
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
106. 【2611.11644】MICE: Multi-animal Interaction Context Encoder - A Hierarchical Foundation Model for Mouse Behavior
链接：https://arxiv.org/abs/2611.11644
作者：Yen-Shuo Su,Weihan Li,Anqi Wu
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Neurons and Cognition (q-bio.NC)
关键词：Quantifying mouse behavior, Quantifying mouse, mouse behavior, drug discovery, tool in neuroscience
备注： NeurIPS 2026 (Spotlight). 25 pages, 4 figures. Code: [this https URL](https://github.com/eric0708/MICE)
点击查看摘要
Abstract:Quantifying mouse behavior from pose is a foundational tool in neuroscience, ethology, drug discovery, and animal welfare. Self-supervised foundation models are a natural fit, but a foundation model for mouse behavior must handle social behavior - many behaviors that matter (aggression, courtship, mounting, allogrooming) are inherently multi-animal. Existing self-supervised pose models fall short: they encode each animal independently and discard interaction signal, hard-code the animal count, and pretrain one dataset at a time. We introduce MICE (Multi-animal Interaction Context Encoder), a hierarchical foundation model for mouse behavior that pretrains jointly on six mouse-pose corpora spanning one to four mice and 7 to 27 keypoints. MICE combines a hierarchical individual encoder capturing per-mouse kinematics at multiple temporal scales with a Perceiver-style social encoder whose learned latent codebook decouples parameter count from animal count, so a single checkpoint serves any group size without retraining. Across four evaluation protocols spanning six datasets, MICE matches or exceeds prior keypoint-based baselines, and layer-wise probing shows the social stage incrementally improves discriminability beyond the individual encoder. Code, weights, and data are available at this https URL.
107. 【2611.11640】Feel My Focus: Gaze-Triggered Digital Twin Creation for Remote Collaboration
链接：https://arxiv.org/abs/2611.11640
作者：Shih-Yu Ma,Suibi Che-Chuan Weng,Ming-Yuan Pai,Tom Yeh,Ellen Yi-Luen Do
类目：Human-Computer Interaction (cs.HC); Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：enables rapid creation, Feel My Focus, gaze-triggered mixed reality, present Feel, mixed reality
备注： 5 pages, 3 figures
点击查看摘要
Abstract:We present Feel My Focus, a gaze-triggered mixed reality (MR) demonstration that enables rapid creation and sharing of lightweight 3D digital twins during remote collaboration. Unlike systems that use gaze primarily as a referential pointer, Feel My Focus treats sustained visual attention as a generative action: a fixation on a physical object initiates single-image capture, attention-guided segmentation, and one-shot 3D reconstruction, allowing a remote partner to inspect and discuss the object in situ. The system integrates gaze-tracking glasses, modular segmentation and reconstruction services, and an MR client for runtime streaming and interaction. This design prioritizes responsiveness and experiential continuity over photometric fidelity. We report observations from a public demonstration, highlighting design trade-offs, failure modes, and user control considerations for deploying gaze-triggered generative systems in real-world collaborative settings.
108. 【2611.11607】Rethinking Geometric Depth in Monocular 3D Object Detection: A Projection-Consistent Reformulation
链接：https://arxiv.org/abs/2611.11607
作者：Zhihao Zhang,Abhinav Kumar,Huaizhi Qu,Tianlong Chen,Xiaoming Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：widely adopted due, hinges on recovering, single image, widely adopted, adopted due
备注： Accepted to NeurIPS 2026
点击查看摘要
Abstract:Monocular 3D detection (Mono3D) hinges on recovering depth from a single image, for which the geometric formulation $z \approx f \cdot H / h_{2D}$ is widely adopted due to its simplicity and direct grounding in projective geometry. We show that this formulation harbors a systematic, projection-induced bias: substituting the 2D bounding-box height $h_{2D}$ recovers the depth of an object's visible front surface rather than its center, causing size-dependent underestimation that persists even under ground-truth inputs. We address this front-surface bias with MonoPCA, a unified framework built on a projection-consistent reformulation. At its core, PCDepth retains the measurable $h_{2D}$ and closes the gap to center depth through an orientation- and size-aware correction derived from perspective geometry, eliminating the bias without introducing ill-posed regression targets. Because PCDepth couples depth to predicted object size and orientation, attribute perception becomes essential. We therefore introduce GeoAlign, a teacher-student framework that transfers geometric representations from Vision Foundation Models into a lightweight student, strengthening attribute perception at no inference cost. Across four challenging benchmarks, MonoPCA achieves SoTA performance, including a +1.44% AP$_{3D}$ gain on the KITTI leaderboard and +2.80% on Omni3D$_{OUT}$. Code is available at this https URL.
109. 【2611.11602】Martine: Benchmarking Multi-View 3D Surface Reconstruction Across Viewpoint Coverage, Resolution, and Lighting
链接：https://arxiv.org/abs/2611.11602
作者：Robin Bruneau,Baptiste Brument,Frederic Giraud,Bastian Sigrist,Sascha Jecklin,Philipp Fürnstahl,Bjoern Menze,Lilian Calvet
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Controlled acquisition setups, sensor configuration, setups are widely, acquisition setups, viewpoint distribution
备注： Accepted at the 40th Conference on Neural Information Processing Systems (NeurIPS 2026), Track on Evaluations and Datasets. 23 pages, 14 figures, 8 tables. Project page: [this https URL](https://martine-benchmark.github.io/)
点击查看摘要
Abstract:Controlled acquisition setups are widely used for high-accuracy multi-view 3D surface reconstruction, as they allow sensor configuration, image resolution, viewpoint distribution, and illumination to be specified. Yet benchmarking remains difficult, since reconstruction accuracy depends jointly on the reconstruction paradigm, object properties, and acquisition regime. Existing benchmarks often restrict viewpoint coverage, resolution, or illumination, which can bias comparisons towards methods suited to the chosen setting. Others lack accurate 3D ground truth or quantified image-to-geometry alignment, limiting their use for metric surface evaluation. We introduce Martine, a benchmark for controlled 3D object surface reconstruction. Martine comprises 28 objects, including transparent materials and fine structures, captured at 9568 x 6376 pixels from 84 views over a spherical cap under both single-light and multi-light regimes. It provides object-independent camera calibration, accurate 3D ground-truth scans, calibration and image-to-geometry accuracy quantified on test images, and 3D property masks for analysing errors by material properties, visibility, curvature and fine structures. Experiments across photogrammetry, classical multi-view stereo, neural implicit surfaces, Gaussian-splatting-based reconstruction, and multi-view photometric stereo show that Martine enables regime-aware evaluation with explicit control over reference-data accuracy. The benchmark resolves sub-millimetric reconstruction differences, with a best observed Chamfer distance of 0.058 mm over the evaluated visible surface.
110. 【2611.11586】FastGRT: Accelerating Training of 3D Gaussian Ray Tracing
链接：https://arxiv.org/abs/2611.11586
作者：Meet Banthia,Xiaoteng Liu,Hexu Zhao,Aurojit Panda,Jinyang Li
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Gaussian Splatting, Ray Tracing enables, Gaussian-based ray tracing, Ray Tracing, enables rendering capabilities
备注：
点击查看摘要
Abstract:Ray Tracing enables rendering capabilities that are difficult to achieve with rasterization-based approaches such as 3D Gaussian Splatting (3DGS). However, the training cost of Gaussian-based ray tracing (GRT) is much higher than that of 3DGS. In this paper, we study how ray tracing using Gaussians executes on GPUs and show that a considerable fraction of the training cost arises from how the computation is organized. We develop FastGRT, which decouples ray traversal from blending and reuses work done in the forward pass for the backward pass. FastGRT further incorporates optimizations such as fast gradient accumulation and a hybrid BVH update strategy to tackle other major bottlenecks in the training pipeline. We implement FastGRT in Vulkan. To the best of our knowledge, it is the first Vulkan-based GRT implementation that supports both training and rendering. Compared to 3DGRT, FastGRT improves training time by 1.9$\times$ to 4.97$\times$, while preserving the original rendering formulation. Our code is open source.
111. 【2611.11583】NightSteps: A Night-Time Dataset and Benchmark for Pedestrian Crossing Intention Prediction
链接：https://arxiv.org/abs/2611.11583
作者：Sjoerd Takken,Shaodi You
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Autonomous vehicles, safely in traffic, participate safely, pedestrian crossing intention, dataset
备注：
点击查看摘要
Abstract:Autonomous vehicles use pedestrian crossing intention prediction (PCIP) to participate safely in traffic. Existing models are largely trained under favourable daytime conditions with sufficient daylight. Little is known about the robustness of these models under night-time and low-light conditions, due to the lack of datasets containing night-time footage. This paper investigates how a dataset, named NightSteps, can be constructed and evaluated as a baseline benchmark. The dataset is based on nighttime dashcam footage collected from six different cities around the world, capturing a wide variety of road conditions. The dataset consists of dashcam-recorded point-of-view footage, raw data of pedestrians' locations with corresponding 'track ids' and ground-truth labels containing accurate information about pedestrian crossing behaviour, resulting in a diverse dataset. Gemini, ChatGPT, and human assessment are used to demonstrate the usability of the dataset by predicting crossings in clips from the dataset and comparing the results with the initial ground-truth labels. These results show that human input achieves an accuracy of 88.17% and an F1-score of 80.21%. Predictions from Gemini and ChatGPT perform lower, with accuracies of 60% and 79.13% respectively, and F1-scores of 42.50% and 63.64%. The evaluation demonstrates that the NightSteps dataset can be used for future model evaluation to test the performance of PCIP, with the aim of improving road safety at night.
112. 【2611.11554】Kimodo-Policy: Learning Kinematic Action Models for Humanoid Loco-Manipulation
链接：https://arxiv.org/abs/2611.11554
作者：Yunheng Wang,Jiaxi Zhang,Wei Lu,Yuetong Fang,Taowen Wang,Yixiao Feng,Shuning Zhang,Junzhe Xu,Yichi Wang,Zizhao Yuan,Kailun Huang,Lusong Li,Mingqian Zhou,Zecui Zeng,Renjing Xu
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：realize task objectives, requires continuous coordination, loco-manipulation requires continuous, Kinematic Action Models, requires continuous
备注： 23 pages, 14 figures, 4 tables. Project page: [this https URL](https://kimodo-policy.github.io/)
点击查看摘要
Abstract:Humanoid loco-manipulation requires continuous coordination of high-dimensional whole-body motion to realize task objectives. While vision-language-action models and world action models transfer semantic and visual-dynamics priors to robot control, these priors do not necessarily capture the structure of robot motion. We introduce Kinematic Action Models (KAMs), a paradigm that treats whole-body motion as a direct pretraining target and uses a pretrained motion generator as the primary action-generation backbone. KAMs ground learned temporal and cross-body coordination priors through task conditioning, visual observations, and execution feedback. We present Kimodo-Policy as an initial instantiation, combining a frozen Kimodo text-to-motion backbone with lightweight ControlNet-based visual conditioning. A root-body-hand hierarchy coordinates locomotion and manipulation, while motion-history conditioning and repeated action-chunk prediction bridge motion synthesis and closed-loop control. Following large-scale loco-manipulation pretraining, the policy achieves the highest overall success among compared policies on multi-task HumanoidArena (72.14%), competitive performance on SIMPLE, and 60% mean success across eight real-world tasks, with 678M parameters (92M trainable). Ablations support the contribution of the pretrained motion backbone. Together, these results provide initial evidence for motion generation as a complementary foundation for humanoid action learning.
113. 【2611.11547】Dropping Tokens Without Dropping Them: Causal Attribution for Diabetic Retinopathy
链接：https://arxiv.org/abs/2611.11547
作者：Pramath Girish Haritz,Chandra Sekhar Seelamantula
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：vision transformer provide, transformer provide causal, attention-based attribution maps, provide causal explanations, diabetic retinopathy
备注： 4 pages, 2 figures. Submitted to ISBI 2027
点击查看摘要
Abstract:In this work, we investigate whether attention-based attribution maps in a vision transformer provide causal explanations for diabetic retinopathy (DR) classification. We introduce a principled decomposition of attention into two attribution maps: the contribution ($c_t$), which satisfies the completeness axiom in explainable artificial intelligence (xAI), and the pull ($p_t$), which quantifies causal explanations. We define an identity relating $c_t$ and $p_t$ that characterizes when $c_t$ fails to capture causality. We test whether each map is causally faithful on the MAPLES-DR dataset by dropping/inserting tokens, and report Necessity ($N$), Sufficiency ($Su$), and Faithfulness Correlation ($FC$). The pull $p_t$ achieves the highest causal alignment ($FC = 0.53$, $N = 0.71\%$, $Su = 3.0\%$), outperforming Attention Rollout, Grad-CAM, and AttnLRP. Occlusion retains better sufficiency ($Su = 1.6\%$) but is about 800 times slower. Furthermore, on MAPLES-DR, $p_t$ achieves $70\%$ of the average precision (AP) of HRDecoder, a state-of-the-art supervised lesion segmentation model, despite the absence of pixel-level supervision. Together, these findings show that the pull $p_t$ and the contribution $c_t$ form computationally efficient attribution maps for reliable causal interpretation in safety-critical medical diagnostics. The code and demo are available at this https URL.
114. 【2611.11517】InfCoiL: Coordinated Planner-Controller Learning for Closed-Loop Physics-Based Human-Object Interaction
链接：https://arxiv.org/abs/2611.11517
作者：Yude Zou,Yifei Yao,Yiwei Hao,Hanqing Wang,Xing Gao
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：goal-conditioned human-object interaction, physics-based character animation, human-object interaction, character animation, goal-conditioned human-object
备注：
点击查看摘要
Abstract:Text- and goal-conditioned human-object interaction (HOI) provides an intuitive interface for specifying high-level intents in physics-based character animation. Mapping such intents to physically plausible, contact-rich behaviors naturally calls for a generative planner and a physics-based controller, yet existing planner-controller systems either execute plans open-loop or close the loop while keeping the planner fixed, so execution feedback never reshapes what is planned. We present InfCoiL, a closed-loop framework for physics-based HOI from coordinated planner-controller learning. InfCoiL couples a morphology-aware flow-matching planner with a unified multi-morphology controller through a shared morphology interface in an autoregressive plan-and-execute loop, and alternately fine-tunes both components with reinforcement learning from the same physical rollouts. To optimize the flow-matching planner online, we introduce Semantic Flow Policy Optimization (SFPO), which stochasticizes selected denoising transitions with channel-wise semantic covariance over heterogeneous HOI features and assigns group-relative, sequence-level rewards from complete closed-loop executions. On held-out OMOMO sequences, InfCoiL outperforms open-loop hierarchical baselines in goal-reaching task success and physical tracking accuracy. Project page: this https URL
115. 【2611.11510】Reaching Is Not Finding: Map-Anchored Visual Prompting for the Last Mile of Aerial Vision-Language Navigation
链接：https://arxiv.org/abs/2611.11510
作者：Ningbo Li,Kebin Liu,Jingcan Chen,Weichen Zhang,Rong Ding,Yunhao Liu,Mo Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Aerial vision-language navigation, Aerial vision-language, natural language, VLN, landmarks
备注：
点击查看摘要
Abstract:Aerial vision-language navigation (VLN) asks a drone to find an object described in natural language. The description usually locates the object relative to named landmarks, such as streets and buildings. We observe that current navigators often bring the drone close to the target and then stop at the wrong place: they reach the target without finding it. This gap is shared by navigators of very different designs, from imitation learners to a fine-tuned 7B vision-language model. A simple test reveals the cause. When we replace the target object in the instruction with another one next to the same landmarks, no navigator goes to it, and most stop where they did before. Navigators learn to reach the landmarks, not to identify the described object. We therefore propose MAP-VP, a plug-and-play module for the last step. After any navigator stops, MAP-VP draws the landmarks named in the instruction onto the drone's current view, using the landmark outlines that the benchmark provides on a map. A fine-tuned 4B vision-language model then locates the target relative to these landmarks. The training data are generated automatically from the benchmark annotations. Neither drawing the landmarks nor fine-tuning helps much alone, but together they are highly effective. Without retraining any navigator, MAP-VP significantly improves all six navigators we test on CityNav. It roughly doubles the success rate of the two strongest trained navigators, raising HETT from 25.9% to 54.6% and FlightGPT from 24.2% to 48.9%, whereas CityNav's official detector-based last step adds less than two points to HETT.
116. 【2611.11503】AgentCT: A Vision-Language Agent for Universal CT Imaging
链接：https://arxiv.org/abs/2611.11503
作者：Zhihao Chen,Qi Gao,Chuang Niu,Qiegen Liu,Yi Zhang,Hongming Shan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：metal artifact reduction, Computed tomography, artifact reduction, single network, network for low-dose
备注： 14 pages, 5 figures
点击查看摘要
Abstract:Computed tomography (CT) restoration methods often use a single network for low-dose CT (LDCT), sparse-view CT (SVCT), and metal artifact reduction (MAR), despite the distinct physics of these degradations. We propose AgentCT, a vision-language agent that identifies the degradation and routes images to task-specific restoration models. A LoRA-adapted Qwen3-VL-4B controller predicts degradation type and severity, selects a specialist, and reassesses the restored image. The LDCT specialist uses an image-domain diffusion model, whereas the SVCT and MAR specialists combine projection-domain correction, data consistency, differentiable filtered back-projection, and image refinement. We evaluated the controller and specialists separately on patient-disjoint Mayo 2020 abdominal CT data across three severity levels for each degradation. The controller achieved 95.7% accuracy for degradation type and 93.9% for severity, with a 100% JSON parse rate. Using ground-truth degradation labels for routing, AgentCT achieved an overall PSNR/SSIM of 46.18 dB/0.984, compared with 44.93 dB/0.976 for AMIR and 44.29 dB/0.979 for TAMP, and attained the highest PSNR in all nine settings. For SVCT, its dual-domain specialist achieved 46.04 dB with 4.2 million parameters, compared with 44.43 dB for single-task AMIR and 43.57 dB for all-in-one AMIR with 23.5 million parameters. These results support degradation-specific CT restoration with controller-based model selection; evaluation under automatic routing and on independent clinical data remains necessary. Code is available at this https URL.
117. 【2611.11500】ForeAct: Geometry-Guided Action Learning from World Representations
链接：https://arxiv.org/abs/2611.11500
作者：Wei Lu,Jiaxi Zhang,Yunheng Wang,Taowen Wang,Yuetong Fang,Zhenhui Zhang,Shuning Zhang,Zizhao Yuan,Yixiao Feng,Zecui Zeng,Renjing Xu
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：Robotic manipulation requires, Robotic manipulation, Robotic, evolution during interaction, manipulation requires representations
备注：
点击查看摘要
Abstract:Robotic manipulation requires representations that capture both scene geometry and its evolution during interaction. Existing approaches have largely treated these two aspects separately. World action models capture such dynamics by coupling action prediction with future video generation, but their reliance on iterative diffusion or rectified-flow inference leads to high computational cost, while their representations lack explicit spatial structure. Explicitly modeling scene geometry typically requires auxiliary modules that increase both parameter count and computational cost. Conversely, geometry-centric policies primarily recover observed spatial structure and often lack explicit supervision for anticipating future geometric changes during interaction. To address these limitations, we introduce ForeAct, which repurposes a pretrained video world model as a single-pass representation backbone for low-latency control. ForeAct directly processes the clean latent of the current observation in one forward pass, eliminating future-frame synthesis and iterative denoising while retaining the backbone's pretrained spatiotemporal priors. Rather than introducing a separate geometry backbone, ForeAct uses learnable tokens supervised by next-frame relative depth to shape the shared video representation through bidirectional self-attention. This compact interface turns the spatial knowledge already encoded in the backbone into a future-aware representation for action generation, with little parameter overhead. The lightweight geometry readout is used only during training and removed at deployment, enabling low-latency, geometry-aware control without depth input or an external geometry backbone. Without additional large-scale pretraining, ForeAct achieves 96.6% average success on LIBERO, 63.5% on SimplerEnv-Bridge, and a 74.4% success rate across 90 real-world rollouts.
118. 【2611.11464】Off-Policy RL with Online Inference Tuning: My Solution to the CoRL 2026 RoboEval Challenge
链接：https://arxiv.org/abs/2611.11464
作者：Ilia Larchenko
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：bimanual tasks, arms in coordination, scored against human, RoboEval challenge, RDS on held-out
备注： Technical report for the RoboEval Challenge at CoRL 2026. Code: [this https URL](https://github.com/IliaLarchenko/RoboEvalSolution) ; checkpoint: [this https URL](https://huggingface.co/IliaLarchenko/RoboEvalSolution) ; project page: [this https URL](https://ilialarchenko.com/projects/roboeval2026/)
点击查看摘要
Abstract:The CoRL 2026 RoboEval challenge has eight bimanual tasks, and it ranks a policy not only on whether it succeeds but on how: every stage of the task, done safely, efficiently and with both arms in coordination, scored against human demonstrations. My solution has two parts. The generic part, carried over from my LeHome challenge solution, is off-policy RL on a $\pi_{0.5}$-based policy that is also its own value function. It is trained with AWR and RECAP on advantages of the exact official score, in a loop where every rollout is at the same time a Thompson-sampling trial of about 20 inference parameters. Out of the box, it took the policy to 0.85 RDS on held-out seeds in two days (and it was still very far from convergence). The competition-specific part adds data that local exploration cannot find: generated demonstrations that reach the full reward, and recovery episodes that start from the policy's own failures. The submitted policy reaches 0.990 RDS on held-out seeds and 0.987 on the official seeds.
119. 【2611.11452】Semantically Aligned KV Cache Compression for Efficient Agentic Autoregressive Video Generation
链接：https://arxiv.org/abs/2611.11452
作者：Weizhong Huang,Huaijia Kou,Tianyu Xie,Xiawu Zheng,Liujuan Cao
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：combines semantic planning, controllable synthesis, verification for controllable, Agentic autoregressive video, visual verification
备注： 32 pages, 12 figures
点击查看摘要
Abstract:Agentic autoregressive video generation combines semantic planning, sequential generation, and visual verification for controllable synthesis. Growing visual histories enlarge the key-value (KV) cache, increasing memory use and attention costs across candidate rollouts. Existing compression methods primarily optimize individual generators without the planner's semantic constraints, risking low priority for states supporting requested attributes or actions. We introduce SemanticKV, a training-free method for semantically aligned KV cache compression. To our knowledge, SemanticKV is the first KV cache compression method for agentic autoregressive video generation that explicitly uses planner-extracted semantic constraints to guide retention. Text cross-attention identifies constraint-related video positions, whose self-attention queries are collected into separate groups. Attention weights are averaged within each group and maximized across groups, giving each cached entry a high score when strongly used by any represented constraint. A single top-k selection retains high-scoring entries under the memory budget, leaving their keys, values, and positions unchanged. For fixed query groups and equal entry costs, this selection minimizes an additive upper bound on worst-group discarded attention. The method operates independently within each candidate without retraining or additional video generations. We evaluate four AR video backbones on three benchmarks for 5-, 30-, and 60-second generation. On Causal Forcing at a compression ratio of 0.7, SemanticKV obtains a VBench Total Score of 84.10, compared with 84.05 for the strongest compressed baseline and 83.99 for Full KV. It achieves a 1.22x speedup over Full KV and reduces KV-cache memory from 6.04 GB to 1.81 GB, a 3.35x reduction.
120. 【2611.11437】How to "train" a surgeon? Benchmarking generalist agents in surgical scene understanding
链接：https://arxiv.org/abs/2611.11437
作者：Gengyuan Zhang,Xiao Han,Shijie Zhou,Abdullah Koukash,Jingpei Wu,Jindong Gu,Yuqicheng Zhu,Nassir Navab,Volker Tresp,Ghazal Ghazaei
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Evaluating general-purpose multimodal, multimodal large language, fragmented evaluation protocols, large language models, scarce surgical data
备注： Accepted at NeurIPS 2026, Evaluations and Datasets Track. 64 pages including appendices. Project page: [this https URL](https://vitagent.github.io/)
点击查看摘要
Abstract:Evaluating general-purpose multimodal large language models (MLLMs) for surgical scene understanding remains limited due to scarce surgical data and fragmented evaluation protocols. We address these challenges through a two-stage evaluation framework for surgical scene understanding. In Stage I, we introduce SurgKnowBench, a diagnostic benchmark that harmonizes public surgical datasets across procedures and tasks and evaluates proprietary and open-source MLLMs to map the boundary of pretrained surgical competence. SurgKnowBench reveals that current models retain partial visual priors but remain weak on relational and procedural understanding and workflow assessment. Building on this failure frontier and motivated by the scaffolded nature of surgical training, we introduce SurgAgentGym, an agentic environment where general-purpose MLLM agents can use bounded knowledge search over SurgWiki and general-purpose visual grounding for surgical tasks. SurgAgentGym evaluates whether generalist agents can improve surgical understanding at inference time through tool-mediated evidence use, without additional surgical training. Our results show that agentic inference narrows the gap mainly for perception-heavy tasks, while fine-grained localization and expert-style assessment remain persistent bottlenecks. This opens a path toward future studies of agentic surgical understanding.
121. 【2611.11433】Unlearning at Speed: Rapid Activation Dampening for Efficient Machine Unlearning in Real-World Face Recognition
链接：https://arxiv.org/abs/2611.11433
作者：Rouqaiah Al-Refai,Leo Scheubel,Philipp Terhörst
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：GDPR empower users, GDPR empower, face recognition, face recognition systems, increasingly important
备注：
点击查看摘要
Abstract:Machine unlearning has become increasingly important in face recognition, where regulations like the GDPR empower users to request the removal of their personal data from deployed models. However, most existing unlearning methods are designed for closed-set classification with small-scale models and training data, and therefore do not generalize to real-world face recognition systems, which operate in an open-set setting with large-scale models and data. In this work, we propose Rapid Activation Dampening (RAD), a fast and targeted unlearning method tailored specifically for large-scale open-set face recognition. RAD approximates differences in average neuron activations between forget and retain identities, identifying and selectively suppressing neurons that are most associated with the targeted identity through a sensitivity-controlled dampening mechanism. We further propose the Forget Score (FS), which addresses the mismatch between existing unlearning metrics and open-set problems by providing a probabilistic interpretation of forgetting directly in the representation space. Experiments across several recent large-scale face recognition architectures and datasets show that RAD achieves strong forgetting while preserving overall model utility and substantially improving unlearning speed. These findings establish RAD as a scalable and practical approach to machine unlearning in face recognition systems.
122. 【2611.11427】Flex-DDCM: Zero-Shot Task-Oriented Image Compression via Diffusion Trajectory Guidance
链接：https://arxiv.org/abs/2611.11427
作者：Yixin Gao,Runsen Feng,Xin Li,Zhibo Chen
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：produce perceptually pleasing, Recent zero-shot image, compression methods exploit, perceptually pleasing reconstructions, pretrained diffusion models
备注：
点击查看摘要
Abstract:Recent zero-shot image compression methods exploit the powerful priors of pretrained diffusion models to produce perceptually pleasing reconstructions without compression-specific training. However, image compression serves not only human viewing but also machine analysis, while existing zero-shot codecs have limited flexibility in meeting the diverse reconstruction requirements of these applications. In this paper, we propose Flex-DDCM, a framework for zero-shot task-oriented image compression via diffusion trajectory guidance. Building on Turbo-DDCM, we adapt the coded diffusion trajectory through task-guided noise selection, embedding the effects of task guidance into the compressed representation. Guidance terms can be applied individually or combined, with timestep-dependent strengths controlling their influence throughout denoising. This design enables task adaptation without introducing additional decoding complexity. Experiments demonstrate flexible trade-offs among pixel fidelity, perceptual quality, and downstream task performance, with competitive performance against trained task-oriented codecs and faster decoding than Diff-ICMH.
123. 【2611.11421】GenRM-Flow: Generators are Process-aware Reward Models in Flow Matching
链接：https://arxiv.org/abs/2611.11421
作者：Siming Fu,Ruizhe He,Zheming Fu,Zeyue Xue,Fengkai Liu,Yufei Jiao,Jie Huang,Xiaoxiao Ma,Xuan Yang,Lihui Luo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Aligning video generation, scores generated videos, human preference depends, preference depends critically, Aligning video
备注：
点击查看摘要
Abstract:Aligning video generation models with human preference depends critically on the quality of the reward model that scores generated videos. Current video reward models, however, source their reward signal from a model's representational rather than generative capacity: they either repurpose vision-language models as pixel-space scorers, or train auxiliary scoring heads on top of frozen generator features. The generator's actual ability to predict velocities, denoise latents, and produce videos plays no role in scoring its own generations. We argue that this overlooks a structural property of offline preference learning. Any preference optimization objective that approximates an offline preference dataset mathematically targets a strictly defined KL-constrained optimal policy. By isolating the reward term from this analytical solution and mapping the exact generation log-likelihood to its flow-matching surrogate, the empirical reward emerges deterministically as the relative difference in continuous-time velocity-prediction errors. We formalize this equivalence into GenRM-Flow, a framework where a preference-tuned video generator inherently operates as a process-aware reward model directly in the noisy latent space. We further show theoretically that distinct fine-tuning objectives, whether contrastive like DPO and IPO or non-contrastive like RWR, are alternative optimization pathways toward the same optimal policy, each inducing a reward readout from the generator's velocity-prediction errors. Furthermore, the extracted process reward seamlessly substitutes external VLM scorers in FlowAWR. Operating purely on native latent outputs without auxiliary reward networks, this generative reward drives measurable improvements in downstream video generation.
124. 【2611.11398】Decomposing Earth Embeddings with Sparse Autoencoders
链接：https://arxiv.org/abs/2611.11398
作者：Vitus Benson,Fanny Yang,Markus Reichstein
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Geophysics (physics.geo-ph)
关键词：produce global metre-resolution, global metre-resolution embeddings, foundation models produce, models produce global, Earth observation foundation
备注： Accepted at NeurIPS 2026. Code: [this https URL](https://github.com/EarthyScience/geosae)
点击查看摘要
Abstract:Earth observation foundation models produce global metre-resolution embeddings that underpin work across agriculture, ecology, hydrology, and beyond. Yet these embeddings are opaque: each dimension entangles unrelated physical concepts, which makes them difficult to interpret and their robustness hard to assess. Here, we propose sparse autoencoders (SAEs) as a principled way to decompose Earth embeddings into sparse, approximately monosemantic features over an overcomplete dictionary. Because LLM judges of interpretations do not transfer to satellite pixels, and spatial autocorrelation matters, we introduce a tailored evaluation protocol. It scores any SAE on reconstruction at matched sparsity, alignment with reference concepts, and spatial scale, each against baselines that include an SAE whose decoder is a frozen random dictionary. On this protocol, SAEs reconstruct AlphaEarth and Tessera embeddings better than every baseline at matched sparsity. Their features align with far fewer reference concepts than raw embedding dimensions (on AlphaEarth, 88% align with at most one of 20 concept groups, most with none, against a median of 12 per raw dimension). They also carry more of their variance at fine spatial scales (23 to 32% within a 640 m patch for BatchTopK and Matryoshka, against 9%). An SAE with a frozen random decoder shares both properties, which therefore follow from sparsity, whereas only a learned dictionary reconstructs the embedding accurately: on AlphaEarth, trained SAEs leave eight times less variance unexplained. We test the sparse code on two applications, discovering land-cover sub-concepts and detecting out-of-distribution pixels by area-of-applicability estimation. Both indicate how sparse features could be used, but neither is yet reliable enough for practical use. Together, these results are a step toward Earth observation models whose features can be inspected.
125. 【2611.11391】Let the Gallery Learn Itself: Training-Free Iterative Side-View Face Recognition
链接：https://arxiv.org/abs/2611.11391
作者：Zijun Huang,Suncheng Xiang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：single gradient update, face recognition system, gradient update, system could learn, single gradient
备注： Work in progress
点击查看摘要
Abstract:What if a face recognition system could learn from every encounter without a single gradient update? We present Gallery Self-Evolution (GSE), a training-free framework where the gallery itself adapts at test time. The core mechanism---dedup-FIFO curation---archives novel appearance samples after successful recognition while permanently locking the enrollment template, bounded at 30 embeddings per identity. On CFP-FP and IJB-C benchmarks, GSE closes the side-view gap by +23 points at 45° yaw and boosts TAR@FAR=0.001 by +9.4 points, all at CPU-level cost. No retraining. No GPU. Just a gallery that grows smarter every time it meets you.
126. 【2611.11378】SegDis: Foreground Segmentation Followed by Type Discrimination for Salient and Camouflaged Object Detection
链接：https://arxiv.org/abs/2611.11378
作者：Dingning Luo,Shuo Dou,Tong Jiang,Xianfeng Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：camouflaged object detection, Salient and camouflaged, joint methods output, object detection, camouflaged object
备注： 15 pages, includes supplementary material
点击查看摘要
Abstract:Salient and camouflaged object detection (SOD and COD) both recover foreground support, yet most joint methods output only a binary mask and therefore cannot distinguish the type. USC12K distinguishes the two types, but its baseline USCNet still binds foreground existence to the type within a single normalization, so the failure source cannot be attributed. Our cross-task study shows that foreground localization transfers between SOD and COD, whereas type discrimination does not: a COD-only model recovers foreground on SOD images but its type judgement follows the training distribution rather than the foreground-background relation, so the two decisions require separate mechanisms. SegDis factorizes the output into an explicit foreground probability and a conditional type probability given foreground: FLR provides high-quality task-agnostic support, and RTA refines the SOD/COD assignment from the foreground-background relation without a task identifier. Because support is explicit, each ground-truth foreground pixel is classified as correct-type, type-swapped, or missed, so foreground-recovery and type-assignment errors are diagnosed separately. With PVT-v2-B2, SegDis attains 68.98% FG-mIoU and 78.35% mIoU on USC12K at about one-eighth of USCNet's parameters; CSCS is 5.75.
127. 【2611.11359】NuJEV: Structured Visual Judgments for Consistent Nuclei Quantification
链接：https://arxiv.org/abs/2611.11359
作者：Yonghuang Wu,Pengfei Wang,Zhenyang Liang,Yize Ma,Pengfei Song,Guoqing Wu,Jinhua Yu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：quantification requires locating, Nuclear quantification requires, quantification requires, requires locating, locating and typing
备注：
点击查看摘要
Abstract:Nuclear quantification requires locating and typing nuclei, beyond generating a count. Inspired by Jev's structured decisions in place of free-form generation, we introduce NuJEV for nuclear perception in Qwen3-VL-2B. We jointly train visual LoRA and a parallel head to predict nuclear presence, centers, and types. One image encoding feeds both the nuclear head and original language decoder. The decoder interprets region and type requests, with counts computed from the predicted nuclei. On 2,732 PanNuke test images, NuJEV achieves a five-query mean absolute error ($\mathrm{MAE}_5$) of 1.844 overall and 5.268 on dense images, with localization/typed F1 of 0.816/0.682. A matched encoder ablation shows 41.0\% lower dense error with visual adaptation. For language requests, NuJEV reduces request MAE by 76.2\% relative to direct generation. Our code will be released as open source.
128. 【2611.11334】MoT3DVG: A Benchmark for Outdoor 3D Visual Grounding with Motion-Aware Descriptions and Temporal Cues
链接：https://arxiv.org/abs/2611.11334
作者：Shijia Zhao,Xusheng Guo,Qiming Xia,Xun Huang,Kezheng Xiong,Zhihong Liu,Chenglu Wen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：localizes language-referred objects, visual grounding, localizes language-referred, broad applicability, outdoor
备注： NeurIPS 2026 Evaluations and Datasets
点击查看摘要
Abstract:3D visual grounding (3DVG) localizes language-referred objects in 3D scenes, with broad applicability in both indoor and outdoor environments. However, existing 3DVG research focuses on static indoor objects, limiting its use in dynamic outdoor autonomous driving. Motion descriptions, which capture the temporal dynamics of moving objects, offer a promising way to address this challenge. We therefore introduce MoT3DVG, a large-scale dataset for dynamic-aware outdoor 3DVG with temporally evolving motion descriptions. It contains 850 scenarios with 31,128 frames from nuScenes dataset, and provides 144,568 language prompts with motion-aware descriptions for dynamic objects across time. We further propose DynaVG, a novel framework that effectively leverages temporal cues for outdoor 3DVG. In addition to the standard modality-specific encoders, DynaVG introduces a Short-Long Integrated Dynamic Encoding (SLIDE) module before the language-point cloud alignment. SLIDE models both local motion cues and global temporal context via short-term window encoding and long-term window shifting. Extensive experiments demonstrate its state-of-the-art performance on MoT3DVG, validating the effectiveness of motion-aware encoding. Our work reveals open challenges and promising directions for future research in outdoor 3DVG.
129. 【2611.11326】Conditional Diffusion-Based Proxy Representation Recovery for BCVA Prediction with Missing SLO Modality
链接：https://arxiv.org/abs/2611.11326
作者：Chuyi He,Hua Zou,Fei Luo,Zixian Yang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：support prognosis assessment, SLO, SLO proxy representation, SLO proxy, support prognosis
备注： 8 pages, 3 figures, 3 tables. Accepted at IEEE BIBM 2026
点击查看摘要
Abstract:Preoperative prediction of postoperative best-corrected visual acuity (BCVA) can support prognosis assessment and individualized decision-making in cataract surgery. Multimodal learning can integrate preoperative optical coherence tomography (OCT) images, scanning laser ophthalmoscopy (SLO) images, and clinical text to characterize patient status. However, SLO images are often missing in real-world clinical data due to acquisition or data-management issues, resulting in incomplete multimodal inputs. To address this problem, this paper proposes a conditional diffusion-based method for SLO proxy representation recovery and fusion prediction. Instead of reconstructing raw SLO images, the proposed method formulates SLO missingness as proxy representation recovery in the latent feature space. Specifically, OCT image features and clinical text features are first fused to construct an OCT-text conditional representation, which guides the reverse denoising process of the diffusion model to estimate sample-specific SLO proxy representations. The recovered SLO proxy representation is then used as a substitute for the unavailable SLO modality and incorporated into the downstream multimodal fusion prediction network for postoperative BCVA prediction. Experiments were conducted on 2,141 preoperative multimodal cataract samples, with an SLO missing rate of 58.80%. The proposed method achieved an accuracy of 0.9714 under the criterion of an absolute prediction error within 0.1 LogMAR and a mean absolute error of 0.0423, outperforming representative postoperative visual acuity prediction and missing-modality learning methods. These results indicate that representation-level proxy recovery can alleviate the impact of SLO modality missingness on postoperative BCVA prediction.
130. 【2611.11320】Beyond Similarity Entropy: A Rank-Guided Data-Free Quantization Framework for Vision Transformers
链接：https://arxiv.org/abs/2611.11320
作者：Runqing Jiang,Ye Zhang,Pengpeng Yu,Zhuo Song,Changjun Li,Longguang Wang,Yulan Guo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Vision Transformers, demonstrated remarkable performance, memory demands pose, demands pose significant, pose significant challenges
备注：
点击查看摘要
Abstract:Vision Transformers (ViTs) have demonstrated remarkable performance, yet their computational and memory demands pose significant challenges for deployment on mobile devices. Data-free quantization (DFQ) enables the compression of ViTs without access to their original training data. Existing DFQ methods often synthesize calibration samples by maximizing the entropy of patch similarity. However, similarity entropy describes the dispersion of similarity values without ensuring that the generated samples cover diverse feature directions, potentially limiting their effectiveness for quantization calibration. To address this limitation, we propose RankQ-ViT, a rank-guided DFQ framework for ViTs. We first observe that patch similarity matrices derived from Gaussian noise tend to have lower ranks than those derived from real images. Motivated by this observation, we introduce a block-aware self-contrastive objective that promotes feature diversity during synthetic data generation without explicitly computing matrix rank at each optimization step. We then select calibration samples based on their rank and semantic consistency and use them for block-wise reconstruction of the quantized model. Experiments on ImageNet, COCO, ModelNet40, and ShapeNet demonstrate the effectiveness of RankQ-ViT across multiple architectures and tasks, particularly under low-bit quantization. The code is available at this https URL
131. 【2611.11304】ransArt3D: From Two States to Articulated 3D Reconstruction with Video Transition Priors
链接：https://arxiv.org/abs/2611.11304
作者：Chenhao Guan,Liying Yang,Xinxing Yu,Hao Mo,Tianshun Han,Renjun Gao,Yanyan Liang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Reconstructing interactable articulated, Reconstructing interactable, interactable articulated assets, robotics and simulation, highly underconstrained
备注：
点击查看摘要
Abstract:Reconstructing interactable articulated assets from a few images is key to robotics and simulation, yet highly underconstrained. Existing optimization-based methods fit an articulated asset under a static 3D prior that scores each state independently, so per-state reconstruction errors leak into the estimated moving part and joint as false motion. Video diffusion models capture how objects move between states, but only implicitly in 2D. To this end, we present TransArt3D, an optimization-based framework that reconstructs an articulated 3D asset from two endpoint images by translating this video transition prior into explicit part structure and joint kinematics. It first lifts frames generated between the endpoints with a transition-coupled 3D consensus that applies the static 3D prior jointly across frames, stabilizing unchanging regions and initializing the parts and joint. A rectified-flow kinematic refinement then lets the video prior supervise a 3D motion field over the whole transition, while part assignment and a shared joint constrain the field throughout optimization, keeping per-state errors out of the articulation. Finally, a motion-aware canonical appearance fusion uses the recovered articulation to map both endpoint images onto one canonical surface, texturing regions that only one state reveals. On PartNet-Mobility, TransArt3D outperforms methods given the same two endpoints in geometry and joint accuracy, and surpasses methods given six observed states in articulated-state geometry, joint localization and appearance.
132. 【2611.11296】Single-Radar Bilateral 3D Near-Field Imaging for Mobile Robots
链接：https://arxiv.org/abs/2611.11296
作者：Yingqi Wang,Tingwei Chen,Zhongqin Wang,Min Xu
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Mobile robots operating, limited elevation diversity, viewpoint-dependent target visibility, near-field wavefront curvature, single forward-mounted millimeter-wave
备注：
点击查看摘要
Abstract:Mobile robots operating in homes need reliable 3D perception of nearby furniture and surrounding structures, yet recovering this information on both sides of the robot's path with a single forward-mounted millimeter-wave radar remains challenging because of near-field wavefront curvature, viewpoint-dependent target visibility, and limited elevation diversity. This paper presents a motion-assisted framework for reconstructing structures on both sides of a robot's trajectory. Our near-field model relates scene reflectivity to stepped-frequency multiple-input multiple-output (MIMO) observations across frequencies and robot positions using spherical paths from transmitter (Tx) to scatterer to receiver (Rx). Bilateral Tx combining provides wideband directional weighting, while sliding-aperture back-projection coherently focuses the measurements using near-field propagation distances. Top-K power fusion combines local images with different visibility. The reconstruction provides lateral-forward support for multi-layer height extraction, followed by guarded adaptive height refinement using the original MIMO channels. Experiments in controlled, office/study, and corridor environments produce mean lateral-forward localization errors of 4.65, 5.63, and 5.98 cm, respectively, with peak-to-background ratios (PBRs) exceeding 13 dB. The framework recovers bilateral 3D scattering structure from one forward pass using a single radar, without relying on learned representations of the scene.
133. 【2611.11291】Multi-Node Transformers for Object Detection and Captioning Across Distributed Edge Networks
链接：https://arxiv.org/abs/2611.11291
作者：Saurabh Kumar,Dewant Katare,Prakriti Jain
类目：Distributed, Parallel, and Cluster Computing (cs.DC); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：distributed edge networks, Jetson Orin Nano, dense region captioning, NVIDIA Jetson Orin, paper presents
备注：
点击查看摘要
Abstract:This paper presents a unified transformer-based framework for object detection and dense region captioning across distributed edge networks. The architecture uses a shared visual encoder followed by detection, region extraction, and autoregressive language-decoding stages, allowing localization and region description to reuse the same image features. This design removes the second image-encoding path required by decoupled detection and captioning pipelines. To support execution on resource-limited devices, a workload-allocation formulation assigns model stages and input streams across connected edge nodes while accounting for execution time, memory capacity, processor utilization, power limits, and intermediate tensor transfer cost. The framework is evaluated on a six-device edge testbed comprising four NVIDIA Jetson Orin Nano and Orin NX inference nodes and two Raspberry Pi 5 auxiliary CPU nodes, with TensorRT FP16 and INT8 execution on the NVIDIA devices. On a Jetson Orin Nano, the unified INT8 model achieves 38.1 FPS with 3.5 GB peak memory use and 11.8 W measured power. Under four concurrent streams, the proposed allocation achieves 35.2 FPS and 28.4 ms mean end-to-end latency with an internode transfer rate of 6.8 MB/s.
134. 【2611.11289】A Unified Framework for License Plate Identification and Character-Recognition
链接：https://arxiv.org/abs/2611.11289
作者：Saurabh Kumar,Dewant Katare,Prakriti Jain
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：low-power edge hardware, edge hardware, license plate detection, paper presents, presents a unified
备注：
点击查看摘要
Abstract:This paper presents a unified framework for license plate detection and character recognition on low-power edge hardware. The proposed network uses a shared CSP-Darknet and PANet feature encoder with an anchor-free localization head and a RoIAlign-based sequence-recognition branch. Character decoding is performed directly on aligned feature maps, avoiding image-space plate cropping and a second recognition backbone. The model is trained on an AI-assisted dataset of approximately 37,000 manually verified images covering license plate layouts from all 50 United States. The dataset includes variations in illumination, viewpoint, weather, blur, occlusion, and plate design. The framework is converted to an INT8 TensorRT engine and evaluated on an NVIDIA Jetson Orin Nano with 8 GB memory. The INT8 model shows an mAP50 of 97.8% and a full-sequence accuracy of 90.7%. It records 147 FPS at 6.8 ms end-to-end latency, with 315 MB inference memory and 9.4 W average power consumption. Relative to the YOLOv8s+CRNN baseline, the proposed deployment provides a 7.1x throughput increase and a 77.8% reduction in allocated inference memory
135. 【2611.11272】BiRefNet-V2: Rethinking Bilateral Reference for High-Resolution Dichotomous Image Segmentation
链接：https://arxiv.org/abs/2611.11272
作者：Peng Zheng,Deng-Ping Fan,Binglu Wang,Nicu Sebe
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Dichotomous image segmentation, segmentation requires pixel-accurate, requires pixel-accurate foreground-background, pixel-accurate foreground-background separation, image segmentation requires
备注： Submission version
点击查看摘要
Abstract:Dichotomous image segmentation requires pixel-accurate foreground-background separation while preserving fine structures such as thin filaments, sharp edges, and intricate textures. BiRefNet addressed this challenge through bilateral references, combining image patches and gradient information, but its inward reference loses local spatial structure and lacks semantic guidance, while its outward reference relies on single-channel gradient attention. We recast this paradigm as controlled information recovery - locality determines what spatial information survives, semantic selectivity what information enters, and focused boundary supervision where refinement occurs - and propose BiRefNet-V2 to implement it: (1) locality-preserving and semantically guided detail injection through space-to-depth transformation, overlapping patches, and a Semantically Guided Gate; (2) a learned boundary stream with focused supervision that generates full-channel residual attention without requiring boundary annotations; and (3) a dual-branch decoder integrating depth-wise boundary convolutions with large-kernel attention. A modernized framework - LayerNorm, GELU, the Lion optimizer, and a DINOv3 backbone - cuts training from 600 to 50 epochs. Extensive experiments demonstrate state-of-the-art performance on DIS5K, camouflaged object detection, and high-resolution salient object detection across all 13 evaluation sets. Code is available at this https URL.
136. 【2611.11265】DuSS-PET: Self-Supervised Low-Dose PET Reconstruction Using Pseudo-Dual-Domain Consistency Without Paired Data
链接：https://arxiv.org/abs/2611.11265
作者：Shuijin Lin,Yuzhu He,Yongbo Wang,Jianhua Ma,Fan Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Positron emission tomography, Positron emission, requires high radiation, PET reconstruction framework, PET reconstruction
备注： Author accepted manuscript. Published in IEEE Transactions on Radiation and Plasma Medical Sciences (Early Access, 2026)
点击查看摘要
Abstract:Positron emission tomography (PET) is pivotal in medicine and healthcare, but requires high radiation doses for quality imaging. Although deep learning has shown promise for low-dose PET reconstruction/enhancement, existing methods primarily rely on fully supervised learning, which requires paired low- and full-dose scans that are clinically impractical to obtain. To overcome this fundamental limitation, we propose DuSS-PET, a novel self-supervised PET reconstruction framework that operates without any paired low- and full-dose data. Our method is built upon a computational Noisier2Noise (Nr2N) paradigm, featuring a Bernoulli corruption strategy that serves as an image-space approximation to emulate low-count noise patterns in image-derived pseudo-sinogram representations. The DuSS-PET framework integrates three core components: an adaptive Swin transformer for pseudo-sinogram restoration, a plug-and-play module for image enhancement, and a consistency-constrained SSL strategy that enforces agreement between the pseudo-sinogram and image representations. Extensive experiments on multi-center datasets demonstrate that DuSS-PET achieves superior reconstruction performance, outperforming state-of-the-art SSL methods and achieving comparable or even better results than fully supervised approaches across various dose levels. In particular, it exhibits exceptional generalization across different scanner vendors. This work is among the first self-supervised low-dose PET reconstruction framework that enforces consistency between reconstructed images and pseudo-sinograms, where the pseudo-sinogram generated in the image space serves as a solid computational consistency constraint for enhanced imaging without full-dose training scans. The source code will be publicly available at this https URL.
137. 【2611.11261】Chatter Attack: Resource Consumption Attack for Large Language Models
链接：https://arxiv.org/abs/2611.11261
作者：Yibo Miao,Yichuan Cao,Xiao-Shan Gao,Yinpeng Dong
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV); Optimization and Control (math.OC)
关键词：overly long outputs, substantial inference cost, incur substantial inference, increasing latency, operational expense
备注： NeurIPS 2026
点击查看摘要
Abstract:LLMs are powerful but incur substantial inference cost, which can be exploited by malicious users to induce overly long outputs, increasing latency and operational expense. Prior resource consumption attacks either coerce repetition or suppress the end-of-sequence token by lowering its logit value. However, with autoregressive, sampling-based generation, the search space grows exponentially with length and small deviations or unstable trajectories can derail optimization, limiting attack effectiveness and stability. To address this issue, we introduce Chatter Attack, a novel class of resource consumption attacks that optimize adversarial prompts to induce predefined short target phrases, thereby avoiding search-space explosion while still eliciting long responses. Specifically, Chatter Attack triggers self-doubt using short doubt-inducing phrases as the target, and sustains this state throughout generation via inference attention loss and global entropy loss. To extend to black-box settings, we further propose a novel Bayesian Prompt Optimization (BPO) method, which models the objective function globally by constructing a discrete token kernel, efficiently exploring the entire search space using prior information. Extensive experiments across multiple models and datasets show that our method outperforms baselines, with maximum response length increases to 31.5$\times$, and revealing practical resource-depletion risks for real-world LLM inference services.
138. 【2611.11258】Auto-GlaKG: Automated Biomarker Reasoning for Explainable Glaucoma Detection
链接：https://arxiv.org/abs/2611.11258
作者：Cheng Huang,Zeyu Han,Yian Hu,Yaopeng Ding,Jingxi Qiu,Yadi Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Interpretable glaucoma detection, clinically meaningful biomarkers, glaucoma detection requires, Interpretable glaucoma, clinically meaningful
备注：
点击查看摘要
Abstract:Interpretable glaucoma detection requires a transparent connection between fundus images, clinically meaningful biomarkers, and diagnostic predictions. Knowledge graph (KG) reasoning provides this structure, but performance measured using annotated biomarkers does not establish performance when only images are available. We present Auto-GlaKG, an automated framework that combines image-based biomarker prediction with fixed clinical-prior rules. A ResNet50 network predicts the cup-to-disc ratio (CDR) and six morphological signs using biomarker supervision, and a KG reasoner aggregates their signed rule contributions into a glaucoma score. On 689 fundus images evaluated using stratified, group-aware five-fold cross-validation, Auto-GlaKG achieves a pooled area under the receiver operating characteristic curve (AUC) of 0.951 (95\% confidence interval: 0.931--0.969), with sensitivity of 0.970 and specificity of 0.779. The matched image classifier also achieves an AUC of 0.951, while the rule stage adds 0.2~ms per image. Replacing predicted CDR with its annotation increases fold-mean AUC from 0.953 to 0.995. The framework provides an explicit rule-level account of image-based predictions and identifies CDR estimation as a priority for validation using independently measured biomarkers.
139. 【2611.11218】Edge Computing for Computer Vision in IoT: Feasibility and Directions
链接：https://arxiv.org/abs/2611.11218
作者：Panagiotis Savvidis,George A. Papakostas
类目：Networking and Internet Architecture (cs.NI); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC)
关键词：Low Power Wide, Power Wide Area, Wide Area Networks, architectures integrating Machine, integrating Machine Learning
备注：
点击查看摘要
Abstract:The convergence of decentralized architectures integrating Machine Learning, Computer Vision and Low Power Wide Area Networks is increasingly becoming an integral part of our daily existence. Internet of Things serves as a real-time data conduit enhancing decision making via embedded technology and continuous data exchange. This paper explores the feasibility of Edge Computing as a foundational pillar in this evolving landscape. We experiment under real world, dynamic conditions, evaluate the technological aspects, strategies, process flows and key observations under the broad Edge Computing domain. Research pathways include Multi-access Edge topologies in future 6G networks, model quantization, and satellite-enhanced communication platforms. Additionally, a discussion is added supporting the advanced AI functionalities, including zero-shot learning, multi modal perception, and decentralized generative AI, thereby broadening the scope of intelligent applications across various domains. The significance and research objective of this study are threefold: (1) evaluation of LoRaWAN and satellite IoT communication strategies, (2) analysis of CV workloads on edge hardware and (3) future research directions where Edge Computing can support low-latency, energy-efficient and socially impactful IoT applications. By explicitly addressing these aspects, we aim to establish a clear link between the technological feasibility, ultimately with a practical and socioeconomic relevance.
140. 【2611.11214】Disentangling Where and When:Factored Spatio-Temporal Explanations for Video Action Recognition
链接：https://arxiv.org/abs/2611.11214
作者：Bhavan Vasu,Giuseppe Raffa,Prasad Tadepalli
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：typically conflate spatial, recognition typically conflate, conflate spatial appearance, Post-hoc explanation methods, video action recognition
备注： Accepted at The Fortieth Annual Conference on Neural Information Processing Systems (NeurIPS 2026)
点击查看摘要
Abstract:Post-hoc explanation methods for video action recognition typically conflate spatial appearance and temporal dynamics into a single saliency or importance map. We propose a perturbation-based framework that disentangles these contributions into a spatial appearance mask ($M_a$) and a temporal motion mask ($M_m$). The two masks are jointly optimized against a frozen action recognition model through factored perturbation architecture, with nearest frame replacement to identify important temporal dynamics. A separation penalty discourages the appearance mask from spending budget on frames that the motion mask has already discarded. A ReLU-based area constraint penalizes explanations larger than an assigned budget. To evaluate these explanations, we introduce a separation protocol that sweeps spatial pixels and temporal frames independently, backed by proofs characterizing the proposed method. Across EPIC-Kitchens-55, EGTEA Gaze+, and Something-Something V2, our method attains the lowest deletion AUC against leading baselines while producing masks roughly five times sparser.
141. 【2611.11210】DynOLAT: OLAT Video Prediction for Controllable Dynamic Full-Body Relighting
链接：https://arxiv.org/abs/2611.11210
作者：Taoming Liu,Yinji ShenTu,Guangzhao He,Yudong Jin,Yukang Ye,Siyu Zhang,Fan Jia,Wei Hua,Hujun Bao,Xiaowei Zhou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Accurate lighting response, realistic dynamic human, Accurate lighting, target lighting direction, dynamic human relighting
备注： Accepted to SIGGRAPH Asia 2026 (Journal Track). Project page: [this https URL](https://zju3dv.github.io/DynOLAT)
点击查看摘要
Abstract:Accurate lighting response is essential for realistic dynamic human relighting, because shadows, highlights, and color changes should follow the target illumination in both direction and relative strength. Current learning-based relighting methods can generate visually plausible videos, but they often exhibit imprecise lighting responses: shadows and highlights may drift away from the target direction, and the output brightness may not faithfully follow the relative intensities in the target environment, making the result closer to appearance harmonization than controllable relighting. To address this issue, we propose DynOLAT, a generalizable OLAT video prediction framework for dynamic full-body humans. Instead of directly synthesizing a single relit appearance, our method predicts temporally consistent One-Light-At-a-Time (OLAT) basis videos from flat-lit inputs, and then linearly combines the predicted bases according to the target environment map. This OLAT-based formulation makes the directional response explicit in the predicted bases, while the relative lighting strength is determined by the linear weights derived from the environment map. We further introduce a dynamic capture pipeline and the first large-scale dynamic full-body OLAT dataset, comprising over 24 million frames from 224 identity-outfit combinations, where different outfits of the same person define separate combinations. Experiments show that DynOLAT responds more faithfully to variations in target lighting direction and relative intensity than the tested baselines, enabling controllable video relighting while preserving fine appearance details and temporal coherence. The dataset and processing tools will be publicly released to foster future research.
142. 【2611.11209】Viscot-steer: Disentangling and Transferring Visual Chain-of-Thought via Activation Steering
链接：https://arxiv.org/abs/2611.11209
作者：Ningning Wang(1),Beier Zhu(1),Xingyu Zhu(2),Kaiyun Yang(1),Xun Yang(1) ((1) University of Science and Technology of China, (2) National University of Singapore)
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：key visual evidence, thinking with images, ability to locate, visual-CoT, Viscot-steer transfers capabilities
备注： Project page: [this https URL](https://nn-wang.github.io/viscot-steer/)
点击查看摘要
Abstract:Visual chain-of-thought (visual-CoT), also known as "thinking with images", equips LVLMs with the ability to locate and use key visual evidence for reasoning. However, acquiring such visual-CoT capabilities requires costly post-training and tightly couples them to a specific backbone, making transfer to other LVLMs difficult. Existing cross-model transfer methods typically treat visual-CoT as a monolithic capability, using a unified representation that ignores the functional distinction between grounding and reasoning and introduces stage-irrelevant interventions. To address this problem, we propose Viscot-steer, a training-free activation steering framework for transferring visual-CoT capabilities across heterogeneous LVLMs. Specifically, Viscot-steer first disentangles visual-CoT into grounding and reasoning vectors and extracts them from the source-model layers associated with the corresponding capabilities. It then aligns the vectors with the activation space of the target model and steers the grounding and reasoning layers during bounding-box prediction and reasoning-trace generation, respectively. Across benchmarks covering high-resolution visual understanding, general visual perception and reasoning, and mathematical visual reasoning, Viscot-steer transfers capabilities from different visual-CoT models to architecturally diverse LVLMs and outperforms the strongest capability-transfer baseline by an average of 1.86 percentage points on the primary evaluation metrics.
143. 【2611.11200】Source-Anchored Visual Autoregression for Extreme Image Compression
链接：https://arxiv.org/abs/2611.11200
作者：Bingxin Wang,Yuan Lan,Yang Xiang,Yiqing Huang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：inferring plausible missing, plausible missing details, constrained generation problem, depends on inferring, inferring plausible
备注：
点击查看摘要
Abstract:In the extreme-low bitrate range below $0.01$ bpp, image compression becomes a constrained generation problem: the reconstruction depends on inferring plausible missing details while staying close to the input image. Autoregressive token models provide an efficient coarse-to-fine prior for this setting, but the transmitted early-scale tokens often leave object identity and texture underdetermined, which can lead to source-inconsistent reconstructions. We introduce Source-Anchored Visual Autoregression (SAVAR), a generative codec built on Visual Autoregressive (VAR) modeling. SAVAR transmits early-scale tokens and a compact caption. The tokens provide image-specific layout information, while the caption supplies global semantics. SAVAR reconstructs a partial VQ-VAE latent from the retained scales, maps it to the start-of-sequence initialization, and uses the same latent to condition the caption embedding before adaptive layer normalization, separating two roles that are typically driven by a shared condition in VAR-style generation. On the Kodak and CLIC2020 datasets in the extreme-low range, SAVAR reduces perceptual distortion relative to matched ARPC retained-scale operating points, lowering LPIPS by about $8$--$9\%$ and DISTS by up to $22\%$ at a lower bpp. It reconstructs a $512 \times 512$ image in about $218$ ms on one NVIDIA L20X GPU, retaining fast autoregressive decoding in the evaluated setting.
144. 【2611.11169】Map2SLAM: From Streaming Map Prediction to Real-Time SLAM
链接：https://arxiv.org/abs/2611.11169
作者：Jian Gao,Lin-Zhuo Chen,Yihang Chen,Jiagang Chen,Jiacheng Dong,Xun Cao,Nan Xue,Yinghao Xu,Yao Yao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：estimate camera poses, correct accumulated drift, estimate camera, fixed once emitted, accumulated drift
备注： 17 pages, 10 figures. Project page: [this https URL](https://robbyant-research.github.io/Map2SLAM/)
点击查看摘要
Abstract:Streaming 3D foundation models (3DFMs) estimate camera poses and dense geometry online, but they fall short of SLAM: their predictions are fixed once emitted, so loop closures cannot correct accumulated drift. With such models already providing strong geometric capability, a central question for SLAM becomes how to schedule their inference and how to keep its results as revisable state. We present Map2SLAM, which keeps LingBot-Map frozen, trains only a lightweight retrieval head, and builds SLAM on the model's inference interface, turning its predictions into observations of an external persistent SLAM state. The front-end tracks every incoming frame with the model's causal streaming inference and decides which frames are written to the persistent state as keyframes. The back-end asynchronously decides when and which past frames to re-observe, re-running the model's joint inference over them with fresh context; verified loop observations correct the trajectory online, and segment observations refine dense geometry after the sequence. All invocations share a single frame encoder pass per image, whose cached features also drive loop retrieval, so frequent re-invocation incurs no additional encoding cost. Map2SLAM achieves state-of-the-art performance on KITTI, VBR, and Oxford Spires, reducing mean ATE by over 40% compared with the best uncalibrated baselines, while maintaining real-time tracking at over 28 FPS at a resolution of $518\times154$ on an NVIDIA RTX 5090D GPU. Please visit our project page at this https URL.
145. 【2611.11152】Full Fine-Tuning is not the Problem: Why Adam Fails and SGD Succeeds in Few-Shot CLIP Adaptation
链接：https://arxiv.org/abs/2611.11152
作者：Nairouz Mrabah,Ismail Ben Ayed,Eric Granger
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：Full fine-tuning, CLIP, Few-shot CLIP adaptation, Few-shot CLIP, dense full fine-tuning
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:Few-shot CLIP adaptation is often treated as a parameterization problem. Full fine-tuning is assumed to overfit, so parameter-efficient fine-tuning (PEFT) methods are preferred. In this paper, we show that this conclusion conflates parameterization with optimization. Across 11 datasets, 3 CLIP backbones, and 5 shot levels, dense full fine-tuning with plain SGD outperforms representative PEFT methods under the reported evaluation protocol, whereas Adam/AdamW collapses. We trace this collapse to unreliable support-set preconditioning. The few-shot second moment systematically underestimates the corresponding full-data statistic, already at initialization. Adam's inverse-square-root normalization converts this error into an oversized adaptive update. Matching Adam's first-step update budget to SGD resolves most of the collapse, whereas numerator-side alignment does not explain the failure. Shampoo and SOAP also fail, so richer preconditioning alone does not resolve the problem. Theory formalizes how few-shot estimation error is amplified into unsafe updates. SGD succeeds because it avoids unreliable preconditioners and stays close to pretrained CLIP. Interpolation probes show low-loss connections along tested directions, and curvature probes show favorable directional curvature. These results identify optimizer-induced preconditioning, not dense full fine-tuning itself, as the main source of failure in few-shot CLIP adaptation.
146. 【2611.11147】Not All Layers Are Equal in Image-to-Video Transfer
链接：https://arxiv.org/abs/2611.11147
作者：Thinesh Thiyakesan Ponbagavathi,Constantin Seibold,Alina Roitberg
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：transfer adapts frozen, adapts frozen image, frozen image foundation, image foundation models, transfer adapts
备注： Accepted to NeurIPS 2026 (Main Track)
点击查看摘要
Abstract:Parameter-efficient image-to-video transfer adapts frozen image foundation models to video via lightweight trainable adapters. Existing methods insert the same adapter at every transformer layer, implicitly assuming all layers require equal temporal modeling. A layer-wise sensitivity analysis across four video-native model families and two pretraining paradigms reveals that this assumption is wrong: temporal sensitivity increases with depth, and the pretraining paradigm determines its growth profile. Vision-only models exhibit a gradual rise, while vision-language models show early suppression followed by late recovery. This finding motivates STRAP, a training-free adapter placement rule that derives a spatial-to-temporal transition boundary from a paradigm-matched video model. Spatial adapters are assigned before this boundary and temporal adapters after it, without modifying the adapter architecture itself. On four fine-grained action recognition benchmarks, STRAP improves accuracy by up to 11.8% over uniform placement, reduces trainable parameters by 29 to 48%, and lowers inference time by up to 10%. On standard benchmarks, it matches accuracy with fewer parameters. Code is available at this https URL.
Comments:
Accepted to NeurIPS 2026 (Main Track)
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2611.11147 [cs.CV]
(or
arXiv:2611.11147v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2611.11147
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
147. 【2611.11140】SurgWorld: Learning Surgical Representations Beyond Observation via Latent Prediction
链接：https://arxiv.org/abs/2611.11140
作者：Jingkun Yue,Pengxiang Wang,Siqi Zhang,Zinan Jia,Yiyao Zhang,Huihuan Xu,Yichang Hao,Xiaohong Liu,Zongbo Han,Guangyu Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：inherently partially observable, continuously infer evolving, infer evolving anatomical, evolving anatomical dynamics, future surgical states
备注： This work has been submitted to the IEEE for possible publication
点击查看摘要
Abstract:Surgical procedures are inherently partially observable, requiring surgeons to continuously infer evolving anatomical dynamics and future surgical states beyond the current observation. However, existing self-supervised learning methods primarily learn from observed surgical videos through masked reconstruction or predicting representations within the camera's current field of view, lacking the capability to explicitly model the out-of-sight surgical dynamics. Inspired by latent predictive world models, we introduce SurgWorld, a video-native, self-supervised framework for surgical representation learning, which treats a specified spatial or temporal shift as a pseudo-action and learns to predict the target latent representation from a partial observation. Specifically, we propose Out-of-Sight Dynamics Modeling (OSDM) as the pretraining objective for predicting representations conditioned on relative spatio-temporal shifts. We further regularize the learned latent dynamics from OSDM with a Geometric Visual Similarity (GVS) objective by aligning patch-level relational structures between predicted and target representations, preserving spatial geometry and local visual coherence for dense perception. These two objectives are integrated through an agglomerative training framework that consolidates complementary supervisory signals from multiple teachers to learn a unified latent representation of surgical dynamics and visual geometry. Extensive transfer learning experiments on 17 surgical benchmarks show that SurgWorld consistently outperforms existing vision foundation models across surgical workflow recognition, fine-grained action understanding, and dense visual perception. We further conduct tailored qualitative and quantitative analyses, demonstrating that SurgWorld effectively captures surgical dynamics beyond the directly observed context through latent prediction.
148. 【2611.11139】Graphene: A Lightweight Transformer with Ising Mean-Field Refinement for Image Super-Resolution
链接：https://arxiv.org/abs/2611.11139
作者：Seungki Hong,Taekwang Jang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Ising Refinement Block, lightweight image super-resolution, image super-resolution architecture, local feature refinement, feature refinement mechanisms
备注：
点击查看摘要
Abstract:This paper proposes Graphene, a lightweight image super-resolution architecture with two complementary feature refinement mechanisms: Ising-model-inspired local feature refinement using an Ising Refinement Block (IRB) and stage-history-based feature refinement using a History Attention (HistAttn) module. The IRB reuses attention output features and pre-softmax attention logits to construct signed pairwise token couplings within each local window, applies unrolled mean-field updates, and refines features through a gated residual correction. These signed couplings allow alignment and opposition between latent spins to modulate local feature refinement. HistAttn attends over the current stage output and earlier representations at the same token position and adaptively blends the current stage output with a history-weighted feature aggregate without adding spatial pairwise attention. On Urban100 at $\times4$, Graphene and Graphene-light improve over IET and IET-light by 0.24 dB and 0.38 dB, respectively, with 34.3%/13.7% fewer parameters, 44.8%/44.4% fewer FLOPs, 78.4%/71.5% lower latency, and 76.0%/85.5% lower peak memory. Real-world SR comparisons further show that Graphene recovers fine details and preserves textures across diverse degradations. Code and reference checkpoints are available at this https URL
149. 【2611.11136】From Game Generation to Game Playing: Fully Automated Ability Training for Vision-Language-Action Models
链接：https://arxiv.org/abs/2611.11136
作者：Changran Liu,Qi Wu,Wenchao Ma,Sharon X. Huang,Haomiao Jiang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：cost of collecting, Training, VLA, collecting demonstrations, diverse games
备注：
点击查看摘要
Abstract:Training vision-language-action (VLA) models to follow gameplay instructions across diverse games is limited by the cost of collecting demonstrations. We introduce a framework that automatically generates game environments and expert demonstrations. An LLM-powered agent uses game-building tools to construct executable environments and tasks targeting specified skills. Programmatic experts then use privileged simulator state to generate aligned instructions, rendered observations, and keyboard and mouse actions. We train our game policy, Script2Play, by post-training a 4B vision-language model with behavior cloning on 150.3 hours of synthetic Minecraft and Roblox gameplay, without human gameplay demonstrations or reinforcement learning. Evaluation on multiple public game benchmarks demonstrates that Script2Play follows gameplay instructions effectively and generalizes across game engines, highlighting the effectiveness of targeted synthetic supervision.
150. 【2611.11132】Confidence-driven adaptive semantic transmission for task-oriented communication
链接：https://arxiv.org/abs/2611.11132
作者：Suman Das,Prajnyajit Mohanty,Siddhartha S. Borkotoky
类目：Networking and Internet Architecture (cs.NI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Image-based remote monitoring, wireless networks faces, Image-based remote, monitoring over wireless, wireless networks
备注：
点击查看摘要
Abstract:Image-based remote monitoring over wireless networks faces a trade-off between communication cost and classification reliability. Transmitting complete images is communication-intensive, whereas relying solely on lightweight edge classifiers may compromise accuracy. To address this challenge, we propose Confidence-Driven Adaptation (CDA) for image transmission and classification. An edge device (ED) captures images and applies a lightweight classifier before transmission to a remote server. Based on its classification confidence, the ED selects among three transmission modes with varying levels of information: a short text string reporting its predicted class when confidence is high, a compressed Region of Interest (ROI) at intermediate confidence levels, or an uncompressed ROI when confidence is low. The server accepts the predicted class directly in the first case and performs classification using a more powerful classifier in the other two cases. Numerical evaluations under bandwidth-limited, lossy links and latency-constrained settings demonstrate that CDA achieves high task accuracy at the receiver compared with non-adaptive baselines that transmit only the edge-classifier outcome or the uncompressed ROI.
151. 【2611.11131】CrossLiDAR: Controllable Multi-Sensor LiDAR Sequence Generation
链接：https://arxiv.org/abs/2611.11131
作者：Khanh Nguyen,Thomas Walker,Hichem Telli,Carlos de la Torre-Ortiz,Stefano Fiorini,Salah Eddine Bekhouche,Mohammed-En-Nadhir Zighem,Wassim Swaileh,Tinghuai Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Robotics (cs.RO)
关键词：High-fidelity LiDAR simulation, autonomous systems, High-fidelity LiDAR, remains a bottleneck, bottleneck for scalable
备注： WACV 2027
点击查看摘要
Abstract:High-fidelity LiDAR simulation remains a bottleneck for scalable development and validation of autonomous systems. Existing generators can synthesize realistic scans, but they are typically constrained to a single sensor configuration, offer limited control over structure and geometry, and drift in long-horizon 4D generation. We present CrossLiDAR, a unified transformer-based framework capable of generating controllable and spatio-temporally consistent multi-sensor LiDAR sequences. Our approach leverages a rectified flow objective with a Multi-Modal Diffusion Transformer (MM-DiT) backbone, within a compact latent space of range images. To support multiple LiDAR sensors, an Inter-sensor Module enables interaction across sensors, while a ControlNet-style branch provides structural conditioning (e.g., BEV priors or 3D bounding boxes). For modeling the temporal consistency, CrossLiDAR generates short $N$-frame sequences and extends them autoregressively to improve long-horizon coherence. Our model significantly outperforms state-of-the-art baselines, achieving an average improvement of 29.56\% in JSD and 15.36\% in MMD evaluated on nuScenes and the Waymo Dataset. CrossLiDAR bridges the gap to modern autonomous-driving simulation by enabling calibration-consistent multi-sensor LiDAR rollouts over long horizons for controllable, scenario-based testing.
152. 【2611.11123】HARP-Bench: Benchmarking Robot Manipulation Around Active Humans
链接：https://arxiv.org/abs/2611.11123
作者：Qinhong Zhou,Riley Zong,Chunru Lin,Diyi Hu,Shivraj Singh Bhatti,Hongxin Zhang,Lin Qiu,Hanqing Zeng,Chuang Gan
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：enabled systematic evaluation, Recent robot manipulation, Recent robot, enabled systematic, systematic evaluation
备注： Accepted at CoRL 2026
点击查看摘要
Abstract:Recent robot manipulation benchmarks have enabled systematic evaluation of general-purpose robot policies across diverse objects, scenes, instructions, and embodiments. However, most existing benchmarks still assume that the robot is the only active agent and that task semantics are determined primarily by the instruction and object state. This assumption overlooks a common source of real-world variation: humans actively sharing the workspace. In such settings, humans may reveal an implicit goal, complete part of the task, temporarily change object availability, or constrain safe robot motion while working nearby. We introduce HARP-Bench, a benchmark for evaluating robot manipulation policies in workspaces shared with active humans. HARP-Bench treats human activity as part of the manipulation problem, rather than as background scene variation. It organizes human-present manipulation into four conditions: Cueing, Contribution, Interruption, and Co-presence. These conditions are instantiated through everyday manipulation tasks, including paired human-present variants for controlled comparison with standard manipulation. HARP-Bench also provides a demonstration-generation pipeline for dynamic human-present settings. We evaluate VLA models, imitation-learning methods, and heuristic policies on HARP-Bench. Human-present variations challenge current policies, and higher task success does not consistently improve safety. Quantitative failure analysis identifies manipulation and recovery as the dominant remaining challenges. Training with HARP-Bench demonstrations improves human-present performance in simulation. A real-world study on one task family shows improved performance under human contribution, but not interruption, providing initial evidence of the data's utility and identifying limits of transfer. Code is available at this https URL.
153. 【2611.11122】What You Show Is Not What You Get: Rethinking Demonstration Following in Visual In-Context Segmentation
链接：https://arxiv.org/abs/2611.11122
作者：Xiao Hu,Ilia Sucholutsky
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Contrast Prompt Selection, Semantic Contrast, semantic, SCPS, Semantic Contrast Prompt
备注：
点击查看摘要
Abstract:Visual in-context segmentation uses visual demonstrations to guide predictions for a new image. In SegGPT, we identify background color mapping deviation, where non-target regions sharing a background label receive different output colors, and part-to-parent expansion, where predictions extend beyond the requested part into its parent object. These deviations can occur even when the relevant regions remain distinguishable in internal features. Controlled changes to demonstration colors and requested targets support an account in which demonstrations guide role and color assignments over familiar semantic regions, influenced by learned semantic and color preferences. Building on these findings, we introduce Semantic Contrast Prompt Selection (SCPS). Its semantic contrast encoding assigns separate colors to the requested part and the rest of its object while keeping the remaining scene black. SCPS combines existing retrieval scores with quality estimates from labeled development images to select demonstrations and their binary or semantic contrast encodings. Averaged across seven retrieval methods on three benchmarks, SCPS improves target IoU by 0.054 and reduces leakage into the rest of the object by 22.7% relative to the original binary selectors. Our findings offer a new perspective on understanding and improving demonstration following in visual in-context segmentation.
154. 【2611.11116】Query-Only Prompt-Agnostic Attacks on Visual In-Context Learning
链接：https://arxiv.org/abs/2611.11116
作者：Xiao Hu,Muhammad Ibrahim,Hao Wen,Pin-Yu Chen,Jianliang Wu,Antonio Bianchi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Visual In-Context Learning, enables promptable segmentation, conditioning RGB predictions, In-Context Learning, visual demonstrations
备注：
点击查看摘要
Abstract:Visual In-Context Learning (VICL) enables promptable segmentation by conditioning RGB predictions on visual demonstrations, making it attractive for auto-labeling, but its robustness under query-only access and unknown deployment prompts remains underexplored. We study query-only, prompt-agnostic targeted attacks where the attacker observes only returned RGB outputs, without access to model internals or deployment prompts. Treating prompt-conditioned RGB rendering as a distinct attack surface, we introduce two appearance-space attacks: Color Hijack (CH) drives foreground colors toward the background to suppress visibility, while Task Hijack (TH) collapses instance-distinguishing colors toward a shared color assignment. To transfer across unseen prompts, we propose a Self-Prompt Surrogate (SPS) constructed from the clean query and its output. In a paired, matched-budget SegGPT comparison, SPS outperforms the Random-Prompt Surrogate (RPS), reducing CH instance foreground retention from 0.918 to 0.155 and TH palette-aware tolerance distance from 0.345 to 0.225. Across four VICL models on COCO and HierText, CH suppresses foregrounds across semantic-, instance-, and text-style outputs, while TH collapses instance colors under held-out deployment prompts. After palette-based decoding, TH also reduces the decoded instance count and mask retention while increasing instance merges. Finally, at 30% corruption, CH-corrupted annotations from a publicly accessible VICL-based auto-labeling pipeline reduce downstream YOLO-seg mAP50 from 0.761 to 0.281.
155. 【2611.11115】MySign: A High-Fidelity Motion-Capture Dataset for 3D Sign Generation in Bahasa Isyarat Malaysia
链接：https://arxiv.org/abs/2611.11115
作者：Jiayu Shen,Kalin Stefanov,Lay-Ki Soon,Vee Yee Chong,Alpha Agape Gopalai,KokSheik Wong
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Bahasa Isyarat Malaysia, scarcity of high-fidelity, Isyarat Malaysia, severe for under-resourced, Bahasa Isyarat
备注：
点击查看摘要
Abstract:Progress in 3D sign generation is constrained by the scarcity of high-fidelity 3D sign language datasets, a limitation that is particularly severe for under-resourced languages. We introduce MySign, the first motion-capture dataset for isolated signs in Bahasa Isyarat Malaysia (BIM). Its 5,000 samples cover 1,000 lexical items (glosses) and were produced by five Deaf native signers. Prior datasets that rely on SMPL-X parameters regressed from video provide pseudo-labels, which are often affected by depth ambiguity, inaccurate finger poses, and temporal jitter. MySign instead provides ground-truth SMPL-X sequences retargeted from recordings made with a motion-capture setup tailored for sign language; these sequences offer higher-fidelity motion, particularly in fine-grained hand and finger articulation. A controlled comparison on the same glosses and signers indicates that training on these sequences improves generation over training on such pseudo-labels. We establish MySign as a challenging benchmark for gloss-conditioned 3D sign generation: state-of-the-art models produce visually plausible outputs but fall short of the ground truth, most notably in fine-grained articulation, revealing persistent gaps in modeling articulated sign motion. In contrast, recognition baselines consistently achieve high lexical accuracy, indicating that the dataset reliably supports supervised learning. The dataset is available at this https URL
156. 【2611.11093】Does Pose Encoding Matter? Analyzing Geometric Representations for Discrete Motion Vocabulary Learning
链接：https://arxiv.org/abs/2611.11093
作者：Amir Kimiyaie,Nahal Mafi,Hamed Tabkhi
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Discrete Mathematics (cs.DM)
关键词：Compressing continuous human, Compressing continuous, continuous human motion, generation pipelines, understanding and generation
备注：
点击查看摘要
Abstract:Compressing continuous human motion into a finite vocabulary of discrete tokens is now the first stage of many motion understanding and generation pipelines. Vector quantization partitions a latent space into Voronoi cells around a finite codebook, but the geometry of that latent space is inherited from the input pose encoding, and it is unclear which encoding admits an efficient discretization. We study four encodings that place skeletal motion in different geometric spaces: Gaussian joint heatmaps on the pixel lattice, which we show to be a morphological dilation of the joint point set by a quadratic structuring function; root-relative joint positions in Euclidean space; local joint rotations on $\SO$ through a continuous 6D embedding; and a redundant full kinematic encoding. For each, we train VQ-VAE tokenizers whose codebooks lie on the unit hypersphere, varying codebook size, temporal stride, and code dimension. Beyond reconstruction, we measure codebook utilization and the effective vocabulary size, i.e., the number of equiprobable spherical Voronoi cells with the same entropy as the observed token distribution. Rotation and position encodings keep converting additional codewords into effective vocabulary, whereas the full kinematic encoding saturates at a few hundred effective cells and heatmaps at fewer than sixty. The smallest code dimension gives the highest utilization for three of the four encodings, and the effect of temporal stride depends on the encoding. Encodings of the same pose family can thus yield effective vocabularies differing by an order of magnitude, a difference that reconstruction loss alone does not reveal, which points to input geometry as a first-order design choice in motion tokenization.
157. 【2611.11087】SoftPAT3D: Physics-Augmented Text-to-3D Scene Generation with Deformables
链接：https://arxiv.org/abs/2611.11087
作者：Lei Shu,Alberta Longhini,Leonidas Guibas,Gordon Wetzstein,Jeannette Bohg
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Robotics (cs.RO)
关键词：generated deformable object, stuffed toys, toys and ropes, deformable object, Existing physics-augmented pipelines
备注： 33 pages, 13 figures
点击查看摘要
Abstract:We present SoftPAT3D, a physics-augmented framework for text-to-3D scene generation in which deformable objects, such as cloth, stuffed toys and ropes, are generated as physically valid, simulation-ready bodies and placed in intersection-free contact with the furniture that supports them, with one another and with themselves. Existing physics-augmented pipelines simulate rigid bodies only and cannot accommodate a generated deformable object, which text-to-3D generation returns as a geometrically invalid mesh, sometimes self-intersecting, that has no rest shape, no material model and no admissible initial state. These are the inputs a deformable simulation requires, and we construct each from information already in the pipeline. The rest shape comes from how the object is manufactured rather than from the generated physically inconsistent deformed configuration, and a material library assigns each deformable object its initial elastic parameters, which can then be optimized. The occluded support is regenerated and converted into a watertight collision mesh, each object is released from an optimizable placement above the supporting part that the prompt specifies, and the complete scene is driven to static equilibrium under one unified contact model, with completion verified by geometric checks and a vision-language model. When a scene fails the prompt, a grid search over placements corrects it, and the adjoint of a differentiable simulation of the same contact energy reaches the targets the grid does not, places several bodies jointly and recovers and optimizes material parameters. Multi-body scenes equilibrate in a single simulation, and the pipeline also runs from the text prompt alone. On all sixty-five prompts, SoftPAT3D produces no undesired interpenetration of any kind, whereas every other system does, and its scenes directly support scene editing and robotic manipulation.
158. 【2611.11076】ADC-RANet: Improving Resolution Adaptive Neural Networks with Attention, Distillation and Calibration
链接：https://arxiv.org/abs/2611.11076
作者：Jeferson Severino de Araujo,Lilian Hollard,Eric Granger,Marco Pedersoli
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Dynamic neural networks, Dynamic neural, Resolution Adaptive Network, potentially reducing computational, maintaining similar performance
备注：
点击查看摘要
Abstract:Dynamic neural networks are a class of adaptive models in which the computation assigned to each input sample is determined dynamically, potentially reducing computational cost while maintaining similar performance. For image classification, the Resolution Adaptive Network (RANet) is a strong approach that progressively allocates computational resources across input scales based on sample difficulty. In this work, we introduce RANet with Attention, Distillation and Calibration (ADC-RANet), an enhanced version of RANet that improves performance across all computational budgets. Our approach combines three tightly connected components: bottom-up channel attention, top-down cascaded knowledge distillation, and overconfidence correction using MixUp, in a synergistic design that coordinates both pathways. Experiments on CIFAR-100 and ImageNet datasets show consistent gains while preserving the efficiency of RANet. Our code is available: this https URL
159. 【2611.11071】NanoNet: Ultra-Lightweight Network for MRI Brain Tumor Classification toward Edge AI
链接：https://arxiv.org/abs/2611.11071
作者：Tran Nguyen-Le,Huu-Thuan Huynh,Minh-Triet Tran,Trung-Nghia Le
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Automated brain tumor, magnetic resonance imaging, medical image analysis, support accessible medical, accessible medical image
备注：
点击查看摘要
Abstract:Automated brain tumor classification from magnetic resonance imaging (MRI) can support accessible medical image analysis, but conventional deep learning models often exceed the resource budgets of highly constrained edge-AI platforms. We present NanoNet, an ultra-lightweight convolutional neural network designed for resourceconstrained MRI classification and motivated by future edge-AI applications. Inspired by MobileNetV2, NanoNet substantially reduces network depth, channel capacity, expansion ratios, and final feature dimensionality, resulting in only five inverted residual blocks and 8,132 parameters. We further investigate dependency-aware structured pruning, knowledge distillation, and INT8 quantization-aware training for additional compression. Experiments on the BRISC 2025 benchmark show that NanoNet achieves 92.80% accuracy and 92.97% macro F1 with 8,132 parameters and 10.498 MFLOPs. Across three compression seeds, it exceeds the mean accuracy of 70%-pruned MobileNetV2 by 5.20 percentage points while using 60.2% fewer parameters and 9.8% less computation. Converted INT8 NanoNet achieves 89.70% accuracy and 90.22% macro F1 across three QAT seeds. Earlier TensorFlow Lite measurements indicate 27.7 KB of baseline model storage, motivating future edge-AI deployment.
160. 【2611.11062】What Does Multiple Choice Actually Measure? Disentangling Video Understanding from Option Exploitation
链接：https://arxiv.org/abs/2611.11062
作者：Elliott Piercy,Justin Chan,Sepand Dyanatkar
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Video understanding evaluations, Video understanding, task solving, video perception, intended to measure
备注： Accepted to TAE (Trust-AI-Eval) Workshop at NeurIPS 2026 [this https URL](https://neurips.cc/virtual/2026/loc/sydney/178197)
点击查看摘要
Abstract:Video understanding evaluations are intended to measure a model's proficiency in video perception and task solving. However, current VideoQA benchmarks struggle to isolate these capabilities due to their reliance on multiple-choice (MC) answer guidance, language priors, and fragile scoring pipelines. Disentangling these confounding factors reveals how much of a model's score is supplied by the evaluation context rather than earned through faithful perception. Across six VideoQA benchmarks of varying length, we find that accuracy is significantly above chance without any visual input. This is caused by shortcutting and option-prior reliance. We express these effects in the language of faithfulness: option-exploitation and answer-conditioned reasoning traces are unfaithful even when they are correct. Together, our results show that a VideoQA score is jointly determined by language priors, option timing, and how outputs and labels are converted into correctness. We produce a novel Option-Delayed Replay (ODR) mechanism that discloses options at controlled stages of an open-ended (OE) trajectory, to obtain objective MC scores from faithful option-free inference. Our work demonstrates that agentic methods with ODR and faithful inference can match option-exploiting performance. Finally, we formalize our diagnostic collection and ODR as a reproducible evaluation protocol, and we release a human-relabelled edition of LVBench (correcting $20.5\%$ of keys) to remove annotation noise as a confounding variable.
161. 【2611.11058】Differentiable Virtual-Slot Partitioning for Adaptive Tokenization in Vision Transformers
链接：https://arxiv.org/abs/2611.11058
作者：Gaoxiang He,Bin Zhu,Bo Xie,Xiaotong Yu,Yi Chen,Hongfei Yan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Adaptive tokenization aims, uninformative image regions, preserving accuracy, aims to reduce, reduce the compute
备注：
点击查看摘要
Abstract:Adaptive tokenization aims to reduce the compute spent on uninformative image regions while preserving accuracy. Existing work relies on (i) fixed or frozen scoring rules, which cannot be trained toward the task loss, or (ii) discrete masks trained with straight-through estimators, which yield noisy gradients, while fully differentiable alternatives instead leave the pre-trained regular grid. We revisit adaptive tokenization from a regular-grid perspective and ask: can a two-scale quadtree be learned end-to-end without deleting a single token during training? We show that one coarse token and its four fine children can be made the two endpoints of a single continuous interpolation. We introduce Differentiable Virtual-Slot Partitioning (\dvsp{}), which keeps four \emph{virtual slots} per $2{\times}2$ region and blends their token features and attention mass with a single weight $\alpha$, exactly reproducing the discrete grid at $\alpha \in \{0,1\}$. On COCO detection with EVA-02-B, \dvsp{} retains $97.9\%$ of dense Box AP while removing $64.2\%$ of visual tokens, giving a $1.61\times$ end-to-end speedup, and it outperforms entropy-based APT, DART, and uniform lower-resolution dense adaptation at matched budgets; these gains depend on the conserved attention mass, whose removal costs $1.59$ Box AP. On a frozen Segmenter it also improves Cityscapes mIoU, and on frozen DeiT backbones it exceeds entropy selection at identical per-image token counts.
162. 【2611.11041】Virtual Task Prompting for Multi-Task Scene Understanding
链接：https://arxiv.org/abs/2611.11041
作者：Zedong Wang,Yucheng Wang,Dan Xu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：vision foundation models, scene understanding models, understanding models typically, models typically rely, Multi-task scene understanding
备注： Accepted at NeurIPS 2026. 24 pages, 8 figures, 5 tables
点击查看摘要
Abstract:Multi-task scene understanding models typically rely on modified vision encoders or complex decoders for cross-task interaction, which limits their flexibility and compatibility with off-the-shelf vision foundation models (VFMs). We introduce Virtual Task Prompting (VTP), which frames multi-task prompting as retrieving task-adaptive compositions from a shared virtual state, where both the state and routing process are optimized in an end-to-end manner. Concretely, VTP maintains an expanded set of virtual tasks alongside the backbone. At each layer, learnable routing matrices read task-specific compositions as input to interact with image tokens and write the processed results back, forming explicit pathways that capture the intricacies among tasks outside the encoder. Since VTP keeps the backbone clean, it integrates seamlessly with pretrained VFMs, advancing the state of the art on Pascal-Context and NYUD-v2. Stress test on Taskonomy with 13 heterogeneous tasks further shows VTP's robustness in extreme settings. Ablations and analysis indicate that VTP's gains stem from adaptive routing rather than increased capacity. The project page is available at this https URL.
163. 【2611.11007】Efficient 3D plant segmentation through multiscale graph learning and optimized geometric processing
链接：https://arxiv.org/abs/2611.11007
作者：Jesus Ivan Ruiz-Martinez,Andres Mendez-Vazquez,Eduardo Rodriguez-Tello
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：computing platforms requires, platforms requires accurate, affordable geometric preparation, Plant organ segmentation, requires accurate predictions
备注：
点击查看摘要
Abstract:Plant organ segmentation on compact computing platforms requires accurate predictions and affordable geometric preparation. We develop and evaluate a multiscale edge based graph attention model that combines local shape descriptors, two neighborhood scales and a residual stem and leaf correction in approximately 78 thousand parameters. The engineering application is plant point cloud segmentation for precision agriculture, assessed through grouped accuracy experiments and physical Raspberry Pi 5 inference. Broad comparisons with hierarchical, graph and transformer baselines establish PointNeXt as the strongest external accuracy reference among the tested local recipes. A nested four variant ablation on a local maize collection separates geometric information from the combined multiscale configuration across seven outer groups and three seeds. The complete model achieves the highest mean intersection over union, 86.36%, although uncertainty and boundary errors qualify the contribution of each component. We then optimize full cloud principal component analysis, sampling and neighbor queries without changing learned weights or descriptor definitions. All 1,180 paired desktop comparisons on PlantNet and TomatoWUR preserve exact logits and predictions. Multiscale pipeline latency falls from 330.33 to 96.82 milliseconds on PlantNet and from 1,054.52 to 463.10 milliseconds on TomatoWUR. PointNeXt also benefits from optimized sampling and remains faster over the complete pipeline. These results support compact graph learning with reduced geometric overhead, while physical board measurements establish inference feasibility rather than energy efficiency or readiness for autonomous flight.
164. 【2611.11001】Elastic Representations via Hyperbolic Geometry
链接：https://arxiv.org/abs/2611.11001
作者：Arjun Ramesh Kaushik,Rudrasis Chakraborty,Nalini Ratha,Venu Govindaraju
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：machine learning systems, modern machine learning, Contrastive Sparse Representations, Learned representations, varying downstream resource
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:Learned representations (or embeddings) are the foundation of modern machine learning systems, yet they are typically trained as fixed-size embeddings, without accounting for varying downstream resource or task constraints. Matryoshka Representation Learning (MRL) addresses this limitation by learning nested representations, but requires costly end-to-end retraining and does not support post hoc expansion, while Contrastive Sparse Representations (CSR) reduce training overhead via lightweight adaptors but operate at a 4x larger dimensionality. Additionally, all prior works restrict their framework towards compression only. In this work, we introduce Hyperbolic Elastic Representation Learning (HERL), a framework for learning dimension-adaptive embeddings (compression and expansion) through a lightweight adaptor without retraining the base encoder. Our key idea is to exploit the exponential capacity of hyperbolic geometry by learning a non-linear mapping from the encoder space to hyperbolic space. We train a simple MLP to downsample the representations before projecting them onto a Lorentzian and learn adaptive representations that respect the Lorentzian geometry. Our approach is model-agnostic and effective in both supervised and unsupervised settings. Through extensive experiments across image and text modalities, we show that HERL preserves downstream performance across a wide range of embedding sizes, exhibits smooth interpolation between dimensions, and achieves these benefits at a fraction of the computational cost. Code: this https URL.
165. 【2611.10991】Sensitivity-Gated Accumulator Caching for On-Device Learning of Low-Bit Hand Networks
链接：https://arxiv.org/abs/2611.10991
作者：Soroor Ghandali,Kanika Mamgain,Manjot Kaur,Akanksha Shukla,Shashira Guntuka
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Small hand-tracking networks, roughly the memory, Small hand-tracking, weight, rounding
备注： 28 pages, 7 figures, 15 tables
点击查看摘要
Abstract:Small hand-tracking networks are deployed as 4- and 8-bit codes, and they should keep adapting to a user's camera after deployment, on the device and within roughly the memory of the model itself. Quantization-aware training cannot do this cheaply, because it keeps a 32-bit master copy of every weight together with its optimizer state, about 96 bits per weight. Training the codes directly with stochastic rounding needs no copy but injects rounding noise at every step, and the methods that remove this noise keep a residual buffer for every weight. We introduce sensitivity-gated accumulator caching (SGAC), which keeps residual state for only a small and changing set of weight groups. A set-associative cache of 8-bit accumulators collects the sub-step updates of the groups with the largest Fisher-weighted squared code step and writes them into the codes as whole steps; an evicted line is flushed by stochastic rounding, and a group without a line does not move until it is admitted. We prove that the write-back is unbiased and show, under a local quadratic model, that rounding a sub-step update costs loss of the same order as the update's own gain, so that rounding pays only where the expected gradient is large relative to the curvature. On a 383k-parameter hand-keypoint network, SGAC trains with 8.1 bits of state per weight. Scored on the 4/8-bit network that the device runs after adaptation, it has the highest mean accuracy of nine deployed low-bit networks on two simulated cameras. On twelve ImageNet-C corruptions it has the highest average of corrupted and clean accuracy of seven deployed methods, ahead of the PEQA-style, ECO-style and direct low-bit baselines with confidence intervals that exclude zero, and it matches an 8-bit accumulator kept for every weight with 56% of that state.
166. 【2611.10960】Anatomy-Activated Mixture-of-Experts for 3D Medical Vision-Language Pre-training
链接：https://arxiv.org/abs/2611.10960
作者：Szymon Płotka,Gizem Mert,Pedro R. A. S. Bassi,Wenxuan Li,Zongwei Zhou,Anna Marcinkiewicz,Wiktoria Romańczyk,Jarosław B. Ćwikła,Łukasz Struski,Ewa Szczurek,Jacek Tabor,Arkadiusz Sitek
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Medical Vision-Language Pre-training, remain fundamentally anatomy-agnostic, current architectures remain, architectures remain fundamentally, Vision-Language Pre-training
备注： NeurIPS 2026
点击查看摘要
Abstract:Medical Vision-Language Pre-training (VLP) leverages the semantic richness of radiology reports to learn 3D representations, yet current architectures remain fundamentally anatomy-agnostic. While clinical diagnostics rely on organ-specific context, standard encoders apply a uniform, dense parameterization to all volumetric patches, and existing Mixture-of-Experts (MoE) routers gate on isolated local features without explicit access to the organ composition of the scan or crop. We propose Anatomy-Activated Mixture-of-Experts (A$^{2}$MoE), a framework that incorporates anatomical inductive biases within the model's computational path. A$^{2}$MoE introduces two key components: (1) a Histogram Representation Router (HRR) that conditions expert selection on global visual context and a predicted anatomical composition histogram, encouraging anatomy-dependent expert weighting; and (2) an Organ-Query Multi-Scale Projector (OQMSP) that utilizes learnable queries to extract organ-level embeddings for fine-grained alignment without requiring manual annotations at inference. By routing at the patch level rather than the token level, A$^{2}$MoE reduces routing complexity by orders of magnitude while satisfying load balancing by construction. Pre-trained on over 60,000 multi-phase CT scans, A$^{2}$MoE achieves state-of-the-art performance across segmentation, classification, and detection benchmarks. Furthermore, we demonstrate that our anatomically grounded inductive biases support robust generalization to MRI and ultrasound, establishing a scalable foundation for medical representation learning. The code is available at this https URL.
167. 【2611.10940】Semantic Synthesis over Brute-Force Search: LLM-Guided Transformation Design for Efficient Learning
链接：https://arxiv.org/abs/2611.10940
作者：Usha Shrestha,Radu Timofte,Dmitry Ignatov
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：computationally expensive problem, transformation pipelines shape, computer vision, expensive problem, Data transformation pipelines
备注：
点击查看摘要
Abstract:Data transformation pipelines shape the training distribution in computer vision, but designing them is a computationally expensive problem. We investigate whether large language models can enable efficient discovery by synthesizing executable transformation programs outside predefined augmentation spaces. We compare nine strategies under a unified training protocol, including standard augmentation policies, brute-force search, direct code generation with two LLMs, and performance-guided generation using LLMs fine-tuned on accuracy-ordered transformation pairs. When the best candidates are retrained for 20 epochs, LLM-generated transformation programs lead on every dataset, reaching 0.8877 accuracy on CIFAR-10, 0.5825 on CIFAR-100, and 0.9588 on SVHN, surpassing brute-force search over 6,000 candidates. The best transform on CIFAR-10 and SVHN comes from a fine-tuned generator using 270 candidates, while the best on CIFAR-100 comes from an off-the-shelf generator using only 10. This needs 22x fewer candidate evaluations in the generation step and 600x fewer for off-the-shelf generations, relative to brute-force search. Beyond transformation discovery, we analyze the reliability of the reduced-budget evaluation commonly used for augmentation search. Correlating one-epoch selection scores with 20-epoch outcomes reveals strong, weak, and absent predictive relationships depending on the dataset and architecture, with correlations ranging from 0.756 to near zero. A positive control indicates that range restriction alone is unlikely to explain the low correlations. Our results indicate that semantic synthesis with code LLMs provides an efficient alternative to search-based transformation discovery and highlight the importance of validating evaluation fidelity when optimizing data transformations.
168. 【2611.10917】Remembering to Reason: Structured Memory for Scene and Workflow Understanding in Robot-Assisted Surgery
链接：https://arxiv.org/abs/2611.10917
作者：Zhiran Zhang,Hu Wang,Yichen Wu,Yutong Xie
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：important foundation, foundation for intelligent, intelligent assistance, Surgical, robot-assisted surgery
备注：
点击查看摘要
Abstract:Surgical video understanding is an important foundation for intelligent assistance in robot-assisted surgery. Similar surgical views can reflect different actions or procedural stages. Interpreting these views requires access to earlier observations, yet frame-centric prompting leaves this history unavailable. We introduce MemSurg, a framework that remembers surgical observations before reasoning over them. Its structured memory graph stores timestamped entity categories, locations, motion cues, and interaction summaries. Chronological links preserve recent context, while entity-associated links connect recurring observations across the procedure. Task-adaptive retrieval then supplies evidence-grounded prompts for scene and workflow reasoning, supporting both frozen inference and memory-conditioned supervised fine-tuning. Evaluation on robot-assisted prostatectomy and two complementary surgical benchmarks shows a 10.43-percentage-point gain over SurgRAW with GPT-4o. Memory conditioning adds 6.52 points under matched Qwen3-VL-8B fine-tuning, and an inference-time plug-in adds 7.04 points to EndoChat. These results support structured memory as a reusable source of procedural evidence for surgical video understanding. Our code will be publicly released.
169. 【2611.10908】Beyond Real or Fake: A Dual-Channel Authenticity and Reasoning Protocol for Photographic Assessment
链接：https://arxiv.org/abs/2611.10908
作者：Xiaoxiao Li,Ruinan Jin,Lili Meng,Miaosen Wang,Athula Balachandran,Pei Cao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：confates fully synthetic, real vs. fake, label that confates, fully synthetic, verification has converged
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:Forensic verification has converged on a binary "real vs. fake" label that confates fully synthetic, tampered, and AI-retouched images despite their very different consequences. We argue that GenAI manipulations decompose along two complementary channels: a camera channel of sensor fingerprints (destroyed by neural processing), and a semantic channel of scene-level coherence (disrupted by content edits). Each manipulation type leaves a distinctive two-channel signature. We instantiate this taxonomy in 2CAP (2-Channel Authenticity Protocol), pairing a contrastively-trained camera encoder with a frozen semantic encoder to serve two applications on a shared backbone: (i) four-class authenticity classification via cross-attention fusion with learnable reliability weights; and (ii) evidence generation, where an authentic image serves as a reference for a query and the two encoders produce per-channel alignment scores together with a patch-level saliency map. These signals are supplied as privileged context to a frozen Vision-Language Model (VLM) through an Observe-Generate-Refine loop, yielding explanations with localization without forensic fine-tuning. On a multi-source benchmark, 2CAP attains the best classification performance, including strong retouching detection where existing methods fail, and improves explanation quality.
170. 【2611.10875】REDiff-AD: No Training and No Target Masks for Industrial Anomaly Image Generation via Diversity-Driven In-Context MMDiT
链接：https://arxiv.org/abs/2611.10875
作者：Chih-Yu Tsai,Chih-Heng Chang,Jian-Jiun Ding
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：leaving insufficient anomalous, effectively train downstream, insufficient anomalous data, leaving insufficient, insufficient anomalous
备注： Accepted to WACV 2027
点击查看摘要
Abstract:Industrial anomaly detection is challenged by the scarcity and diversity of real defects, leaving insufficient anomalous data to effectively train downstream models. Existing anomaly generation methods often require product-specific fine-tuning, target mask annotation, or costly procedures to achieve realistic and diverse defects. We propose REDiff-AD, a framework that requires neither model training nor target masks and introduces Rectified Flow MMDiT into industrial anomaly generation for efficient sampling with fewer generation steps. Given a normal product image and a single masked reference anomaly, REDiff-AD employs in-context learning to transfer the defect appearance from the reference into the normal image. Internal attention signals generated during this process are further reused to localize the synthesized anomaly, while edge and color cues refine the localization into pixel-level pseudo-masks. Two lightweight modules further improve generation quality: adaptive reference conditioning enhances defect fidelity, while diversity guidance promotes varied defect patterns without additional training. Experiments demonstrate that REDiff-AD can well address the tradeoff between realism and diversity for anomaly pattern generation and achieve competitive downstream anomaly classification, detection, and localization performance. These results show that REDiff-AD is a simple, efficient, and effective solution for large-scale anomaly data augmentation and pixel-level data construction. Github code: this https URL
171. 【2611.10869】Interactive Person Retrieval with On-the-Fly Visual Feedback
链接：https://arxiv.org/abs/2611.10869
作者：Lyucheng Qian,John Yuehan Zhang,Pingyu Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Traditional text-based person, Traditional text-based, interactive person retrieval, person retrieval, complete description
备注：
点击查看摘要
Abstract:Traditional text-based person retrieval (TPR) assumes that a witness provides a complete description at once, whereas interactive person retrieval (Inter-PR) refines a partial description through question-answer exchanges. In this setting, the questioner inspects retrieved candidates to decide what evidence to request next, while the answerer sees only the witness-side memory and cannot report candidate-specific visual differences. Existing methods mainly learn offline question orderings, leaving this visual-feedback loop underexplored. To address this limitation, we introduce visual-feedback interactive person retrieval (VFI-PR), a new interactive retrieval paradigm in which retrieved candidates produce visual feedback that becomes evidence for subsequent questioning and re-ranking. To support training and evaluation in this setting, we construct VFI-PEDES, a dataset and evaluation protocol for visual-feedback interaction, and propose VFI-ReID, a framework that learns to use visual feedback during interactive person retrieval. Through the Dynamic Accumulated-evidence Retriever (DAR) and retrieval-aware question optimization, VFI-ReID adapts retrieval and question generation to evolving evidence states, turning visual feedback into complementary evidence for subsequent retrieval. Experiments show that VFI-ReID consistently improves retrieval across VFI-PR interaction stages, demonstrating the utility of visual feedback for interactive person retrieval and outperforming existing Inter-PR baselines.
172. 【2611.10858】Beyond Bit Matching: Orthogonal Watermarks for Collusion-Resistant Image Fingerprinting
链接：https://arxiv.org/abs/2611.10858
作者：Zhakshylyk Nurlanov,Tobias Weißberg,Florian Bernard
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Image fingerprinting assigns, source tracing, fingerprinting assigns, assigns each distributed, distributed copy
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:Image fingerprinting assigns each distributed copy a user-specific watermark for source tracing. Averaging collusion is a central threat: several recipients can average their differently marked copies to suppress each individual mark. Discrete bit-string watermarks are especially vulnerable because averaging drives bit evidence toward ambiguous decisions. We introduce \textbf{VectorMark}, which maps user keys to near-orthogonal high-dimensional unit vectors and identifies colluders by cosine similarity to the extracted watermark direction. Under ideal averaging of $K$ vector keys, the normalized average preserves a cosine signal of order $1/\sqrt{K}$ for each colluder, while unrelated keys remain concentrated near zero. The spherical geometry of random directions gives a shifted-Beta null distribution for cosine similarities, enabling analytic per-key false-positive-rate control after validation on unwatermarked images. VectorMark uses a neural watermark encoder and centered extractor trained with JND masking and a progressive curriculum for photometric, geometric, and collusion robustness. Experiments on MS-COCO, OpenImages, and AI-generated images show that VectorMark maintains robust watermark attribution under photometric and geometric distortions, and achieves the best strict all-colluder detection among evaluated methods, while preserving high visual quality. Our code is publicly available: this https URL
173. 【2611.10847】Fine-resolution land-use segmentation and synthetic image-label augmentation in the Kathmandu Valley
链接：https://arxiv.org/abs/2611.10847
作者：Pranil Parajuli,Sugam Dahal,Kiran Chandra Dahal
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Global South cities, urbanizing Global South, rapidly urbanizing Global, Global South, Parcel-scale land-use data
备注： 21 pages, 26 figures
点击查看摘要
Abstract:Parcel-scale land-use data is missing for most rapidly urbanizing Global South cities, as current segmentation architectures rely on multispectral imagery and planned layouts. We introduce a hand-annotated six-class land-use corpus covering 202 km$^2$ of Kathmandu Valley across 408 fine-resolution RGB scenes. The dataset is uniquely challenging: RGB spectral similarity is high, class imbalance approaches 100:1, and key structural features like rivers measure just two to three pixels wide at a standard hierarchical decoder's prediction stride. Evaluating five architectures reveals that standard random data splitting conceals massive spatial leakage. Switching to a strict sequence-block split drops performance by up to 0.095 mIoU. This penalty exceeds the performance gap between the architectures themselves. We modified the SegFormer baseline by integrating a half-resolution residual detail path, boundary-reliability reweighting, a topology-aware loss, and a presence-balanced sampler. Adding only 1.9% more parameters, the enhanced architecture improves mean IoU across every test fold, with gains concentrated in rare, thin-structure classes. However, both models achieve identical results on the external LoveDA benchmark. Finally, augmenting with diffusion-generated pairs at matched compute degraded accuracy across all architectures, especially harming rare classes it aimed to improve. This demonstrates that blindly incorporating synthetic data can severely damage performance, highlighting a critical need to rigorously evaluate and filter generated samples before training.
174. 【2611.10840】Simple Test-Time Refinement for Plot-to-Code Generation via Visual-Code Diagnostics
链接：https://arxiv.org/abs/2611.10840
作者：Peiming Guo,Jinpeng Huang,Yangbin Sun,Gaoxiong Cao,Ensheng Shi,Yuchi Ma,Yu Zhang,Meishan Zhang,Baotian Hu,Min Zhang
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：large language models, recent multimodal large, multimodal large language, language models, greatly advanced
备注： Accepted by NeurIPS 2026
点击查看摘要
Abstract:Plot-to-code generation has been greatly advanced by recent multimodal large language models (MLLMs). However, existing studies mainly focus on one-pass generation or iterative sampling guided by verifier-based filtering, which does not align with the typical human programming workflow of generate first, then iteratively error-location and fix. This naturally motivates a test-time refinement paradigm for plot-to-code generation. In this work, we present the first study on plot-to-code generation via iterative test-time refinement. We propose a Visual-Code Diagnostics framework that enables refinement through visual feedback from source code. Specifically, we first categorize generation errors into four coarse-grained types, and then train lightweight discriminators to recognize and localize these errors based on the rendered visual outputs and corresponding code. Unlike traditional compiler- or debugger-based verification, our approach performs iterative refinement guided by one diagnostics system, enabling more effective semantic and visual correction during test time. Extensive experiments demonstrate that our method consistently improves generation quality across diverse generators and significantly outperforms strong test-time scaling baselines.
175. 【2611.10821】AmodalBox: Automated 3D Bounding Box Annotation under Partial Visibility
链接：https://arxiv.org/abs/2611.10821
作者：In-Jae Lee,Namtae Kim,Robert Exley,Kwonyoung Ryu,Jaesik Park
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：vision foundation models, jointly leveraging LiDAR, Recent progress, made automated open-vocabulary, leveraging LiDAR point
备注： Accepted by CoRL 2026
点击查看摘要
Abstract:Recent progress in vision foundation models (VFMs) has made automated open-vocabulary 3D bounding box annotation increasingly feasible by jointly leveraging LiDAR point clouds and images. However, partial observations remain a major challenge in sparse driving scenes, where visible LiDAR points often cover only a small fraction of the object's surface and provide insufficient cues for estimating its full spatial extent. As a result, existing methods often produce mislocalized boxes or leave objects unlabeled. To address this limitation, we propose \textbf{\Ours{}}, an automated annotation framework that leverages image-generated 3D assets as amodal geometric priors for partially observed objects. By establishing correspondences between input images and rendered views of 3D assets, \Ours{} robustly aligns canonical amodal geometry with partially observed world-space LiDAR point clouds. To improve temporal consistency and reduce computational cost, \Ours{} generates a single asset per instance, estimates its metric scale once at a single frame and propagates it across frames for dynamic instances, and aggregates multi-frame observations for static instances. 3D object detectors trained on annotations from \Ours{} improve performance over strong baselines by 14.1 mAP on the nuScenes dataset and by 12.45 AP at IoU 0.5 for the vehicle class on the Waymo Open Dataset (WOD). Our project page is available at: \href{this https URL}{this https URL}
176. 【2611.10819】Selective Cooperative Perception via Blind Spot Reasoning and Agentic Dialogue with Vision-Language Models
链接：https://arxiv.org/abs/2611.10819
作者：Chengyuan Ma,Shixiao Liang,Hangyu Li,Zheng Li,Hang Zhou,Keke Long,Bofeng Cao,Zhaohui Liang,Xiaopeng Li
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Multiagent Systems (cs.MA)
关键词：posing scalability challenges, Real-time cooperative perception, Real-time cooperative, highly resource-intensive, large-scale deployment
备注：
点击查看摘要
Abstract:Real-time cooperative perception (CP) in multi-agent traffic environments is highly resource-intensive, which posing scalability challenges for large-scale deployment. Efficiency can be significantly improved by selectively performing CP only in safety-critical scenarios and for key occluding objects. Vision-Language Models (VLMs) are well-suited for complex reasoning in dynamic and uncertain environments, making them a promising tool for this selective CP task. This study proposes a VLM-driven agentic framework for blind spot reasoning and dialogue-based CP. A mixed-model architecture is designed that integrates conventional object detection for stable perception, vision-language reasoning for identifying impactful occlusions, and a physics-based geometric module to align reasoning with real-world visibility constraints. The framework also incorporates a Chain-of-Thought (CoT) prompting mechanism to enhance interpretability and intent-aware decision-making. We collect real-world data from connected vehicles operating in urban traffic and compare the driving-critical blind spot identification and dialogue performance of four state-of-the-art VLMs. Experimental results demonstrate that our method achieves over 80% accuracy in driving-critical blind spot detection and over 90% success in dialogue-driven perception sharing. This work provides a scalable, interpretable, and bandwidth-efficient alternative to conventional CP pipelines, and offers new insights into agentic communication design for future connected traffic systems.
177. 【2611.10811】STAR-VF: Spatio-Temporal Aware Representation Condensation for Data-Efficient Video Fusion
链接：https://arxiv.org/abs/2611.10811
作者：Yuchen Xian,Yunqiu Xu,Guosheng Lin,Yang He
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：producing visually informative, coherent spatio-temporal structures, visually informative videos, integrate complementary cues, heterogeneous sources
备注： Accepted at ACM Multimedia 2026 (MM '26)
点击查看摘要
Abstract:Video fusion aims to integrate complementary cues from heterogeneous sources, producing visually informative videos with coherent spatio-temporal structures. Jointly learning cross-modal complementarity and temporal dependencies typically relies on large-scale, high-quality video datasets, whose storage and repeated use during optimization incur substantial costs, making data-efficient learning highly desirable. To address this challenge, we rethink video fusion from the perspective of dataset condensation and propose STAR-VF, the first framework that condenses spatio-temporal representations for data-efficient video fusion. STAR-VF condenses the original training set into a compact set of learnable spatio-temporal representations, which are decoded into synthetic video clips and optimized using feature-level supervision provided by a frozen proxy model. The resulting condensed data preserves fusion-relevant spatial and temporal cues without requiring ground-truth fused videos as supervision. To adapt fusion learning to condensed representations, we equip the final fusion model with flow-free inter-frame temporal modeling and query-driven intra-frame aggregation, enabling direct temporal interaction and adaptive selection of fusion-relevant information in representation space. Extensive experiments on infrared-visible, multi-exposure, multi-focus, and medical video fusion benchmarks demonstrate that STAR-VF, trained with only approximately 1/16 of the original temporal training set, achieves fusion quality comparable to methods trained on the full data. Further analyses validate the contributions of learned condensation and flow-free temporal modeling, and demonstrate the robustness of the condensed supervision across different proxy encoders and downstream fusion models. Project page: this https URL.
178. 【2611.10774】Same Measurements, Different Velocity Risk: Complementary Rolling-Shutter Readouts under Clock Uncertainty
链接：https://arxiv.org/abs/2611.10774
作者：Lunshuo Tian,Dongheng Liu,Mingwei Ma
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：identical measurement budgets, velocity estimation rates, Camera rigs, timing is uncertain, identical measurement
备注： 36 pages, including appendices. Lunshuo Tian and Dongheng Liu contributed equally
点击查看摘要
Abstract:Camera rigs with identical measurement budgets can have different velocity estimation rates when exposure timing is uncertain. We establish this distinction for rolling-shutter reconstruction with two calibrated moving anchors, unknown scene points, and independently unknown auxiliary poses and clocks. On the same fixed local physical class near a separated lateral rig, repeated readouts have worst-case squared velocity risk at least of order $\sigma\rho_{\mathrm{eff}}$, whereas complementary readouts have minimax risk of order $\sigma^2$, for a fixed admissible clock displacement $\rho_{\mathrm{eff}}0$ as the noise standard deviation $\sigma$ tends to zero. A finite physical compensation path gives the lower bound; a nonlinear velocity inverse proves complementary stability. All motion, structure, pose, and clock nuisances remain unknown. We identify mounting configurations in which both designs become regular and quantify the risk floor induced by metric uncertainty. We quantify full-parameter domains with independent 6-ms clocks and test in-domain reconstruction under paired noise and a depth-offset intervention. Raster studies examine image formation and calibration sensitivity.
179. 【2611.10771】WorldFoundry: Towards Unified Infrastructure for World Intelligence
链接：https://arxiv.org/abs/2611.10771
作者：Juanxi Tian,Jiadong Hou,Baiang Li,Xin Lin,Zhengbo Jiao,Weijia Zhang,Yeying Jin,Truong Nguyen,Haitian Zheng,Zhifei Zhang,Jianfei Yang,Ming-Hsuan Yang,Felix Heide,Wei Xiong,Enze Xie,Wanhua Li
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：models increasingly blur, Visual generative models, generative models increasingly, increasingly blur, blur the line
备注： 39 pages, 10 figures. This technical report will be updated periodically
点击查看摘要
Abstract:Visual generative models increasingly blur the line between synthesizing observations and simulating environments. Yet visual plausibility alone does not constitute successful world modeling: compelling outputs may lack persistent state, physical dynamics, or causally consistent responses to interactions. We define a generative world model as a predictive dynamical system that maintains a persistent, history-conditioned representation of an environment, updates that representation in response to actions or interventions, and generates temporally coherent trajectories that reflect outcomes under observed and counterfactual interventions. From this definition, we derive an intelligence-oriented framework spanning perceptual grounding, persistent state modeling, controllable transformation, dynamics-aware prediction, and closed-loop interaction. We present WorldFoundry, open-source infrastructure for reproducible inference and evaluation across video, 3D and 4D, embodied action, and interactive world systems. WorldFoundry unifies model and benchmark discovery, runtime and asset preparation, execution orchestration, artifact management, and interactive visualization, while modality-specific adapters preserve native inputs, execution semantics, output representations, and evaluation protocols. Explicit manifests, durable artifact contracts, and evidence-aware scorecards separate execution readiness from evaluative claims, making each claim traceable to its supporting artifacts. The catalog contains 270 model entries, 74 benchmarks, and 62 registered metric entries, with readiness and execution evidence recorded separately. WorldFoundry enables reproducible comparison of persistent, controllable dynamics across heterogeneous systems, advancing the field from perceptual synthesis toward measurable world intelligence.
180. 【2611.10770】How reliable is an embedding of the seabed? Repeat-look measurement of frozen encoders on synthetic aperture sonar
链接：https://arxiv.org/abs/2611.10770
作者：Harold Horsley,Oscar Pizarro,Hayat Rajani,Morten Omholt Alver
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Applications (stat.AP)
关键词：self-supervised representation learning, Pretrained encoders, learning are increasingly, increasingly applied, repeat-look reliability
备注： Accepted at the Maritime Computer Vision Workshop (MaCVi) at WACV 2027
点击查看摘要
Abstract:Pretrained encoders from self-supervised representation learning are increasingly applied to sonar imagery of the seafloor, where they are evaluated with protocols that take one embedding per target. A target patch of seabed, by contrast, is re-imaged from an alternate look on overlapping survey passes, so each embedding is one measurement of that target. Standard protocols cannot say how consistent those measurements are, or how much of their spread belongs to the patch and how much to the acquisition geometry. We treat this as a measurement-reliability problem. Using a synthetic-aperture sonar (SAS) survey, we measure the repeat-look reliability of embeddings from a frozen natural-image encoder (DINOv3 ViT-S/16). Standard single-look metrics, effective rank, clustering and a linear probe for coral, are all stable to the look, and the probe performs well (AUC 0.93). Yet the repeat-look reliability of the same embeddings is poor, with a distance-based intraclass correlation (dbICC) of 0.20 and nearest neighbours and clusters that barely agree across looks. This contradiction resolves as we find the probe learns a stable direction, whose ICC of 0.60 is 3.0 times that of the full embedding. Variance components, calculated from generalizability theory, attribute under a tenth of the within-cell spread to look acquisition geometry. The rest is cell-specific and cannot be separated without repeat passes at matched geometry. A sonar-pretrained encoder (BenthicDINO) and a classical SAS texture descriptor show the same pattern. For this dataset and the tested representations, uses that depend on patch identity fail, such as cross-pass comparison and retrieval, while uses at the level of habitat type (e.g. coral classification) do not. Because the standard metrics did not detect this, we argue that repeat-look reliability should accompany any evaluation of representations of the seafloor.
181. 【2611.10764】BAPLe++: Cross-Model Transferability and Prompt-Level Defense of Backdoors in Medical Foundation Models
链接：https://arxiv.org/abs/2611.10764
作者：Ufaq Khan,Umair Nawaz,Satyajit Tourani,Awais Rauf,Fahad Shamshad,Asif Hanif,Rao Muhammad Anwer,Muhammad Haris Khan,Mohammad Yaqub
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Medical foundation models, Medical foundation, backbone remains frozen, increasingly adapted, adapted to clinical
备注： 13 pages, 4 figures, 3 tables
点击查看摘要
Abstract:Medical foundation models (Med-FMs) are increasingly adapted to clinical tasks through prompt learning, which tunes a small set of prompt tokens while the backbone remains frozen. Recent work has shown that this efficiency introduces a vulnerability: jointly optimizing learnable prompts and an imperceptible noise trigger during few-shot adaptation implants a backdoor that leaves clean performance intact but steers triggered inputs to an attacker-chosen class. Since prompts are compact and readily shared, this raises two questions: whether a backdoored prompt remains effective on a different Med-FM, and whether it can be repaired without retraining the backbone. We address both in BAPLe++. First, we present the first study of cross-model transferability of prompt-based backdoors, quantified by two proposed metrics, Clean Accuracy Difference (CAD) and Backdoor Accuracy Difference (BAD). Second, we propose DePLe (Defense via Prompt Learning), which uses the infected prompt as a fixed anchor and learns a new prompt on a small clean set that preserves the clean task while diverging from the compromised embedding region. Experiments on four Med-FMs and six chest X-ray and histopathology datasets show that backdoors transfer across models, but asymmetrically and in a dataset-dependent manner. Compared with four training-free input transformations, DePLe reduces backdoor accuracy more consistently while preserving, and in several settings improving, clean accuracy. Our code can be accessed on this https URL
182. 【2611.10758】Unified Framework with Convex-Concave Decomposition and Sparse Topological Learning for Skeleton-Based Clinical Assessment
链接：https://arxiv.org/abs/2611.10758
作者：Quang-Anh N. D.,Duc Pham Minh,Minh-Anh Nguyen,Hien Quang Kha,Manh Hung Ha,Minhhuy Le,Oscal Tzyh-Chiang Chen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Skeleton-based rehabilitation assessment, faces fundamental limitations, Graph Convolutional Network, Skeleton-based rehabilitation, clinically important deviations
备注：
点击查看摘要
Abstract:Skeleton-based rehabilitation assessment faces fundamental limitations of fixed topologies which cannot model compensatory patterns, uniform joint treatments overlook clinically important deviations, and lack of geometric understand- ing. We propose Concave-Convex Decomposition Sparse Topological Graph Convolutional Network (CC2-STG), a multi-stream model that combines geo- metric decomposition, sparse feature learning, and adaptive topology. Our framework decomposes joint relationships into complementary convex-concave distance functions to model both local and global movement characteristics, with sparse regularization with proximal optimization selecting clinically relevant geo- metric features, while multi-scale topological analysis captures non-anatomical joint dependencies in pathological movements. Experiments on the KiMoRe and UIPRMD datasets validate the effectiveness of our approach, achieving state-of-the-art performance on clinical pathological movement assessment.
183. 【2611.10751】Constrained Look-ahead Guidance for Interference-Aware Flow Editing
链接：https://arxiv.org/abs/2611.10751
作者：Doudou Zhang,Qi Chen
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：powerful generative modeling, enable powerful generative, flow models enable, models enable powerful, remains challenging due
备注：
点击查看摘要
Abstract:Diffusion and flow models enable powerful generative modeling, but controlled editing remains challenging due to the need to balance source fidelity and edit compliance along the generative trajectory. We propose a principled, inversion-free framework for flow-based image editing from a trajectory centric perspective. Rather than relying on inversion or heuristic guidance, we introduce a one-step look-ahead mechanism that evaluates the effect of candidate updates on both edit and fidelity rewards estimated via denoising, and adjusts the current update based on this evaluation. At each step, our method applies reward-driven corrections guided by the look-ahead evaluation under an explicit fidelity constraint, resulting in stable and coherent trajectory evolution. This look-ahead design mitigates gradient interference between edit and fidelity objectives by anticipating their interaction in future states, leading to improved trade-offs. Experiments demonstrate that the proposed approach achieves stronger semantic edits while better preserving source content compared to existing strong baselines.
184. 【2611.10746】RoadState: A Domain-Prior-Enhanced Vision-Language System for Industrial-Grade Lane-Level Map Updating
链接：https://arxiv.org/abs/2611.10746
作者：Deguo Xia,Zihan Li,Jiaqi Wang,Dong Xie,Xiyan Liu,Liuhui Zhang,Jizhou Huang,Mengmeng Yang,Diange Yang,Chen Zhu,Liwei Qian,Xin Pei,Shuanglong Li,Hanmeng Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：ambiguous lane markings, requires temporally consistent, updating requires temporally, Baidu Maps' map-updating, physically valid
备注： 12 pages, 5 figures, including appendices. Accepted to AAAI-IAAI 2027, poster presentation
点击查看摘要
Abstract:Lane-level map updating requires temporally consistent, physically valid, and auditable road-scene semantics despite occlusions, ambiguous lane markings, temporary obstacles, and viewpoint changes. We present RoadState, a production-deployed vision-language system that transforms sequential road-scene observations into structured lane-level semantics for Baidu Maps' map-updating pipeline. Its core model, RoadState-VLM, formulates road-scene understanding as autoregressive state estimation, predicting the current structured road state from the previous observation and symbolic state together with the current observation. We introduce Geometric Chain-of-Thought (Geo-CoT), which uses a directed acyclic graph of semantic dependencies as a domain prior to improve semantic consistency and reasoning fidelity across interdependent road-state dimensions. Extensive experiments on a real-world dataset show that RoadState-VLM achieves 94.33% mean accuracy across six road-state dimensions, outperforming the strongest fine-tuned VLM baseline. Ablation studies further demonstrate the complementary effectiveness of Geo-CoT and temporal transition context. A cascaded routing pipeline directs routine cases to lightweight models while reserving complex cases for RoadState-VLM. Since its deployment in March 2025, RoadState has supported lane-level map updating across more than 360 cities and reduced overall production costs by 30%. Together with human-in-the-loop auditing, the system maintains robust performance under stress-test conditions. These results demonstrate how domain-prior-enhanced reasoning, structured state interfaces, selective routing, and human quality control can bridge the gap between VLM-based road-scene understanding and large-scale lane-level map updating.
185. 【2611.10744】Writer-independent handedness identification from offline Bangla handwriting under controlled acquisition
链接：https://arxiv.org/abs/2611.10744
作者：Tanzim Hasan Prappo,Sayeed Hassan,Sayem Ali,Sukhendra Nath Dhar,M. Shahidur Rahman
类目：Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY); Machine Learning (cs.LG)
关键词：forensic document examination, writing hand, forensic document, document examination, reported accuracies
备注： 8 pages, 7 figures, 3 tables
点击查看摘要
Abstract:Handedness is a soft-biometric cue for forensic document examination and writer profiling, yet reported accuracies from offline handwriting rarely keep writers, texts and image acquisition apart, so models may recognise the writer or capture conditions rather than the writing hand. Such controlled evidence is missing for Bangla. Using our BanglaHand dataset of 42 writers (21 left- and 21 right-handed), who each wrote six shared prompts and two own texts under controlled collection and photography, we evaluate handedness identification with all images of each test writer held out, whole-writer permutation tests and photometric controls. An ink-gradient descriptor identified the handedness of unseen writers with 77.4% balanced accuracy (95% writer-bootstrap interval 67.7-86.5%; p=0.001) and frozen ImageNet embeddings with 69.5-72.0%. Part of this signal is stroke darkness: in a post hoc analysis, right-handed writers' strokes were darker at their centres for equal stroke width, consistent with higher pen pressure and not explained by lighting drift. With ink density and brightness regressed out, the descriptor still reached 64.5% (p=0.027), whereas writing-only shape features were weaker (60.8%; p=0.090). Handedness is thus identifiable from offline Bangla handwriting under controlled acquisition, and photometric controls are essential to interpret such cues.
186. 【2611.10740】Evaluating Physically Grounded Procedural Reasoning in VLMs through Real-World Execution: Crochet as a Testbed
链接：https://arxiv.org/abs/2611.10740
作者：Maximiliano Wardle
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：work in practice, Vision-Language Models, procedural reasoning, generate procedures, paper
备注：
点击查看摘要
Abstract:Vision-Language Models (VLMs) can generate procedures that look convincing on paper, but do they work in practice? In this paper, we propose crochet as an ideal testbed for physically grounded procedural reasoning in VLMs. Crochet cannot be reliably simulated or automated: the only way to know what a pattern produces is to make it by hand, yet verification is tangible and cheap, requiring nothing but a hook and a ball of yarn. We introduce FoundationChain, a deceptively simple test of procedural reasoning: given an image of a basic crochet object, can VLMs infer how it was made and generate a pattern that produces the same result? We crochet 40 patterns generated by four VLMs by hand. Even at this scale, physical execution not only reveals failures that automated proxies cannot detect, but also enables a more precise diagnosis of their causes and consequences: while models write fluent, convincing patterns, only four are free of errors, and our analysis exposes deficiencies in visual, geometric and procedural reasoning.
187. 【2611.10734】ny Evidence Region Localization with Selective Contrastive On-Policy Self-Distillation
链接：https://arxiv.org/abs/2611.10734
作者：Yujuan Pang,Wenhao Xu,Yinglei Teng
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Multimodal large language, general visual tasks, Multimodal large, fine-grained visual tasks, visual tasks
备注：
点击查看摘要
Abstract:Multimodal large language models have made progress in general visual tasks. However, limitations remain in fine-grained visual tasks requiring evidence from minute image regions. Existing methods primarily train models using evidence-related regions while overlooking the influence of extensive background regions, resulting in a limited ability to resist interference from irrelevant regions. We propose selective positive-negative on-policy self-distillation (SPN-OPSD), which considers both evidence and background regions. Supervision from both views improves the model's ability to resist interference from irrelevant regions. Furthermore, selective token-level distillation provides more informative supervision, improving the model's ability to attend to evidence regions in Fine-Grained Visual Tasks. On Qwen3.5-2B, SPN-OPSD improves accuracy on V* Bench, ZoomBench, and MME-RealWorld-Lite from 76.44%, 45.92%, and 57.43% to 84.82%, 54.56%, and 59.56%, respectively. Similar gains are also observed on Qwen3.5-0.8B.
188. 【2611.10729】LIFT: Local Metric Alignment and Foundation-guided Propagation for Few-shot Depth Completion
链接：https://arxiv.org/abs/2611.10729
作者：Xiang Li,Xiaojin Gong
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Few-shot depth completion, depth completion aims, offering a favorable, target-domain annotations, annotation cost
备注： 8 pages, 5 figures
点击查看摘要
Abstract:Few-shot depth completion aims to recover dense metric depth from sparse measurements using only a small number of target-domain annotations, offering a favorable balance between annotation cost and model adaptation. We propose LIFT, a framework that harnesses both depth and feature priors from a frozen pretrained monocular depth estimation (MDE) foundation model for few-shot depth completion. Specifically, LIFT first estimates local scale and shift parameters on a coarse grid and interpolates them into smooth, dense parameter fields, providing a spatially adaptive metric depth initialization. It then progressively refines this initialization through multi-scale depth propagation guided by foundation features. Finally, a lightweight residual decoder combines multi-level foundation features with propagation correction to refine the metric depth. Extensive experiments on NYUv2 and KITTI-DC demonstrate that our proposed method achieves state-of-the-art few-shot performance. The source code will soon be released.
189. 【2611.10728】3D Segmentation in the Clinic: A Grand Challenge
链接：https://arxiv.org/abs/2611.10728
作者：Bram van Ginneken,Tobias Heimann,Martin Styner
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：brain MRI data, computed tomography scans, Medical Image Computing, Computer Assisted Intervention, brain MRI
备注： 9 pages, 1 table. Published in the proceedings of the MICCAI 2007 workshop 3D Segmentation in the Clinic: A Grand Challenge
点击查看摘要
Abstract:This paper describes the set-up of a segmentation competition for automatic and semi-automatic extraction of the liver from computed tomography scans and the caudate nucleus from brain MRI data. This competition was held in the form of a workshop at the 2007 Medical Image Computing and Computer Assisted Intervention conference. The rationale for organizing the competition is discussed, the training and test data sets for both segmentation tasks are described and the scoring system used to evaluate the segmentation is presented.
190. 【2611.10720】Locating and Repairing Domain Shift in VLM Trajectory Planning
链接：https://arxiv.org/abs/2611.10720
作者：Zhihong Cui,Hengyu Liu,Michael Alexander Riegler,Guandong Xu,Amir Taherkordi,Tor Skeie
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：Vision-Language Models, domain shift, shift, increasingly adopted, Models
备注： Accepted at NeurIPS 2026 (Main Track). 30 pages, 7 figures, 16 tables. Code: [this https URL](https://github.com/ZhihongCui/MoLaRx)
点击查看摘要
Abstract:Vision-Language Models (VLMs) are increasingly adopted as end-to-end driving planners, yet they suffer from cross-city domain shift. Existing methods treat this shift as a single quantity addressed by uniform alignment or single-site editing. We challenge this view on two counts: (i) domain shift in VLM trajectory planners is inherently structured across modality and layer, and (ii) a locate-then-repair recipe matched to this structure outperforms every uniform-objective baseline. We analyse domain shift via activation patching and uncover two regularities. (F1) Modality axis. Image and text tokens exhibit distinct shift patterns in each VLM. (F2) Layer axis. The layer-wise shift partition is architecture-dependent and dataset-stable. These findings recast domain shift as a two-dimensional tensor indexed by modality (image vs. text tokens) and layer, motivating a simple principle: locate where shift occurs, and repair only there. We instantiate this principle in MoLaRx (Modality-Layer Repair), a locate-then-repair framework. The Causal Importance Score (CIS) estimates the domain shift as a modality-layer tensor and partitions the layers into functional zones. CIS-Guided Selective Repair (CISR) then applies a matched operator (Maximum Mean Discrepancy (MMD) / low-rank adaptation (LoRA) / freezing) to repair each zone, with the composition adapting automatically to each architecture. We evaluate MoLaRx on three architecturally distinct VLMs (LFM2-VL-1.6B, Qwen2-VL-2B, and PaliGemma2-3B) across two cross-city benchmarks (nuScenes and Argoverse 2). MoLaRx attains the lowest cross-city trajectory-error gap among adaptation methods in all six main-table settings, while using 50-60% fewer trainable parameters and 8.4-10.9 ms lower inference latency. In contrast, uniform MMD-only adaptation collapses in all six settings, highlighting the importance of structure-guided repair.
191. 【2611.10717】Disentangled Stylized Image Generation via IP-Cross-Attention Rearrangement
链接：https://arxiv.org/abs/2611.10717
作者：Beibei Dong,Yueming Lyu,Yue Jiang,Jing Dong
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：solid theoretical foundation, generating excellent stylized, achieved controllable generation, controllable generation leveraging, large-scale datasets
备注： 12 pages, 11 figures
点击查看摘要
Abstract:With a solid theoretical foundation and pretraining on large-scale datasets, diffusion-based methods have achieved controllable generation leveraging text and image conditions, and generating excellent stylized images is possible using diffusion models. However, previous methods face significant challenges. First, because diffusion generation is iterative, the common approach of learning implicit style representations via cycle-consistency strategies is too costly and not well-suited to diffusion, even for LoRA-based methods. Second, decoupling style is difficult in the latent space of diffusion models. Representations of attributes are coupled in the latent space of diffusion models; thus, extracting style attributes with diffusion models usually suffers from the issue of content leakage. Furthermore, because style is hard to represent in natural language, capturing style using text prompts or textual inversion is deficient. In this paper, we propose a method for achieving disentangled stylized image generation through IP-cross-attention rearrangement, based on our experimental observations. We also propose negative content guidance, inspired by classifier-free guidance, to reduce content leakage in stylized image generation.
192. 【2611.10714】Permute-then-Adapt: Weak-to-Strong Contrastive Image-Text Adaptation
链接：https://arxiv.org/abs/2611.10714
作者：Jinhao Li,Sarah Erfani,Lei Feng,Guangrui Li,James Bailey,Feng Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Image-text alignment models, Image-text alignment, CLIP are typically, strict negatives, treated as strict
备注： 28 pages; accepted at NeurIPS 2026 (Spotlight)
点击查看摘要
Abstract:Image-text alignment models such as CLIP are typically trained with contrastive learning, where unpaired examples are treated as strict negatives. While this assumption introduces noise by penalising semantically related pairs, existing solutions often rely on heuristic similarity thresholds that lack statistical grounding and sensitivity to dataset-specific noise distributions. In this paper, we propose Permute-then-Adapt (PTA), a framework that leverages efficient weak models to identify missed positives while controlling Type-I error relative to a conditional permutation reference, up to calibration approximation error. Unlike standard distillation or arbitrary thresholding, PTA estimates a random-pairing reference distribution from the weak teacher's similarity scores and uses its upper tail, determined by $\alpha$, to select auxiliary positives. The calibrated positive set is then trained against by a single multi-positive contrastive objective: each anchor maximises the total probability mass it assigns to its positive set. Offline calibration with the weak model adds negligible training overhead. Experiments show gains over heuristic soft-label approaches in object recognition, cross-modal retrieval, and data efficiency. Project repository: this https URL.
193. 【2611.10713】Quadratic Bezier Splatting with Structural Initialization for Efficient Painting Rendering
链接：https://arxiv.org/abs/2611.10713
作者：Jinfan Liu,Xuhan Zhan,Mengqin Zhao,Guangyi Deng,Wuze Zhang,Bingbing Ni
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：pixel-level reconstruction task, Stroke-based rendering, Quadratic Bezier Splatting, reconstruction task, Stroke-based
备注：
点击查看摘要
Abstract:Stroke-based rendering is often optimized as a pixel-level reconstruction task. This over-reliance on global error reduction not only degrades strokes into fragmented curves due to a lack of structured planning, but also allows locally defective primitives to be concealed by overlapping layers. To address these issues, we introduce a model-guided framework for stroke-audited rendering. Our framework uses Quadratic Bezier Splatting to analytically model continuous curved strokes with efficient differentiable alpha compositing. Built on this renderer, a feedforward multi-scale stroke decoder provides a structural initialization with learned stroke-scale allocation, while test-time stroke optimization supplies the reconstruction capacity needed for high-fidelity refinement. We further propose a single-stroke audit mechanism that explicitly evaluates local stroke quality, preventing defective primitives from surviving optimization through layer-wise compensation. Compared with existing methods, our approach achieves coherent layouts, improves PSNR by up to 5.46 dB, yields a 16% more compact representation, and accelerates combined renderer forward and backward computation by a factor of 220.3.
194. 【2611.10699】PLS-GS: Probabilistic Lidar Scaffolds for Compact, Surface-Aligned Gaussian Splatting
链接：https://arxiv.org/abs/2611.10699
作者：Krishnan Harikumar,Alejandro Fontan,Thierry Peynot,Emili Hernández,Niko Sünderhauf
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Robotics (cs.RO)
关键词：accurate geometric structure, combining rich visual, mapping applications provide, rich visual appearance, Gaussian Splatting
备注： Accepted to WACV 2027. Main paper and supplementary material. Code: [this https URL](https://github.com/k-harikumar/PLS-GS)
点击查看摘要
Abstract:While 3D Gaussian Splatting (3DGS) is typically optimized from images only, many robotics and mapping applications provide both camera and high-definition LiDAR data, combining rich visual appearance with accurate geometric structure. We introduce PLS-GS, a probabilistic LiDAR scaffold for Gaussian Splatting that exploits this complementary sensing setting to construct a compact 3DGS representation aligned to the measured surface. PLS-GS fits a Hierarchical Gaussian Mixture Model jointly over position and color, yielding a continuous and adaptive scaffold that eliminates the need for discrete scene partitioning such as voxel grids or octrees. The fitted mixture then guides the renderable 3DGS Gaussians: each rendering Gaussian is associated with a GMM component and constrained in the local surface frame induced by that component's covariance. A Mahalanobis support loss bounds the deviation of the rendering Gaussians from the corresponding LiDAR-derived surface. Across five large outdoor scenes, PLS-GS places primitives markedly closer to the LiDAR measurements than both image- and LiDAR-initialized baselines, while employing substantially fewer primitives, yielding a considerably more compact model and faster rendering. At matched capacity, PLS-GS places primitives closer to the LiDAR measurements, with comparable rendering quality. Code is available at this https URL.
195. 【2611.10694】Perception, Not Reasoning, Limits Visual Theory of Mind
链接：https://arxiv.org/abs/2611.10694
作者：Mohamed Rayan Barhdadi,Syed Talal Wasim,Juergen Gall,Erchin Serpedin,Hasan Kurban
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Neurons and Cognition (q-bio.NC)
关键词：Vision-language models pass, models pass text-based, pass text-based false-belief, text-based false-belief probes, twenty percentage points
备注： 36 pages, 6 figures. Accepted to NeurIPS 2026 (ED). Code and dataset: [this https URL](https://kurbanintelligencelab.github.io/perception-not-reasoning/)
点击查看摘要
Abstract:Vision-language models pass text-based false-belief probes at near-human levels but drop by over twenty percentage points on abstract panels the moment the same problem is conveyed visually. The consensus diagnosis is conceptual, prescribing new belief-reasoning modules. We argue the dominant bottleneck is perceptual: not what the model cannot reason about, but what it cannot see. We propose a five-condition dissociation protocol that holds the reasoning task constant while varying perceptual fidelity from visual only to text only, and quantify the result with the Perceptual Contribution Ratio, the share of the visual-to-text gap a given fidelity closes. We test this on two kinds of scenes: abstract 2D panels in the Heider--Simmel tradition, and naturalistic 3D game scenes from MuMA-ToM and MindPower. The evaluation covers seven VLMs and roughly 159,000 API calls. Ground-truth scaffolds substantially close the gap in every setting, and on the abstract panels and MuMA-ToM they match or exceed the text-only reasoning. Whereas scaffolds built by automatic parsers, including frontier VLMs, fail. The most common error in the visual-only condition is \emph{reality bias}, which accounts for 60\% of false-belief failures. Models report where an object actually is, not where an absent agent believes it is. This points to a perceptual front-end that fails to track which agents were present at each moment. Under the evaluated protocol, structured visual scene-state extraction, rather than belief inference, is the dominant bottleneck for visual ToM.
196. 【2611.10690】JoVox: Joint Hierarchical Flow Matching for Lightweight Voxel Generation
链接：https://arxiv.org/abs/2611.10690
作者：Xiangjun Tang,Jianqi Chen,Peter Wonka
类目：Computer Vision and Pattern Recognition (cs.CV); Computer Science and Game Theory (cs.GT)
关键词：Generating high-fidelity voxels, Generating high-fidelity, lightweight nature remains, computer vision, remains an open
备注：
点击查看摘要
Abstract:Generating high-fidelity voxels while keeping their lightweight nature remains an open problem in computer vision. Current generators are either high-fidelity but computationally heavy, or lightweight but of lower fidelity. Hierarchical methods keep the lightweight nature of voxels. However, their coarse levels, which decide where all finer cells can appear, are generated with the least information about the shape and are never revisited, so they are often plausible but wrong. Our key insight is to let finer cells take part in deciding coarse cells. To this end, we propose JoVox, a discrete flow matching framework that learns the joint distribution of all levels of the voxel hierarchy, instead of a separate distribution for each level, so that coarse cells can be predicted with finer cells already generated nearby. Within this framework, we further introduce a two-level prediction, which outputs the cells two levels finer at once instead of one level finer, halving the number of levels that the network processes and yielding voxels of higher fidelity. We also introduce an unmasking strategy that revisits early decisions once finer cells are generated and corrects inconsistencies in masked diffusion models. Our framework outperforms the baselines on both unconditional and image-conditioned voxel generation. Compared with the current state-of-the-art TRELLIS.2, we achieve 8x higher training throughput, 1/15 of the FLOPs in a forward pass, train on 4 vs. 32 GPUs, and obtain higher quality with an 11% lower Chamfer distance.
197. 【2611.10678】MGE: A Membership Guided Data Extraction Attack against Diffusion Models
链接：https://arxiv.org/abs/2611.10678
作者：Yuchang Mei,Longqiang Wang,Haoyang Jiang,Mingyang Yi,Shaolei Zhang,Keman Huang,Wuqiong Pan,Ju Fan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：achieved remarkable performance, achieved remarkable, remarkable performance, Recently, data
备注：
点击查看摘要
Abstract:Recently, diffusion models have achieved remarkable performance in image generation. However, their inherent memory properties introduce a potential safety risk of training data leakage, i.e., data extraction attack. To illustrate such risk, we propose a membership guided extraction (MGE) framework to effectively extract training data from a pre-trained diffusion model. Our core idea is to formulate the data extraction as a conditional generation, where the condition signal is from a membership inference classifier. To improve the success rate and efficiency of MGE, we propose adversarial gradient and parallel branch decoding. Our experiments on image generation benchmarks demonstrate that our MGE can extract hundreds of images, which shows that more attention should be paid to privacy-preserving of diffusion model.
198. 【2611.10672】Heterogeneous Asymmetric Contrastive Distillation
链接：https://arxiv.org/abs/2611.10672
作者：Qi Wang,Jinjia Zhou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Knowledge distillation, Transformer teacher, CNN student, architectural families, networks learn
备注： 13pages, 7 figures
点击查看摘要
Abstract:Knowledge distillation (KD) between architectural families, e.g., from a Transformer teacher to a CNN student, is difficult because the two networks learn different representations. Logits share a label space, but heterogeneous teachers differ in logit offset, scale, and sharpness, and their non-target classes are less semantically organized. Conventional logit distillation matches these values sample by sample, asking the student to imitate how another architecture expresses its predictions. We argue that a heterogeneous teacher should pass on the relational structure of its predictions, i.e., how it arranges samples relative to one another, and propose Heterogeneous Asymmetric Contrastive Distillation (HACD) to transfer this structure. HACD maps teacher and student logits to centered, temperature-softened probability directions on a shared unit hypersphere, which removes architecture-dependent offsets and lets the temperature control how sharply peaked outputs enter the representation while keeping informative non-target classes. Each student output must then identify its own teacher target within the batch. Because every teacher target also acts as a negative for the others, HACD computes the targets on a moderately augmented view and contrasts both a moderate and a strong student view against them. HACD adds no learnable parameters and needs one teacher pass per sample. It achieves the best or second-best accuracy on 11 of 12 heterogeneous pairs on CIFAR-100, without ground-truth labels, and on 14 of 15 pairs on ImageNet-1K, improving over the reported vanilla KD results by 8.82 and 1.33 percentage points on average. Checkpoints are available at this https URL the code will be released upon publication.
199. 【2611.10665】Physically Guided TeX Generation for Low-Light Visual Tasks
链接：https://arxiv.org/abs/2611.10665
作者：Daoheng Li,Jianjun Qian,Mengkai Yan,Jian Yang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：images lack color, Low-light conditions reduce, conditions reduce visible, reduce visible contrast, infrared images lack
备注：
点击查看摘要
Abstract:Low-light conditions reduce visible contrast and obscure details, while infrared images lack color and texture, motivating the fusion of infrared and visible information for visual tasks. Existing fusion methods primarily optimize image appearance or task-specific features without explicitly disentangling the coupled factors underlying thermal observations, limiting their physical interpretation under thermal degeneracy. Hyperspectral thermal measurements enable physical decomposition, but they require specialized imaging hardware, while pixel-level physical annotations for supervision or evaluation incur additional costs. We propose TeX-Gen, a physically guided framework for TeX generation from paired visible and infrared images in low-light visual tasks. TeX Generation constructs complementary multi-view features and employs independent branch-specific gates to route cues into the Temperature, Emissivity, and Texture maps. TeXMetric integrates radiometric reconstruction, channel structure, and material consistency to assess the generated maps without requiring pixel-level physical labels. TeX Tune improves performance through task-guided adjustments, jointly optimizing the adjustment modules and task network while keeping the generator frozen. Experiments show that TeX-Gen achieves competitive task performance in low-light environments on the FLIR, LLVIP, M3FD, and MSRS datasets. Experiments on HADAR also examine the association between TeXMetric scores and downstream detection performance.
200. 【2611.10664】ask-Critical Part Alignment Improves Imitation of Object Interactions
链接：https://arxiv.org/abs/2611.10664
作者：Denis Hadjivelichkov,Sebastian Ægidius,Valerio Modugno,Dimitrios Kanoulas
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：paper presents enhancements, paper presents, DINOBot framework, presents enhancements, imitation learning
备注： 6 pages, 6 figures. Accepted at ICAR 2025. This is the preprint version; the published version may differ slightly
点击查看摘要
Abstract:This paper presents enhancements to the DINOBot framework for imitation learning of object-object interactions. We introduce two key contributions aimed at improving the accuracy and efficiency of alignment in imitation-based robotic tasks. First, we integrate RANdom SAmple Consensus (RANSAC) for outlier rejection during the alignment phase, effectively mitigating the impact of noisy depth data and spurious feature matches. This improves robustness when transferring demonstrations to real-world applications. Second, we refine the semantic correspondence process by focusing on task-relevant interaction regions, ensuring that the learned representation prioritizes critical object features that influence successful manipulation. We evaluated our approach in a range of real-world manipulation tasks, including picking, insertion, shaking, and pouring, using a robotic system. The experimental results demonstrate an overall improvement of 13.8% in task success rates compared to the baseline, along with faster convergence in the alignment process. These results highlight the effectiveness of our enhancements in improving precision and efficiency for object-object interaction imitation in robotics.
201. 【2611.10660】Dynamics-Informed Action Learning for Goal-Conditioned Latent Planning
链接：https://arxiv.org/abs/2611.10660
作者：Yinuo Jiang,Guangzhi Wang,Yiran Wang,Junfu Pu,Cheng Cheng,Honghao Chen,Cheng Cheng,Ying Shan
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：compact representation spaces, Latent world models, world models enable, representation spaces, compact representation
备注：
点击查看摘要
Abstract:Latent world models enable visual control by planning action sequences in compact representation spaces, but a gap remains between how latent dynamics are learned and how they are used for planning. First, teacher-forced training does not expose the dynamics model to the recursively predicted latent states encountered during planning. Second, sampling-based planners typically initialize action search from goal-agnostic proposals, without exploiting the action-conditioned dynamics learned by the world model. We introduce Dynamics-Informed Action Learning (DIAL) to bridge these two gaps. During training, rollout alignment exposes the forward model to its own autoregressive latent predictions, while multi-step inverse supervision trains a lightweight inverse dynamics head to infer actions from latent-state transitions. We further apply the inverse head to model-generated transitions with its parameters held fixed, encouraging predicted rollouts to retain action-relevant information. At test time, DIAL autoregressively couples the inverse and forward dynamics to construct a dynamics-informed action sequence toward the goal, which initializes the mean of the Cross-Entropy Method (CEM) proposal distribution. The subsequent CEM search then refines this initialization using the standard sampling and updating procedure. Experiments across four visual control benchmarks demonstrate that DIAL outperforms existing latent world models and planning baselines in both standard and long-horizon scenarios.
202. 【2611.10655】STABLE: A Continual Learning Optimizer with Adaptive Drift Control
链接：https://arxiv.org/abs/2611.10655
作者：Xiaoyan Li,Lanpei Li,Massimo Coppola,Vincenzo Lomonaco,Antonio Carta
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：suffers from catastrophic, loss of past, past knowledge, adaptation across task, Continual learning suffers
备注： Accepted at the 40th Conference on Neural Information Processing Systems (NeurIPS 2026)
点击查看摘要
Abstract:Continual learning suffers from catastrophic forgetting, leading to the loss of past knowledge and unstable adaptation across task streams. Existing approaches typically address this issue through replay buffers, architectural changes, or additional regularization terms. We argue that forgetting is a consequence of unstable learning dynamics, which may benefit from an optimizer-level solution. The main challenge is that learning dynamics are time-dependent, as demonstrated by empirical phenomena such as the stability gap. First, we formally prove that, for distance-based classifiers, bounded parameter drift guarantees bounded margin erosion under a local score-stability condition. Based on this insight, we propose STABLE, a primal-dual optimizer with adaptive drift control. STABLE enforces a drift budget by increasing the dual variable when the budget is violated and decreasing it otherwise. This results in high stability without penalizing plasticity. Experiments on long-horizon unimodal streams and CLIP-based multimodal streams show that vanilla PEFT baselines trained with STABLE match or outperform specialized continual learning methods. In the multimodal setting, STABLE further preserves zero-shot transfer, matching or exceeding dedicated multimodal continual learning methods. Code is available at this https URL.
203. 【2611.10653】FG-DSA: Frequency-Guided Depthwise Separable Attention for Efficient Dense Prediction
链接：https://arxiv.org/abs/2611.10653
作者：Yiyao Yang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：scenarios remain challenging, resource-constrained scenarios remain, repeated downsampling substantially, downsampling substantially reduces, Efficient Dense Prediction
备注： 20 pages, 8 figures, 9 tables
点击查看摘要
Abstract:Dense prediction and generative modeling in resource-constrained scenarios remain challenging, as repeated downsampling substantially reduces spatial detail and degrades boundaries. Although recent attention mechanisms have alleviated the problem of semantic ambiguity, they often fail to preserve high-frequency features or do so at the expense of a very high computational cost. In this paper, we propose the Frequency Guided Depthwise Separable Attention for Efficient Dense Prediction (FG-DSA), a novel framework for efficient dense visual understanding and generation. FG-DSA employs a 2D FFT high-pass filtering module to explicitly inject frequency domain priors into the spatial attention mechanism, allowing lightweight networks to recover sharp boundary transitions with linear complexity. A range of experiments show that FG-DSA is effective at recovering fine object boundaries and leads to a consistent performance gain in the task of semantic segmentation. Importantly, we show that FGA-DSA can be used as a module in diffusion-based generative U-Nets, leading to a significant improvement in the detail of the generated images with very little additional parameter and Floating Point Operation (FLOP) cost.
204. 【2611.10652】SHIN: Scalable Hierarchy for INcremental 3D Gaussian Splatting
链接：https://arxiv.org/abs/2611.10652
作者：Reagan Koo,Yeong-Gyu Kim,Eun-Seok Ryu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：real-time novel-view synthesis, high-quality real-time novel-view, deployment budgets vary, Gaussian Splatting, novel-view synthesis
备注： 8 pages of main text (13 pages including references and supplementary material), 7 figures
点击查看摘要
Abstract:3D Gaussian Splatting (3DGS) provides high-quality real-time novel-view synthesis, but deployment budgets vary across devices and network conditions. Most compact methods target one operating point, so another budget requires a separate representation. SHIN is a scalable 3DGS hierarchy with a reusable Base and additive enhancement layers, so each higher-quality operating point extends rather than replaces the decoded representation. Constructing this hierarchy requires deciding which Gaussians each stage adds and how much spherical-harmonic (SH) appearance each retains, because these choices remain fixed in later prefixes. SHIN derives one shared Gaussian order from multi-scale position-scale sensitivity and divides each stage budget between adding Gaussians and retaining SH bands using calibrated gradient-based scores per byte. Lightweight opacity updates adjust compositing while transmitted geometry and SH coefficients remain unchanged. Across three benchmarks, SHIN progressively improves one cumulative representation and achieves the best PSNR-size efficiency in every overlapping comparison with the multi-rate and progressive baselines.
205. 【2611.10644】Agent2BIM: A Systematic Evaluation of Reality-Capture Configurations and Prior Models for As-Built Modeling
链接：https://arxiv.org/abs/2611.10644
作者：Boyu Wang,Borja García de Soto
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：as-built Building Information, Building Information Models, generate as-built Building, Building Information, as-built Building
备注：
点击查看摘要
Abstract:AI agents can generate as-built Building Information Models (BIMs) from reality-capture data, but the evidence required for accurate reconstruction remains unclear. This paper presents Agent2BIM, an agent-based Scan-to-BIM framework, and evaluates seven capture configurations in a research laboratory and a mechanical, electrical, and plumbing (MEP) scene. Inputs include 360° panoramas, smartphone video, smartphone LiDAR, terrestrial laser scanning (TLS), TLS with posed panoramas, and imagery supplemented by prior IFC models. Outputs are compared against TLS-verified reference models for component detection, geometric accuracy, and MEP connectivity. In the laboratory, component recall ranged from 84% to 100%, but only 9% of components reconstructed from panoramas were within 20 cm of their reference positions, compared with 86% using smartphone LiDAR. In the MEP scene, scale-free inputs recovered 11 - 43% of components, versus 75 - 93% for metric inputs. Prior IFC models improved MEP reconstruction but could propagate inaccuracies. The results highlight the complementary roles of visual and metric evidence in agent-based Scan-to-BIM.
206. 【2611.10642】VisProve: Learning Typed Visual Provenance for Scientific Document Question Answering
链接：https://arxiv.org/abs/2611.10642
作者：Jingxuan Wei,Zhengyang Wang,Zheng Guo,Xiaoming Wu,Fuqiang Wang,Xin Wang,Bihui Yu,Yining Wang,Junnan Zhu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：cited content contributes, Visual citations show, citations show, cited content, content contributes
备注：
点击查看摘要
Abstract:Visual citations show where an answer is supported, but not how the cited content contributes to it. In scientific document question answering, a model may read a value directly, compress several observations, or combine evidence to infer a conclusion. We study typed visual provenance, where a system generates an answer together with source regions and explicit support relations. We introduce ReViE, a dataset of 3,941 questions over complete scientific documents, with page, section, and region annotations labeled as Quotation, Compression, or Inference. We further propose VisProve, which augments joint answer and provenance generation with differentiable Spatial Evidence Reading and Evidence-Answer Relation Feedback. VisProve conditions next-token prediction on localized visual evidence and its estimated support relation through a gated norm-bounded residual. On the document-disjoint ReViE test set, VisProve improves Typed-F1 from 3.52 to 5.48 and Section-F1 from 45.99 to 53.24 over joint supervised fine-tuning with the same backbone, while Page-F1 changes only marginally. These results suggest that coupling visual grounding with support relation modeling mainly improves fine-grained provenance, while the low absolute Typed-F1 reveals a substantial gap between answer generation and precise visual evidence attribution.
207. 【2611.10637】VAComp: View-Aware Full Projector Compensation
链接：https://arxiv.org/abs/2611.10637
作者：Kai Zhou,Qingyue Deng,Bingyao Huang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：photometric distortions introduced, Full projector compensation, projector compensation adjusts, projection surface, distortions introduced
备注： 14 pages, 13 figures
点击查看摘要
Abstract:Full projector compensation adjusts a projector's input image to compensate for both geometric and photometric distortions introduced by the projection surface. Existing methods generally treat the viewing condition as a static camera viewpoint. When applied to a moving viewer, existing methods face two key challenges: (1) view-dependent methods require model retraining or recalibration to compensate for novel viewpoints; and (2) NeRF/GS-based view-agnostic methods use structure from motion (SfM) to calibrate the projector-camera systems (ProCams) with an unknown global scale, while view-aware tracking requires calibrating a camera oriented opposite to the projector, which introduces an additional calibration challenge. To address these challenges, we introduce VAComp, the first view-aware framework for full projector compensation for a moving viewer in a naked-eye setting. Using a projector, VAComp enables the viewer to perceive a virtual object that visually replaces the real object or to observe view-consistent modifications of the real object's appearance and material properties. To resolve the SfM scale ambiguity, we use metric calibration as a reference to recover the global scale; to calibrate the oppositely facing camera, we use two checkerboards, one facing the RGB camera and the other facing the depth camera. To balance compensation quality and runtime efficiency, we develop two non-iterative hybrid methods, VAComp-SD and VAComp-SI. Both combine 2D Gaussian-based view-conditioned geometric correction with learned photometric compensation, predicting each compensation image through a single forward pass without per-frame iterative optimization. Real-world experiments show that both methods achieve competitive compensation quality, with VAComp-SD enabling real-time updates and VAComp-SI operating at interactive rates. Project page: this https URL.
208. 【2611.10632】Latent-WAM++: Shaping World and Action Representations for End-to-End Autonomous Driving
链接：https://arxiv.org/abs/2611.10632
作者：Yichen Zhang,Yupeng Zheng,Linbo Wang,Pengxuan Yang,Zebin Xing,Junli Wang,Shiwei Li,Kangwei Liu,Fan Ren,Qichao Zhang,Yifeng Pan,Ji Tao,Dongbin Zhao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：World Action Model, Action Model, representation-centered World Action, autonomous driving, World Representation Construction
备注： 16 pages, including supplementary material
点击查看摘要
Abstract:We introduce Latent-WAM++, a representation-centered World Action Model (WAM) for end-to-end autonomous driving. Existing WAMs are primarily trained to predict future states or final actions, leaving the intermediate world and action representations that connect prediction to planning only indirectly constrained. Latent-WAM++ matches the supervision of each representation to its role in planning. World Representation Construction combines scene-ego future prediction, SIGReg-based distribution stabilization, and frozen geometric priors to learn a temporally predictive, non-degenerate, and geometry-aware world representation without an EMA target encoder. Trajectory MeanFlow Planner directly predicts multimodal trajectory proposals while being optimized with an Improved MeanFlow velocity-space objective, enabling one-step sampling. Visual-Action Representation Alignment further aligns the resulting pre-output action features with a stop-gradient target derived from current visual semantics. Latent-WAM++ achieves state-of-the-art performance on NAVSIM v2 and under zero-shot evaluation on HUGSIM, reaching 90.1 EPDMS on NAVSIM v2 and 47.0 average RC and 30.1 average HD-Score on HUGSIM. Training the planner end to end costs 190 GPU-hours for Latent-WAM++ versus 1,600 for Latent-WAM, a reduction of 88.1%.
209. 【2611.10626】EndoSCOP-V: A Multi-Turn Video Understanding Evaluation Framework for Multimodal Models in Endoscopy Reporting and Clinical Reasoning
链接：https://arxiv.org/abs/2611.10626
作者：Abhishek Tyagi,Tanmay Jain,Vilas Biradar,Krithi Krishna Koduri,Misba Hul Bashir Masoodi,Swetha Rapolu,Hardik Rughwani,Rachana Kotha,Anjan Kumar Kaipa,Anudeep Katrevula,Rakesh Garlapati,Aniruddha Pratap Singh,Rajendra Patel,Abhay Tyagi,Sundeep Lakhtakia,Mohan Ramchandani,Rakesh Kalapala,D. Nageshwar Reddy
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Endoscopic diagnosis unfolds, single positive finding, Endoscopic diagnosis, gastrointestinal tract sets, diagnosis unfolds
备注： NeurIPS 2026
点击查看摘要
Abstract:Endoscopic diagnosis unfolds over native video, where a single positive finding during traversal of the gastrointestinal tract sets off a multi-minute chain of reasoning over location, morphology, severity and intervention. Existing endoscopy multimodal benchmarks test only static images or single-disease videos, which miss the temporal and clinical reasoning that real-world reporting demands. We introduce EndoSCOP-V, a video-grounded multi-turn evaluation framework for structured endoscopy reporting and clinical reasoning. It contains 1,307 real-world endoscopy and colonoscopy videos (63.2 h; 97% 1080p) averaging about 174 s. Its 20,274 question-answer turns are instantiated deterministically from clinician-filled structured endoscopy-reporting EHRs, so no per-case annotation is synthetic or LLM-rephrased. They come from 1,033 clinician-reviewed templates, about 18 per disease, that span a clinically aligned 9-task x 30-sub-task reporting taxonomy over 54 World Endoscopy Organization (WEO) MST 3.0 diseases. 22% of procedures carry co-existing pathologies, up to six per case. A Markovian context-pruned oracle-forcing protocol evaluates the dialogue turn by turn, injecting the gold answer before each subsequent turn so that per-turn reasoning is isolated from cascading dialogue errors. A panel of 15 board-certified endoscopists sets a 78% strict-accuracy baseline on 1,500 questions. Across 14 open-weight LMMs, the best 27B-class model reaches 59.8% strict accuracy, falling to 53.4% once format-trivial disease-rejection items are excluded. On a between-subjects spot-check, the best of 3 frontier proprietary models trails the clinician panel by 23 pp on strict NDR accuracy. Sub-task analysis reveals consistent gaps in quantitative measurement, multi-variable grading and intervention reasoning on long-horizon video. Data: Hugging Face (EndoSCOP-V). Code: GitHub (abhi25t/EndoSCOP-V).
210. 【2611.10609】Reason First, Retrieve What Matters: Hypothesis-Guided Keyframe Selection for Long Video Understanding
链接：https://arxiv.org/abs/2611.10609
作者：Yisong Hu,Junbo Wang,Yuke Li,Jiangbin Zheng
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Long video understanding, video understanding requires, Long video, temporally distributed evidence, limited frame budgets
备注： 14 pages, 4 figures, 3 tables
点击查看摘要
Abstract:Long video understanding requires models to identify and reason over sparse, temporally distributed evidence within limited frame budgets. Existing keyframe selection methods typically retrieve query-relevant frames from a densely sampled candidate set before inference. However, global image-text matching incurs unnecessary computation when a small set of uniformly sampled frames already provides sufficient evidence. Query relevance alone may also overlook evidence that distinguishes competing answers, while one-shot selection offers no opportunity to correct earlier selection errors. We propose HypoKFS, a training-free, plug-and-play framework that couples keyframe selection with iterative inference by multimodal large language models (MLLMs). HypoKFS first reasons over sparsely sampled frames to construct an initial hypothesis space. The resulting answer distribution determines whether additional frame selection is needed. When needed, the retained hypotheses guide the selection of discriminative frames, followed by renewed inference and hypothesis refinement. This iterative process directs additional visual computation toward unresolved hypotheses while avoiding unnecessary global frame matching. Experiments on Video-MME, LongVideoBench, and MLVU demonstrate consistent improvements across multiple MLLM backbones. HypoKFS improves accuracy by up to 6.7 percentage points and achieves 72.9% accuracy on Video-MME at only 1.3% of the reference frame-hypothesis matching cost.
211. 【2611.10599】he RenAIssance: Caption-Guided Diffusion Models for Historical-Art Visual Media
链接：https://arxiv.org/abs/2611.10599
作者：Zhanyu Tuo
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM)
关键词：paired descriptions needed, expand cultural collections, artworks rarely provide, adapt modern image, historical artworks rarely
备注： Accepted at ACMMM26 RichMediaGAI. This work is co-funded by the European Union's Horizon Europe research and innovation programme under MSCA with grant agreement No 101081674
点击查看摘要
Abstract:Generative AI can expand cultural collections into prompt-responsive visual media, but historical artworks rarely provide the paired descriptions needed to adapt modern image generators. We present The RenAIssance, a scalable pipeline that turns a collection of historical European artworks into a reusable text-to-image media resource. The pipeline generates scene-level captions with BLIP and uses the resulting approximately 15,000 image--text pairs from DEArt to train a compact LoRA adapter for Stable Diffusion v1.5. The adapter shifts generated images toward the historical-art distribution while retaining the base model's ability to render novel concepts. On historical and contemporary prompts of different lengths, it improves FID to the DEArt reference distribution in every setting with only a modest decrease in CLIP text--image similarity. Qualitative results show that the same adapter can render both period-appropriate subjects and contemporary concepts in a coherent historical visual language. By decoupling a reusable style representation from the base generator, the approach offers a practical building block for controllable historical-art media creation, interactive authoring, and rich-media experiences.
212. 【2611.10592】MotionGraphicsBench: Evaluating Motion Graphics Generation with Programmatic Verification
链接：https://arxiv.org/abs/2611.10592
作者：Jiaju Ma,Ashvini Kumar Jindal,Chuhua Wang,Sumithra Bhakthavatsalam
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：natural language requests, Large language models, Large language, language requests, natural language
备注：
点击查看摘要
Abstract:Large language models can generate motion graphics from static images and natural language requests, but it remains difficult to evaluate how well models can follow requests that combine spatial, appearance, and temporal requirements. We introduce MotionGraphicsBench, an expert-curated benchmark of 100 instances for animating an input static SVG with a motion edit prompt. By supplying all required visual elements, our editing task reflects a designer-like workflow and isolates motion generation from graphic generation. Derived from real-world Lottie motion designs, our benchmark contains diverse combinations of spatio-temporal animation behaviors. Each benchmark instance pairs its model input with a deterministic, human-readable verification program that accepts different valid implementations and reports which prompt requirements pass or fail, rather than comparing against a reference animation or using a VLM judge. We construct these programs with a multi-agent pipeline using human-labeled animations and synthesized test cases. On a balanced test set of 180 animations, our programs achieve 93.3% raw agreement with human judgments, compared with 83.3% for a GPT-6 Astra VLM baseline, and outperform the baseline in both approval and rejection recall. Across 47 configurations from 32 LLMs and 12 providers, pass@1 ranges from 6.0% to 67.7%. Across 15 models evaluated at their highest available reasoning effort with 32 attempts per instance, additional attempts improve every model, but pass@32 still ranges from 38.0% to 95.0%. Our analysis of verification programs reveals that generated animations often fail to match reference poses, follow requested motion trajectories, or coordinate related events. We release our benchmark at this https URL.
213. 【2611.10578】EgoVeil: Personalized Privacy Reasoning for Egocentric Video
链接：https://arxiv.org/abs/2611.10578
作者：Xue Wang,Yang Zhang
类目：Human-Computer Interaction (cs.HC); Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY)
关键词：interpret egocentric video, Recent advances, vision-language models, egocentric video, advances in vision-language
备注： 19 pages, 8 figures, 4 tables
点击查看摘要
Abstract:Recent advances in vision-language models (VLMs) enable AI systems to interpret egocentric video. Yet continuous visual capture raises privacy concerns because sensitive content is pervasive and varies across users and contexts. We present EgoVeil, a personalized privacy reasoning system that determines which visual content to obscure based on individual preferences while retaining context useful for downstream assistance. It converts localized visual regions into structured semantic observations and combines a privacy reasoner with an explicit user-specific memory for personalized privacy reasoning. This design supports personalization and continual adaptation as preference evidence accumulates. We evaluate on in-the-wild data from 10 smart-glasses users under a cross-user chronological protocol. EgoVeil achieves 91.93% balanced accuracy and 84.42% Mask recall, outperforming direct VLM baselines and other controlled privacy reasoning baselines. Our results show that personalized, adaptive privacy reasoning better aligns privacy preservation with individual preferences while retaining the visual context needed for effective smart-glasses assistance.
214. 【2611.10575】ROLECUE: Diagnosing Cross-Lingual Role-Binding Failures in Vision-Language Models
链接：https://arxiv.org/abs/2611.10575
作者：Niaz Mohaiman Abtahi,Evan Maksud
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：bind visual Agent-Patient, visual Agent-Patient structure, role cues depend, Vision-language models, depend on morphology
备注： Accepted to WACV 2027, Evaluations and Datasets Track
点击查看摘要
Abstract:Vision-language models (VLMs) can recognize events in images and parse sentences, but it remains unclear when they bind visual Agent-Patient structure to linguistic semantic roles across languages whose role cues depend on morphology, word order or construction. We introduce ROLECUE, a controlled diagnostic that pairs 192 validated two-person action images with German, Turkish, Japanese, English, Korean and Bangla sentences in canonical and patient-first orders. The evaluation separates image-only role recognition, text-only role parsing, direct image-sentence matching, response-compliance behavior and an external modular composition of the model's own component predictions. Across eight recent open-weight VLMs, ROLECUE reveals a structured spectrum: some models fail visual or linguistic component tests, some largely solve the diagnostic, some collapse to constant semantic assent and several show component-joint gaps in which reliable image-only and text-only role predictions do not survive direct joint inference. The largest non-degenerate gaps reach 44.9 percentage points, with final bootstrap intervals confirming that the effect is not a point-estimate artifact. These results reveal multilingual component-joint performance gaps and acceptance biases hidden by aggregate VLM benchmarks and show why component diagnostics are necessary before interpreting joint multimodal errors.
215. 【2611.10571】Understanding the Effect of Visual Attention in CNNs: A Decision-Space Alignment Perspective
链接：https://arxiv.org/abs/2611.10571
作者：Niladri B. Puhan,K. Kamala Priya
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Visual Attention enhances, convolutional neural networks, enhances convolutional neural, Attention enhances convolutional, modulating intermediate features
备注：
点击查看摘要
Abstract:Visual Attention enhances convolutional neural networks (CNNs) by modulating intermediate features, yet their effects on downstream decisions remain less understood. We present a decision-space framework that models multiplicative attention as an intermediate feature perturbation and derives a first-order prediction of its effect on the target-versus-competitor classification margin. We further introduce the Decision Alignment Score (DAS) to quantify the directional alignment between the perturbation and the local margin gradient. We evaluate the framework on CIFAR-100 using SimAM and CBAM across five popular CNN backbones, ResNet-18, ResNet-20, ResNet-50, ResNet-56, and MobileNetV2. The analysis examines prediction agreement, DAS margin correlations, and downstream activation-state changes. Across most final-attention configurations, predicted and actual margin changes show good agreement, while DAS exhibits positive correlations with actual margin changes. Single-attention experiments further show that prediction agreement and DAS margin correlations depend on attention placement, with stronger associations at later stages.
216. 【2611.10562】ZARA: Zero-shot Animatable and Relightable 3D Avatar reconstruction from a single image
链接：https://arxiv.org/abs/2611.10562
作者：Yixiao Chen,Dongdong Weng,Chengfeng Zhao,Tao Gong,Zhihe Zhao,Zhe Zhu,Yue Liu,Yuan Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Recent large human, Recent large, models create remarkable, create remarkable animatable, appearance remains entangled
备注：
点击查看摘要
Abstract:Recent large human reconstruction models create remarkable animatable 3D avatars from a single image, but their appearance remains entangled with the illumination and cannot be relighted. In contrast, existing 3D relightable-avatar reconstruction methods typically require person-specific optimization. We present ZARA, a zero-shot feed-forward framework that reconstructs an animatable 3D Gaussian avatar together with its intrinsic attributes from a single image. ZARA couples a pretrained large-scale human reconstruction model with a Material Transformer to inherit geometry priors while learning material-aware Gaussian representations. To preserve localized details, we introduce Gaussian-aligned material feature fusion strategy, which injects multi-scale material features onto individual Gaussians and combines them with geometry tokens. As most human-avatar datasets lack ground-truth material maps, we use pseudo-material labels as conditioning inputs and supervision targets during training. We further introduce MatFace regularization to preserve facial structure and color in albedo prediction under unreliable facial pseudo-material supervision. Extensive experiments demonstrate that ZARA reconstructs animatable and relightable humans within tens of seconds without person-specific optimization or post-processing, outperforming existing baselines in both relighting quality and materials generalization ability. As the ability of recovering the physically-based-rendering attributes of the human, ZARA also enables direct material editing of the avatar's appearance.
217. 【2611.10559】CompositionEvidence: Controlling Geometric Evidence for Cinematic Composition Reasoning with Frozen Vision-Language Models
链接：https://arxiv.org/abs/2611.10559
作者：Yichen He,Xin Huang,Yuxi Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Cinematic composition questions, Cinematic composition, Cinematic, in-frame geometry, depend on in-frame
备注： Accepted at the 33rd International Conference on MultiMedia Modeling (MMM 2027)
点击查看摘要
Abstract:Cinematic composition questions depend on in-frame geometry that vision-language models (VLMs) use inconsistently. External perception tools can expose this geometry, but naive prompt injection can overwrite useful visual predictions. On ShotBench composition, pre-question geometry reduces Qwen2.5-VL-7B from 49.5% to 46.3%; corrupted measurements lower it to 33.6%. CompositionEvidence derives nine reproducible features from frozen detection, depth, and line experts and supplies their shared 24-dimensional representation through two interfaces. A training-free channel appends gated neutral evidence after the question, reaching 56.2% (+6.7, exact McNemar p=0.0018) and 48.4% under corrupted evidence. A minimal-training channel maps the same representation to four soft tokens with a 7.37M-parameter projector while leaving the VLM frozen; it reaches 61.0% (+11.5). Across nine VLMs, including five commercial models queried through official provider APIs, zero-shot accuracy ranges from 43.8% to 63.0%, and the text channel changes it by +6.7 to -6.9 points; the highest baseline is among the regressions. The effect of explicit geometry depends on measurement reliability and on how the receiving model integrates it.
218. 【2611.10552】Seeing Isn't Enough: Unlocking Visual Reasoning by Bridging the Reasoning-Access Gap with TIGER
链接：https://arxiv.org/abs/2611.10552
作者：Gregory Kang Ruey Lau(1 and 2),Minh Huynh Nguyen(1),Bryan Kian Hsiang Low(1) ((1) Department of Computer Science, National University of Singapore, Singapore, (2) CNRS@CREATE, Singapore)
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Multimodal Large Language, Large Language Models, Large Language, inherit strong textual, language backbones
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:Multimodal Large Language Models (MLLMs) inherit strong textual reasoning capabilities from their language backbones and text pretraining, but often fail to apply the same level of competency to visual inputs. We show that this degradation cannot be attributed to only perception failures, by evaluating models on semantically-equivalent text and rendered-text image inputs: models can accurately read text in the images and recover near-text performance when provided their own transcriptions, but just cannot reason well on the images directly. We characterize this discrepancy as a modality reasoning-access gap, where models fail to route perceived visual content into existing reasoning machinery accessible with text. To bridge this, we propose TIGER (Text-to-Image Gap-targeted training for Enhanced Reasoning), which first mines synthetic modality counterfactuals where a model succeeds on a text problem but fails when provided the corresponding rendered image, and post-trains the model on the image input via Group Relative Policy Optimization (GRPO), along with SFT and DPO variants. Importantly, although trained exclusively on synthetic rendered-text images with no multimodal annotations, TIGER results in model performance improvements across diverse real-world visual benchmarks including geometric diagrams (MathVerse), multi-disciplinary sciences (EMMA, MMMU), complex charts (ChartQAPro), and embodied spatial reasoning (RoboSpatial-Home). TIGER also complements existing state-of-the-art RLVR visual reasoning methods, yielding further performance gains. Analysis involving reasoning-subspace activation and activation patching provide support indicating that TIGER helps to align visual-to-reasoning pathways toward text reasoning states. Our implementation is available at this https URL.
219. 【2611.10547】HSGNav: Hypothesis Scene Graphs for Multi-Scale Lifelong Navigation under Object Relocation
链接：https://arxiv.org/abs/2611.10547
作者：Kaiyao Liao,Qingfeng Li,Chen Chen,Qing Sun,Ningbo Gu,Xiaoze Wu,Haochen Zhao,Ying Li,Jianwei Niu
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：tiny tabletop items, people move objects, repeatedly locate targets, real homes, assistive robots
备注： 11 pages, 4 figures, 4 tables
点击查看摘要
Abstract:In real homes, assistive robots must repeatedly locate targets from large furniture to tiny tabletop items, as people move objects between household surfaces. Uniformly instantiating detections at different scales as 3D objects can be brittle for small on-surface items; without explicit object-state validation, stale entries may persist after scene changes. Our key insight is to separate persistent 3D furniture entities from revisable surface-object hypotheses, retaining their visual evidence without requiring independent object geometry. We formalize this design as the Hypothesis Scene Graph (HSG), which preserves small-object evidence and supports local revision without rebuilding the stable entity topology. Building on HSG, HSGNav uses this separation for multi-scale lifelong navigation: retrieval selects entity or hypothesis evidence according to target scale, exploration acquires additional surface observations, and verification confirms target presence or invalidates contradicted hypothesis records. Because existing lifelong benchmarks such as GOAT-Bench rarely require mid-episode memory invalidation or multi-scale search, we introduce FAROS-Bench (Find And Re-find Objects across Scales) for mid-episode relocation of surface objects and multi-scale find goals. Experiments show that HSGNav performs competitively on GOAT-Bench while substantially outperforming prior methods on FAROS-Bench.
220. 【2611.10528】PrivMark: Pixel-Space Steering against Privacy Leakage in Vision-Language Models
链接：https://arxiv.org/abs/2611.10528
作者：Ruofan Xing,Arman Akbari,Weikai Lin,Yuhao Zhu,Xuan Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：exposing demographic information, routinely disclose soft-biometric, downstream API user, disclose soft-biometric attributes, routinely disclose
备注： 33 pages, 12 figures
点击查看摘要
Abstract:Vision-language models (VLMs) routinely disclose soft-biometric attributes such as age, gender, and race in their text outputs, exposing demographic information from uploaded images to any downstream API user. Existing privacy defenses do not fit this setting: face de-identification leaves distributed soft-biometric cues intact, classifier-targeted adversarial perturbations do not transfer to open-ended generation, and stronger VLM-specific methods require retraining or runtime activation access unavailable to downstream APIs. We propose PrivMark, a framework that suppresses biometric leakage at the image level. By analyzing VLM activations, we identify two weakly aligned steering vector directions in hidden-state space, each tied to a distinct leakage behavior --- one corresponding to incidental attribute disclosure under open-ended descriptions, the other to compliance with direct biometric probes instead of refusal --- and encode both directions into a single bounded pixel perturbation, so the protected image alone enforces privacy with no invasive access to model internals at deployment. To support evaluation, we assemble BioleakBench, $1{,}600$ VQA pairs covering biometric privacy attributes under both free-form description and direct-probe protocols. Across three white-box source models, PrivMark achieves up to $85.9\%$ biometric suppression while retaining $75\%$ of clean OK-VQA utility, up to $1.4\times$ the privacy-utility tradeoff of the strongest pixel-only baseline. The same one-shot perturbations transfer consistently to seven unseen VLMs including closed-source APIs.
221. 【2611.10523】Action Transfer Across Character Body Plans in Latent-Action World Models: An Empirical Study of Animated Characters
链接：https://arxiv.org/abs/2611.10523
作者：Amarnath R
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Machine Learning (cs.LG)
关键词：Latent-action world models, recent methods aim, Latent-action world, world models learn, video without labels
备注： 28 pages, 13 figures, 8 tables. Dataset: [this https URL](https://huggingface.co/datasets/amarnathresearch/synthetic-2d-body-plans)
点击查看摘要
Abstract:Latent-action world models learn actions from video without labels, and recent methods aim to share these actions across bodies. Transfer between 2D characters with different body structures remains underexplored. In this paper, we study whether an action learned from one character can make a character with a different body perform the same action. A cat, a blob and a human can all jump, but each moves its body in its own way. The usual transfer gain mixes body motion with screen movement and can assign a perfect score to a model that ignores its action. To address this, we introduce a transfer score that compares the correct action with wrong ones from the same source. We test five training objectives on a new synthetic benchmark of 2D cartoon characters with six body plans, the standard Sprites benchmark, and 431 selected animal and human animations from DeformingThings4D. With a fixed camera, a baseline that only copies the source's screen movement scores 0.71, as high as most learned models. In contrast, with a camera that follows the body, the best model reaches only 0.46 for an unseen animal family and 0.20 for humans. With this camera, a linear probe identifies the action class of unseen animal families with 66% to 86% balanced accuracy (chance 17%). The learned actions therefore retain information about which action is performed, but the correct action closes only part of the prediction error gap for a new character.
222. 【2611.10518】Beyond Row Alignment: Virtual-Camera-Aware Online Stereo Rectification
链接：https://arxiv.org/abs/2611.10518
作者：Yizhao Peng,Rui Gong,Zaiwang Gu,Xudong Jiang,Jun Cheng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Stereo, accurately calibrated, Online stereo rectification, image, comparing the left
备注： Accepted as poster in NeurIPS 2026
点击查看摘要
Abstract:Stereo matchers estimate depth by comparing the left and right images from a stereo camera pair, but they assume that the two cameras are accurately calibrated and rectified. In real deployments, small physical shifts after calibration, caused by camera motion, mechanical drift, vibration, or installation changes, can break this assumption and degrade depth estimation. Online stereo rectification is therefore needed to correct the image pair during operation and recover a stereo geometry where standard stereo matching can work reliably. Recent online rectification methods mainly optimize row alignment, making the left and right views of the same scene point fall on the same image row. We show that this target, while necessary, is insufficient for deployable stereo depth estimation. A rectifier may make a small set of matched points look well row-aligned, but still distort the full images in ways that hurt stereo matching: useful image regions may be cut off, large blank areas may appear, objects may be stretched or squeezed, or image scale may change unevenly across the view. We propose VirtualRect, an online stereo rectification method designed for reliable real-world deployment. Rather than treating rectification as simply making the left and right image rows line up, this method estimates a rectified virtual stereo camera and combines image-wide supervision of image warp behavior. This makes the rectified images and the camera parameters come from the same geometry, so the images used for matching and the model used for depth computation remain consistent. Experiments on multiple datasets show that, compared with the prior state-of-the-art online rectifier, VirtualRect reduces vertical flow error by 17% on Carla-Flowguided and 7% on Semi-Truck Highway, and lowers depth MAE by 30-41% on Carla-Flowguided across three downstream stereo matchers.
223. 【2611.10509】Scaling Optimization-Oriented Hypernetworks for Implicit Neural Representations
链接：https://arxiv.org/abs/2611.10509
作者：Lulu Cai,Hanxiang Ren,Siyan Dong,Li Sun,Jiefeng Wu,Youyi Zheng,Yi Ma,Yanchao Yang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：single forward pass, implicit neural representation, forward pass, test-time optimization, implicit neural
备注： 33 pages, including appendices. Code: [this https URL](https://github.com/lulucai435/hyper-inrs)
点击查看摘要
Abstract:We present a hypernetwork that generates the parameters of an implicit neural representation (INR) for a given signal in a single forward pass, without test-time optimization. Existing hypernetworks for this problem either ignore the chain-rule structure of the test-time optimization that produces an INR or, when they preserve it, instantiate the structure with MLPs whose parameter count grows quartically in target-network width. Our central contribution is to show that this parameter-count cost is structural to the MLP instantiation, not to the optimization-oriented principle of preserving chain-rule structure, and to resolve it by replacing the MLP body with attention. The resulting hypernetwork combines three design choices: an output-neuron-centric tokenization that aligns the token axis with each layer's output-neuron axis; an information-flow consistency rule that fixes the role of every cross-attention module from the representation its output should occupy; and a token-space iterative rollout that realizes the five quantities one optimization step on the target INR computes as five cross-attention modules with parameter count independent of target-network width. Across five 2D and 3D INR generation benchmarks, our method outperforms the state-of-the-art single-pass and optimization-oriented baselines; scales to target-network widths at which the MLP-based optimization-oriented paradigm exhausts GPU memory; and produces the highest result on NeRF generation without ground-truth INR weights supervision.
224. 【2611.10506】SRA: Spatial Reasoning Adapter via Evolving Social Interaction Graphs for Trajectory Prediction
链接：https://arxiv.org/abs/2611.10506
作者：Jaewoo Jeong,Seonkyu Song,Hyeonwoo Park,Jegyeong Cho,Yujin Bae,Giwon Lee,Daehee Park,Kuk-Jin Yoon
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Predicting where multiple, autonomous driving, people safely, fundamental to autonomous, share space
备注： Accepted to NeurIPS 2026
点击查看摘要
Abstract:Predicting where multiple agents will move next is fundamental to autonomous driving, robotics, and any system that must share space with people safely. Modern stochastic predictors read off inter-agent interactions once from the observed past and keep that view fixed throughout the generative rollout, so the reciprocal geometric constraints that emerge as the joint future sharpens are not re-examined. We address this gap with SRA (Spatial Reasoning Adapter), a modular graph denoiser that is integrated into existing diffusion and flow-matching predictors without redesigning their generative cores. At every reverse step, SRA reads the host's current future estimate, builds a sparse Euclidean interaction graph on the predicted trajectories, and returns a residual correction to the host's decoding path. Our adapter consists of three core components: a sparse neighborhood retrieved with a learned query-key score and a geometric bias, a future-conditioned relational feature recomputed on the evolving prediction, and uncertainty-weighted message passing where confident agents act as anchors for uncertain ones. We instantiate SRA on three structurally different hosts (LED, MID, and MoFlow) across four multi-agent benchmarks: SDD, NBA, Soccer, and Football. SRA improves ADE for every host on every dataset, with average gains of 5.8% in ADE and 7.0% in FDE. A cumulative ablation shows that the three components act as one mechanism: only together do they improve every host on every sports dataset, indicating that spatial reasoning over the model's own evolving future, weighted by how far that future can be trusted, is broadly useful across denoising architectures. Code is available at this https URL.
225. 【2611.10503】Learning a Unified Cross-Model Semantic Dictionary via Gated Bottleneck Sparse Autoencoders
链接：https://arxiv.org/abs/2611.10503
作者：Jinchi Zhu,Tie Luo
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：similar data distributions, data distributions tend, learn overlapping semantic, Gated Bottleneck Sparse, Bottleneck Sparse Autoencoder
备注： The 40th Annual Conference on Neural Information Processing Systems (NeurIPS 2026)
点击查看摘要
Abstract:Foundation models pretrained on similar data distributions tend to learn overlapping semantic structure, but their representations are distinct due to different model architecture, pretraining objectives and protocols. This prevents unified interpretability and cross-model feature reuse. Existing approaches extract interpretable concepts from individual models and align these concepts in a shared coordinate system using cross-reconstruction objectives, but the alignment only applies to latent coordinates while the concepts themselves remain model-specific and cannot be shared or reused. This paper introduces the Gated Bottleneck Sparse Autoencoder (GB-SAE), which casts unified cross-model interpretability as a representation factorization problem and solves it by simultaneously learning a unified shared dictionary and multiple private model-specific dictionaries via a gated bottleneck sparse autoencoder framework. The shared dictionary encodes the cross-model common semantic structure in unified concepts that are reusable across all participating models (and beyond), while each private dictionary comprises residual concepts that capture model-specific biases. We evaluate GB-SAE with distinct foundation models including ViT, SigLIP, DINOv2, and ConvNeXt. GB-SAE demonstrates superior reconstruction capability, unified and faithful interpretability, strong reusability and generalization to unseen models and downstream tasks. The code is available at this https URL.
226. 【2611.10498】EmbodiedIntentBench: Benchmarking Intent-Driven Runtime Adaptation for Mobile Robotic Missions
链接：https://arxiv.org/abs/2611.10498
作者：Rajat Bhattacharjya,Changwoon Lee,Hyeonjong Ju,Sing-Yao Wu,Hamidreza Alikhani,Zhuoyi Yang,Ian Harris,Nalini Venkatasubramanian,Nikil Dutt
类目：Robotics (cs.RO); Hardware Architecture (cs.AR); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)
关键词：robotic sensing systems, Mobile robotic sensing, observation opportunities shaped, operator requirements, Mobile robotic
备注： Paper is currently under review. Authors' version posted for personal use and not for redistribution
点击查看摘要
Abstract:Mobile robotic sensing systems must adapt to operator requirements, limited resources, changing connectivity, and observation opportunities shaped by physical motion. Evaluating runtime strategies therefore requires assessing whether their decisions fulfill mission objectives, beyond isolated perception accuracy or execution efficiency. We present EmbodiedIntentBench, a benchmark for intent-driven runtime adaptation in mobile robotic missions. It represents mission intent through structured contracts for coverage, temporal evidence, reporting, urgency, and resources, and couples simulated unmanned aerial vehicle (UAV) workloads with causal, resource-accounted execution. Computation decisions affect mission time, resource use, and which observations can contribute evidence. We evaluate fixed and adaptive perception strategies in multi-phase missions and under changing urgency, connectivity, and battery conditions. In the multi-phase Depot study, a configuration with 87.5% full-bank target recall across visible target observations completes only 1 of 16 missions, whereas a lower-recall configuration completes 14. In an ablation, ignoring execution-induced observation loss increases aggregate mission success and reverses the ordering of two runtime strategies. Replays using Jetson AGX Orin CPU and GPU profiles change the relative success of local and remote strategies. In selected Jetson GPU-profile replays, intent-driven adaptation reduces modeled task energy by up to 28% with unchanged mission success. EmbodiedIntentBench provides an extensible framework for evaluating runtime decisions against mission fulfillment under physical and resource constraints.
227. 【2611.10497】Disentangling Channel Semantics in Vision Transformers via Token Decorrelation and Composition-Aware Modulation
链接：https://arxiv.org/abs/2611.10497
作者：Daeun Kim,Hyesong Choi,Hyejin Park,Dongbo Min
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：images encode heterogeneous, shared spatial structure, Multi-channel images encode, encode heterogeneous channel, multi-channel Vision Transformers
备注： Accepted at NeurIPS 2026. 32 pages, 12 figures
点击查看摘要
Abstract:Multi-channel images encode heterogeneous channel semantics aligned over a shared spatial structure, which requires models to jointly capture globally shared structure and channel-specific variations. Recent multi-channel Vision Transformers attempt to address this challenge by augmenting the [CLS] token with memory tokens to organize multi-channel representations under varying channel compositions. However, we find that these context tokens collapse onto a few dominant channels under high inter-channel redundancy, producing redundant representations and a biased global summary that fails to reliably support composition-aware channel interpretation. We propose MuCa-ViT (Multi-Channel Composition-Aware Vision Transformer), a unified framework that addresses these limitations through two coupled mechanisms. Factorial Token Learning (FTL) enforces token-level decorrelation among context tokens, encouraging the [CLS] token to capture globally shared semantics while memory tokens preserve complementary channel-specific cues. Channel Composition-Aware Modulation (CAM) uses the FTL-refined [CLS] as a semantic anchor to generate sample-wise modulation signals, which enable composition-aware interpretation of channels within a unified backbone rather than relying on static channel embeddings. Experiments on JUMP-CP, CHAMMI, and So2Sat show that MuCa-ViT outperforms prior multi-channel ViTs across all three benchmarks, and the magnitude of improvement aligns with the inter-channel redundancy of each dataset ($\rho \in [0.19, 0.77]$), validating the diagnostic analysis that motivates our design. Our code is available at this https URL .
228. 【2611.10485】Decoupling Direction and Magnitude: Language-Steered Flow Matching for Super-Resolution in the Dark
链接：https://arxiv.org/abs/2611.10485
作者：Jiaxin Gao,Ziyu Yue,Yaohua Liu,Danchen Cui,Zhihui Zhao,Zhixun Su
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：reconstruct missing details, prevent hallucinated textures, demand aggressive generative, aggressive generative enhancement, well-exposed areas require
备注： Accepted at NeurIPS 2026 (poster). 32 pages, 12 figures, and 13 tables. Code and pretrained models: [this https URL](https://github.com/moriyaya/DeLang-SR)
点击查看摘要
Abstract:Image super-resolution in the dark is fundamentally challenged by extreme spatial heterogeneity: severely underexposed and noisy regions demand aggressive generative enhancement to reconstruct missing details, while relatively well-exposed areas require conservative updates to prevent hallucinated textures. Standard diffusion and flow-matching models, however, rely on globally uniform integration trajectories, making them sub-optimal for such spatially varying degradations. In this paper, we propose DeLang-SR (Degradation-Language steered Super-Resolution), a one-step flow-matching framework that explicitly decouples the restoration direction and magnitude. Rather than treating low-light corruption as arbitrary latent features, DeLang-SR translates measurable physical statistics into structured degradation language, harnessing the semantic prior of pretrained text-to-image models. The degradation-language intent, complemented by image-specific visual tokens, steers the velocity field (direction) toward restoration-relevant manifolds. Simultaneously, a continuous spatial update-strength field acts as a locally varying Euler step-size field (magnitude), applying stronger integration steps in heavily degraded shadows while enforcing conservative updates in reliable regions. Experiments on paired and real dark images, together with ablations and diagnostic analyses, show that DeLang-SR provides an effective and interpretable one-step route to super-resolution in the dark. Code and pretrained models are available at this https URL.
229. 【2611.10484】Can General-Purpose Generative AI Supply Training Data for Medical Vision Models? A Multimodal Retrospective Study
链接：https://arxiv.org/abs/2611.10484
作者：Jiachuan Peng,Kyle Lam,Jierui Qu,Lin Li,Haining Zheng,Bang Zheng,Aniruddha Agarwal,Zaki Almallah,Min Chen,Vicente Grau,Hagai Rossman,Eran Segal,Jianing Qiu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：imaging datasets remain, diverse medical imaging, evaluated Nano Banana, medical imaging datasets, Nano Banana
备注：
点击查看摘要
Abstract:Background: Well-annotated, diverse medical imaging datasets remain a major constraint for vision-based medical AI. We evaluated Nano Banana, a general-purpose image generation and editing model, as a source of synthetic medical images for model training, subgroup augmentation, and model auditing. Methods: In this retrospective study across four imaging modalities, chest radiography, fundus photography, and CT models were trained only on synthetic images and externally validated on real-world data against real-data-trained models. Carotid ultrasound models were trained on a private Human Phenotype Project cohort (aged 40-75 years) with and without synthetic augmentation. Clinicians rated image plausibility. Evaluation used AUROC, AUPR, calibration, and decision curve analysis. Findings: Synthetic-only models achieved AUROCs of 0.877 (95% CI 0.843-0.910) for pneumonia (n=14863), 0.963 (0.948-0.975) for retinal detachment (n=1149), and 0.711 (0.600-0.823) for renal calculus (n=4122), comparable to real-data-trained models, but their calibration and net benefit were not consistently more favorable. With mixed synthetic-real training, a carotid ultrasound model produced an ordinal vascular age index that stratified 633 external subjects into subgroups differing in BMI and glucose (both p0.01), linking vascular aging to cardiometabolic health. To stress-test shortcut learning, editing a moderate tessellated pattern into fundus photographs reduced the true-class probability for central serous chorioretinopathy from 0.996 to 0.822. Clinician-guided editing raised low-quality CT plausibility from 3.10/5 to 4.30/5. Interpretation: Synthetic data can complement real data in model training, subgroup representation, and model testing via controlled editing, but its clinical value should be assessed with calibration, decision curve analysis, and clinician review, not discrimination alone.
230. 【2611.10483】hey Can See It but Not Say It: Iterative Self Knowledge Re-expression in Visual Reasoning Relative Pose Identification
链接：https://arxiv.org/abs/2611.10483
作者：Mengyu Wang,Ken Deng,Yftah Ziser,Shay B. Cohen,Tiejun Ma
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：relative pose identification, modern vision-language models, exposed critical weaknesses, spatial reasoning capabilities, pose identification
备注： Accepted as NeurIPS 2026 Oral
点击查看摘要
Abstract:The task of visual reasoning relative pose identification (VRRPI) has exposed critical weaknesses in the multi-view 3D spatial reasoning capabilities of modern vision-language models (VLMs). We present a systematic analysis of VLMs' behavior in VRRPI, uncovering stable output biases where VLMs disproportionately predict specific motion patterns regardless of visual evidence. To mitigate these inherent biases, we propose self knowledge re-expression with iterative debiasing (SKR-ID), an annotation-free pipeline that adapts VLMs for VRRPI using only randomly extracted unannotated image pairs. SKR-ID transitions VLMs' output mechanism from generic next-token prediction to task-optimized classification heads. The pipeline proceeds in two stages: (1) a cold-start initialization using debiasing object-centric prompts to anchor motion inference in 2D visual evidence; and (2) a recursive logit-ranking mechanism that enforces statistical parity by using the median logit value as a dynamic threshold. Experimental evaluation across frontier VLMs on standard benchmarks demonstrates that SKR-ID significantly mitigates systematic biases. Our method improves open-source VLMs' Macro-F1 scores from 35.0-45.4% to 53.7-58.0%, without using any annotated data. These results show that SKR-ID can effectively improve 3D reasoning performance from a severely collapsed baseline. The code is publicly available at this https URL.
231. 【2611.10475】WordEval: Evaluating Word-Native Operation Fidelity in Document Editing
链接：https://arxiv.org/abs/2611.10475
作者：Jinyoung Park,Yupan Huang,Shimin Zhang,Jiayu Ding,Yilin Jia,Yuzhong Zhao,Tengchao Lv,Wenshan Wu,Shaohan Huang,Nan Yang,Xiangyang Zhou,Dongdong Zhang,Li Dong,Lei Cui,Sun Mao,Xun Wang,Tao Ge,Huitian Jiao,Si-Qing Chen,Changick Kim,Furu Wei
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Microsoft Word, central environment, faithful execution, important capability, Word
备注： Accepted at NeurIPS 2026 (Evaluations and Datasets Track). Project page with code and data at [this https URL](https://aka.ms/word-eval)
点击查看摘要
Abstract:Microsoft Word is a central environment for office automation, and the faithful execution of its editing operations is an important capability for document agents. Unlike plain-text editing, editing in Word modifies a structured object model, where the requested effect is realized in object properties. Existing benchmarks, however, evaluate office workflows or desktop automation, treating word-processor documents as one task domain among many and verifying outcomes with keyword matching, per-task property checks, or screenshot comparison. We introduce WordEval, an operation-fidelity benchmark that instead centers evaluation on Word editing operations, testing whether each requested edit is realized as intended changes to Word objects and properties. It contains 642 cases across 15 Word feature areas, ranging from text and lists to charts, shape geometry, and SmartArt. 546 atomic cases cover 231 commands, 96 compositional cases combine multiple edits in a single document, and a Word-native oracle checks task-specific object properties and preservation conditions. Cases are constructed from editing-unit specifications, yielding controlled input documents, reference documents, and aligned oracle checks. Each compositional case is linked to corresponding atomic cases, supporting fine-grained diagnosis of editing failures. We evaluate eight agent systems and find that many struggle on the Atomic track, with performance varying across feature areas. Moreover, every system scores lower on Compositional than on Atomic, with gaps that vary substantially by system. Exact atomic-intent links and recorded failure diagnoses provide complementary views of this variation.
232. 【2611.10448】ESTRA: Enabling Extreme Attention Sparsity for Training-Free Video Diffusion Acceleration
链接：https://arxiv.org/abs/2611.10448
作者：Enhuai Liu,Yunke Wang,Yutong Wang,Changming Sun
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Video diffusion transformers, generate high-quality videos, inference computationally expensive, diffusion transformers generate, transformers generate high-quality
备注：
点击查看摘要
Abstract:Video diffusion transformers generate high-quality videos, but attention over long spatiotemporal sequences makes inference computationally expensive. Sparse attention reduces this cost by computing only a subset of query-key interactions exactly, and recent training-free methods further approximate the remaining interactions. These methods, however, degrade quickly at high sparsity, which limits the achievable speedup. We present ESTRA (Extreme Sparsity Through Refined Attention), a training-free acceleration method that preserves generation quality even at extreme sparsity. ESTRA concentrates exact attention computation on a small set of important key-value tokens and approximates the remaining contributions with cluster representatives. To identify these tokens efficiently, it groups similar queries and uses their representatives to score individual keys. A variance-based correction further refines the attention weights of the cluster representatives, improving the accuracy of the approximation. Experiments on Wan2.1-14B and HunyuanVideo-13B show that ESTRA establishes a new quality-efficiency frontier for training-free sparse attention, achieving $3.26\times$ and $4.71\times$ end-to-end speedups at 5% attention density while surpassing Sol-Attn and SVG-EAR in fidelity to dense generation and on most VBench dimensions. Even at 1% density, ESTRA remains more faithful to dense generation than Sol-Attn at 12.5%, while reaching up to $5.39\times$ speedup.
233. 【2611.10441】Split and Bridge: Multimodal Generation via Diffusion Bridging
链接：https://arxiv.org/abs/2611.10441
作者：Ahmad Arrabi,Xiaohan Zhang,Xingyu Li,Safwan Wshah
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：multiple complementary modalities, Visual data, complementary modalities, segmentation masks, underlying structure
备注：
点击查看摘要
Abstract:Visual data are often expressed through multiple complementary modalities (e.g., images and segmentation masks), each capturing different aspects of the same underlying structure. Most existing multimodal methods adopt a top-down paradigm, learning a shared latent variable through joint training from scratch, which limits scalability. We propose Split and Bridge (SnB), a bottom-up framework for multimodal generation that couples pretrained unimodal diffusion models at sampling time. Rather than learning a unified latent space, SnB generates coherent multimodal samples by following a shared diffusion trajectory up to a split point and then branching into modality-specific trajectories guided by a bridge module. This design enables plug-and-play reuse of powerful pretrained models without joint training, making it scalable and easily adaptable. Across standard benchmarks (PolyMNIST, CelebAMask-HQ) and more complex settings (PIE-Bench++, ROCO), SnB achieves a strong balance between sample quality and coherence. We show that SnB naturally extends to downstream zero-shot tasks such as interleaved co-generation, image editing, and style coupling/decoupling. Our results demonstrate that bottom-up generation provides a practical framework that complements existing top-down multimodal approaches. Code is available at this https URL
234. 【2611.10423】Mental Imagery That Matters: Curing Latent Collapse in Multimodal Reasoning
链接：https://arxiv.org/abs/2611.10423
作者：Mi Luo,Rohan Dugad,Zihui Xue,Alex Dimakis,Kristen Grauman
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：flexible human cognition, current multimodal large, multimodal large language, large language models, Mental simulation
备注： Accepted by NeurIPS 2026, Project page: [this https URL](https://vision.cs.utexas.edu/projects/AnchorSim/)
点击查看摘要
Abstract:Mental simulation, the ability to reason by constructing and updating internal visual states, is central to flexible human cognition, but remains elusive in current multimodal large language models. Latent multimodal reasoning offers a promising route toward this capability by interleaving text with continuous visual latent blocks, allowing models to maintain internal visual workspaces without decoding them into pixels. In this paper, we ask whether these latent visual states actually matter. Through a direct perturbation analysis across representative latent-reasoning MLLMs, we find that they often do not: dropping, replacing, or shuffling generated visual latents has only minor effects on the model's own final-answer probability, while equivalent perturbations to the linguistic reasoning trace are substantially more damaging. We call this failure mode Mental Simulation Collapse (MSC): the model appears to perform interleaved visual reasoning, but routes most answer-relevant computation through text. We further diagnose that MSC follows naturally from existing training objectives: visual alignment can make generated latents resemble helper-image embeddings, but it does not require the decoder to rely on them; subsequent text-only supervision further leaves the semantic role of the latent pathway unidentifiable. To address this, we introduce AnchorSim (Anchored Mental Simulation), a contrastive distillation framework that trains models to make their generated visual latents consequential. Across multiple visual reasoning benchmarks, AnchorSim improves performance, while diagnostic re-evaluation shows that visual perturbations now meaningfully affect predictions. Our results expose a fundamental failure mode of latent multimodal reasoning and demonstrate that mental simulation must be anchored to model behavior in order to matter.
235. 【2611.10416】S2HAND: Accuracy-Preservation Trade-Offs for Hand Specialization in Whole-Body Pose Models
链接：https://arxiv.org/abs/2611.10416
作者：Singyu Muk,Xuanren Song,Kalin Stefanov
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：estimators jointly predict, jointly predict body, pose estimators jointly, Unified whole-body pose, degrade on small
备注： 39 pages, including appendices. Code and models: [this https URL](https://github.com/ronggong000/S2HAND)
点击查看摘要
Abstract:Unified whole-body pose estimators jointly predict body, face, and hand landmarks, but often degrade on small, blurred, or occluded hands. Attaching a standalone hand specialist introduces extra detection overhead, coordinate alignment, and wrist-stitching artifacts. We introduce S2HAND, a hand-specialized Sapiens2-5B framework that preserves the native 308-keypoint output interface. Specifically, S2HAND-MT adapts a lightweight 0.87M-parameter pose branch to route 40 finger heatmaps while strictly preserving the shared Transformer, auxiliary task heads, and the other 268 body, foot, and face heatmaps. S2HAND-Pose further fine-tunes three Fisher-selected Transformer blocks (267.13M parameters), trading exact preservation for stronger hand recovery: it lifts macro AUC from 57.83% to 65.73% across HInt TEST, COCO WholeBody VAL, and FreiHAND EVAL, and surpasses HInt-adapted Hand5/HRNet and stitched Hand5 systems on all five Native Pipeline benchmarks. On COCO, S2HAND-Pose improves hand AP by 12.89 points and body-plus-foot AP by 0.19 points. Across a 512-image multi-task audit, it maintains 99.60% foreground segmentation agreement with the public checkpoint, with quantified normal and pointmap drift. Its 2D coordinates also lower 3D mesh error in frozen Pose2Mesh transfer, while our optional TailGuard re-cropping module cuts S2HAND-MT's severe failure rate on NewDays from 13.45% to 10.43%. S2HAND thus resolves the whole-body hand bottleneck with either exact non-hand preservation (MT) or empirically audited trade-offs (Pose).
236. 【2611.10413】Frequency-Structure Complementary Modeling for Hyperspectral Image Fusion
链接：https://arxiv.org/abs/2611.10413
作者：Song Qiya,Tian Siyu,Li Shutao,Dian Renwei,Sun Long,Liu Jinyang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Complementary Modeling Network, Existing methods, rely on convolutional, Frequency Calibration Attention, attention-based spatial-spectral interaction
备注：
点击查看摘要
Abstract:Existing methods mainly rely on convolutional aggregation or attention-based spatial-spectral interaction. However, conventional feature-domain attention does not explicitly characterize variation patterns along spatial-token and learned latent-channel coordinates, while spatially shared local operators lack the flexibility to adapt neighborhood aggregation to heterogeneous structures. To address these limitations, we propose a Frequency-Structure Complementary Modeling Network (FSCM-Net), which couples frequency-aware dependency learning with structure-adaptive local refinement. Specifically, a Spatial-Spectral Frequency Calibration Attention (SSFCA) module constructs spatial-token affinities from Fourier-interacted query-key representations and builds latent-channel affinities after input-conditioned frequency filtering along learned channel coordinates. The latent-channel response is then calibrated by a learned shared gain and combined with the spatial-token response. Complementarily, a Structure-Coherent Dynamic Feature Fusion (SC-DFF) module combines regularized structure-tensor cues from MSI features with context-modulated HSI detail representations to generate channel- and position-dependent aggregation kernels. This design makes local HSI refinement responsive to smooth regions, edges, and textures while maintaining spectral fidelity. The two modules are progressively integrated within a multiscale encoder-decoder to coordinate representation-level interaction and structure-adaptive reconstruction. Experiments on two simulated benchmarks and one real remote-sensing dataset demonstrate favorable performance against representative fusion methods in spatial detail reconstruction and spectral preservation.
237. 【2611.10392】resias: Towards Language-Conditioned World Models
链接：https://arxiv.org/abs/2611.10392
作者：Fengyi Wu,Yifei Dong,Yetong Sha,Lingdong Kong,Qiyu Hu,Bohan Xiong,Qi Dai,Alexander G. Hauptmann,Zhi-Qi Cheng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：intuitive task specification, internal simulation, World models enable, task specification, models enable planning
备注： 33 pages, including appendix and references. Code: [this https URL](https://github.com/UWMILab/Tiresias)
点击查看摘要
Abstract:World models enable planning through internal simulation, while natural language provides intuitive task specification. Yet, language-conditioned world modeling remains fragmented across domains with disparate action spaces, datasets, and evaluation protocols. We introduce LCWM, a shared task that maps an initial agent-view observation and a language instruction to an action sequence that fulfills the instruction. Its accompanying benchmark, LCWM-Bench, integrates 15 datasets across navigation, robotics, 3D gaming, and driving under a shared action interface and evaluation protocol, pairing 142,987 episodes with 428,961 instructions in three styles. We further propose Tiresias, an agent that plans via selective imagination: a language-conditioned diffusion policy generates candidate trajectories, a trajectory ranker shortlists them, and a video-pretrained world model imagines their visual consequences. A visual ranker evaluates these rollouts, complementing trajectory scores to select the final plan. Tiresias achieves competitive planning and imagination performance on LCWM-Bench. Ablations demonstrate the complementary benefits of trajectory ranking and visual verification, while experiments with alternative proposal methods show that the trained rankers remain effective beyond our diffusion policy. Together, LCWM-Bench and Tiresias provide a unified evaluation setting and an effective starting point for studying language-guided planning through world models.
238. 【2611.10382】From Reflection to Co-Evolution: Self-Evolving Agents with Locally Verified Memory
链接：https://arxiv.org/abs/2611.10382
作者：Xinxiang Yin,Xinglang Zhang,Haodong Chen,Zhiqing Cui,Weidong Tang,Yuxuan Wang,Junrui Wang,Jingyi Zhang,Jianfeng Zhang,Jian Qian
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：motivating growing interest, made impressive progress, LLM agents, mathematical reasoning, motivating growing
备注： 31 pages, 9 figures, 6 tables
点击查看摘要
Abstract:LLM agents have made impressive progress in coding and mathematical reasoning, motivating growing interest in learning from long-horizon interaction. Memory supports this process, but plausible lessons can be redundant or reinforce inappropriate actions. Can a memory's source decision provide a practical test for whether to retain it? We localize consequential trajectory steps, extract candidate memories, and replay each source decision with and without its candidate under the same context. This reveals two properties: most candidates barely shift the probed distribution, and both successful and failed source actions can be reinforced or suppressed. These observations motivate Anchor, which tests shift magnitude and source-role alignment before retention. Admitted memories guide later trajectories, enabling experience-driven improvement under a frozen policy. On held-out ALFWorld and WebShop tasks, Anchor improves success rate and mean score by up to 19.9% and 17.2%, respectively, relative to the strongest baseline for each backbone. With Qwen3.5-27B, it retains 41% fewer ALFWorld cards than unfiltered retention and outperforms all four WebShop cost-comparison baselines while using fewer tokens.
239. 【2611.10379】RefineSplat: Reconstruction-Guided Object-Centric Gaussian Splatting for Open-Vocabulary Querying
链接：https://arxiv.org/abs/2611.10379
作者：Yiren Lu,Disheng Liu,Sreya Srinidhi,Yunlai Zhou,Yiran Qiao,Chaoda Song,Tuo Liang,Jing Ma,Huan Wang,Yu Yin
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：natural language queries, scene understanding aims, retrieve arbitrary objects, understanding aims, aims to segment
备注：
点击查看摘要
Abstract:Open-vocabulary 3D scene understanding aims to segment and retrieve arbitrary objects in 3D scenes using natural language queries. Most existing methods typically follow a splat-then-segment paradigm, where 3D Gaussian Splatting is first reconstructed and then augmented with labels or language features for subsequent segmentation. However, this pipeline often suffers from view inconsistency, ambiguous object boundaries, and weak object-level correspondence, especially in complex static and dynamic scenes. Building on our prior Segment-then-Splat framework, we present RefineSplat, a reconstruction-guided extension that retains its object-centric paradigm: it first tracks objects in 2D and then reconstructs each object with a dedicated set of 3D Gaussians, preserving explicit object-Gaussian correspondence for unified open-vocabulary segmentation and retrieval. To improve robustness, we further close the loop between 2D tracking and 3D reconstruction. Since off-the-shelf video trackers can produce unreliable masks that propagate errors into object reconstruction, we introduce a reconstruction-guided feedback mechanism that refines object tracking using rendered masks and multi-view consistency. Moreover, instead of assigning each object a single language embedding, we propose a viewpoint-aware embedding assignment strategy, where each object maintains multiple view-clustered embeddings to capture view-dependent semantic cues. We also introduce Blender-OVS, a synthetic benchmark of static and dynamic sequences with exact object meshes and point clouds, enabling direct evaluation of extracted geometry. Experiments on static and dynamic benchmarks show improved rendered-view segmentation and lower object-level Chamfer distances, with competitive scene reconstruction quality.
240. 【2611.10377】Vision Language Models for Primary Structure Threat Identification in Wildland Urban Interface Fires
链接：https://arxiv.org/abs/2611.10377
作者：Zhangding Liu,Neda Mohammadi,John E. Taylor
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Wildland urban interface, rapid visual assessment, increasingly threaten communities, Wildland urban, fires increasingly threaten
备注： 6 pages, 3 figures, 1 table. Accepted at the 2026 IEEE International Smart Cities Conference (ISC2), Porto, Portugal
点击查看摘要
Abstract:Wildland urban interface (WUI) fires increasingly threaten communities and infrastructure, motivating the need for rapid visual assessment. Recent research has focused primarily on detecting fire and assessing post-event damage. However, structure-level fire threat identification during active WUI fire events remains underexplored. This study evaluates Qwen3-VL-8B-Instruct for this active-fire decision using two separately scored tracks: 1,824 synthetic images from 491 designed WUI scenarios and 45 frames from a controlled-burn experiment conducted in collaboration with Columbus Fire EMS Department. Under zero-shot prompting, the model returned valid target fields for 1,808 synthetic images and 39 controlled-burn frames. Accuracy among valid outputs was 94.0% for the synthetic track and 69.2% for the controlled-burn track, compared with a 16.0% random-selection baseline for the latter. On the synthetic track, the model generally identified the intended target across varied designed WUI scenarios when the relevant fire-spread cues were visually distinct. Controlled-burn performance was well above random selection, but errors showed difficulty interpreting spatial relations in complex scenes. The dual-track protocol provides scalable stress testing in designed scenarios and a controlled-burn reference for assessing model behavior under physical fire conditions. Future work can use the synthetic data for VLM post-training and then evaluate the adapted models on larger and more diverse real WUI fire datasets.
241. 【2611.10376】PhysDNet: Physics-Driven Gradient Amplification for Real-Time Image Dehazing
链接：https://arxiv.org/abs/2611.10376
作者：Rayen Dhahri,Lei Sun,Victor Javier Kartsch Morinigo,Alice Pagnoux,Luca Benini,Danda Pani Paudel,Luc Van Gool
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Modern dehazing networks, Modern dehazing, dehazing networks, computationally expensive, expensive and overfit
备注： Accepted to NeurIPS 2026. Code, deployment scripts and pre-trained checkpoints: [this https URL](https://github.com/Heatdh/PhysDnet)
点击查看摘要
Abstract:Modern dehazing networks are often computationally expensive and overfit to synthetic haze, limiting real-time deployment. This underscores an urgent demand for efficient, high-fidelity restoration methods that can operate on resource-constrained edge devices in practical, dynamic environments. We introduce PhysDNet, a lightweight multimodal architecture that fuses NIR imagery with sparse LiDAR depth and is trained with a physics-constrained dual-head objective. Differentiating through a fixed Koschmieder inversion induces density-adaptive gradient amplification, acting as an implicit resource allocation mechanism that concentrates learning on heavily degraded regions without increasing inference cost. PhysDNet delivers superior restoration with minimal capacity and enhanced training efficiency, facilitating real-time deployment on edge devices without increasing inference overhead. On the Seeing Through Fog benchmark, PhysDNet outperforms competitors by 1.67 dB at 5.2 times lower compute while recovering 54.9% of fog-induced detection loss. Ablations and cross-domain evaluations show that physics-guided training improves generalization, including under non-homogeneous haze that violates the Koschmieder assumption. PhysDNet further demonstrates compatibility with fixed-function NPUs, running at 29/45/99 FPS at 4 W across L/M/S variants. Code, deployment scripts and pre-trained checkpoints are available at this https URL.
242. 【2611.10370】ClearForm: Shared-Surface Gaussian Splatting for Transparent and Opaque Scenes
链接：https://arxiv.org/abs/2611.10370
作者：Hajeong Lee,Jong-Il Park
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：recover glass surfaces, Transparent-interface reconstruction, recover glass, Transparent-interface, observed color
备注： 15 pages, 9 figures
点击查看摘要
Abstract:Transparent-interface reconstruction must recover glass surfaces even when most observed color comes from the scene behind them. We present ClearForm, a shared-planar-Gaussian method for jointly reconstructing transparent interfaces and the appearance seen through them. We identify and analyze the Geometry-Appearance Compositing Dilemma (GACD): when the same transparency-dependent alpha controls both color and geometry, revealing the background can weaken a transparent surface's contribution to geometric reconstruction. We derive its effect on plane-based depth estimation, identify a mechanism that can weaken geometric learning, and quantify the loss of interface support through controlled comparisons. To address this conflict, we develop geometry-preserving dual-opacity surface reconstruction. Shared planar Gaussians retain interface contributions in geometry compositing while modeling transmission and sparse reflection in RGB, supported by transparency-aware geometric constraints. To manage the different primitive-visibility requirements of these compositors, we introduce Dual-Evidence Lifecycle (DEL), which retains Gaussians supported by multi-view geometry or RGB reconstruction evidence. On 3D-FRONT-T, ClearForm achieves 27.05 mm Chamfer distance (CD) and 0.928 F1, compared with 59.18 mm CD for our PGSR reproduction and the reported 34 mm CD and 0.836 F1 for GLINT. On TransLab, it achieves 1.65 mm CD, 0.963 F1, and 40.14 dB PSNR. In matched ablations, dual-opacity compositing reduces CD from 59.25 to 27.09 mm, while DEL improves PSNR by 2.06 dB. Our project page is available at this https URL.
243. 【2611.10353】DAPointRWKV: Domain Adaptive Vision RWKV for Point Cloud Completion
链接：https://arxiv.org/abs/2611.10353
作者：Yinghui Li,Qianyu Zhou,Hao Yang,Richard Dazeley,Ye Zhu,Xuequan Lu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Domain adaptive point, labeled source domains, unlabeled target domains, point cloud completion, adaptive point cloud
备注： This paper has been accepted by 34th ACM International Conference on Multimedia
点击查看摘要
Abstract:Domain adaptive point cloud completion (DA PCC) aims to bridge the geometric discrepancy between labeled source domains and unlabeled target domains for accurate 3D shape completion. Existing methods based on CNNs, Transformers, and Mamba-like sequence models still face challenges from limited receptive fields, high computational complexity, insufficient geometric bias, and serialization sensitivity. Recently, Receptance Weighted Key Value (RWKV) provides a linear-complexity alternative for long-range sequence modeling. However, adapting RWKV to DA PCC remains challenging due to the lack of explicit geometric priors, the mismatch between recurrent modeling and coarse-to-fine generation, and unstable target-domain adaptation. To address these challenges, we propose DAPointRWKV, a novel RWKV-based framework for DA PCC. DAPointRWKV consists of three components: Geometry-Aware RWKV (GA-RWKV) Backbone, RWKV-Oriented Progressive Decoder (RWKV-PD), and Dual Structural Regularization (DSR). Specifically, GA-RWKV introduces geometry-aware recurrent representation learning, RWKV-PD bridges RWKV token representations with coarse-to-fine reconstruction through local token-guided refinement, and DSR stabilizes target-domain transfer through visible-structure anchoring and complete-shape hypothesis stabilization. Extensive experiments on synthetic and real-world benchmarks demonstrate that DAPointRWKV consistently outperforms state-of-the-art methods.
244. 【2611.10349】SituRecBench: Evaluating Frontier Models as Situated Recommendation Assistants in 3D Environments
链接：https://arxiv.org/abs/2611.10349
作者：Jingtong Yang,Dongding Lin,Jian Wang,Wenjie Li
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：static retrieval engines, Recommender systems, systems are transitioning, transitioning from static, static retrieval
备注： Accepted by NeurIPS 2026 Evaluations and Datasets Track
点击查看摘要
Abstract:Recommender systems are transitioning from static retrieval engines into interactive assistants grounded in physical environments. However, current studies largely neglect the combined complexities of spatial navigation, visual grounding, and multi-turn social interaction. To bridge this gap, we introduce SituRecBench, an interactive benchmark for evaluating frontier vision-language models (VLMs) as situated recommendation assistants within high-fidelity 3D environments. We reformulate recommendation as a situated assistance process in which an assistant interacts with a user while sharing the user's egocentric view. Our benchmark simulates real-world shopping environments (e.g., supermarkets and home furnishings stores), requiring assistants to elicit preferences, ground recommendations in the environment, and guide the user to relevant locations through dialogue. The benchmark evaluates dialogue quality, recommendation utility, and navigation effectiveness through a unified interactive protocol. Extensive experiments reveal persistent challenges in spatial grounding and preference elicitation, highlighting limitations in their ability to integrate global contextual information with local observations. SituRecBench provides a rigorous foundation for advancing the development of situated assistants in the real world.
245. 【2611.10348】Guided Co-Attention with Adaptive Gating for Multimodal Medical Data Fusion
链接：https://arxiv.org/abs/2611.10348
作者：Muntaqim Ahmed Raju,Priyanka Siddappa,Md Shifat Haider Al Amin,Ruizhe Ma,Md Ripon Ahammed
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：complementary cross-modal views, Multimodal fusion requires, exchanging information, cross-modal views, fusion requires
备注： IEEE BIBM 2026
点击查看摘要
Abstract:Multimodal fusion requires not only exchanging information across modalities but also determining which representations should participate in the interaction and how complementary cross-modal views should be combined. We introduce Guided Co-Attention with Adaptive Gating, a fusion framework that integrates token-wise guidance, bidirectional cross-attention, and sample-specific fusion. The proposed method constructs two directional representations: an image-conditioned text representation, obtained by allowing textual tokens to query visual features, and a text-conditioned image representation formed in the reverse direction. Token-wise guidance modulates the representations before cross-attention, while an adaptive gate learns the relative contribution of the two resulting directional representations for each sample. We evaluate the approach using paired chest radiographs and radiology reports as an image-text test bed for binary (normal vs. abnormal) classification. The two cross-attention directions exhibit distinct performance characteristics, demonstrating that reversing the query and source modalities does not produce interchangeable representations. Ablation experiments further show that bidirectional interaction, adaptive gating, and token guidance provide complementary benefits. The proposed model achieves 96.05% accuracy, 96.10% F1-score, 98.37% AUC, 95.60% Sens@95Spec, and 96.51% Spec@95Sens, yielding the highest mean performance across all evaluated metrics. These findings support explicitly modeling interaction direction, token relevance, and sample-dependent integration when constructing multimodal representations.
246. 【2611.10347】PoseBench: Probing Pose Awareness in Visual Foundation Models
链接：https://arxiv.org/abs/2611.10347
作者：Most Nilufa Yeasmin,Draix Wyatt,Ruyi Lian
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：visual foundation models, greater feature similarity, Pose awareness, Pose awareness characterizes, similar poses exhibit
备注：
点击查看摘要
Abstract:Pose awareness characterizes the extent to which a learned feature space aligns with the underlying object-pose manifold, such that observations with similar poses exhibit greater feature similarity than those with increasingly different poses. While such structure is desirable for pose-sensitive 3D vision tasks, visual foundation models pre-trained on individual 2D images typically lack explicit 3D or pose supervision. This raises a fundamental question: Do 2D visual foundation models exhibit pose awareness after large-scale pretraining? To answer this question, we introduce PoseBench, a systematic benchmark to probe pose awareness in pretrained visual features. Our evaluation follows a progressive design: held-out rendered views probe intrinsic pose-aware structure under controlled conditions, while real-image queries evaluate how robustly this structure remains accessible under real-world variations. We further introduce pose-graph-based refinement as a complementary probe of compatibility between feature neighborhoods and the underlying pose manifold. Across 31 publicly available checkpoints from 10 pretraining families, PoseBench reveals that pose awareness is an implicit but non-uniform property of 2D visual foundation models, and consistent gains from pose-graph refinement suggest that feature spaces retain structure compatible with the underlying pose manifold. PoseBench therefore provides a systematic basis for understanding and selecting pretrained features for pose-sensitive 3D vision tasks.
247. 【2611.10344】MaRiO: Multi-agent Collaborative Reasoning via Shared Observations in MLLMs
链接：https://arxiv.org/abs/2611.10344
作者：Nathaniel Redmond,Fidel Omar Tito Cruz,Devansh Sharma,Shehreen Azad,Sirshapan Mitra,Shruti Vyas,Yogesh S. Rawat
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Large Language Models, Multimodal Large Language, Large Language, existing evaluations largely, evaluations largely focus
备注： Accepted to the NeurIPS 2026 Evaluations Datasets Track (poster). First two authors contributed equally
点击查看摘要
Abstract:Multimodal Large Language Models (MLLMs) show strong visual perception capabilities, but existing evaluations largely focus on single-view or multi-view settings with shared camera parameters, leaving the challenge of multi-agent collaborative scenarios underexplored. In such settings, multiple agents observe a shared environment from independent viewpoints, and reliable decisions require reasoning across these independent observations of the same environment. To study this problem, we introduce MaRiO, a benchmark for evaluating multi-agent collaborative reasoning, and evaluate 23 state-of-the-art MLLMs on it. Our analysis reveals three key findings: (1) tasks governed by static perception are generally easier than tasks that require transformational event sequences; (2) most models struggle to resolve cross-agent correspondences, with errors increasing with scene complexity; and (3) models show limited ability to leverage geometric cues present in the scene. As an initial step toward addressing these challenges, we explore geometry-guided synthetic view augmentation that generates intermediate transition frames between agent observations, providing auxiliary spatial context that improves performance in certain categories. Overall, our results highlight that multi-agent collaborative reasoning remains an open challenge and an important direction for multimodal embodied systems. The code is available on the project page: this https URL.
248. 【2611.10338】On the universal structure in deterministic generative diffusion
链接：https://arxiv.org/abs/2611.10338
作者：Defang Chen,Zhenyu Zhou,Can Wang,Zeyu Zheng,Siwei Lyu
类目：Machine Learning (cs.LG); Statistical Mechanics (cond-mat.stat-mech); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)
关键词：Diffusion-based generative modeling, general computational framework, Diffusion-based generative, simulating high-dimensional, modeling has emerged
备注：
点击查看摘要
Abstract:Diffusion-based generative modeling has emerged as a general computational framework for simulating high-dimensional, structured data across various domains. Understanding its generative mechanisms is paramount for advancing model training and inference in a principled way. Here, we demonstrate that deterministic sampling trajectories share a universal geometric structure invariant to data modalities and diffusion model implementations. This structure can be largely explained by an exactly solvable model based on the optimal linear denoiser.
249. 【2611.10337】meTraveler: Temporal Strategy Planning with Time Dictionary for Streaming Video Understanding
链接：https://arxiv.org/abs/2611.10337
作者：Minkuk Kim,Junho Kim,Seong Tae Kim
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：answer user queries, continuously evolving video, Streaming video understanding, requires models, evolving video streams
备注： Accepted at NeurIPS 2026. Project page: [this https URL](https://geppa.github.io/TimeTraveler)
点击查看摘要
Abstract:Streaming video understanding (SVU) requires models to answer user queries over continuously evolving video streams. Unlike offline video QA, SVU must handle queries whose evidence may lie in the past, appear in the current scene, or emerge only after future observations. Existing streaming video systems often rely on compact visual memories or fixed evidence-access schemes, which can lose fine-grained details and fail to adapt the answering process to the temporal intent of each query. In this paper, we propose TimeTraveler, a streaming VQA framework that performs temporal strategy planning with a Time Dictionary. Inspired by the need to search across different temporal regions of a stream, TimeTraveler stores each observed moment as a timestamp-indexed structured caption and uses this dictionary as an explicit source of queryable evidence. Given a query, TimeTraveler determines whether to recall past evidence, read the present context, or wait for future observations, and then applies a strategy-specific evidence acquisition process. Comparative experiments on streaming video QA benchmarks show that TimeTraveler improves streaming question answering by preserving fine-grained temporal evidence and selecting the appropriate temporal strategy for each query. The project page is available at this https URL.
250. 【2611.10331】Evaluating classification and explainability in multimodal petrographic image analysis
链接：https://arxiv.org/abs/2611.10331
作者：Thomas James Wood,Oktay Karakuş,Can Eyüpoğlu
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Automated thin-section classifiers, thin-section classifiers increasingly, classifiers increasingly combine, increasingly combine plane-polarised, Automated thin-section
备注：
点击查看摘要
Abstract:Automated thin-section classifiers increasingly combine plane-polarised and cross-polarised light (PPL and XPL), two complementary views central to petrographic identification. Classification accuracy alone does not reveal whether model errors reflect mineralogical relationships, how predictions depend on each optical view, or whether attribution maps identify regions that influence model decisions. Here, we examine these complementary aspects of the released LITHOS dual-stream vision transformer using outputs from an earlier evaluation of 105,802 expert-annotated grains across 25 categories. Classification errors frequently followed the label taxonomy: 72.6\% of misclassified plagioclase, microcline and sanidine grains were assigned the generic Feldspar label, while 87.1\% of quartz-family grains received a label within that family, compared with 66.6\% assigned their exact label. Replacing the XPL input with its per-channel spatial means produced a greater reduction in true-class probability than equivalent PPL replacement in 20 of 25 categories, but not in the three quartz categories. Five explainable artificial intelligence (XAI) attribution procedures generated visually distinct maps for identical inputs. In a superpixel-deletion analysis involving 30 grains from 29 thin sections, method-minus-random contrasts ranged from $-0.043$ to $0.057$, with all 41 simultaneous 95\% confidence intervals including zero. Together, these findings show that error structure, modality sensitivity and attribution behaviour capture distinct aspects of model performance that cannot be established from classification accuracy or visual inspection of attribution maps alone.
251. 【2611.10321】LoCo: Selective Local Competition for Discriminative Open-Vocabulary Multi-Label Recognition
链接：https://arxiv.org/abs/2611.10321
作者：Zhuoming Li,Bo Han,Xiaoyu Wang,Yuheng Jia
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：aims to identify, local, semantic concepts present, local prediction, concepts present
备注： The paper is accepted by NeurIPS 2026
点击查看摘要
Abstract:Open-Vocabulary Multi-Label Recognition (OV-MLR) aims to identify all queried semantic concepts present in an image. Existing methods mainly improve global image-text matching or text-side representations, leaving local prediction largely under-explored. In this paper, we revisit local prediction and reveal that it can serve as a strong discriminative branch once two properties are properly handled: spatial consistency of local visual features and compatibility-aware local competition. This perspective is motivated by local semantic sparsity: each image region is related to only a small subset of queried concepts, while compatible concepts of different granularities or types may still coexist locally. We instantiate this perspective with LoCo, a selective Local Competition framework for OV-MLR. LoCo adopts a spatially consistent visual encoder to reduce local feature entanglement, and introduces Selective Softmax to impose competition only among locally incompatible categories while preserving compatible responses. Multi-scale inference further improves local prediction at different scales. LoCo can also be ensembled with an existing global predictor to provide complementary image-level context. Experiments on four multi-label benchmarks show that standalone LoCo improves average F1-score and mAP over TagCLIP by 3.4% and 3.8%, respectively. LoCo + DualPrompt achieves the highest averages among the compared methods, with gains of 4.8% and 5.2% over TagCLIP. Our results suggest that local semantic sparsity offers a useful basis for developing more discriminative open-vocabulary multi-label recognition methods. The code is available at this https URL.
252. 【2611.10318】AI-Driven Repair of Missing Automotive Components
链接：https://arxiv.org/abs/2611.10318
作者：Kazim Abbas,Zheng Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Due to supply, replacing damaged automotive, damaged automotive components, synthetically damaged components, replacing damaged
备注： 6 pages, 4 figures
点击查看摘要
Abstract:Due to supply constraints, replacing damaged automotive components can be expensive and time-consuming, while replacing the entire component can be wasteful when much of it remains usable. This paper presents a pipeline to investigate whether missing geometry can be reconstructed as a repair patch using paired observations of the intact models and synthetically damaged components. Noise-free color, depth, and silhouette images were produced using the camera viewpoints. Depth differences were then used to identify the potential missing regions, while multi-view voxel reconstruction was used to estimate the missing portion. A pretrained DINOv2 model was also added to validate missing candidates and determine whether pretrained visual features could improve reconstruction. We tested the pipeline on 20 automotive CAD models, each with a synthetically removed portion. Each model was tested under four different conditions using two reconstruction methods for a total of 160 trials. The predictions were compared with the missing geometry of the unchanged ground-truth using predefined thresholds of the voxel intersection-over-union over 0.85 and the absolute relative volume error less than 15%. Of the 160 experimental trials, 109 of them satisfied both thresholds. Geometry-only reconstruction passed 16 of 20 components with eight views but only 10 of 20 with four adjacent views. Further analysis showed that 24 out of the 37 failed reconstructions could be categorized as unsuccessful because extra material was incorrectly added to areas that should have been empty. The implementation of DINOv2 into the pipeline did not improve the overall reconstruction accuracy and made prediction generation slower. For 13 verified tests, printing only the repaired sections instead of the entire parts reduced filament use by 93.08% and printing time by 89.39% based on the median results.
253. 【2611.10297】Uncertainty, Not Concealment: A Mechanistic Reappraisal of Sycophancy in Vision-Language Models
链接：https://arxiv.org/abs/2611.10297
作者：Mohamed I. Eldagla,Zeyad H. ElShafei,Ahmed M. Anter
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：medical retrieval-augmented generation, Vision-language models, safe deployment, medical retrieval-augmented, retrieval-augmented generation
备注： Accepted to the NeurIPS 2026 Med-Reasoner Workshop
点击查看摘要
Abstract:Vision-language models (VLMs) in medical retrieval-augmented generation must be able to say when a retrieved report contradicts the X-ray, so understanding whether they can detect such conflicts is important for safe deployment. The sycophancy mask hypothesis holds that these models internally detect conflicts but refuse to report them, concealing a detected contradiction. We introduce a three-part diagnostic that separates concealment from uncertainty: representation probing, activation steering, and two-way forced choice. Across four instruction-tuned VLMs on chest X-rays, we confirm behavioral suppression of contradiction and find that a linear probe separates matched from mismatched inputs, beyond what a simple CLIP model achieves. Steering the learned conflict direction never elicits contradiction, and forcing a binary choice does not recover one; instead, cross-modal attention to the image drops on mismatched pairs. We conclude that these models fail to contradict because the mismatch registers as hedged, gated uncertainty rather than concealed knowledge, calling for re-grounding and uncertainty surfacing. Code is available at this https URL.
254. 【2611.10263】DAC-MACE: Context-Conditioned Expert Routing for Compact Scene Coordinate Regression in Camera Relocalization
链接：https://arxiv.org/abs/2611.10263
作者：Dingying Fan,Mingkai Liu,Haohua Que,Haojia Gao,Xianliang Huang,Qian Zhang,Xueqian Wang,Fei Qiao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：absolute pose sensor, prebuilt map, scene, absolute pose, pose sensor
备注： 10 pages, 6 figures. Submitted to IEEE Sensors Journal
点击查看摘要
Abstract:A camera becomes an absolute pose sensor when its images can be relocalized against a prebuilt map of the scene. On mobile robots and augmented-reality devices, that map must be small and quick to build. Scene coordinate regression (SCR) stores the scene in a compact network that predicts a 3D coordinate for every pixel, and mixture-of-experts (MoE) variants extend its capacity to larger outdoor scenes. In existing MoE-based SCR, however, the router assigns each pixel to an expert from the same local descriptor that the experts regress from, so repeated facades and windows at different locations receive similar routing inputs. We present DAC-MACE, which conditions soft expert routing on recalibrated and contextualized features. A residual context adapter (RCA) reweights the channels and locations of frozen encoder features, a global context encoder (GCE) mixes them with multi-scale self-attention, and an image-level pooled descriptor is added to the router input. A dual-threshold RANSAC--Levenberg--Marquardt estimator recovers the pose. On Cambridge Landmarks, DAC-MACE attains a mean per-scene median translation error of 13.0 cm over three seeds, the lowest among the RGB-only SCR methods compared (GLACE 13.6 cm, MACE 14.4 cm), and reduces the error on the largest scene from 24 to 19 cm relative to MACE. In a cumulative study, the MoE head, GCE, RCA, and the dual-threshold estimator lower the mean error from 17.0 cm to 14.4, 14.0, 13.6, and 13.0 cm. On 7-Scenes, adding GCE to a single ACE head raises Recall@(5 cm, 5$^\circ$) from 86.56% to 87.60%.
255. 【2611.10262】Domain Generalization for Style-Debiased Object Detection via Label-Consistent Training across Multiple Styles
链接：https://arxiv.org/abs/2611.10262
作者：Chaoran Zhang,Shirshak Bhusal,Zhilin Gao,Qiang Xue,Haoting Shen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：unseen target domains, object detection aims, improve model performance, detection aims, aims to improve
备注：
点击查看摘要
Abstract:Domain generalization (DG) for object detection aims to improve model performance on unseen target domains. Existing detectors, however, suffer substantial degradation on visually distinct unseen domains, as models confined to limited training styles tend to overfit superficial statistical cues rather than object-level semantics. Motivated by human perception, which attends primarily to semantically relevant features while ignoring irrelevant style cues, we propose Origin-Anchored Multi-Style Consistency (OAMSC), a source-only framework that couples multi-style data synthesis with cross-style consistency learning to suppress style-sensitive shortcut learning. For data preparation, we leverage off-the-shelf diffusion models to expand the source datasets into 20 distinct styles, with all generated images manually verified to ensure that object instances and annotations remain consistent across style variants. During training, we impose Origin-anchored consistency constraints at scene and object levels to reinforce the learning of domain-stable features while suppressing the influence of style-sensitive cues. Extensive experiments and ablation studies on multiple challenging DG benchmarks demonstrate the consistent effectiveness and strong generalization performance of OAMSC across diverse domain shifts. Notably, our approach applies to both one-stage and two-stage detectors, while its data-centric design is complementary in principle to other DG methods. The training code and two style-transfer datasets constructed for the experiments, comprising approximately 180K images in total, are publicly available on GitHub.
256. 【2611.10260】STAIRS: Staging the Inverse Problem via Admissible-Support Scheduling for Unrolled MRI Reconstruction
链接：https://arxiv.org/abs/2611.10260
作者：Xiangjian Hou,Chang Ni,Chao Qin,Zhiwei Tan,Xin Wang,Xinrui Ye,Rong-Rong Chen,Chun Yuan,Xiaodong Ma
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Accelerated magnetic resonance, incomplete Fourier measurements, magnetic resonance imaging, shifting acquisition burden, Accelerated magnetic
备注：
点击查看摘要
Abstract:Accelerated magnetic resonance imaging (MRI) forms images from incomplete Fourier measurements, shifting acquisition burden to computational reconstruction. Deep unrolled networks interleave learned regularization and data consistency, yet typically estimate the full unmeasured spectrum at every cascade. We propose STAIRS (Staging the Inverse Problem via Admissible-Support Scheduling), which projects intermediate reconstructions onto nested Fourier supports that expand to the full spectrum and conditions each update on its support transition. Conditional increments of a regularized log-determinant score of training covariance define a normalized spectral coordinate, accounting for dependencies between newly and previously admitted frequencies. Dyadic targets allocate larger coordinate increments to earlier cascades and are mapped to fixed supports before training, enabling coarse-to-fine reconstruction with unchanged sampling masks and data consistency. On fastMRI and Stanford2D, STAIRS improves matched Transformer (HUMUSNet) and convolutional (NAFNet) backbones in single- and multi-coil reconstruction, including radiologist-annotated pathology regions. It also outperforms predictor-based progression with lower parameter overhead and inference latency. Stage-wise analysis shows repeated error correction by projection and lower intermediate reconstruction errors than the backbones alone throughout support expansion. Ablations favor dyadic allocation over uniform expansion for square and line-band supports and over manual front-loading for square windows. Support projection alone improves reconstruction, and transition conditioning strengthens the gain. Cross-dataset evaluation shows improvements for both backbones in both directions. Support allocation thus complements regularizer design in unrolled MRI reconstruction.
257. 【2611.10249】Beyond Frame-Level Accuracy: Analyzing Video-Level Stability in Transformer-Based Deepfake Forensics
链接：https://arxiv.org/abs/2611.10249
作者：Syed Azmul Hasan,Mowmita Pervin Hera,Afroza Lona Mim,M M Jihad Hossain,Hazrat Ali,Mohammad Farhad Bulbul
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Deepfake videos generated, advanced generative models, generative models pose, misinformation control, digital security
备注： Paper submitted to international journal of intelligent systems, Wiley publishers, accepted version of open-access paper
点击查看摘要
Abstract:Deepfake videos generated by advanced generative models pose serious threats to digital security, misinformation control, and media forensics. Although numerous detection methods have been proposed, their reported performances are often based on heterogeneous preprocessing pipelines, inconsistent data splits, and model-specific training protocols, hindering fair architectural comparison. This work presents a controlled and reproducible comparative study of convolutional neural networks (ResNet-18 and EfficientNet-B0) and a transformer-based architecture (ViT-B/16) within a unified, face-centric deepfake detection framework. All models are trained using identical preprocessing, augmentation, optimization settings, and data splits on Celeb-DF v2 and FaceForensics++, and results are validated across three independent random seeds with bootstrapped confidence intervals. Experimental results show that while CNN-based models perform competitively at the frame level, their performance degrades after video-level aggregation. In contrast, ViT-B/16 demonstrates more stable video-level performance, achieving 92.8\% [95\% CI: 91.7--94.0] video-level accuracy and an AUC of 0.950 [95\% CI: 0.934--0.964] on Celeb-DF v2 (3-seed bootstrapped). Cross-dataset evaluation across the same three random seeds reveals a large, asymmetric generalization gap (AUC 0.79 FF++$\rightarrow$Celeb-DF vs. 0.64 Celeb-DF$\rightarrow$FF++), indicating that in-domain video-level stability does not transfer to unseen manipulation domains. These findings indicate that global self-attention improves robustness and video-level stability for deepfake detection within a given data domain, while highlighting the need for further work on cross-domain generalization.
258. 【2611.10245】From Weapons to Events: Evaluating Evidential Support in Multimodal AI for Policing
链接：https://arxiv.org/abs/2611.10245
作者：Armin Mustafa,Syed Sameed Husain
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)
关键词：Computer vision, seized weapons, reviewed by people, policing has centred, centred on recognising
备注： 34 pages, 2 figures, 4 tables; appendices include annotation guidelines, prompt templates and a datasheet
点击查看摘要
Abstract:Computer vision (CV) for policing has centred on recognising objects such as seized weapons, while body-worn video (BWV) is still reviewed by people, with existing AI tools using only its audio. Multimodal video AI could make BWV review faster and cheaper. At the object level, we present the KnifeHunter dataset, developed with UK law enforcement, with over 25,000 images of 543 knife classes and a protocol reflecting investigative conditions, and KHNet, a retrieval architecture fusing local and global features, which with about 125,000 distractor images attains 85.7% and 63.4% mean Average Precision (mAP) on the medium and hard protocols. At the event level, we present an evaluation protocol for video understanding pipelines, which describe a video as events and a transcript, that scores transcription, speaker attribution, event detection, temporal localisation and unsupported events. Whether each event is supported by the recording is labelled by a judge validated against blinded human labels. We apply it to complete pipelines, three 2026 omni-modal models and our hybrid NarrativeBridge-PAL-GPT-5 pipeline, on UKBWV-27, a pilot stress-test set of 27 publicly released UK BWV recordings (118 minutes). On this set the hybrid pipeline leads on five of six measures, yet it leaves 13.6% of predicted events unsupported and misattributes 27.7% of utterances, and every pipeline degrades on recordings from edited releases, long recordings and noisy audio. We propose readiness levels separating assistive tasks from those requiring verification of every output.
259. 【2611.10241】OfficeTwin: Realizing 3D Reconstruction of Redundant Scenes through Partial Viewpoint Perception
链接：https://arxiv.org/abs/2611.10241
作者：Quanyun Wu,Kyle Gao,Daisy Li,Kshitij Goyal,Dayou Mao,David A. Clausi,Jonathan Li,Yuhao Chen
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：uncalibrated monocular stream, dense point cloud, single inference pass, matching fails outright, keypoint matching fails
备注：
点击查看摘要
Abstract:Feed-forward 3D reconstruction turns an uncalibrated monocular stream into a dense point cloud in a single inference pass, orders of magnitude faster than classical structure-from-motion (e.g., COLMAP), and reliable on the weakly textured, repetitive surfaces where keypoint matching fails outright. However, raw point clouds lack the object identity, physical properties, and watertight volume required for robot learning. This gap widens under robot-native capture. A camera mounted on a robot constrained to a few degrees of freedom sees each object only partially, and the repetitive, weakly textured structure of an office makes distinct workstations nearly indistinguishable, leaving redundant and partial observations that downstream reconstruction cannot resolve. Existing image-to-3D generation methods struggle with these conditions, hallucinating geometry under incomplete views and confusing repeated instances. We present OfficeTwin, a robot-native framework that converts these incomplete observations into simulation-ready digital twins. OfficeTwin first imposes metric and structural constraints, then exploits the office's structural redundancy by registering repeated cubicles into a shared canonical frame, where complementary observations recover geometry occluded in any single view without hallucination. On a real office scan, OfficeTwin recovers every cubicle as an individually watertight, metric solid, outperforming feed-forward reconstruction and generative baselines that fail to produce simulation-ready assets.
260. 【2611.10236】Anatomy-Preserving Unpaired Medical Image Translation via Shared Latent Anchoring
链接：https://arxiv.org/abs/2611.10236
作者：Zhilin Zou,Hieu Le,Saumya Gupta,Jingyi Xu,Prateek Prasanna,Chao Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：requires synthesizing target-modality, synthesizing target-modality images, translation requires synthesizing, requires synthesizing, synthesizing target-modality
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:Unpaired medical image-to-image translation requires synthesizing target-modality images from source-modality images without aligned supervision. Existing methods learn a direct source-to-target mapping that entangles structure preservation and appearance generation within a single model, often distorting clinically meaningful anatomy in the translated output. We argue that these two objectives should be decoupled entirely: anatomical structure should be captured independently of generation, and the generator should operate only on a frozen structural representation. To this end, we propose a two-stage framework for unpaired medical image translation. In the first stage, we learn a shared structure space by training a structure encoder-decoder on source images, target images, and structural masks jointly, using mask reconstruction to anchor the latent space to modality-agnostic anatomy. For source images without mask annotations, a target-domain memory bank provides soft structural supervision via prototype retrieval. In the second stage, a conditional flow model learns to render target-domain appearance under fixed structural conditions. This ensures the generator inherits target appearance statistics and can focus entirely on structural conditioning rather than learning appearance from scratch. We validate our framework on OCT-to-OCTA synthesis and brain MR-to-CT translation. Our method outperforms all unpaired baselines on both tasks and, despite requiring no paired supervision, also surpasses paired baselines, improving PSNR by up to 11.2% and SSIM by up to 26.4% on OCT-to-OCTA, and achieving consistent gains across whole-image, soft-tissue, and bone regions on MR-to-CT. The project repository is available on GitHub.
261. 【2611.10199】RigidGS: Geometry-Aware Object Decoupling for Rigid-Body Interaction in 3D Gaussian Splatting
链接：https://arxiv.org/abs/2611.10199
作者：Paul Sansah Gyreyiri,Diksha Shukla
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：applications demand photorealistic, demand photorealistic, representations that support, support real-time rendering, applications demand
备注： 12 pages, 5 figures, 7 tables. Accepted at WACV 2027 (Applications Track). Project page: [this https URL](https://gyreyirisansah.github.io/rigidgs)
点击查看摘要
Abstract:Interactive VR/MR applications demand photorealistic 3D representations that support real-time rendering and object-level manipulation. While 3D Gaussian Splatting (3DGS) achieves high rendering quality, it represents scenes as unstructured, monolithic primitives. Existing object-aware 3DGS methods jointly optimize geometry and semantic states but suffer from two key failure modes: noisy foundation-model masks on complex geometry, and label-geometry coupling, in which co-optimized identity gradients mislabel boundary Gaussians. We introduce RigidGS, an end-to-end pipeline that decouples geometric learning from object identity. We propose a depth- and temporally-aware mask refinement module that addresses two complementary SAM2 failures: over-inclusion on thin structures and under-inclusion on multimodal-depth objects. We then determine object identities entirely upstream via COLMAP projection voting and freeze them during training, directing mask supervision solely toward geometric optimization. Refined masks alone substantially improve competing methods, yet a residual gap in label-geometry coupling persists that our fixed-identity design eliminates. RigidGS outperforms prior object-aware 3DGS methods on LLFF/NVOS, Mip-NeRF~360, and iNeRF360, improving segmentation and boundary IoU by 7.7 and 14.5 points on LLFF/NVOS. Finally, RigidGS enables real-time rigid-body manipulation on Meta Quest~2 without mesh extraction. Our code and project page are available at this https URL.
262. 【2611.10182】ATLAS: A Multi-Procedure Benchmark and Context-Aware Model for Surgical Anatomy Segmentation
链接：https://arxiv.org/abs/2611.10182
作者：Ronald L. P. D. de Jong,Tim J. M. Jaspers,Raf A. H. Vervoort,Aron F. H. A. Bakker,Anna L. Dijk,Yiping Li,Jip L. Tolenaar,Jelle P. Ruurda,Willem M. Brinkman,Daan de Geus,Fons van der Sommen,Josien P. W. Pluim,Marcel Breeuwer
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Recognizing anatomical structures, minimally invasive surgery, support intraoperative navigation, Recognizing anatomical, segmentation methods developed
备注：
点击查看摘要
Abstract:Recognizing anatomical structures during minimally invasive surgery (MIS) could support intraoperative navigation and improve patient safety, but progress is limited by small, single-procedure datasets and by segmentation methods developed for natural scenes. This work addresses both limitations through a new dataset and model. First, we introduce ATLAS-120k, a clip-level semantic segmentation dataset of 121,018 annotated frames from 100 surgical videos, covering 14 laparoscopic and robot-assisted procedures and 41 classes. Annotations were created with a pipeline that combines manual labeling, tracker-based propagation, and review by surgeons. Second, we propose ATLAS (Anatomy Recognition with Context Learning using Foundation Representations), a video semantic segmentation model for surgical anatomy recognition. ATLAS builds on in-domain foundation-model embeddings and adds context queries for the procedure and surgical phase, together with query propagation between frames for short-term memory. ATLAS outperforms state-of-the-art natural-image and in-domain foundation models in both segmentation accuracy and temporal consistency, achieving a Dice score of 0.70 with ViT-L while running in real time at 76.2 FPS. Ablations show that the context queries improve accuracy and that query propagation improves temporal consistency. ATLAS also generalizes well, matching a dedicated model zero-shot on CholecSeg8k and improving phase recognition on AutoLaparo over SurgeNet initialization. The model weights, dataset annotations, and annotation tool are publicly available at this https URL.
263. 【2611.10174】CXR-CMFA: A Cross-Modal Feature Aggregation Network for Chest X-Ray Pathology Classification
链接：https://arxiv.org/abs/2611.10174
作者：Talukder Hasnat Zadid,Jahin Sultana,Felipe Bochini Brisola,Kishore Roy,Mysha Rahman,Syeda Asrafa Islam,Md. Abdullah-Al-Jubair
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Chest X-ray, interpretation remains challenging, limited visual evidence, image-quality variation, interpretation remains
备注：
点击查看摘要
Abstract:Chest X-ray (CXR) interpretation remains challenging because subtle pathology can be obscured by overlapping anatomy, image-quality variation, and limited visual evidence in isolated radiographs. Although image-only deep learning models provide useful baselines, they discard the complementary diagnostic context available in radiology reports, while large vision-language models can be computationally expensive for practical deployment. This paper presents CXR-CMFA, a lightweight cross-modal feature aggregation network for binary CXR pathology classification. The proposed framework combines a dual-stream visual encoder, using EfficientNet-B0 for global anatomical representation and DenseNet-121 for local pathological detail, with a TF-IDF-MLP report encoder. Two fusion modules integrate these modalities: the Dual-Modal Spatial Attention Module (DMSAM) uses the report embedding to gate global and local visual features, and the Cross-Modal Gated Feature Fusion (CGFF) module learns per-instance weights for visual and textual contributions. Experiments on the MIMIC-CXR benchmark, using the provided train, validation, and test splits, show that CXR-CMFA achieves 93.45% accuracy, 99.88% precision, 91.8% recall, 95.7% F1-score, and 99.19% AUC on the held-out test set. The model produces only four false positives among 984 normal test cases, supporting its suitability for high-specificity screening workflows. An ablation study further demonstrates a 22.47 percentage-point AUC improvement over the global-image-only variant, confirming the value of adaptive cross-modal fusion. These results indicate that compact report-conditioned fusion can provide strong discriminative performance without relying on large pretrained language models.
264. 【2611.10160】Improving the Diffusability of Motion Tokenizer
链接：https://arxiv.org/abs/2611.10160
作者：Guanhe Huang,Songqiao Han,Tangzheng Lian,Oya Celiktutan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：text-driven human motion, efficient text-driven human, shown promising performance, human motion generation, variational auto-encoder
备注： Accepted to NeurIPS 2026 (Spotlight). 26 pages, including appendix
点击查看摘要
Abstract:Latent diffusion models paired with a variational auto-encoder (VAE) tokenizer have shown promising performance for efficient text-driven human motion generation. However, motion latent diffusion suffers from a generation-reconstruction trade-off: simply increasing tokenizer capacity enhances reconstruction but fails to proportionally improve text-conditioned generation quality. We assume this trade-off stems from a spectral mismatch inside the VAE tokenizer: the encoder yields a latent space biased toward high frequencies, and the decoder introduces temporal artifacts. In this paper, we propose the Diffusable Motion Tokenizer (DiMoT) to improve the diffusability of the tokenizer, rather than scaling up the diffusion backbone. To improve text-conditioned optimization, Critic Spectral Adaptation (CSA) leverages a pretrained diffusion model as the critic to suppress high-frequency latent energy. To preserve motion dynamics, the Alpha-Flow Motion Decoder (AMD) performs generative decoding via average-velocity prediction, enabling efficient one-step decoding. Extensive experiments demonstrate that DiMoT achieves state-of-the-art performance across various challenging text-to-motion benchmarks, yielding superior motion fidelity and text-motion alignment. Project page: this https URL.
265. 【2611.10148】BATCH: Behavior Alignment for Cross-Embodiment Learning from Humans
链接：https://arxiv.org/abs/2611.10148
作者：Zeyi Liu,Shuran Song
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：remains challenging due, learning remains challenging, action spaces, differences in embodiment, provide a scalable
备注： Project website: [this https URL](https://batch-embodiment.github.io/)
点击查看摘要
Abstract:Human demonstrations provide a scalable source of diverse manipulation data, but leveraging them for robot learning remains challenging due to differences in embodiment, viewpoint, action spaces, and temporal structure. We introduce BATCH, a cross-embodiment learning framework that explicitly aligns human and robot behaviors. BATCH learns self-supervised temporal representations with a cycle-consistency objective to establish cross-embodiment correspondences without manual annotation. We further introduce two complementary training objectives that leverage these correspondences within an autoregressive videoaction diffusion model: behavior-aligned co-training and human-to-robot style transfer. On real-world manipulation tasks, BATCH improves generalization to unseen task configurations compared with training on unaligned data and prior cross-embodiment baselines, with additional gains from the style-transfer objective. Our results demonstrate that explicit behavior alignment enables more effective transfer from human demonstrations to robot policies.
266. 【2611.10106】Beyond Prompt Attacks: Least-Action Auditing of Concept Erasure
链接：https://arxiv.org/abs/2611.10106
作者：Yifei Zhu
类目：Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV)
关键词：Concept, prompt attack tests, Concept erasure, concept unlearning, Safe Latent Diffusion
备注： 22 pages, 12 figures
点击查看摘要
Abstract:Concept erasure, or concept unlearning, in text-to-image diffusion models is usually audited with prompt attacks. A prompt attack tests whether one conditioning string still retrieves the erased concept. It does not measure the probability that the frozen generator still assigns to that concept. We introduce least-action auditing of this residual probability, and evaluate it on Stable Diffusion concept-erasure checkpoints. The least-action barrier is the minimum control cost of driving the frozen reverse process into a detector-defined concept event. This cost equals the path-space KL divergence of conditioning the model on the event, and therefore the event's negative log-probability. The estimate $\Delta S_{\mathrm{rob}}$ uses a CLIP$\wedge$DINOv2 consensus terminal, with no retraining and no adversarial prompt. Across $18$ erased concept-mechanism pairs spanning object classes and NSFW nudity, $\Delta S_{\mathrm{rob}}$ predicts deployment leakage counted on $1{,}500$ fresh samples per model by detectors excluded from the audit (pooled Spearman $\rho{=}{-}0.76$, $p{=}5{\times}10^{-4}$). Within every audited concept, the eraser with the higher barrier leaks less ($18/18$). On NSFW nudity the barrier orders the standard erasers exactly: UCE $\Delta S_{\mathrm{rob}}{=}3.9$ (leak $16.4\%$) $$ ESD $75.5$ ($9.8\%$) $$ RECE $224.5$ ($1.4\%$), while Safe Latent Diffusion (SLD) stays near zero and leaks $85.5\%$ under explicit prompts. The same trajectories repair deployed checkpoints. An audit-guided closed-form patch reduces UCE nudity leakage from $16.2\%$ to $0/1{,}500$ and RECE church leakage by $3.3\times$, where direction-count-matched random edits fail.
267. 【2611.10097】A Privacy-Aware Deep Learning Benchmark for Facial Emotion Recognition
链接：https://arxiv.org/abs/2611.10097
作者：Larissa Palhares,Maria Machado,Hudson Bruno,Raphael Ramos,Andrew Vale,Barbara Barbosa,Inara Souza,Fabio Grassiotto
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：raw RGB images, introducing privacy risks, Facial Expression Recognition, RGB images, identity-confounding visual shortcuts
备注： 7 pages, 2 figures
点击查看摘要
Abstract:Facial Expression Recognition (FER) traditionally relies on raw RGB images, introducing privacy risks, sensitivity to illumination variations, and susceptibility to identity-confounding visual shortcuts. As an alternative, this work proposes a lightweight, privacy-aware pipeline using exclusively geometric representations-facial landmarks (478 points) and blendshapes (52 coefficients, ARKit standard)-eliminating persistent raw video storage. Six neural architectures trained from scratch on fused CREMA-D and RAVDESS datasets were benchmarked against an ImageNet-pretrained ResNet50 baseline under a 5-fold subject-independent cross-validation protocol. Geometric models consistently outperformed the pixel baseline on unseen subjects with 12-124 times fewer parameters, while demonstrating superior robustness on subtle emotional expressions such as sadness. Ablation studies reveal that blendshapes capture the primary discriminative signal, while landmarks provide essential complementary spatial topology. These results demonstrate that compact geometric representations preserve affective semantics, eliminate downstream transfer learning dependency on visual backbones, and enable efficient, privacy-aware emotion recognition.
268. 【2611.10093】Contrastive fine-tuning against stain and scanner bias improves robustness and downstream performance across pathology foundation models
链接：https://arxiv.org/abs/2611.10093
作者：Ryan Kim,Hassan Muhammad,Anish Dulal,Paul S. Scotti,Tanishq Mathew Abraham
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：limiting real-world utility, potentially limiting real-world, Histopathology foundation models, creating generalization gaps, achieve strong performance
备注： ASCI Workshop, Neurips 2026
点击查看摘要
Abstract:Histopathology foundation models achieve strong performance across diverse downstream tasks, yet their representations have been shown to encode scanner- and site-specific biases, creating generalization gaps and potentially limiting real-world utility. We introduce SPECTRA (Scanner and Pathology Embedding Contrastive Tuning for Robust Alignment), a model-agnostic contrastive learning post-training framework which explicitly encourages scanner- and stain-robust representations, to optimize performance and generalization on downstream applications. Using parameter-efficient LoRA adapters trained on matched multi-scanner and multi-stain whole-slide images sourced from the PLISM dataset, our method aligns spatially corresponding regions across acquisition conditions (scanner, stain), using other locations within each candidate condition as negatives. SPECTRA improved PathoROB robustness index, gene-expression prediction on HEST, slide-level classification AUC on CPTAC, and held-out PLISM retrieval for every model. Overall tile-level classification on THUNDER also improved, with exceptions for segmentation and calibration tasks. We open-source our training and evaluation codebases and release adapters and model weights for selected backbones.
269. 【2611.10092】Adapting Frozen Promptable Segmenters to User-Defined Taxonomies via Few-Shot Proposal Learning
链接：https://arxiv.org/abs/2611.10092
作者：Khayrul Islam,Christopher Frederic Miller(Computational Engineering Division, Lawrence Livermore National Laboratory, Livermore, CA, USA)
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Promptable segmenters, SAM family turn, family turn, turn a click, costly part
备注： LLNL-CONF-2026172
点击查看摘要
Abstract:Promptable segmenters of the SAM family turn a click or a phrase into an instance mask, so the costly part of a label is now its class. However, each annotation project draws its own class boundary, often through objects these models already know: people from cars, sedans from trucks, one sedan model from another. A generic model's boundary is fixed by its training vocabulary. We present SNAP, an annotation pipeline that learns the project's boundary from the labels the annotator draws anyway. On one frozen SAM2.1 pass per image, we fit a per-project head, SnapHead, that classifies every proposal and refits in seconds after each labeled image. Where SAM 3 is available, the same labels decide class by class whether to keep its boundary or ours. Given the true masks of eight look-alike cell lines, SAM 3 assigns classes at Cohen's kappa = 0.038 and SnapHead at 0.754 (60 labeled images), and when only the class names change, SAM 3 falls to chance and SnapHead's score is unchanged. End to end, with 20 labeled images, SNAP beats a SAM 3 oracle tuned on the evaluation labels on five microscopy projects (0.484 against 0.441 F1), and run unchanged on five held-out datasets, it beats SAM 3 as shipped on four. Our results suggest that frozen foundation features already encode the class boundaries a generic vocabulary misses, and that a project's own labels are enough to read them out.
270. 【2611.10088】Same Pixels, Different Documents: Measuring Part-Level Editability in Image Vectorization
链接：https://arxiv.org/abs/2611.10088
作者：Boheng Zhu,Zehua Wang,Wei Chen,Ming-Hao Lin
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：Image vectorization, evaluated by rendering, render identically, identically but support, Image
备注： 11 pages, 2 figures, 4 tables
点击查看摘要
Abstract:Image vectorization is often evaluated by rendering fidelity, which cannot distinguish documents that render identically but support different edits. Edit-based evaluation tests outcomes, but an oracle that gathers a part's fragments can conceal the cost of selecting them. We introduce Pass@k, which tests whether a prescribed edit can succeed using objects selectable within k clicks under a specified interaction model. Eight document diagnostics characterize properties relevant to editing beyond these tasks. We assess structural sensitivity through controlled perturbations, practical relevance through designer operations, and reference dependence through alternative drawings. We evaluate twelve open and commercial methods on 211 references, with 635 edit tasks on 93 of them. In each of four reference sets, including two drawn by designers, 64-88% of oracle-passed tasks on parts composed of multiple shapes fail at Pass@1, against 6-40% for single shapes, pooling counts over configurations. Higher fidelity does not guarantee higher Pass@1, while selected diagnostics are associated with designers' effort in our study.
271. 【2611.10066】VLM as an Editing Pilot: VLM-Steered Velocity Control for Flow-Based Image Editing
链接：https://arxiv.org/abs/2611.10066
作者：Kuan-Shen Chiu,Jia-Wei Liao,Yu-Chieh Chao,Li-Xuan Peng,Wei-Yun Ma,Cheng-Fu Chou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Text-guided image editing, Text-guided image, requested semantic change, preserving content unrelated, image editing requires
备注：
点击查看摘要
Abstract:Text-guided image editing requires realizing the requested semantic change while preserving content unrelated to the instruction. FlowEdit provides an efficient inversion-free solution, but its source-anchored coupling can become overly restrictive, causing zero-edit, where the output remains close to the source and the requested change fails to emerge. We find that source coupling directly governs the preservation--editing trade-off, while a fixed coupling schedule cannot adapt to timestep-specific editing needs. Motivated by this observation, we propose V2C-Edit, a training-free VLM-steered velocity control framework. V2C-Edit constructs complementary coupling-controlled velocities and dynamically selects among them using Instruction-Level Similarity (ILS), which evaluates whether the predicted transformation follows the editing instruction. Adaptive spatial masking further preserves regions unrelated to the edit. Experiments on MagicBrush and PIE-Bench with FLUX and Stable Diffusion 3 show that V2C-Edit consistently improves instruction alignment over FlowEdit while maintaining competitive structural preservation, and that ILS better reflects editing effectiveness than target-caption CLIP similarity. Our code is available at this https URL.
272. 【2611.10062】REFORM-3D: A Representation-Centric Evaluation Framework for 3D Medical Vision Foundation Models
链接：https://arxiv.org/abs/2611.10062
作者：Maregu Assefa,Muzammal Naseer,Divya Velayudhan,Gedamu Alemu Kumie,Naoufel Werghi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：downstream task scores, entangle representation quality, textbf, task scores, adaptation choices
备注： 32 pages, 6 figures, Accepted to NeurIPS 2026 ED Track
点击查看摘要
Abstract:Evaluation of 3D medical foundation models is typically dominated by downstream task scores, which entangle representation quality with adaptation choices. This is especially critical in volumetric imaging, where spacing and anisotropy can substantially alter image statistics while the anatomy itself remains unchanged. We therefore introduce \textbf{REFORM-3D}, a \textbf{R}epresentation-centric \textbf{E}valuation \textbf{F}ramew\textbf{OR}k for benchmarking frozen 3D medical vision foundation \textbf{M}odels across three questions: Acquisition Robustness, asking whether features remain stable when spacing varies while anatomy is fixed; Cross-Modal Anatomical Alignment, asking whether labeled anatomical structures remain recoverable across modalities under balanced bidirectional retrieval; and Anatomical Transfer, asking whether organ identity remains recoverable from limited labeled support under case-disjoint evaluation. These are also pretraining questions, because what a 3D encoder learns depends on how volumes are geometrically presented during self-supervised pretraining. We further introduce Med3DINO encoder family, pretrained on $62.6$K unlabeled MR, CT, PET, CTA, and CBCT volumes under three explicit geometric assumptions: isotropic normalization, voxel-relative sampling, and spacing-aware resampling. Across Med3DINO and heterogeneous external encoders, REFORM-3D reveals module-specific strengths rather than a single model ordering. Within the controlled Med3DINO comparison, voxel-relative sampling yields lower embedding drift, whereas spacing-aware resampling favors anatomical transfer; semantic-transfer advantages depend on the dataset and feature type. Project link: \href{this https URL}{\highlightLR{REFORM-3D}}.
273. 【2611.10061】UniLatent: Cross-Embodiment Transfer via Latent Observation Alignment
链接：https://arxiv.org/abs/2611.10061
作者：Yufei Ding,Yi Du,Weiduo Yuan,Hao Jiang,Dylan Goetting,Lawrence Yunliang Chen,Daniel Seita,Yue Wang
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：specific embodiment, making it difficult, datasets are costly, costly to collect, difficult to reuse
备注： Accepted to CoRL 2026
点击查看摘要
Abstract:Robot datasets are costly to collect and are usually tied to a specific embodiment, making it difficult to reuse demonstrations across robots with different geometry, appearance, and kinematics. We introduce UniLatent, a cross-embodiment transfer framework that reduces the embodiment-induced observation gap in a shared latent space. UniLatent renders paired source-target robot observations in simulation and aligns a source visual encoder to a frozen target encoder. A policy trained on encoded source demonstrations can then run directly on target observations, with no pixel-level image translation. Across three simulation tasks and two target robot arms, UniLatent reaches up to 93% zero-shot success, exceeding the strongest pixel-translation baseline by over 30 points on average. In real-world xArm-to-Franka transfer, fine-tuning with only 10 target demonstrations per task yields 27/30 successful rollouts. Code, videos and data are available at this https URL.
274. 【2611.10033】Ultra-Lightweight 3D Medical Image Segmentation via Knowledge Distillation in Label-Scarce Domains
链接：https://arxiv.org/abs/2611.10033
作者：Rahim Ullah,Hasan Abbas,Syed Waqar Nabi
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：medical image segmentation, reduces computational complexity, neural network architecture, computational complexity, medical image
备注： This is a four pages paper having 3 figures and is submitted to ISBI2027
点击查看摘要
Abstract:Mamba is a neural network architecture that reduces computational complexity, and has been shown to be effective for 3D medical image segmentation. However, existing models still remain computationally expensive. We propose compressing Mamba by distillation while achieving competitive performance. Specifically, we demonstrate compression of a 139M-parameter SegMamba-V2 teacher into a lightweight TinyUNet3D student with about 0.96M parameters, achieving about 145$\times$ compression with a performance drop of just over one Dice point. We further investigate the utility of knowledge distillation in a range of data-labeling scenarios under identical experimental settings, and show that its advantage is most prominent when labeled data is scarce. To demonstrate the generalizability of our approach, experiments are conducted on three datasets: BraTS 2023, MSD Spleen and MSD Hippocampus. The code for TinyUNet3D is publicly available at: this https URL.
275. 【2611.10032】GMD-Mamba: Lightweight 3D Medical Image Segmentation Using a Grouped Multi-Directional Mamba
链接：https://arxiv.org/abs/2611.10032
作者：Rahim Ullah,Hasan Abbas,Hazrat Ali,Syed Waqar Nabi
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：medical image segmentation, capture global context, medical image, image segmentation, capability to capture
备注： It is a four pages paper with 2 figures and submitted to ISBI2027
点击查看摘要
Abstract:Mamba has the capability to capture global context in linear time for 3D medical image segmentation. However, existing methods employ Mamba with full-width directional scans at every resolution, keeping the model large (64-138M parameters and high FLOPs). We propose Grouped Multi-Directional (GMD) Mamba, a lightweight network based on the GMD scan that divides input channels $C$ into groups $G$ and flattens each group in different directions in one pass. This gives multi-directional context at $O(C^2/G)$ instead of $O(K \cdot C^2)$, where $K$ is the number of scan directions. Additionally, we employ Mamba only at the deepest encoder stages, resulting in 19.2M parameters. On BraTS2023, it achieves the best average Dice of 92.0% and the lowest HD95 of 2.7 at $\sim$1/7 the parameters of SegMamba-V2. For model validation, we also ran experiments on the MSD Spleen dataset, achieving competitive performance. The implementation details and code are publicly available at this https URL.
276. 【2611.10028】Beyond Hash Matching: AI-Based Detection of Previously Unidentified CSAM and its Legal Implications in the EU
链接：https://arxiv.org/abs/2611.10028
作者：Emmanouela Kokolaki,Georgios Samaritakis,Paraskevi Fragopoulou
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Sexual Abuse Material, Child Sexual Abuse, unidentified Child Sexual, previously verified material, previously unidentified Child
备注：
点击查看摘要
Abstract:The detection of previously unidentified Child Sexual Abuse Material (CSAM) remains a significant challenge for law enforcement authorities, online service providers, and child protection organizations, as traditional hash-matching technologies are primarily designed to identify previously verified material. This paper reviews and classifies existing AI-based technologies that could complement hash-based approaches and support the detection, analysis, and prioritization of potentially harmful content. The reviewed approaches are organized into three categories: real-time image and video analysis, image and video classification and tagging, and AI-based behavioral monitoring. A comparative analysis examines the capabilities, limitations, and potential integration of general-purpose computer vision platforms, content moderation services, and specialized CSAM detection tools within existing detection workflows. An experimental evaluation was conducted using Google Cloud Vision AI and Sightengine to investigate sexual-content classification and child-adult age estimation. The results highlight differences in classification taxonomies and outputs across providers, as well as significant limitations in age classification, particularly for adolescents. These findings highlight the importance of using AI-based assessments as complementary tools for analysis and prioritization, rather than as definitive determination of CSAM. Finally, the paper examines the relevant European Union regulatory framework, with particular attention to the EU AI Act, the General Data Protection Regulation (GDPR), fundamental rights, transparency, accountability, and human oversight. The legal analysis highlights how regulatory obligations and safeguards may differ depending on the deployment context, potentially creating inconsistencies across interconnected detection and reporting workflows.
277. 【2611.10014】Nanopath: Fast, Fair, Open Experimentation for Pathology Foundation Models
链接：https://arxiv.org/abs/2611.10014
作者：Paul S. Scotti,Hassan Muhammad,Ryan Kim,Nima Ashjaee,Ratna Sagari Grandhi,Saman Rahbar,Raymond Biju,Anish Dulal,Chao Feng,Connor Lane,Benjamin Warner,Tanishq Mathew Abraham
类目：Computer Vision and Pattern Recognition (cs.CV); Tissues and Organs (q-bio.TO)
关键词：evaluating small-scale pathology, small-scale pathology foundation, TCGA pathology tile, million TCGA pathology, open-source framework
备注： 17 pages, 2 figures, 10 tables. NeurIPS 2026 workshop: AI at Scale for Clinical Impact: Cancer Pathology Foundation Models
点击查看摘要
Abstract:We introduce nanopath, an open-source framework and benchmark for rapidly training and evaluating small-scale pathology foundation models. Using a single H100 GPU, a typical nanopath model trains in a little over an hour on up to one million TCGA pathology tile presentations and evaluates within 25 minutes on a broad suite of tile-level and slide-level tasks. Nanopath enables rapid exploration of research ideas at small scale, so promising training recipes can subsequently be tested with more data and compute. To enable fair comparisons between ideas, we constrain submissions to fixed data and compute budgets while keeping the downstream evaluation protocol fixed. Anyone may clone the codebase, automatically download the data, reproduce or modify existing models, and submit a run to Labless, our public experiment ledger where researchers and AI agents can search through prior attempts. Since its public release in June 2026, nanopath has received 1,269 experiments from 20 contributors. Here, we detail its design and assess how well its rapid evaluation tracks standardized THUNDER, HEST, and PathoBench (CPTAC) benchmarks across six nanopath and 14 reference foundation models. Nanopath's fast evaluation suite strongly tracked these standardized benchmarks, and a few 22M parameter nanopath models even outperformed giant 1.1B parameter models on a subset of downstream tasks. We subsequently discuss how we have since optimized nanopath's evaluation suite to be an even more faithful, quick proxy for external benchmarking. Nanopath provides an accessible testbed for students, researchers, and AI agents to explore pathology foundation modeling through fair, transparent, and directly comparable experiments.
278. 【2611.10013】From Video to Digital Twin: An Exploratory Study of World Models and Gaussian Splatting on In-the-Wild Video
链接：https://arxiv.org/abs/2611.10013
作者：Somesh Mohapatra
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：Gaussian Splatting promise, Generative world models, Gaussian Splatting, Splatting promise, Generative world
备注： 35 pages, 14 figures. Supplementary movies and code: [this https URL](https://github.com/pikulsomesh/foodbank-spatial-twin)
点击查看摘要
Abstract:Generative world models and 3D Gaussian Splatting promise to turn ordinary video into explorable 3D scenes, but little is reported on how they behave on uncurated, in-the-wild footage. We study what these models recover when the only input is a publicly available news walkthrough of a food bank warehouse, with presenters walking through every shot and no drawings, scans or site visit, and we use the result as the geometry of a digital twin. A commercial world model given 20 frames recovered camera poses and metric depth for three areas, which we fused into about 747,000 Gaussian splats for 200 credits (20 US cents). Splat models optimized locally on a CPU, at no credit cost, were photorealistic near the filmed path but degraded quickly away from it. On held-out frames, scored in pixels not covered by people, they reached 21.2 and 23.1 dB PSNR from 64 and 43 training frames, and lost 3.8 and 5.4 dB when given only the 8 frames a world model accepts. Removing the trainer's background fill and person-hull carving raised held-out PSNR, showing that cleaning the space behind moving people costs fidelity in observed pixels while its gain lies where no ground truth exists. Asking the world model to generate views of areas the video never showed failed on the provider's side twice, so extrapolation could not be evaluated and unseen space was filled by a scripted model instead. We also describe the corrections needed to turn world-model output into a valid, metric Universal Scene Description (OpenUSD) asset with its native splat schema, which serves as the only interface to a data layer, a browser viewer, Blender and NVIDIA Omniverse. The findings suggest that today's models recover the observed parts of a real scene cheaply and at metric scale, while few-view fidelity and extrapolating unobserved space remain open. The work is an exploration of these methods, not a deployed product.
279. 【2611.10007】Representation Learning for 3D Brain Imaging: A Benchmark
链接：https://arxiv.org/abs/2611.10007
作者：Pierre Falconnier(MYRIAD),Robin Trombetta(MYRIAD),Nicolas Duchateau(MYRIAD),Carole Lartizien(MYRIAD)
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：RGB images, deep learning, computer vision, vision tasks rely, deep learning models
备注：
点击查看摘要
Abstract:Many deep learning architectures for computer vision tasks rely on features extracted by a pre-trained encoder on large databases of natural 2D RGB images. However, the wide domain gap with medical images hampers the direct transfer of optimized deep learning models from computer vision to clinical applications. Recently, self-supervised pre-training and foundation models emerged as promising alternatives to mitigate these limitations. Yet, constructing such models for medical imaging faces critical challenges, including designing and adapting training strategies for large 3D volume datasets, and the need for standardized benchmarks to evaluate feature extraction performance. In this study, we propose an extensive comparison of vision encoders with a focus on 3D brain MRI. First, we consider 8 fully and self-supervised models pretrained on natural images (e.g. ResNet, DINO, CLIP) and 10 backbone architectures trained on medical images, either based on supervised (e.g. RadImageNet) or self-supervised (e.g. BiomedCLIP, SimCLR) tasks. All pre-trained encoders are evaluated on various downstream tasks to assess the representation power of their latent representations, including age and sex prediction as well as disease classification on the ADNI and PPMI datasets. Our study shows that 2D encoders pre-trained on natural images perform the most favorably, even compared to models pre-trained on more than 100k brain MRI volumes, highlighting the need for more suitable and robust methods for representation learning in 3D medical imaging. The source code for this study is publicly available at: https: //github.com/PierreFalconnier/brain-representation-benchmark.
280. 【2611.10005】EarthJev: Efficient Visual Evidence Acquisition and Decision for UHR Remote Sensing Understanding
链接：https://arxiv.org/abs/2611.10005
作者：Pengyu Dai,Yao Zhang,Jian Song,Junjue Wang,Yafei Ou,Yuzeng Chen,Junshi Xia,Hongruixuan Chen,Naoto Yokoya
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：requires locating fine-grained, remote sensing visual, visual input budgets, locating fine-grained evidence, limited visual input
备注： 13 pages, 8 figures
点击查看摘要
Abstract:Ultra-high-resolution (UHR) remote sensing visual question answering (VQA) requires locating fine-grained evidence in large scenes under limited visual input budgets. Active observation addresses this challenge through selective exploration, but repeated generative judgments can make region search costly. Its decisions also concern distinct prediction targets: spatial pointer validity, evidence presence, and reasoning correctness. We propose EarthJev, a framework that separates region scoring from answer generation and uses target-specific decision signals while keeping the answering model frozen. A spatial pointer verifier uses visual and geometric cues to guide exploration or bypass search. An evidence-aware decision mechanism scores compact candidate views in batches using a lightweight head on frozen representations, without generating textual region judgments. Format-specific confidence calibration then guides selection between candidate answers generated from memory and overview presentations of the acquired evidence. Across five benchmarks, EarthJev achieves a mean accuracy of 53.06% with Qwen3.5-9B, outperforming ZoomSearch with the same answering model by 2.33 to 14.73 percentage points per benchmark while reducing mean latency from 11.30 - 1.67 seconds per question. With four additional frozen answering models, model-specific fitting of the decision modules and calibration mappings yields mean accuracy gains of 3.41 - 6.53 percentage points over the corresponding single-pass baselines. Code is available at this https URL
281. 【2611.10004】MATA: Motion-aligned Temporal Adapter
链接：https://arxiv.org/abs/2611.10004
作者：Ashish Kumar Singh,Prakash Chandra Chhipa
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：recognition requires recognizing, action recognition requires, Few-shot fine-grained video, Few-shot fine-grained, video action recognition
备注： Accepted at WACV 2027. Joint first authors with equal contributions. Code - [this https URL](https://github.com/prakashchhipa/MATA-Motion-aligned-Temporal-Adapter)
点击查看摘要
Abstract:Few-shot fine-grained video action recognition requires recognizing novel action classes from only a few labeled examples. The difficulty is that visually similar actions often share actors, scenes, poses, and objects, differing only in the order, timing, and short duration of motion changes. We study this problem under three practical constraints: few tunable parameters, low compute cost, and use of the video modality alone. We propose Motion-aligned Temporal Adapter (MATA), a parameter-efficient adapter on top of a frozen CLIP backbone. MATA specializes CLIP features along the temporal dimension using two components: temporal phase alignment through learnable temporal positional embeddings, and a local motion transition operator through depth-wise convolution. With only ~3.6M tunable parameters, MATA achieves state-of-the-art performance across multiple fine-grained benchmarks while remaining robust to both visual corruptions and temporal disruptions induced by frame dropping. Code is available at this https URL
282. 【2611.10003】Reliability-Aware Benchmarking of Self-Supervised Learning in Histopathology Under 1-10% Label Regimes
链接：https://arxiv.org/abs/2611.10003
作者：Alicem Koyun,Pranjali Changadeo Pingale,Sachin Mote,Gianluca Pizzuti
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Expert annotation, realistic histopathology workflows, low-label regimes remain, annotation in digital, digital pathology
备注： Oral presentation, CIBB 2026 (21st International Conference on Computational Intelligence Methods for Bioinformatics and Biostatistics, Rome, Italy). 6 pages, 4 figures, 3 tables. Code: [this https URL](https://github.com/alicemkyn/ssl-histopath-reliability)
点击查看摘要
Abstract:Expert annotation in digital pathology is expensive, and low-label regimes remain common in realistic histopathology workflows. Self-supervised learning (SSL) offers a practical way to learn transferable representations from unlabeled pathology images, but performance-only evaluation can hide unreliable confidence behavior under domain shift. We present a reliability-aware benchmark of SimCLR, BYOL, and an MAE-inspired masked-reconstruction baseline on PatchCamelyon (PCam; 96x96) and PANDA (prostate cancer) under 1%, 5%, and 10% labeled regimes with frozen-encoder linear probing. To address common single-run concerns, ResNet-18 results are repeated over 3 splits x 3 seeds (n=9) and ViT-B/16 over 1 split x 3 seeds (n=3) under practical compute constraints, with mean+/-std reporting and per-run logs. Beyond AUROC, accuracy, and F1-score, we report Expected Calibration Error and Brier score, OOD confidence diagnostics for cross-dataset PCam-PANDA scoring, federated-vs-centralized SimCLR comparisons on PCam, and cross-dataset transfer to colorectal histology tiles. SSL improves label efficiency on the more controlled PCam task, while PANDA's noisier patch-level proxy can remain near coin-flip with higher variance. The study highlights that histopathology SSL should be assessed not only by ranking performance but also by calibration, robustness, and transparent reproducibility diagnostics before clinical interpretation.
283. 【2611.10001】Optimized Car Damage Detection Using CNN and Object Detection Model
链接：https://arxiv.org/abs/2611.10001
作者：Sania Ejaz,Jaison Shajan Thomas,Zaheeruddin Ahmed,Sushma Hans
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：car garage exhibits, Car damage detection, accident reporting systems, damage detection systems, insurance claims process
备注： 6 pages, extended technical report
点击查看摘要
Abstract:Car damage detection systems play a vital role in scenarios, like the insurance claims process, accident reporting systems, or a documented write-up of the various damages a vehicle in a car garage exhibits upon entry and exit. This paper presents a two-fold model architecture encompassing a convolutional neural network used to classify the collected input samples as clear or damaged, thereby filtering out the undamaged images, before the input is passed on to the object detection layer for further localization and classification of defects into Scratch, Dent, Glass Shatter, and Smash. A deviation from the focus of related work, this paper poses the use of unified models while applying transfer learning techniques to augment performance that caters to multiple use cases. The design of this model has been made to optimize performance by incorporating the two models to streamline the processing of input samples. The model boasts significant performance with accuracies of 98% for the CNN layer and 0.5 mAP for the object detection layer. However, the metric for the object detection layer seems to understate its performance due to reasons discussed within the paper.
284. 【2611.09998】Quality-Governed Deep Learning Network for Brain Tumor MRI Segmentation
链接：https://arxiv.org/abs/2611.09998
作者：Asifiqbal Saiyed,Nitesh Chilakala,Jimmy Joseph,Praneetha Goli,Rohini Maskar
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：magnetic resonance imaging, Deep Learning Network, resonance imaging, computer-aided neuro-oncology, treatment planning
备注：
点击查看摘要
Abstract:The segmentation of brain tumors from magnetic resonance imaging (MRI) is an essential step for computer-aided neuro-oncology, treatment planning and follow-up. While effective encoder-decoder representations are achieved by U-Net and Attention U-Net, the skip sections of the network can generate weak-contrast or noisy responses in the case of heterogeneous boundaries of the tumor. In this paper, we introduce a Quality-Governed Deep Learning Network (QGDL-Net) that can be used for binary tumor segmentation from FLAIR MRI slices. The proposed model is able to predict the slice quality based on contrast and SNR statistics and to fine-tune the encoder features prior to decoding by learnable quality gates. We used the 80:20 train-validation split for experiments with BraTS 2021. QGDL-Net achieved a Dice of 0.9747, IoU of 0.9506, precision of 0.9755, recall of 0.9739, F1 of 0.9747 and accuracy of 0.9982, outperforming U-Net and Attention U-Net. The EigenCAM maps and segmentation overlays provide better tumor localization and interpretable activation around the lesion regions.
285. 【2611.09997】SurvAD: How Anomalies Survive Diffusion Reconstruction
链接：https://arxiv.org/abs/2611.09997
作者：Lexing Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Diffusion-based anomaly detectors, anomaly detectors reconstruct, Diffusion-based anomaly, remains uncharacterized, image towards normality
备注： 10 pages, 4 figures
点击查看摘要
Abstract:Diffusion-based anomaly detectors reconstruct a test image towards normality, yet how much of an anomaly survives, its leak, remains uncharacterized. We show that a first-order deterministic sampler obeys an exact recursion along the anomaly, whose continuous limit is a survival law. The anomaly decays exponentially as the noise falls, at a rate set by the retention $r$, the share the model keeps on the states it visits. Because $r$ depends on the noise level and not on the step count, one measured path predicts the leak of other step counts, samplers and schedules from a nearby start to within a few hundredths, on four diffusion models and real defects. The law also shows that the leak's growth over steps is exposure bias and that normal details obey the same law, so changing the path or the training trades leak for detail error. We introduce SurvAD, which fine-tunes the reconstructor on inference-like starts and fits a comparator that adds evidence to the residual map without suppressing its ranking elsewhere. For under $2\%$ more inference time, SurvAD raises the multi-class pixel average precision (P-AP) of DeCo-Diff from $76.8$ to $80.7$ on MVTec AD and from $57.5$ to $60.0$ on VisA. It matches CostFilter-AD on the same reconstructor with $9\times$ fewer trainable parameters and, under Dinomaly's protocol, exceeds its reported P-AP on Dinomaly on both benchmarks.
286. 【2611.09993】Retrieval-Grounded Multi-View Reasoning for Clinically Reliable Radiology Report Generation
链接：https://arxiv.org/abs/2611.09993
作者：Wanshu Fan,Zeyu Wang,Zheng Tong,Qi Ai,Wencai Weng,Haifan Gong,Congyu Liao,Guoliang You,Xiaofeng Liu,Dongsheng Zhou,Cong Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Chest radiograph report, radiograph report generation, Adaptive Multi-view Evidential, Multi-view Evidential Reasoning, Clinical Prompt Learner
备注：
点击查看摘要
Abstract:Chest radiograph report generation is hampered by retrieved reports that resemble the current image but are clinically inconsistent with it, and by diagnostic-label imbalance. We present RG-MVR, a retrieval-grounded framework comprising Retrieval-Augmented Evidence Grounding, which combines dense memory summaries with visually gated sparse retrieved evidence; Adaptive Multi-view Evidential Reasoning, which weights image, memory, and retrieved evidence per case; and a Clinical Prompt Learner, which models finding mention separately from positive, negative, or uncertain status. On MIMIC-CXR, RG-MVR achieved a clinical-label F1 of 0.483 and a BLEU-4 of 0.118 (IU X-ray: 0.202 and 0.110). In an exploratory external cohort of 22 examinations, clinical-label agreement declined markedly (F1, 0.071) and unsupported statements remained common, although physicians found fewer unsupported temporal comparisons (9 vs. 20 cases) and device-related statements (7 vs. 15) than with the baseline. Evidence-aware retrieval and structured diagnostic prompting may reduce specific reporting errors, but broader external validation is required.
287. 【2611.09987】Stochastic Deep Supervision for Gallery-Consistent Early-Exit Face Recognition
链接：https://arxiv.org/abs/2611.09987
作者：Guray Ozgur,Tahar Chettaoui,Eduarda Caldeira,Naser Damer,Fadi Boutros
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Vision Transformers, inference limits deployment, fixed-depth inference limits, perform strongly, face recognition
备注： Accepted at WACV2027
点击查看摘要
Abstract:Vision Transformers (ViTs) perform strongly in face recognition (FR), yet their fixed-depth inference limits deployment in resource-constrained settings. We propose SD-ViT, a training framework that gives a usable exit at every block depth by making every depth produce discriminative embeddings, for budget-selected fixed-depth exits. Standard ViTs supervise intermediate layers only through backpropagation, so their intermediate representations are not directly optimized to form usable identity embeddings. SD-ViT adds a stochastic auxiliary signal: at each iteration a randomly selected intermediate block is passed through the same embedding head as the final layer and trained with a weighted margin-penalty softmax loss. The objective is thus stochastically sampled deep supervision through a shared classifier. Because both loss terms share that head and classifier, intermediate tokens are trained to map into the same embedding space as final-layer tokens. This matters for FR, where matching is by similarity: a probe processed at an early exit can be compared directly against full-depth gallery embeddings, with no gallery recomputation or adaptation layers. On established benchmarks, SD-ViT stays within 0.4 IJB-C points of the same backbone trained conventionally at full depth, while its early-exit probes recover over 96% of their own full-depth performance at 50% of the computational cost without modifying the reference gallery. A single verification threshold calibrated at full depth remains usable from quarter depth onward.
288. 【2611.09982】QCVS: Question-Contrastive Visual Steering for Multimodal Reasoning
链接：https://arxiv.org/abs/2611.09982
作者：Tong Fu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：low-level perceptual noise, entangles query-relevant reasoning, query-relevant reasoning dynamics, Inference-time steering, causing collateral degradation
备注： 5 pages, 2 figures, 3 tables
点击查看摘要
Abstract:Inference-time steering in vision-language models often entangles query-relevant reasoning dynamics with low-level perceptual noise, causing collateral degradation on correct predictions. We propose Question-Contrastive Visual Steering (QCVS) to isolate task-specific intervention directions via double-differential activation probing. By contrasting spatial layout perturbations under the target query against a generic description reference, QCVS cancels task-agnostic visual artifacts without ground-truth supervision. A dual-threshold gating mechanism then evaluates relative interaction strength and signal amplitude, selectively applying a single bounded hidden-state update only when necessary. Empirical evaluations across multiple scales of Qwen3.5 (2B to 9B) and DeepSeek-VL2 on DynaMath and We-Math demonstrate that QCVS achieves state-of-the-art accuracy gains under sparse coverage (approximately 22%-30%). Crucially, QCVS yields repair rates up to 13.98% while suppressing collateral damage down to 0.41%, proving high intervention precision and computational efficiency.
289. 【2611.09980】Preconditioned Implicit Midpoint Langevin Sampling for Non-Smooth Bayesian Imaging
链接：https://arxiv.org/abs/2611.09980
作者：Sichen Wang,Zhipeng Lu
类目：Computer Vision and Pattern Recognition (cs.CV); Numerical Analysis (math.NA); Optimization and Control (math.OC)
关键词：implicit-midpoint Langevin sampler, preconditioned implicit-midpoint Langevin, high-dimensional log-concave targets, implicit-midpoint Langevin, Langevin sampler
备注： Accepted at NeurIPS 2026. 40 pages, 19 figures
点击查看摘要
Abstract:We introduce P-IMLA, a preconditioned implicit-midpoint Langevin sampler for high-dimensional log-concave targets with non-smooth regularization. The obstruction is that the large steps enabled by matrix preconditioning are precisely where preconditioned Euler-Maruyama inflates stationary variance. Implicit midpoint removes this surplus via a Cayley-transform identity, making P-IMLA Gaussian-exact at any step size. Beyond Gaussians, whitening transfers the sharp IMLA contraction rate to $\kappa_{\mathrm{eff}}$, and backward-error analysis gives drift-only rather than Euler-type diffusion bias under explicit smoothness assumptions. An $M$-norm Moreau envelope yields a proximal non-smooth variant with a three-term error budget. Controlled Gaussian and TV-regularized imaging experiments confirm the predicted separation: the unpreconditioned midpoint scheme retains long transients as $\kappa_f$ grows, whereas P-IMLA remains $\kappa_{\mathrm{eff}}$-governed and near variance-exact.
290. 【2611.09977】Seeing Like a Shopper: Validating Vision-Language Models as Synthetic Consumers
链接：https://arxiv.org/abs/2611.09977
作者：Woongki Kim,Seungkook Baek,Minhyeok Lee
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Language models, behavioral experiments, market research, VLM shoppers, shoppers
备注：
点击查看摘要
Abstract:Language models are widely used as synthetic respondents in surveys, behavioral experiments, and market research. Most of these respondents read text, whereas shoppers in a store choose by looking at shelves, which makes vision-language models (VLMs) natural synthetic shoppers. We test whether VLM shoppers follow real consumers at two levels. At the purchase level, VLM shoppers built from household records plan their trips from a store directory and select products from shelf images, and we compare their purchases with six public datasets from three countries. The synthetic baskets hit held-out purchases as often as the households' own past trips, and synthetic group differences correlate with real ones twice as strongly as those of a trained regression. Without fitting, VLM shoppers reproduce alcohol purchases by gender and age in Russia and trip sizes by store distance in Taiwan, and respond to situations, prices, and displays within measured ranges. At the level of a single shelf choice, a model's answer confounds the product with its position and letter label. We therefore introduce ShelfSight, shelf renderings that vary products, positions, labels, viewpoints, and prices independently, together with a factor model that separates product preferences from the effects of label and position, which we call answer effects. On ShelfSight, hosted VLMs read the shelf, follow stated needs, keep their product preferences across views, and respond to price as budget shoppers. These answer effects, a preference for the letter A and for positions in the image, are estimated once per image type and removed. VLMs are thus good synthetic shoppers whose corrected shelf choices reflect product preferences.
291. 【2611.09973】ReelCache: An Efficient KV Cache Compression and Management System for Multi-Round Video Generation
链接：https://arxiv.org/abs/2611.09973
作者：Tianyu Wang,Daiyang Yu,Zhiwei Ren,Junbo Li,Jitian Zhang,Longfei Shangguan
类目：Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC)
关键词：Autoregressive video diffusion, Autoregressive video, diffusion models produce, models produce large, produce large
备注： 18 pages total, 11 pages body plus 5 pages appendix
点击查看摘要
Abstract:Autoregressive video diffusion models produce large KV caches during multi-round video generation. Keeping all these KV chunks would consume substantial memory, while rebuilding discarded caches would significantly delay video chunk generation. This paper presents ReelCache, a KV cache compression system for efficient multi-round, long video generation. ReelCache combines an intra-chunk compressor with an inter-chunk cache manager. The compressor applies low-rank decomposition across channels and video coding to the resulting coefficients, predicting the decomposition rank per transformer layer online to meet retained-energy targets. The cache manager shares basis directions across consecutive chunks and organizes chunk states in a tree, allowing generation branches to share historical state while supporting restoration for resume, rewind, and fork. Experiments across five video generation models show that ReelCache reduces KV storage by 14.46-21.13x relative to baselines and accelerates next-chunk generation by 1.25-3.36x, with less than 1% drop in six representative VBench metrics. GitHub: this https URL
292. 【2611.09971】Clinically Informed Colour Encoding Improves the Localisation and Stability of Explanations in Deep Learning ECG Models: External Validation in a UK Biobank Epilepsy Cohort
链接：https://arxiv.org/abs/2611.09971
作者：Lauren Hutchinson,Moses Nkgari,Alaa Alahmadi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：deep learning models, electrocardiogram analysis, deep learning, input representation governs, pseudo-colour encoding
备注：
点击查看摘要
Abstract:Objective: It is not known whether the input representation governs the quality of explanations of deep learning models for electrocardiogram analysis. Risk of dangerous ventricular repolarisation is judged from the QT-interval and the shape of the T-wave, features that are hard to assess visually and harder still to verify in a model's reasoning. We evaluate a pseudo-colour encoding filling the area beneath the QT interval, its colour sequence designed from clinical electrophysiology knowledge and mapped to a validated risk prediction model, the QT-nomogram. Methods: Two identically configured residual networks were trained on single-heartbeat images from a clinical trial, differing only in whether pseudo-colour encoding was applied, so that any difference is attributable to the chromatic channel alone. To externally validate the effect, both models were applied without fine-tuning or threshold tuning to a previously unseen epilepsy cohort from the UK-Biobank at two visits, and eight explanation methods compared on faithfulness, localisation and stability. Results: The pseudo-colour model achieved areas under the receiver operating characteristic curve of 0.903 and 0.914 at the first and follow-up visits, against 0.719 and 0.720 for the monochrome model, recovering three to five times as many at-risk heartbeats at comparable specificity. Pseudo-colour encoding improved explanation localisation and stability for almost every method, and the improvement reproduced across both visits. Conclusion: The input representation is a controllable and previously overlooked determinant of both predictive performance and explanation quality. Significance: Treating interpretability as a representation-design problem offers a route towards explanations clinicians can check against known electrophysiology.
293. 【2611.09964】How Many Demonstrations Does a VLA Need? On the Sample Efficiency of VLA Finetuning
链接：https://arxiv.org/abs/2611.09964
作者：Rahul Chand,Miguel Villa Floran
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：Pretrained vision language, rarely deployed directly, Pretrained vision, show strong zero-shot, models show strong
备注： 16 pages, 10 figures, CoRL Workshop
点击查看摘要
Abstract:Pretrained vision language action (VLA) models show strong zero-shot performance but they are rarely deployed directly and are often first post-trained on demonstrations from the target setting. Yet VLAs are typically compared by zero-shot or full-data fine-tuned success which reveals little about the data and compute required for downstream adaptation. We study adaptation efficiency for six VLAs ($\pi_0$, $\pi_{0.5}$, and GR00T N1-N1.7) on four LIBERO suites, varying both demonstrations and training steps. This reveals differences hidden by full-data fine-tuning: models which are within two points on the full LIBERO-Spatial dataset differ by up to 3$\times$ in success with 50 demonstrations. $\pi_{0.5}$ needs 2-5$\times$ fewer demonstrations than $\pi_0$ and is the most sample-efficient model at every budget, with the largest gap on the long-horizon suite. Within GR00T, N1.5 adapts more efficiently than N1.6 and N1.7 on three of four suites, despite their stronger zero-shot performance. We also study one pretraining factor behind these differences by freezing the VLM during finetuning: this severely degrades the $\pi$ models whose VLM is jointly trained with the action expert during pretraining, but barely affects GR00T models.
294. 【2611.09960】SceneShifter: Training-free Multi-Scene Temporal Control for Audio-driven Human Animation
链接：https://arxiv.org/abs/2611.09960
作者：Jianzhi Long,Rong-Cheng Tu,Hao Guan,Siyuan Liang,Shunyu Liu,Xiao Luo,Dacheng Tao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：achieved impressive realism, Semantic-Aware Temporal Decoupling, effective Multi-Scene Temporal, orchestrating background transitions, Multi-Scene Temporal Control
备注： Neurips 2026
点击查看摘要
Abstract:Although audio-driven human animation has achieved impressive realism, it still lacks effective Multi-Scene Temporal Control: orchestrating background transitions at precise timestamps while preserving a coherent foreground subject. We show that this challenge stems from the diffusion transformer's self-attention mechanism, and addressing it requires two capabilities: (1) Semantic-Aware Temporal Decoupling, which isolates background attention across scenes while retaining cross-scene foreground attention for subject consistency; and (2) Foreground Motion Localization, which accurately tracks the foreground subject across latent frames, especially under large motion. To address these challenges, we introduce SceneShifter, a training-free framework for precise multi-scene control in audio-driven human animation. SceneShifter guides spatio-temporal self-attention by suppressing cross-scene attention among background tokens while preserving cross-scene attention among foreground tokens. To support this guidance under large motion, SceneShifter extracts dynamic foreground masks from the self-attention layers and heads that best capture subject trajectories. We further introduce SceneShifterBench, a benchmark designed to evaluate scene-timing accuracy, foreground preservation, and visual quality under large motion, multiple subjects. Experiments show that SceneShifter achieves frame-level scene timing, strong subject preservation, and high visual quality, outperforming existing baselines. Code is available at this https URL.
295. 【2611.09959】A four-view smartphone video dataset of a robot-held flexible strip, with camera poses and a 3D LaGSplat baseline
链接：https://arxiv.org/abs/2611.09959
作者：Louen Pottier
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：deformable object driven, Gaussian Splatting decoder, measured pose, result obtained, note describes
备注： 2 pages, 1 figure, 1 table. Dataset and checkpoints: doi: [https://doi.org/10.5281/zenodo.23601189](https://doi.org/10.5281/zenodo.23601189) . Training code: [this https URL](https://github.com/LouenPottier/lagsplat-mpov) . Interactive demo: [this https URL](https://louenpottier.github.io/xrdays.html)
点击查看摘要
Abstract:This note describes a multi-view video dataset of a deformable object driven by a measured input, with the measured pose of every camera, and a first 3D result obtained on it with LaGSplat. LaGSplat learns from video a low-dimensional latent state that is both the generalized coordinate of a learned dissipative Lagrangian and the conditioning variable of a Gaussian Splatting decoder; fitting the decoder in 3D calls for synchronized multi-view footage, which the original paper only had from synthetic renderings. Here a robot arm moves a flexible strip by oscillating along a one-dimensional path, and four iPhones, three fixed and one handheld, film it for ten minutes. The videos are synchronized, the cameras are posed from the scene, and the position of the gripper is given per frame as the input of the system. LaGSplat fitted on this data with the gripper acceleration as a forcing term renders held-out views at 26 to 33 dB PSNR and runs as a real-time interactive demo in a web browser. Dataset, checkpoints and training code are public.
296. 【2611.09958】HippoMamba: A Mamba-augmented network for hippocampal segmentation and serial volumetry in Alzheimers disease
链接：https://arxiv.org/abs/2611.09958
作者：Dawa Chyophel Lepcha,Sophie A. Martin,Pierrick Coupe,Shabbir Syed-Abdul
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：serial MRI visits, earliest structural markers, Alzheimer disease, markers of Alzheimer, MRI visits
备注： 22 pages, 7 figures, 5 tables
点击查看摘要
Abstract:Hippocampal atrophy is among the earliest structural markers of Alzheimer's disease, and reliable hippocampal segmentation across serial MRI visits is a prerequisite for measuring it. We present HippoMamba, a network that combines a 3D convolutional encoder and decoder with a Mamba selective state space block at the bottleneck, designed to process one or more MRI visits of a subject. On the Medical Segmentation Decathlon hippocampus dataset (260 subjects, five-fold cross-validation), HippoMamba obtained a mean Dice similarity coefficient of 0.8861 $\pm$ 0.0094, the highest among six convolutional and transformer-based methods trained with the same folds and patch size, and its per-subject Dice was significantly higher than that of each method (Holm-corrected Wilcoxon tests, $p \leq 0.013$). Its mean 95th percentile Hausdorff distance (1.45 mm) and average surface distance (0.44 mm) were the lowest of the compared methods, although they did not differ significantly from those of Attention U-Net, and the Hausdorff distance did not differ significantly from that of SegResNet. Without retraining, the five-fold ensemble was applied to 600 T1-weighted sessions from 150 participants of the OASIS-3 cohort. In sessions meeting a registration quality criterion, predicted hippocampal volumes ranked consistently with FreeSurfer volumes (Pearson r = 0.778, 95% CI 0.699 to 0.838; ICC(3,1) = 0.772) but were systematically smaller by about 27%. In a pre-specified analysis of participants followed for at least two years, annualised volume change derived from per-visit segmentation was moderately correlated with that of FreeSurfer (r = 0.503, 95% CI 0.319 to 0.659), with a larger mean rate. These results support the use of HippoMamba for hippocampal segmentation and for ranking hippocampal volume within a cohort, with absolute volumes and rates of change interpreted relative to the reference method.
297. 【2611.09957】HALMES: Knowing When to Intervene in LVLM Hallucination Mitigation
链接：https://arxiv.org/abs/2611.09957
作者：Ruining Hu,Jiaqi Lu,Xiao Liu,Ying Shen,Yu Wang,Lin Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Large Vision-Language Models, demonstrated strong capabilities, Large Vision-Language, Vision-Language Models, multimodal tasks
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:Large Vision-Language Models (LVLMs) have demonstrated strong capabilities in multimodal tasks. Nevertheless, their outputs remain prone to object hallucinations that are inconsistent with visual content. Contrastive decoding, as a training-free inference-time mitigation approach, typically intervenes in the output distribution at every decoding step. However, such indiscriminate full-stage intervention may disrupt originally correct generations and even induce new hallucinations. To address this issue, we first analyze the relationship between internal attention features and hallucinated token segments in LVLMs, revealing that hallucination-related abnormalities already emerge progressively in preceding token segments. Based on this observation, we propose HALMES, a lightweight plug-and-play module that identifies hallucination precursor segments from attention features during generation and selectively triggers contrastive decoding. HALMES can be integrated with various full-stage contrastive decoding methods, transforming indiscriminate intervention into on-demand targeted correction. Extensive experiments across different LVLM architectures and multiple benchmarks show that HALMES further improves the hallucination mitigation performance of existing contrastive decoding methods while reducing the negative impact of full-stage intervention on normal outputs, validating the importance of modeling and selectively intervening on hallucination-prone segments.
298. 【2611.09956】MAPA: Mode-Aware Prototype Allocation for Latent Dataset Distillation in 3D Medical Classification
链接：https://arxiv.org/abs/2611.09956
作者：Weiqi Zhang,Hiroyuki Kubo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：small training set, synthesizing full volumetric, full volumetric samples, Dataset distillation, synthesizes a small
备注： Accepted at WACV 2027. 17 pages including supplementary material
点击查看摘要
Abstract:Dataset distillation (DD) synthesizes a small training set from a large one, but applying it to 3D medical classification is constrained by the memory and optimization costs of synthesizing full volumetric samples. Under a storage-equivalent budget, distilling in the latent space of a frozen autoencoder reduces this cost and fits more synthetic samples (prototypes) than in voxel space. However, class-level matching, such as distribution matching, causes prototypes to concentrate in dense latent regions while underrepresenting sparser intra-class regions, a consistent imbalance that we term prototype concentration. To address this, we propose MAPA (Mode-Aware Prototype Allocation), a latent distillation method that spreads prototypes across intra-class modes while preserving class-level matching. MAPA marks these modes with fixed anchors estimated by clustering the real latents and distributes prototypes over them through a soft assignment, together with a lightweight anti-collapse regularizer and curriculum weighting that stabilize the optimization. Across five 3D medical classification tasks, MAPA improves the aggregate balanced accuracy by +4.2 points over the strongest latent baseline while using the same number of prototypes. An exploratory severity analysis on MosMedData suggests improved worst-stratum recall without loss of normal-case specificity.
299. 【2611.09955】RadAI: Gaze-Intention Fusion Pipeline for Attention-Guided Educational Videos in Chest X-Ray Interpretation
链接：https://arxiv.org/abs/2611.09955
作者：Kavish Mehta,Yuvan Siddharth Katamaneni,Akash Awasthi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：remain largely implicit, expert search strategies, radiograph interpretation errors, Chest radiograph interpretation, search strategies
备注： 5 pages, 2 figures, 1 table, accepted to 2026 MIT IEEE URTC conference
点击查看摘要
Abstract:Chest radiograph interpretation errors often arise from failures in visual search: although trainees may correctly identify an abnormality once pointed out, they frequently fail to fixate on the relevant region, while expert search strategies (where radiologists look, in what sequence, and for how long) remain largely implicit. Eye movement modeling examples (EMME), which replay a recorded expert's gaze over the image, have been shown to improve novice detection of findings on chest radiographs, but producing one requires an eye-tracking session on that specific case, so teaching sets are limited to recorded sessions by experts. In this work, RadAI is presented, the first end-to-end framework for transforming predicted radiologist gaze into narrated instructional videos, enabling scalable gaze-guided training without collecting new eye-tracking data. Given only a chest X-ray and its report, RadAI predicts an expert fixation sequence, associates each interval of that sequence with the diagnostic finding it pursues, extracts the corresponding image region, and renders the result as an EMME-style video in which each highlighted finding is narrated with synthesized speech. RadAI is evaluated on 97 cases from the EGD-CXR dataset, assessing whether the highlighted regions correspond to annotated abnormality locations. We position this work as a framework for scalable generation of educational content for residents and medical students in the field of radiology.
300. 【2611.09954】DiffusedSplitFed: Latent Diffusion-based Obfuscation for Reconstruction-Resilient Split Federated Medical Image Segmentation
链接：https://arxiv.org/abs/2611.09954
作者：Chamani Shiranthika,Parvaneh Saeedi
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Split Federated Learning, Federated Learning, raw patient data, sharing raw patient, Split Learning
备注：
点击查看摘要
Abstract:Federated Learning (FL), Split Learning (SL), and Split Federated Learning (SplitFed) enable collaborative medical image analysis without sharing raw patient data. However, intermediate features and gradients exchanged during SplitFed training may reveal sensitive information through reconstruction attacks. To address this vulnerability, we propose \textbf{DiffusedSplitFed}, a SplitFed framework that integrates Latent Denoising Diffusion Models (LDDMs) at client--server split points to obfuscate transmitted representations while preserving segmentation performance. Three architectural variants (V1--V3) are developed using different combinations of dual conditioning and global feature fusion to investigate trade-offs among reconstruction resistance, segmentation accuracy, and computational complexity. Experiments on three medical imaging datasets (HAM10K, Blastocysts, and FHPsAOPMSB), supported by multiple independent runs and paired statistical analyses, demonstrate improved resistance to the evaluated image reconstruction attacks compared with Baseline SplitFed, while maintaining competitive segmentation performance. Comparisons with existing diffusion-based segmentation methods further demonstrate competitive segmentation accuracy under the evaluated settings. A conditional convergence analysis is also provided to characterize the effects of LDDM-induced gradient perturbations and local optimization on training. These findings highlight the potential of latent diffusion-based representation obfuscation for reconstruction-resilient collaborative medical image segmentation. The implementation is available at this https URL.
301. 【2611.09953】Confusion-Adaptive Margin Learning for Handwritten Letter Recognition: A Controlled Study on EMNIST Letters
链接：https://arxiv.org/abs/2611.09953
作者：Azam Nouri
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Handwritten character recognition, Handwritten character, character recognition systems, visually similar classes, achieve high accuracy
备注：
点击查看摘要
Abstract:Handwritten character recognition systems can achieve high accuracy while retaining concentrated errors among visually similar classes. Motivated by residual letter confusions in earlier geometry-based recognition work, we investigate whether these errors can be addressed through the training objective. We introduce Confusion-Adaptive Margin Learning (CAML), which constructs a sparse weighted confusion graph from a discovery partition held out from pilot training and applies pair-specific cosine-separation constraints during final training. CAML adds no classifier, routing rule, or inference-time parameters. We evaluate CAML on EMNIST Letters against a strictly matched cross-entropy CNN baseline, using the same architecture, final training data, deterministic augmentation, optimizer, and checkpoint selection. Eight confusion pairs are targeted: I/L, G/Q, U/V, R/V, D/O, C/E, I/J, and H/N. On the official clean test set, accuracy changes from 95.6346% to 95.6731%, and macro-F1 from 0.956326 to 0.956724. Mean accuracy across ten predefined corrupted conditions increases from approximately 95.3812% to 95.4303%; symmetric errors within targeted pairs decrease from 614 to 605 (1.47%). The global differences are small and not statistically reliable. CAML fixes 124 baseline errors but introduces 116 new errors on clean data (exact McNemar p=0.6515), and no corruption-specific difference remains significant after Holm correction. Thus, CAML does not establish global superiority, but shows that a leakage-controlled, pair-specific margin objective can alter targeted error structure with limited overall benefit for an already strong classifier.
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
MSC classes:
68T10, 68T07
ACMclasses:
I.5.2; I.5.4
Cite as:
arXiv:2611.09953 [cs.CV]
(or
arXiv:2611.09953v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2611.09953
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
302. 【2611.09951】Video-DCI: How Far Are VLM Agents from Human Viewers in Direct Video Corpus Interaction?
链接：https://arxiv.org/abs/2611.09951
作者：Garry Yang,Yuqiao Liu,Hao Lin,Luohao Pan,Xinru Chen,Wanqi Ren,Zhikang Xu,Yizhan Huang,Huaixiao Tou,James Cheng
类目：Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：inspecting short moments, answer complex visual, complex visual questions, inspecting short, redirecting attention
备注：
点击查看摘要
Abstract:Humans answer complex visual questions by inspecting short moments, updating what they know, and redirecting attention toward missing evidence. Existing video benchmarks, however, often provide the relevant video, evaluate only final answers or isolated localization, or permit textual shortcuts, leaving multi-round visual evidence seeking underexplored. We introduce Video-DCI, a diagnostic benchmark and functionally matched human-agent protocol for Direct Video-Corpus Interaction. It comprises DCI-Loc for temporal evidence localization and DCI-QA for end-to-end discovery, retention, and composition of cross-video evidence. In DCI-QA, videos within each pool are topically related, yet every answer requires hidden temporal evidence from multiple videos. Given only the question and video pool, humans and agents iteratively inspect bounded local windows, retain supporting evidence, and answer with cited temporal spans. Human trajectories provide reference curves for evidence acquisition and use across rounds. Experiments reveal a consistent retrieval-to-grounding gap. On DCI-Loc, frontier VLMs often retrieve and expose the reference moment, yet convert far less of this exposure into precise final citations than the human reference. On DCI-QA, the loss begins earlier and compounds across videos. Ablation studies further confirm that iterative search outperforms one-shot retrieval. Multi-round search is therefore necessary but insufficient: current agents accumulate candidates and observations more readily than precise, jointly sufficient evidence.
303. 【2611.09949】Counting Events, Not Seeing Them: Diagnosing and Repairing the Readout Failure in Video LLMs
链接：https://arxiv.org/abs/2611.09949
作者：Dongwu Qian
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：missing object permanence, Video LLMs fail, Video LLMs, LLMs fail conspicuously, object permanence
备注： Preprint v1 (2026-10-21). 11 pages, 4 figures, 6 tables. A corrected-prompt retrain of the REALCOUNT adaptation arms is in progress; v2 will update those results. Comments welcome
点击查看摘要
Abstract:Video LLMs fail conspicuously at counting how many times an object crosses the screen, a failure attributed to missing object permanence. Using construction-grounded synthetic testbeds with validated labels, we show this attribution is incomplete: the count signal is present but unread - linear probes decode per-window presence at 93% while global count decoding collapses to a duration confound. Concurrent work reports the same representation-output dissociation for repetition counting; we show that in exit-and-reappear event counting it is repairable: two readout-directed repairs (episode-localization supervision and a discrete event-symbol side channel) raise same-object counting from 46.7% to 65.0% (oracle 66.7%) on a chance-33% benchmark across 7B-30B systems. Transfer to an independent factory costs nothing, and a measurement audit exposes five data-integrity failures that had obscured the boundary. A real-video audit (REALCOUNT, n=18, blind-audited) shows the boundary persists - best 55.6% at chance 33.3% - and symbol transfer fails zero-shot. A 1-epoch in-domain adaptation bench is negative (six levers at 28-50%), but 3 epochs reverse this for the symbol channel: with oracle timelines the reader reaches 94.4% sequence-disjoint (and 100% strict on the full set), while the deployed 2-epoch head reaches 61.1% in all three seeds (42-44), no better than a shuffled-symbol control (61.1% seed 42, 66.7% seed 43), and one clip above the unadapted reader (55.6%). The residual gap is detector evidence, not reader capacity: the same reader reaches 72.2-88.9% on GT timelines. The failure is repairable with informative timelines, but the deployed head remains the bottleneck; a frozen-feature boundary probe is weak (AUC 0.62 vs. 0.51 permutation) and non-transferring (0.77 within-clip vs. 0.62 across windows).
304. 【2611.09939】Rethinking Supervision Targets for Multimodal LLM Unlearning: Less Private Information, Reduced Distribution Shift
链接：https://arxiv.org/abs/2611.09939
作者：Leijiang Gu,Zhen Zeng,Feng Li,Le Zhang,Zenglin Shi
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Multimodal Large Language, Large Language Models, Multimodal Large, Large Language, posing significant privacy
备注：
点击查看摘要
Abstract:Multimodal Large Language Models (MLLMs) can memorize and reproduce sensitive information from their training data, posing significant privacy risks. Their ability to encode knowledge across both textual and visual modalities further complicates the selective removal of such private information. Many existing methods guide model unlearning by training the model toward constructed labels or output distributions, which we refer to as supervision targets. However, these methods often suffer from a trade-off between forgetting effectiveness and model utility. We identify supervision target limitations as a key factor in this trade-off and empirically show that targets containing more private information lead to insufficient forgetting, while larger distribution shifts from the original output distribution are associated with greater utility degradation. Motivated by these findings, we propose FFN-Perturbed Self-Distillation (FPD), which starts from the teacher's original output distribution as a zero-shift reference and selectively perturbs FFN activations associated with private information across textual and visual modalities. By precisely reducing private information from the teacher's original output distribution, FPD constructs supervision targets with less private information and reduced distribution shift. Extensive experiments on S-MLLMUn Bench demonstrate that FPD achieves a better forgetting-utility trade-off than existing methods.
305. 【2611.09916】Semantic-Enhanced Sparse Temporal Modeling for Dynamic Engagement Estimation in Multimodal Interactions
链接：https://arxiv.org/abs/2611.09916
作者：Yangchen Yu,Taoliang Wang,Jia Li,Nor Mazlina Ghazali,Mohd Nazim Mohtar,Bingkun Bao,Richang Hong
类目：Human-Computer Interaction (cs.HC); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：infer participants' evolving, participants' evolving engagement, engagement estimation aims, evolving engagement states, multimodal interaction streams
备注：
点击查看摘要
Abstract:Dynamic engagement estimation aims to infer participants' evolving engagement states from continuous multimodal interaction streams. Existing approaches typically combine acoustic, pose, and visual representations with temporal models to capture observable interaction patterns. However, conversational semantics are difficult to align with frame-level engagement annotations in the same manner as continuous audio-visual signals, leaving dialogue context less effectively exploited in existing temporal modeling pipelines. Moreover, engagement annotations often evolve smoothly over time, making dense frame-level modeling computationally redundant and potentially sensitive to local annotation noise. To address these issues, we propose SEST, a Semantically-Enhanced Sparse Temporal framework that models engagement-related information from both semantic and temporal perspectives. SEST leverages Multimodal Large Language Models to extract multimodal semantic embeddings, providing dialogue-aware contextual information beyond conventional frame-level features. In parallel, SEST replaces dense-to-dense temporal modeling with a sparse-to-dense pathway, where continuous frame sequences are first encoded into compact temporal dynamics to reduce redundant computation and broaden temporal coverage, then fused with semantic context and recovered to the original label resolution for dense engagement prediction. Experiments on the MEE2026 benchmark demonstrate the effectiveness of SEST, which achieved first place in the challenge.
306. 【2611.09913】Engagement Estimation in Human-Robot and Human-Human Interactions across Domain, Age and Culture: MultiMediate'26 Challenge
链接：https://arxiv.org/abs/2611.09913
作者：Marius Funk,Daksitha Withanage Don,Michal Balazia,Victor Oei,Shogo Okada,François Brémond,Andreas Bulling,Elisabeth André,Philipp Müller
类目：Human-Computer Interaction (cs.HC); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Robotics (cs.RO)
关键词：Understanding engagement, context-aware AI systems, essential for modelling, modelling assistive, assistive and context-aware
备注： 6 pages, 1 figure, ACM MultiMedia 2026 Grand Challenge Baseline Paper
点击查看摘要
Abstract:Understanding engagement in human interaction is essential for modelling assistive and context-aware AI systems. Previously, the MultiMediate challenge has focused on estimating momentary continuous engagement values in adult conversation across cultures, achieving high levels of generalisability across domains. However, engagement can be measured in different metrics and manifest differently between children and adults. MultiMediate'26 therefore expands the evaluated domain set to include the PInSoRo dataset of Child-Child and Child-Robot play sessions in English. These sessions were annotated categorically with task and social engagement, diversifying engagement types, age ranges and interaction types. In this paper, we describe the MultiMediate'26 challenge and its goals, introduce the NoXi, NoXi-J, MPIIGI, and PInSoRo datasets, showcase extracted multi-modal features, present our baseline model for engagement estimation across all domains, and discuss challenge submissions and approaches. In an effort to provide a transparent and welcoming challenge environment, baseline code, leaderboard, datasets, and extracted features are publicly available at this https URL.
307. 【2611.09897】Process then Retrieve: Investigating the Origins of the Modality Gap in Vision-Language Models
链接：https://arxiv.org/abs/2611.09897
作者：Arpita Shanbhag,Julia Tran,Dhruv Mandala,Ayda Sultan
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：Understanding the origins, language models remains, significant challenge, remains a significant, Understanding
备注：
点击查看摘要
Abstract:Understanding the origins of the modality gap in vision language models remains a significant challenge. This work investigates whether differences in information density between modality specific tokens at the embedding layer contribute to this imbalance. We show that text tokens enter the model with much lower semantic density than visual tokens, driving early layers to focus on processing text representations before combining them with vision. Through mechanistic analysis, we demonstrate that replacing vision token positions with their semantically closest text token counterparts elicits increased attention to those positions in early layers. These findings provide a foundation for addressing the modality gap and provide insight to improve multimodal reasoning in VLM architectures.
308. 【2603.10967】Med-DualLoRA: Local Adaptation of Foundation Models for 3D Cardiac MRI
链接：https://arxiv.org/abs/2603.10967
作者：Joan Perramon-Llussà,Amelia Jiménez-Sánchez,Grzegorz Skorupko,Fotis Avgoustidis,Carlos Martín-Isla,Karim Lekadir,Polyxeni Gkontra
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：cardiac magnetic resonance, including cardiac magnetic, robust downstream performance, Foundation models, show great promise
备注： 11 pages, 2 figures. Submitted to MICCAI 2026
点击查看摘要
Abstract:Foundation models (FMs) show great promise for robust downstream performance across medical imaging tasks and modalities, including cardiac magnetic resonance (CMR), following task-specific adaptation. However, adaptation using single-site data may lead to suboptimal performance and increased model bias, while centralized fine-tuning on clinical data is often infeasible due to privacy constraints. Federated fine-tuning offers a privacy-preserving alternative; yet conventional approaches struggle under heterogeneous, non-IID multi-center data and incur substantial communication overhead when adapting large models. In this work, we study federated FM fine-tuning for 3D CMR disease detection and propose Med-DualLoRA, a client-aware parameter-efficient fine-tuning (PEFT) federated framework that disentangles globally shared and local low-rank adaptations (LoRA) through additive decomposition. Global and local LoRA modules are trained locally, but only the global component is shared and aggregated across sites, keeping local adapters private. This design improves personalization while significantly reducing communication cost, and experiments show that adapting only two transformer blocks preserves performance while further improving efficiency. We evaluate our method on a multi-center state-of-the-art cine 3D CMR FM fine-tuned for disease detection using ACDC and combined M\Ms datasets, treating each vendor as a federated client. Med-DualLoRA achieves statistically significant improved performance (balanced accuracy 0.768, specificity 0.612) compared to other federated PEFT baselines, while maintaining communication efficiency. Our approach provides a scalable solution for local federated adaptation of medical FMs under realistic clinical constraints.
309. 【2602.22678】ViCLIP-OT: The First Foundation Vision-Language Model for Vietnamese Image-Text Retrieval with Optimal Transport
链接：https://arxiv.org/abs/2602.22678
作者：Quoc-Khang Tran,Minh-Thien Nguyen,Nguyen-Khang Pham
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Vietnamese image-text retrieval, existing vision-language models, Regularized Optimal Transport, Image-text retrieval, fundamental component
备注： Preprint submitted to Expert Systems with Applications
点击查看摘要
Abstract:Image-text retrieval has become a fundamental component in intelligent multimedia systems; however, most existing vision-language models are optimized for highresource languages and remain suboptimal for low-resource settings such as Vietnamese. This work introduces ViCLIP-OT, a foundation vision-language model specifically designed for Vietnamese image-text retrieval. The proposed framework integrates CLIP-style contrastive learning with a Similarity-Graph Regularized Optimal Transport (SIGROT) loss to enhance global cross-modal consistency and mitigate modality gap issues. Extensive experiments on three Vietnamese benchmarks (UITOpenViIC, KTVIC, and Crossmodal-3600) demonstrate that ViCLIP-OT consistently outperforms CLIP and SigLIP baselines in both in-domain and zero-shot settings. On UIT-OpenViIC, the model achieves an average Recall@K of 67.34%, improving upon CLIP by 5.75 percentage points. In zero-shot evaluation on Crossmodal-3600, ViCLIPOT surpasses CLIP by 11.72 percentage points. Embedding-space analysis further confirms improved alignment and reduced modality gap. The results indicate that integrating SIGROT provides an effective and scalable strategy for cross-modal retrieval in low-resource languages, offering practical implications for intelligent multimedia retrieval systems in Vietnamese and other underrepresented linguistic contexts.
310. 【2611.12682】A four-step validation protocol for radiomic survival analysis in small cohorts: a body composition case study
链接：https://arxiv.org/abs/2611.12682
作者：Mariela Talavera-Muñoz,Cecilia Diana-Albelda,Miguel Antonio Sampedro-Nuñez,Victor Rodriguez-Laval,Jesus Bescos,Álvaro García-Martín
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Gastroenteropancreatic neuroendocrine tumors, based body composition, Gastroenteropancreatic neuroendocrine, body composition radiomics, lack prognostic biomarkers
备注：
点击查看摘要
Abstract:Gastroenteropancreatic neuroendocrine tumors (GEP-NET) lack prognostic biomarkers, and computed tomography (CT)-based body composition radiomics at the third lumbar vertebra (L3) is a promising candidate. Small cohorts make high-dimensional radiomic models prone to overfitting and single-split evaluations variable and optimistic. This methodological study proposes a four-step validation protocol for radiomic survival analysis in small cohorts: (1) false discovery rate (FDR)-corrected feature selection, (2) a dual-path comparison of prior feature selection versus embedded regularization, (3) repeated nested cross-validation (CV) and (4) a negative control with Gaussian noise features. In 78 GEP-NET patients, 535 radiomic features from five L3 compartments were used to evaluate five survival models with Harrell's concordance index (C-index), time-dependent area under the curve (AUC) and integrated Brier score (IBS). Step 1 selected at least one feature in 18% of outer folds under noise (nominal level 20%) versus 84% with radiomic features. The dual-path comparison showed no consistent difference between strategies. Repeated nested CV reduced variability across seeds (41% median reduction in C-index standard deviation), but not enough to distinguish models. The nested CV C-index exceeded chance by 0.07-0.15 with radiomic features but not clearly under noise (0.40-0.42 with prior feature selection, 0.47-0.55 with embedded regularization). Frequently selected features tentatively linked greater subcutaneous fat, skeletal muscle compactness and texture to better prognosis. These findings suggest a modest prognostic signal in L3 radiomics, with considerable uncertainty that the protocol quantifies. The protocol may transfer to other small-cohort radiomic survival studies. Code: this https URL.
Subjects:
Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
Cite as:
arXiv:2611.12682 [eess.IV]
(or
arXiv:2611.12682v1 [eess.IV] for this version)
https://doi.org/10.48550/arXiv.2611.12682
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Cecilia Diana-Albelda [view email] [v1]
Mon, 9 Nov 2026 16:46:25 UTC (7,678 KB)
311. 【2611.12044】Leveraging High-Activity Post-Therapeutic I-131 Scans for Deep Learning Reconstruction of Extremely Sparse Planar Images in Differentiated Thyroid Cancer
链接：https://arxiv.org/abs/2611.12044
作者：Boyang Pan,Hang Yang,Jianchen Pan,Cui Gan,Lanxi Zhang,Hongmin Li,Nan-Jie Gong
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Medical Physics (physics.med-ph)
关键词：differentiated thyroid cancer, low administered activity, whole-body planar imaging, thyroid cancer, administered activity
备注： 12 pages, 2 figures, 3 tables
点击查看摘要
Abstract:Background: Diagnostic I-131 whole-body planar imaging in differentiated thyroid cancer (DTC) is count-limited by low administered activity, and quality worsens under rapid acquisition. Models trained on such data struggle because their targets lack photon statistics. Purpose: To test whether high-quality post-therapeutic (PT) I-131 scans can serve as superior training references for enhancing sparse diagnostic planar images, using transfer learning and input-image addition. Methods: In this single-center prospective study, 111 patients were enrolled in PT training (n = 19), diagnostic follow-up (FU) training (n = 58), and FU paired test (n = 34) cohorts. Five Restormer-based models were trained: FU_DLx2 on FU labels; PT_DLx2 transfer-learned on PT data; PT_DLx1+ and PT_DLx2+ with input-image addition; PT_DLx6 as a PT-only reference. Test-time processing used two-step denormalization and Poisson re-scaling to preserve noise statistics. Quality was assessed by PSNR, SSIM, and a blinded dual-reader evaluation of all 34 test-cohort patients. Results: PT_DLx2 achieved the highest PSNR (34.4 +/- 3.6 dB) and SSIM (0.81 +/- 0.07). PT_DLx1+ and PT_DLx2+ were comparable (33.8 and 33.3 dB; SSIM 0.80). FU_DLx2 ranked below the unprocessed fast scan (30.3 vs. 32.0 dB; 0.76 vs. 0.79). Subjectively, PT_DLx2+ scored highest in image quality (4.54 +/- 0.60) and diagnostic confidence (4.54 +/- 0.60), surpassing the reference standard (4.19 +/- 0.83 and 4.31 +/- 0.81; P = 0.005 and P = 0.008). FU_DLx2 and PT_DLx6 scored lowest. Conclusion: Count-rich PT scans provide effective training priors for reconstructing extremely sparse images. Input-image addition and cross-domain transfer learning from PT data outperformed direct training on count-limited diagnostic data, supporting 2x scan acceleration with quality matching or exceeding the unaccelerated standard scan for selected PT-derived configurations.
312. 【2611.10544】Compact Quantum Channel Attention for Static ASL Recognition: A Controlled Study with Parameter-Matched Baselines
链接：https://arxiv.org/abs/2611.10544
作者：Ronak Bhalgami,Deep Kothadiya,Nikita Bhatt
类目：Quantum Physics (quant-ph); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Hybrid quantum-classical models, American Sign Language, Hybrid quantum-classical, report good accuracy, static American Sign
备注：
点击查看摘要
Abstract:Hybrid quantum-classical models often report good accuracy on image tasks, but it is rarely clear whether the quantum part is responsible. This paper proposes QCA-DenseNet, a static American Sign Language (ASL) recognition pipeline in which an eight-qubit variational circuit acts as a channel-attention gate on DenseNet121 features. The quantum channel attention (QCA) gate has 17,464 parameters, 7.51 times fewer than a squeeze-and-excitation (SE) block. The pipeline is tested on 1,815 MU HandImages images by holding out one of five signers at a time, and a frozen-backbone ablation uses small parts of the Kaggle ASL Alphabet data. On unseen signers, QCA-DenseNet reaches 94.50% mean accuracy, above SE (93.72%) and within 0.28 points of the best model. A matched classical MLP and a model without attention perform about the same, and no difference is significant. QCA gives a much smaller attention gate without a detectable loss in accuracy, but no quantum advantage.
313. 【2611.10228】FAIR Universe Weak Lensing ML Uncertainty Challenge: Dataset and Cosmological Inference Competition
链接：https://arxiv.org/abs/2611.10228
作者：Biwei Dai,Po-Wen Chang,Erwan Allys,Wahid Bhimji,Boris Bolliet,Thomas Borrett,Paolo Calafiura,Ragansu Chakkappai,Yuan-Tang Chou,Noé Dia,Sascha Diefenbacher,Ibrahim Elsharkawy,Steven Farrell,Sacha Guerrini,Isabelle Guyon,Chris Harris,Shih-Chieh Hsu,Wassim Kablan,François Lanusse,Celia Lecat,Julia Linhart,Yuezhou Ma,Benjamin Nachman,Shubhojit Naskar,Andy Nilipour,Laurence Perreault-Levasseur,Sébastien Pierre,Benjamin Remy,David Rousseau,Uroš Seljak,Haonan Shangguan,Sammy Nasser Sharief,Yuanxu Sun,Andreas Tersenov,Ihsan Ullah,Huikun Weng,Licong Xu,Justine Zeghal,Yulei Zhang,Hang Zhou
类目：Cosmology and Nongalactic Astrophysics (astro-ph.CO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Data Analysis, Statistics and Probability (physics.data-an)
关键词：enables direct mapping, governing structure formation, powerful cosmological probe, fundamental parameters governing, parameters governing structure
备注： 10+7 pages, 2+4 figures, 2+1 tables. Key results of the NeurIPS 2025 FAIR Universe Weak Lensing ML Challenge Phase 1. The challenge dataset is publicly available at Zenodo: [this https URL](https://zenodo.org/records/20056065) . Challenge GitHub repository: [this https URL](https://github.com/FAIR-Universe/Cosmology_Challenge)
点击查看摘要
Abstract:Weak gravitational lensing is a powerful cosmological probe that enables direct mapping of the matter distribution and precise constraints on the fundamental parameters governing structure formation in the universe. In recent years, machine learning has shown strong potential for extracting cosmological information from weak-lensing data beyond traditional summary statistics. However, progress has been limited by the lack of standardized benchmarks that capture the complexity of the dataset, simulator imperfections, and various systematic biases encountered in realistic analyses. To address this gap, we present the FAIR Universe Weak Lensing Machine Learning Uncertainty Challenge, one of the NeurIPS 2025 competitions, as a benchmark dataset and evaluation study. Our dataset reflects realistic weak-lensing observations, incorporating multiple systematic biases, and thereby providing a controlled testbed for robust cosmological inference under uncertainties. We summarize the main methodological advances developed by the winners of our challenge, including data augmentation with conditional optimal transport, an AI-agent-driven approach for parameter inference, ensemble learning, Vision Transformer-based architectures, and physics-informed feature integration. By unifying the benchmark dataset and the winning solutions, this work provides a community resource for developing and evaluating machine learning methods for weak lensing cosmology and, more broadly, for scientific inference under systematic uncertainties.
314. 【2611.10144】Dataset Collections: Challenges of Large-Scale Data Aggregation in 3D Medical Image Datasets
链接：https://arxiv.org/abs/2611.10144
作者：Yannick Kirchhoff,Saikat Roy,Elisa Stegmeier,Hamideh Haghiri,Constantin Ulrich,Maximilian Rouven Rokuss,Tassilo Wald,Karol Gotkowski,Benjamin Hamm,Raphael Stock,Nico Disch,Michael Baumgartner,Dimitrios Bounias,Anand Deshpande,Stefan Dinkelacker,Stefan Dvoretskii,Katharina Eckstein,Selen Erkan,Jessica Kächele,Kim-Celine Kahl,Balint Kovacs,Lucas Kulla,Moritz Langenberg,Philipp Schader,Stephen Schaumann,Dasha Trofimova,Shuhan Xiao,Sebastian Ziegler,David Zimmerer,Marco Nolden,Fabian Isensee,Klaus Maier-Hein,Ralf Floca
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：deep learning-based medical, high-quality annotated data, development of deep, deep learning-based, depends on high-quality
备注： Accepted at NeurIPS 2026 ED Track
点击查看摘要
Abstract:The development of deep learning-based medical AI depends on high-quality annotated data. Yet, dataset creation remains constrained by the need for expert radiologist annotations, limiting curated datasets to relatively small cohorts. To overcome this limitation, recent efforts increasingly aggregate disparate public datasets into large-scale dataset collections. However, combining datasets at scale often obscures data provenance, introducing substantial risks of reuse propagation, unintended leakage, bias amplification and distorted data distributions. In this work, we study these problems on a massive collection of 565k 3D radiological images across 1034 public datasets and provide practical resources to address them. Firstly, we formalize dataset collections as a distinct paradigm in medical image analysis and characterize their structural challenges, including reuse propagation, duplication, and provenance fragmentation. Secondly, we perform a large-scale empirical study of duplication on this collection and demonstrate extensive exact and near-duplicate reuse across public datasets via perceptual hashing and manual tracing, identifying a lower bound of 118k duplicate pairs. We make the perceptual hashes publicly accessible for comparison through our website, providing researchers with a standardized reference for identifying potential overlaps and shared provenance. Thirdly, since hashing alone cannot detect all duplicates, we introduce MAP (Metadata for Aggregation and Provenance), a lightweight, portable metadata profile for documenting provenance, known overlaps, and deduplication decisions in dataset collections. Our contributions help dataset collections shift from coarse aggregations to reliable and provenance-aware data scaling mechanisms in medical image analysis. A web tool supporting our work is available at this https URL.
315. 【2611.10091】Polarization Aware Deep Learning Framework for SAR Despeckling
链接：https://arxiv.org/abs/2611.10091
作者：Gianpaolo Passarello,Sergio Vitale,Hossein Aghababei,Giampaolo Ferraioli,Vito Pascazio
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：synthetic aperture radar, complicates image interpretation, aperture radar, imagery that complicates, reliable information
备注：
点击查看摘要
Abstract:Speckle is an inherent characteristic of synthetic aperture radar (SAR) imagery that complicates image interpretation and the extraction of reliable information. Although deep-learning-based despeckling methods have demonstrated promising performance, their applicability across different polarimetric configurations is often limited by the need for specialized architectures or separate training procedures. This paper presents a unified deep-learning framework for despeckling single-, dual-, and full-polarization SAR data using a single trained convolutional neural network. The proposed approach adopts a common nine-channel representation of the polarimetric covariance matrix and a polarization-aware masking strategy to accommodate different configurations without modifying the network architecture. Qualitative and quantitative comparison on three different scenes from different sensors demonstrate competitive performance across the considered experiments and support the feasibility of a unified, polarization-flexible approach to SAR despeckling across different polarimetric configurations.
316. 【2611.10073】Noise-Regularized Training for Learned Image Compression
链接：https://arxiv.org/abs/2611.10073
作者：Renjie Zou,Zhiwei Huang,Dong Jiang
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：Learned image compression, Learned image, entropy model differentiable, additive uniform proxy, uniform proxy injected
备注： 22 pages, 4 figures. Accepted as a Spotlight paper at NeurIPS 2026
点击查看摘要
Abstract:Learned image compression (LIC) is trained almost exclusively on clean images: the only stochastic perturbation in the loop is an additive uniform proxy injected in the latent domain to keep the entropy model differentiable. Outside compression, by contrast, a long line of work---from Tikhonov regularization and contractive autoencoders through denoising score matching and modern diffusion models---has established that Gaussian noise at the input of a network with a clean target acts as a structured probe of the data manifold rather than as data augmentation. Building on this view, we introduce noise-regularized training for LIC: at every training step we add Gaussian noise to the encoder input while keeping the distortion target, the latent uniform proxy, the hyperprior, and the entropy coding pipeline unchanged. The recipe is architecture-agnostic and adds essentially no training or inference overhead. Across backbones and operating regimes it yields consistent BD-Rate gains: -2.60% on a reproduced ELIC and -0.85% / -1.05% / -2.38% on the Base/Medium/Large scales of a variable-rate DMCI codec, with DMCI-Large reaching -22.02% against VTM-22.0. A second-order expansion of the noisy RD loss accounts for these gains: because the noise enters upstream of the analysis transform, it converts the clean RD objective into a structured $O(\sigma^{2})$ regularizer comprising an information-weighted encoder-Jacobian penalty (rate side) and a Frobenius contractive penalty on the end-to-end reconstruction map (distortion side). A finite-difference Lipschitz analysis shows corresponding sensitivity reductions of ~12% for the encoder and ~8% for the end-to-end codec, while an exact-JVP test further shows preferential contraction of high-information directions. Code and trained models are available at this https URL.
317. 【2611.10070】Frequency-consistent synthesis and selective transfer for medical image analysis
链接：https://arxiv.org/abs/2611.10070
作者：Zhuhui Wang,Jianwei Zuo,Xin Peng,Kai Zhong,Xuliang Deng,Jiajia Luo
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：improve downstream analysis, necessarily improve downstream, downstream analysis, necessarily improve, improve downstream
备注： 40 pages, 5 figures
点击查看摘要
Abstract:Complementary imaging is not always available, and realistic synthesis does not necessarily improve downstream analysis. Here we introduce a training framework linking medical image synthesis to task learning through adaptive frequency consistency and selective feature transfer. Image-specific frequency constraints encourage consistency of structure and detail. Features are transferred only when a teacher using synthetic images achieves a lower task-error score than the student by a task-specific margin on a labelled training sample. Evaluations across five datasets show improved translation fidelity with three adversarial and diffusion-based translators trained without paired supervision, alongside gains in brain-tumour segmentation on tumour-containing slices and lesion centre-point detection. All 105 reported paired comparisons yielded point estimates favouring the proposed methods, including 36 external translation comparisons on post?treatment MRI without retraining. These findings support synthetic modalities as task-oriented complements to acquired scans when complementary imaging is unavailable.
318. 【2611.10043】Covariate-Conditioned One-Step Diffusion for Multi-Horizon 3D Brain MRI Prediction in Aging and Neurodegeneration
链接：https://arxiv.org/abs/2611.10043
作者：Natenaile Asmamaw Shiferaw,Ali Farki,Deepika Koundal,Jussi Tohka
类目：Image and Video Processing (eess.IV); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Predicting longitudinal brain, magnetic resonance imaging, characterize structural progression, Predicting longitudinal, resonance imaging
备注： 5 pages, 2 figures, 4 tables. Submitted to IEEE ISBI 2027
点击查看摘要
Abstract:Predicting longitudinal brain changes from magnetic resonance imaging (MRI) can help characterize structural progression associated with aging and neurodegeneration. However, diffusion-based forecasting typically requires iterative denoising, limiting inference efficiency. We propose a covariate-conditioned one-step diffusion framework for multi-horizon prediction of 3D gray-matter density (GMD) maps. Rather than directly generating future anatomy, the model predicts longitudinal GMD changes through residual prediction in a single denoising step. The predicted changes are added to the baseline GMD map to reconstruct future anatomy. The model is conditioned on baseline anatomy, age, diagnosis, APOE4 allele count, and continuous follow-up time. Training combines mean squared error with a Pearson correlation loss to improve the spatial agreement between predicted and observed GMD changes. A unified model supports prediction horizons from 2 to 10 years. On the held-out ADNI test set, our method achieves a $\Delta$-Pearson of 0.478, mean squared error (MSE) of $5.176 \times 10^{-3}$, and structural similarity index measure (SSIM) of 0.979, with $\Delta$-Pearson reaching 0.582 at 10 years. Without retraining, external evaluation on AIBL yields a $\Delta$-Pearson of 0.450, MSE of $4.016 \times 10^{-3}$, and SSIM of 0.985. Ablation studies further demonstrate the benefits of residual prediction, covariate conditioning, and correlation-based supervision. Code: this https URL.
319. 【2611.10000】Benchmarking Neural Image Compression with DCT-Based Spectral Diagnostics
链接：https://arxiv.org/abs/2611.10000
作者：Nikolay I. Kalmykov,Razan Dibo,Yujun Du,Yipeng Liu,Ivan Oseledets,Anh-Huy Phan
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：Neural image compression, individual spatial frequencies, treats individual spatial, codec treats individual, Neural image
备注： 17 pages, including supplementary material. Code: [this https URL](https://github.com/nkalmykovsk/dct_benchmark_nic)
点击查看摘要
Abstract:Neural image compression (NIC) models are commonly evaluated with scalar rate-distortion metrics, which do not show how a codec treats individual spatial frequencies. We propose a benchmark that probes codecs with the DCT basis matrix and single-frequency test images. We measure relative off-target energy (leakage), the fraction of reconstruction energy outside the probed frequency, together with target-frequency gain. Exact decompositions and bounds relate these measurements to reconstruction error. At operating points nearest 1 bpp, the BMSHJ, MBT, and Cheng2020 models leave 80-97% of their reconstructed high-band energy outside the target bin and have target-frequency gains of 0.02-0.23, whereas TCM and FTIC attain off-target energy in the classical-codec range. Both probe types identify behavior absent from scalar metrics: released Cheng2020-Anchor models produce extreme pre-clamp outputs on isolated single-frequency inputs. Finally, decoder-only fine-tuning with natural-image and leakage losses reduces basis off-target energy by 90-99.8% across all eight evaluated architectures while keeping the bitstream fixed, at a Kodak PSNR cost of 0.09-0.59 dB.
