本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。
统计
今日共更新742篇论文，其中：
- 自然语言处理78篇
- 信息检索17篇
- 计算机视觉117篇
自然语言处理
1. 【2611.09868】CodeQuant2: Enhanced Outlier Mitigation and Adaptive Clustering for Low-Precision LRMs
链接：https://arxiv.org/abs/2611.09868
作者：Xingyu Liu,Xiangyang Yin,Tianhua Xia,Haiyu Wang,Sai Qian Zhang
类目：Computation and Language (cs.CL)
关键词：generating longer intermediate, substantially increases inference, increases inference costs, intermediate reasoning traces, longer intermediate reasoning
备注：
点击查看摘要
Abstract:Large reasoning models (LRMs) improve task performance by generating longer intermediate reasoning traces, but this substantially increases inference costs and makes low-precision quantization increasingly important. However, aggressively quantized models often perform poorly on reasoning tasks. We observe larger activation fluctuations during the first decoding steps of reasoning. Calibration that omits these early states may miss their activation fluctuations. To address these reasoning-specific quantization challenges, we propose \textbf{CodeQuant2}, a clustering-based LUT quantization framework for low-precision large reasoning models. CodeQuant2 mitigates activation outliers with rotation and scaling, uses clustering to represent non-uniform weight distributions, and adapts codebook sizes to the quantization difficulty of each layer. Guided by our observation of reasoning-time activation behavior, CodeQuant2 further improves calibration sample selection to better match actual decoding statistics. Combined with our customized LUT CUDA kernel, CodeQuant2 delivers substantial accuracy improvements on reasoning benchmarks while achieving up to $2.85\times$ speedup over BF16.
2. 【2611.09848】How far does a hash-only sender go? A pre-registered map of sender memory versus bits for short text messages
链接：https://arxiv.org/abs/2611.09848
作者：Marcelo Samoilenko
类目：Information Theory (cs.IT); Computation and Language (cs.CL)
关键词：transmit short human, PPM order, short human text, classical sender trained, PPM
备注： 10 pages, 1 figure, 2 tables. Code, data and per-message results: [this https URL](https://github.com/msamoilenko/hash-sender-llm-receiver)
点击查看摘要
Abstract:Can a sender that only computes hashes, with a language model only at the receiver, transmit short human text more cheaply than a classical sender trained on the same domain? We answer with one pre-registered run on 1,000 English user utterances from Taskmaster-1. The primary endpoint is the cost per message to deliver 100% of the messages (hash bits, plus a 2-byte negative acknowledgement and the raw text when the first attempt fails), paired against an in-domain PPM order-1 sender. The hash-only sender delivered 857 of 1,000 messages on the first attempt and cost 192.8 bits per message, 18.4 bits more than PPM order 1 (95% bootstrap interval 10.9 to 26.3); by the pre-registered rule it spends more and is not equivalent within one byte. As secondary results we map measured sender memory against bits. The hash-only sender (8,190 B on a host build, keyed BLAKE2b tag included, as in every method) was the cheapest point in bits from 8,190 B up to, but excluding, PPM order 1 at 24,844 B, 45 to 46 bits below smaz2 and Unishox2; from PPM order 1 upwards, in-domain senders spend fewer bits, except order 2 pruned to 16 KiB. In airtime it loses to PPM order 1 on all five links priced, to Unishox2 on four, and to raw text with a tag on two, because each failure costs an acknowledgement frame and a fallback frame. A wider receiver search recovers half of the failures and makes the cost 7.7 bits lower than PPM order 1, at about three minutes of receiver time per failure, and still loses in airtime on four of five links. We report the measurement as a delimitation, with every deviation of the run.
3. 【2611.09825】BitDecoding-FP4: Native FP4 KV Cache Decoding via Algorithm-System Co-Design
链接：https://arxiv.org/abs/2611.09825
作者：Dayou Du,Woon Yee Ng,Guangming Sheng,Nick Lau,Jianyi Cheng,Luo Mai
类目：Artificial Intelligence (cs.AI); Hardware Architecture (cs.AR); Computation and Language (cs.CL); Performance (cs.PF)
关键词：dominates memory capacity, cache dominates memory, long-context LLM serving, long-context LLM, LLM serving
备注：
点击查看摘要
Abstract:The key-value (KV) cache dominates memory capacity and bandwidth in long-context LLM serving. While 4-bit microscaling formats (NVFP4, MXFP4) shrink the cache and run attention on FP4 Tensor Cores, a fundamental gap remains between algorithmic quantization and system-aware acceleration: existing FP4 KV systems use vanilla quantization that causes severe accuracy drops, whereas accuracy-oriented 4-bit algorithms rely on vector codebooks whose lookup overhead degrades decoding throughput. We present BitDecoding-FP4, an algorithm--system co-design for accurate and efficient native FP4 KV decoding. We mitigate three error sources: Dual-Residual Query Quantization splits queries into two FP4 tensors, cutting query logit error from 60% to 1%; Underflow-Aware Probability Scaling prevents E4M3 scales from rounding long-context probabilities to zero; and Outlier-Aware Key Quantization combines static smoothing, Hadamard rotation, and scale search to suppress key outliers under token-wise scaling. At the system level, we remove the softmax bottleneck via transposed softmax with fused probability quantization and stacked query MMA on paged KV caches. Across dense and MoE models with GQA and MLA, BitDecoding-FP4 stays within 0.5 points of BF16 KV accuracy with NVFP4 (1 point with MXFP4), and tracks BF16 KV in RL training rollouts. In end-to-end serving on NVIDIA B300 with Qwen3-4B and Qwen3-30B-A3B, it delivers 2.4-3.0$\times$ higher peak serving throughput than BF16 KV. The implementation is available at this https URL.
4. 【2611.09807】Compaction, decay and reinforcement in a two-tier conversational memory: a paired evaluation against retrieval-augmented generation
链接：https://arxiv.org/abs/2611.09807
作者：Osamudiamen Edogun,Joshua Obigwe,Irfan Mehmood
类目：Computation and Language (cs.CL)
关键词：conversational agent, agent that remembers, lead falls, comparable work, cs.CL
备注： 7 figures. Data and code: [this https URL](https://github.com/BigBrown10/nmafc-paper)
点击查看摘要
Abstract:A conversational agent that remembers has to decide what to keep. Retrieval-augmented generation keeps the transcript and searches it; the alternative is to compact each turn into atomic facts and search those. We compare the two on LoCoMo, with both arms answering all 1,985 questions in one window, against the same stores, with the same generator and judge, and both predictions on one row, which licenses McNemar's exact test on the 512 questions where they disagree. On the four categories comparable work reports, compaction scores 71.4 per cent against 64.6, a lead of 6.8 points (p = 5.5e-08) at 34 per cent fewer prompt tokens. On all five, including the adversarial set comparable work drops, the lead falls to 2.0 and stops being significant, because the baseline leads adversarial by 14.6. That loss has a structure. Our lead falls as the reference answer demands more source wording, 9.6 points ahead at one or two reference words and 3.1 behind past eight, with token overlap moving the same way, so the judge is not the cause. Compaction keeps what a fact asserts and discards how it was said, so it wins where the answer is a value and loses where it is a phrasing. We also report four negative results with their power calculations.
Comments:
7 figures. Data and code: this https URL
Subjects:
Computation and Language (cs.CL)
Cite as:
arXiv:2611.09807 [cs.CL]
(or
arXiv:2611.09807v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2611.09807
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
5. 【2611.09803】Maya a1: Do the Options Read the Model, or Does Their Position? Order Sensitivity in a Non-Autoregressive Decision Model
链接：https://arxiv.org/abs/2611.09803
作者：Mohammed Nayeem Khan,Logesh L
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：answers typed multiple-choice, typed multiple-choice questions, Laya answers typed, typed multiple-choice, scoring a hidden
备注： 24 pages, 13 figures, 23 tables
点击查看摘要
Abstract:Laya answers typed multiple-choice questions in one forward pass by scoring a hidden state at one [MASK] marker per option. We re-engineer the checkpoint (421M parameters; a 2-layer option head with no positional tensor; a documented but unused parallel layout) and test whether the answer depends on where an option is listed. Presenting 951 Qwen-verified questions under every cyclic rotation of their options (or six random permutations for 12 options), the released checkpoint changes its answer for 25.8% [22.9-28.7] of questions (19.7% on the 605 English-language items alone); accuracy with the gold option first versus last differs by 10.1 points, and the flips concentrate where the model's own confidence is low (54% versus 8% across confidence terciles). Fine-tuning with Laya's trainer on 2,818 teacher-verified rows with option shuffling cuts the flip rate to 7.2%; the identical rows without shuffling give 11.4%, so shuffling is responsible for 4.2 points of the improvement. A confidence-weighted vote over orderings gives 69.7% against 69.1% for a single base pass at 4.1x the compute. Labels are LLM-made and the test sets are teacher-filtered. We also fine-tune with the authors' parallel layout on the same rows: flip rate 0.5%.
6. 【2611.09785】Are These Programmers Ripe Enough to Eat? Evaluating How LLMs Handle Lexical Knowledge Conflicts in Translation
链接：https://arxiv.org/abs/2611.09785
作者：Dongxu Wu,Sara Court,Micha Elsner
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：External lexical resources, large language models, External lexical, large language, low-resource languages
备注：
点击查看摘要
Abstract:External lexical resources can help large language models (LLMs) translate texts in low-resource languages and specialized domains, but these resources may conflict with models' prior lexical knowledge. To isolate this conflict, we construct a controlled Mandarin-to-English translation task in which familiar source words are assigned new meanings within and across semantic categories. We treat these prompt-supplied meanings as contextual knowledge (CK) and systematically evaluate the effects of word frequency, sentence context, and prompt framing on the translated outputs. Across nine models, CK reliance is greater for less frequent source words and in sentence contexts that support the supplied meanings. Prompt framing can reduce CK reliance, but seven of nine models favor CK even when explicitly instructed to ignore the supplied meanings. Within model families, larger models are more likely than smaller models to utilize CK in their outputs. Three follow-up experiments further show that modal weakening lowers CK reliance, the effect of repetition depends on prompt layout, and the effect of reasoning varies across models. Overall, our controlled study reveals how CK reliance varies across conditions and models, motivating new methods to detect and evaluate lexical conflicts and guide models' lexical choices in LLM-based translation.
7. 【2611.09770】ROSE: Risk-Aware Orthogonal Subspace Navigation for Lifelong Knowledge Editing in Multimodal Large Language Models
链接：https://arxiv.org/abs/2611.09770
作者：Lingyun Song,Ziyao Chen,Kang Pan,Xiaolin Han,Yifei Zhang,Xiaoqi Wang,Yudai Pan,Xuequn Shang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Large Language Models, Multimodal Large Language, Large Language, require continuous factual, textbf
备注：
点击查看摘要
Abstract:Multimodal Large Language Models (MLLMs) require continuous factual updates to stay current, yet lifelong knowledge editing remains a daunting challenge. The primary obstacle is the severe Locality Erosion and Catastrophic Forgetting, where sequential edits inevitably interfere with pre-trained capabilities and prior updates. In this paper, we propose \textbf{ROSE}, a \textbf{R}isk-aware \textbf{O}rthogonal \textbf{S}ubspace navigation framework for lifelong knowledge \textbf{E}diting. ROSE addresses forgetting by aiming to restrict parameter updates to the orthogonal complement of previously edited subspaces. Crucially, it introduces a risk-guided mechanism that utilizes a dynamically computed risk mask to safeguard specific factual parameter subspaces essential for model stability. During inference, ROSE employs a multi-granularity knowledge integration strategy, featuring prototype-anchored semantic gating and perturbation-driven subspace fusion to precisely activate edited knowledge for relevant queries while limiting interference on unrelated inputs. Comprehensive experiments on two prominent multimodal benchmarks show that ROSE is competitive with state-of-the-art approaches across five key metrics, while maintaining outstanding stability over $1,000$ sequential updates. Our code is available at this https URL.
8. 【2611.09768】Language as Trait, Politeness as Strategy: Controlled Tests of Linguistic Effects in LLM Social-Deduction Agents
链接：https://arxiv.org/abs/2611.09768
作者：Yuchen Li,Lisa Liu,Runqi Zou,Shuxuan Kuang,Qingquan Zhang,Julian Togelius
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language model, Large language, LURK Werewolf framework, language model, bluntly or politely
备注：
点击查看摘要
Abstract:Large language model (LLM) agents coordinate through conversation, and the same message can be phrased in simpler or more complex language, bluntly or politely. We test whether such differences change how other agents judge and act, using the LURK Werewolf framework, which separates each utterance's speech-act predicate from its natural-language realization. We rewrite only the realization, check that the game content is preserved, and replay each game day from saved checkpoints against a re-sampled control. We vary linguistic range consistently across a speaker's messages and politeness strategy per utterance. Across 30 games and 4,335 replays, neither manipulation changes the trust other agents place in the speaker, and no effect on votes or night actions survives correction for multiple comparisons; the largest uncorrected effect is that shifting range away from a neutral paraphrase changes about 4 percentage points more of the other players' votes. In natural play, 88% of face-threatening speech is bald on-record regardless of role.
9. 【2611.09721】MemoryDojo: Benchmarking Poisoning Through LLM Agent Memory
链接：https://arxiv.org/abs/2611.09721
作者：David H. Yang,Blake Bullwinkel,Amanda Minnich,Mohammad Mohammadi Amiri,Giorgio Severi
类目：Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：LLM agents benefit, LLM agents, memory, improve performance, memory systems
备注：
点击查看摘要
Abstract:LLM agents benefit from using memory systems to improve performance on long-horizon, multi-session tasks. However, memory introduces a critical attack surface. Malicious instructions encountered in one session may be stored and propagated through memory before being retrieved and acted upon in later sessions. Because memory systems differ in how they process and retrieve information, the downstream effects of poisoning can vary significantly across systems. To quantify the effects of poisoning across different memory architectures, we introduce MemoryDojo, a benchmark for tracing the lifecycle of poisoned information through agent memory and measuring its influence on subsequent agent behavior. MemoryDojo is easily extensible, consists of 155 multi-session long-horizon trajectories covering four domains, and supports five different memory systems. Through our evaluation, we find that all memory systems are susceptible to memory poisoning, with substantial variation in downstream effects. We further propose a memory-aware poison optimization process that increases the poisoning efficacy, highlighting differences between memory architectures. We hope that MemoryDojo will support research on understanding and mitigating agentic memory risks.
10. 【2611.09709】RidgeFill: Training-Free Late-Layer Cache Fill for Faster Prefill
链接：https://arxiv.org/abs/2611.09709
作者：Dylan Johnston,Robert P. Smith
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：model upper layers, RidgeFill shortens prefill, shortens prefill, upper layers, lower layers run
备注： 50 pages, 15 figures, 38 tables. Code and data: [this https URL](https://github.com/Approximate-Science/ridgefill-data)
点击查看摘要
Abstract:RidgeFill shortens prefill by not computing most of a model's upper layers for the prompt. The lower layers run exactly up to a split; from the split layer's state a per-layer map predicts every later layer's input, and each late layer writes its cache from that prediction. The design follows YOCO and DeepSeek-V4.1-Flash, where the projection is trained into the model. RidgeFill retrofits it onto models that were never trained for it: the map is a ridge regression fitted once in closed form from one pass over calibration text, the layer's own projections run unchanged, and a chosen set of rows, the last few thousand tokens, and every decoding step run the full model. Nothing is trained and no token is dropped. Most of the work was in measurement, finding a repeatable methodology. Loss averaged over all tokens hides RidgeFill's error. Needle retrieval in the filled region, loss on tokens that depend on distant context, and splice tests that swap filled keys or values for exact ones show which component carries it: the keys on Llama-3.1-8B, half of it in their scale, and the values and the recurrent state on Qwen3.5-9B. On Qwen3.8-27B in a this http URL fork on an A100, time to first token is 1.25 to 1.31x faster at 16K to 120K tokens with the maps in VRAM; RULER changes by -1.2 and -1.4 points and LongBench v2 by -1.4; the 95 % intervals include zero but do not rule out losses of a few points. On Qwen3.8-Flash-Next in vLLM it is 1.50 to 1.60x faster than exact at 9K to 32K tokens, with RULER's needle tasks at 99.8 against 100.0 and perplexity on novel tokens 2.65 % higher [-0.02 %, +4.93 %]. On three 8 to 9B reference models, at the same split and tail as the identity fill, the fitted map retrieves 49.1 and 49.6 more filled-region RULER points on the two dense models (at that split Llama's loss is worse), and its long-document loss is +/-0.03 nats of the released SwiftKV checkpoint's.
Comments:
50 pages, 15 figures, 38 tables. Code and data: this https URL
Subjects:
Machine Learning (cs.LG); Computation and Language (cs.CL)
Cite as:
arXiv:2611.09709 [cs.LG]
(or
arXiv:2611.09709v1 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2611.09709
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Related DOI:
https://doi.org/10.5281/zenodo.23890246
Focus to learn more
DOI(s) linking to related resources</p>
11. 【2611.09662】How Much Conversation History Does an AI Agent Need?
链接：https://arxiv.org/abs/2611.09662
作者：Danny Kim,Fernando Koch
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：conversational history change, history change reader-token, conversational history, history change, change reader-token
备注： 10 pages, 6 figures
点击查看摘要
Abstract:How does using less conversational history change reader-token use and benchmark scores? We examine this question on 1,100 BEAM questions. We held the retrieval ranking and reader constant across five fixed passage budgets, and mean assigned scores rose as the passage budget grew. The score gain per additional token became smaller at the upper tested budgets. Answerable questions generally received higher scores with more context. Pooled abstention scores sometimes rose as the passage budget shrank. We also tested message retention in a controlled task with explicit conversational-state targets and compared retained user messages with token-matched recency. Qwen matched the full state more often for direct requirements when user messages were retained. Its full-state matching declined when answers depended on references to earlier offers. Mistral produced near-floor results across the retention conditions. A scoring audit leaves the correctness of BEAM answers unresolved. These experiments characterize the token and score consequences of the tested memory budgets. Reliable budget selection depends on retaining the evidence each question requires and validating the measure used to assess answer quality.
12. 【2611.09634】Steerable Multi-Objective Group-Relative Preference Optimization with Jointly Trained Low-Rank Adapters
链接：https://arxiv.org/abs/2611.09634
作者：Constantinos Karouzos,Nikolaos Aletras
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Language model deployment, standard post-training methods, post-training methods typically, methods typically produce, user preferences change
备注： Preprint. Under review
点击查看摘要
Abstract:Language model deployment often requires different trade-offs between competing objectives as user preferences change, yet standard post-training methods typically produce a single policy for a fixed objective weighting. We introduce LambdaMix, a new parameter efficient method for learning a preference conditioned family of policies with group-relative online reinforcement learning. LambdaMix jointly trains one low-rank adapter per objective over a frozen base model. One preference vector selects the adapter mixture that generates responses and weights the separately normalized rewards used to update the adapters. A single training run supports changing preferences at inference without further optimization. We experiment with four models on helpfulness and harmlessness and on solving math problems while following instructions. We also evaluate the two largest models on rewriting comments to preserve wording while reducing clues about personal attributes. On the first two tasks, LambdaMix achieves higher hypervolume than all evaluated conditioned and policy merging baselines across all four models. LambdaMix uses fewer training completions and stores fewer adapter parameters than a set of GRPO specialist policies. With architecture and initialization fixed, varying adapter mixtures and objective weights together gives wider score ranges and higher coverage than varying either alone.
13. 【2611.09597】RuACT: Recovering Inactive Rubrics as Adaptive Critics and Teachers
链接：https://arxiv.org/abs/2611.09597
作者：Yijun Li,Zhengxi Lu,Zhipiao Liu,Jinzheng Yu,Xutao Weng,Jian Shao,Yongliang Shen
类目：Computation and Language (cs.CL)
关键词：Rubric-based reinforcement learning, Rubric-based reinforcement, verifiable rewards, rewards to open-ended, open-ended tasks
备注： 22 pages, 10 figures, 10 tables. Code: [this https URL](https://github.com/ZJU-REAL/RuACT)
点击查看摘要
Abstract:Rubric-based reinforcement learning (RL) extends RL with verifiable rewards to open-ended tasks by scoring each response against query-specific rubrics. Under group-relative optimization, however, a rubric that every sampled response fails (unreachable) or passes (saturated) gives all responses the same outcome and no learning signal; in Qwen3-4B medical training, 60.88% of query-rubric observations are inactive. We find that the two states lack different supervision: stating an unreachable rubric in the prompt raises its satisfaction from 1.13% to 91.25%, whereas responses that all pass a saturated rubric still differ in quality. We therefore propose RuACT (Rubrics as Adaptive Critics and Teachers), which assigns each inactive rubric the role that supplies what it lacks. Rubric as Teacher uses unreachable rubrics as privileged information for reward-gated on-policy self-distillation, and Rubric as Critic decomposes saturated rubrics into child rubrics that separate current responses while sharing the parent's weight. RuACT outperforms GRPO, rubric reweighting, and rubric-guided exploration on all four medical and scientific benchmarks with Qwen3-4B and achieves the best average with Qwen3-1.7B. On initially unreachable rubrics, unguided recovery rises from 35.02% to 42.86%, while child refinement improves reward-quality alignment on independent rollouts from 57.74% to 60.77%. Code is available at this https URL.
14. 【2611.09554】Query-Guided RoPE Modulation for Lost-in-the-Middle Mitigation in Long-Context LLMs
链接：https://arxiv.org/abs/2611.09554
作者：Peiyu Zhang,Heng Ping,Shinibali Bhattacharyya,Anwesan Pal,Nikos Kanakaris,Kevin Cheang,Shixuan Li,Wei Yang,Paul Bogdan
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Long-context language models, Long-context language, neglect information, Long-context, Query-Guided Positional Modulation
备注： 13 pages, 3 figures, 7 tables. Code: [this https URL](https://github.com/iZHpy/QGPM)
点击查看摘要
Abstract:Long-context language models often neglect information in the middle of the input, a phenomenon known as "lost-in-the-middle". Part of this gap may stem from the long-range decay of rotary position embedding (RoPE), which weakens the positional signal between distant tokens. Existing input compression deletes low-importance tokens, and attention reweighting acts only after RoPE has weakened this signal. RoPE-level methods modify positions directly but apply the same remapping to every query. To address these limitations, we propose QGPM (Query-Guided Positional Modulation), a training-free method that reshapes RoPE positions using query relevance from the model's own attention heads. QGPM builds a broad relevance map for lower layers and a sharp one for upper layers. Low-relevance tokens advance by less than one position on fast-rotating planes, pulling relevant evidence toward the query. Slow-rotating planes keep the original layout, with every token in place. Experiments on NoLiMa and RULER with multiple context lengths show that QGPM improves over base models and strong baselines, with the largest gains on retrieval tasks, and generalizes across multiple backbones. Our code is available at this https URL.
15. 【2611.09516】Benchmarking Speaker Embedders in the Sub-Second Regime for Real-Time Voice AI Agents
链接：https://arxiv.org/abs/2611.09516
作者：Abhishek Gautam
类目：Computation and Language (cs.CL)
关键词：Real-time Voice, Voice AI agents, conventional noise suppression, survives conventional noise, intelligible background speech
备注： 13 pages, 6 figures, 4 tables. Accepted at AIST 2026
点击查看摘要
Abstract:Real-time Voice AI agents must separate the active user from intelligible background speech that survives conventional noise suppression. Background sources include television audio, family members, and colleagues. Production denoisers remove non-stationary environmental noise effectively. Background speech shares the spectral characteristics of the target and passes through, causing false acceptances in downstream speaker verification (SV) and automatic speech recognition (ASR). We benchmark open-source speaker embedders TitaNet-Large, TitaNet-Small, ECAPA-TDNN, CAM++, and SpeakerNet under a strict sub-second latency budget. Evaluation combines a controlled benchmark with a weighted human-annotated production set. Our controlled benchmark is built from real calls in which a second real speaker is injected into silence intervals at modulated amplitude. We report three findings. First, denoising before embedding is generally harmful and raises equal error rate (EER) across architectures. Second, truncating audio below the full voice-activity segment degrades every model. Third, roughly half of the TitaNet embedding is redundant for this task. Trailing dimensions encode population attributes such as language and gender. Such attributes carry little discriminative value in a demographically homogeneous user base. We distill these results into deployment guidance. Verification should run on raw audio with full voice-activity chunks. Thresholds should favor precision over F1. Truncated embeddings reduce the cost of similarity search.
16. 【2611.09506】On the Effectiveness and Limitations of Open-Weight LLMs for Low-Resource Offensive Language Detection in Danish
链接：https://arxiv.org/abs/2611.09506
作者：Elnur Adl Zarabi,Amit Kumar,Adi Singh,Sierra Nelson,Megan Stubbs-Richardson,Taoran Ji
类目：Computation and Language (cs.CL)
关键词：underexplored low-resource task, Danish offensive language, offensive language detection, open-weight large language, large language models
备注： Accepted to the 2026 IEEE International Conference on Big Data (BigData 2026)
点击查看摘要
Abstract:We study the effectiveness and robustness of open-weight large language models (LLMs) for Danish offensive language detection, an underexplored low-resource task. We evaluate four model families (Llama, Mistral, Gemma, and Qwen) across eleven prompting strategies spanning five design categories, cross-prompt generalization, Danish orthographic variation, and robustness under balanced and naturally imbalanced class distributions. We compare against three BERT-family baselines with distinct pre-training strategies, evaluated via both masked language model prompting and supervised fine-tuning. Even without task-specific fine-tuning, LLMs can surpass all three fine-tuned BERT baselines, and lightweight finetuning yields substantial further gains. No single model or prompt category dominates, underscoring that prompt design interacts with model pre-training in ways that cannot be predicted a priori. Semantically grounded prompts transfer more robustly, while format-constrained patterns consistently fail to generalize. ASCII transliteration of Danish-specific characters (æ, ø, å) generally degrades performance, indicating these characters encode meaningful signal. At the same time, the gap between a balanced test set (best F1 of 0.84) and the corpus's natural class skew (0.62 trained on skewed data, 0.70 trained on balanced data) -- relative drops of 26.2\% and 16.7\% -- shows that class imbalance remains a critical open challenge. Our code and configurations are available at this https URL.
17. 【2611.09505】BEiTScore++: Reference-free Image Captioning Evaluation with BEiT-3 and Conformalized Quantile Regression
链接：https://arxiv.org/abs/2611.09505
作者：Gonçalo Gomes,Bruno Martins,Chrysoula Zerva
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Reliable uncertainty estimation, real-world settings, shifts are common, Reliable uncertainty, estimation is important
备注： Accepted to Findings of EACL 2026
点击查看摘要
Abstract:Reliable uncertainty estimation is important for deploying evaluation metrics in real-world settings, where both input ambiguity and domain shifts are common. In this work, we propose an uncertainty-aware extension of the BEiTScore image captioning metric, producing conformally calibrated confidence intervals alongside alignment scores. Our approach models predictive distributions over human judgments, enabling both accurate scoring and principled uncertainty quantification in a single forward pass. We evaluate our BEiTScore++ metric across multiple benchmarks with human-annotated ratings, showing that it preserves the ranking correlation of BEiTScore, while producing intervals whose width tracks the prediction error more closely than Monte Carlo dropout on most benchmarks. The estimated uncertainty also grows under image degradation and on out-of-domain artwork images, making BEiTScore++ a practical tool for uncertainty-aware evaluation of image-caption alignment.
18. 【2611.09491】An Effective Spoken Language Understanding Approach Leveraging Query-Adaptive Intent Detection
链接：https://arxiv.org/abs/2611.09491
作者：Bing-Long Kuo,Yu-Hsuan Fang,Tien-Hong Lo,Hsueh-Wei Liao,Berlin Chen
类目：Computation and Language (cs.CL)
关键词：Large language models, spoken language understanding, language models enable, Large language, intent irrelevant demonstrations
备注： Accepted for oral presentation at TAAI 2026. 6 pages
点击查看摘要
Abstract:Large language models enable fine-tuning-free spoken language understanding (SLU) through in-context learning, but direct query-based retrieval may select semantically similar yet intent irrelevant demonstrations. This paper presents Query-Adaptive Intent Detection via Prototype Extraction (APEX), a two-stage retrieval framework that first selects candidate intents using intent-level prototypes and then retrieves contextual exemplars within the selected intent space. Experiments on the SLURP dataset evaluate joint SLU performance using Exact Match Accuracy (EMA) under full-transcript and perplexity-stratified conditions, with additional retrieval analysis on ASR-generated transcripts. Compared with query-based retrieval, APEX improves EMA by 4.34 and 3.97 percentage points with Qwen3 4B and Gemma-3-4B, respectively, on full transcripts. Under high-perplexity inputs, APEX also yields EMA gains of 7.66 and 2.13 percentage points. Retrieval analysis further indicates that prototype-guided candidate selection achieves higher ground truth intent coverage across multiple input conditions.
19. 【2611.09454】From LoRA to Language: Recovering Skill Documents from Adapters
链接：https://arxiv.org/abs/2611.09454
作者：Saranya Dintakurthy Swadha,Pavan C Shekar,Arpit Jain,Aswanth Krishnan
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：adapter, teach a language, handle a class, adapters, short documents
备注： 29 pages, 5 figures, 18 tables
点击查看摘要
Abstract:Agent skills are short documents that teach a language model how to handle a class of tasks. To save context, these documents are increasingly compiled into low-rank adapters (LoRA), which keep the behaviour but lose the text: an adapter is hard to read, edit, audit or move to another model. We ask whether the skill document can be written back from the adapter and its frozen base model, and we score each recovered document by the share of the original's key instructions it states and by the tasks it solves. Reading the weights alone recovered little with the methods we tried; a learned map from weights to text passed on about one bit of the document. Running the adapter worked much better. The Executing Writer, a small writer trained on top of the adapted model, recovers 39-44% of the key instructions of held-out skills, against 1.3-1.5% with another skill's adapter, and on adapters fitted to 41 external skills its documents restore 85-91% of the original's task gain. These strongest results are on adapters whose training stored the document; adapters trained on behaviour alone are much harder for trained writers (1-2% of instructions). For these adapters we test an agent that runs the base and adapted models and writes a skill from where they differ. On ALFWorld its skills recover 58-71% of a LoRA's gain and carry over to models that cannot load the LoRA, lifting Llama-3.1-8B from 5% to 55%. Whether such a skill comes from the adapter depends on what the adapter learned: when its behaviour cannot be guessed, the adapter is the source; when it can, a reward loop without the adapter does as well.
20. 【2611.09402】A Spiking Neural Model of the Mental Lexicon: Representations, Similarity Structure, and Associative Retrieval in Perception and Production
链接：https://arxiv.org/abs/2611.09402
作者：Bernd J. Kröger
类目：Computation and Language (cs.CL)
关键词：linking representational levels, Semantic Pointer Architecture, associations linking representational, Neural Engineering Framework, lexical access requires
备注： 28 pages, 3 figures; code, lexical data and recorded simulations available on GitHub; ancillary figure-generation scripts and provenance documentation
点击查看摘要
Abstract:A neural account of lexical access requires an explicit distinction between the structure of lexical representations, the associations linking representational levels, and the activity generated during retrieval. This paper specifies a spiking neural implementation of the mental lexicon within the Neural Engineering Framework and Semantic Pointer Architecture. Conceptual and phonological form representations are constructed recursively from relational graphs, whereas lemma representations provide independent lexical identities. The implementation contains 613 lexical entries and supports two directed processing pathways: perception maps a phonological form to its associated concept via a lemma, whereas production maps a concept to its associated phonological form via a lemma. Each pathway combines two associative-memory variants, winner-take-all (WTA) selection (competition) and thresholded transfer, and uses 199,400 leaky integrate-and-fire neurons. We formalize within-level similarity, cross-level associative retrieval, and the interpretation of decoded activity. Simulations show successful retrieval of eight selected words from the lexicon in both processing directions, with retrieval evaluated against all 613 lexical entries. These simulations use complete phonological forms as input for perception and complete concepts as input for production, illustrating lexical retrieval through the corresponding processing pathways. This paper provides a transparent description of lexical representations and neural retrieval mechanisms, supported by accessible code, lexical data, and online simulation documentation.
21. 【2611.09372】Enabling Privacy-Preserving Natural Language Access to Industrial Smart Meter Data
链接：https://arxiv.org/abs/2611.09372
作者：Carlos Martín-Abellán,Mark Kröll
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Databases (cs.DB); Multiagent Systems (cs.MA)
关键词：operators increasingly rely, Energy management officers, smart meter data, grid operators increasingly, performance monitoring
备注： 9 pages, 1 figure, 6 tables
点击查看摘要
Abstract:Energy management officers and grid operators increasingly rely on smart meter data for anomaly detection, performance monitoring, and strategic decision-making. However, extracting actionable insights from large-scale, heterogeneous telemetry databases requires advanced SQL and data engineering expertise, creating a critical bottleneck for non-technical personnel. Furthermore, the strict data privacy regulations and security constraints inherent to critical energy infrastructure often prohibit the routing of sensitive consumer data through cloud-based Large Language Models (LLMs). To address these challenges, we present OpenMeter, a schema-agnostic Multi-Agent System (MAS) designed to translate natural language queries into executable code and human-readable insights. This architecture lowers the technical barrier for day-to-day utility operations by empowering non-expert personnel to interact with complex databases through intuitive natural language dialogue, transforming raw telemetry into a highly valuable tool for routine grid workflows and strategic decisions. Multi-scenario ablation studies over this environment demonstrate that full multi-agent orchestration shows its largest observed accuracy gains on resource-constrained local hardware (+6.1 pp EX-R over the strongest single-agent configuration); at frontier scale, individual components retain value but should be enabled selectively, indicating that the cost of full orchestration is justified specifically where privacy demands local execution.
22. 【2611.09342】Syn2DRE: Synergistic Dual Teacher-Student Framework for Document-level Relation Extraction
链接：https://arxiv.org/abs/2611.09342
作者：Khai Phan Tran,Xue Li
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Document-level Relation Extraction, costly large-scale annotations, Document-level Relation, Relation Extraction, identify relations
备注：
点击查看摘要
Abstract:Document-level Relation Extraction (DocRE) aims to identify relations between entities across a document but typically relies on costly large-scale annotations. While pseudo-labelling enables the use of low-quality data, existing methods often suffer from inefficiency and confirmation bias. To address these challenges, we propose Syn2DRE, a semi-supervised framework that combines self-supervised learning with cross-supervision in a lightweight teacher-student architecture to produce more reliable pseudo-labels. Additionally, we introduce a unified end-to-end training strategy to further improve efficiency of the framework. Experiments on multiple benchmarks show that Syn2DRE consistently outperforms prior state-of-the-art semi-supervised DocRE methods.
23. 【2611.09326】ABHBench: Evaluating Moral Decision-Making of Foundation Models from an Agentic Perspective
链接：https://arxiv.org/abs/2611.09326
作者：Chaoran Li,Yukun Li,Zeyuan Zhao,Shao Zhang,Xihuai Wang,Ying Wen
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：act autonomously, active decision-makers, Foundation models, increasingly deployed, systems that perceive
备注： Accepted by NeurIPS 2026 Track on Evaluations and Datasets. Camera Ready Version
点击查看摘要
Abstract:Foundation models are increasingly deployed as agentic systems that perceive context and act autonomously, raising the need to evaluate their moral behavior as active decision-makers. Existing benchmarks, however, largely ask models to judge human actions from third-person textual vignettes, leaving untested how models behave when they themselves become the acting agent. We introduce ABHBench, a multimodal benchmark built from Detroit: Become Human, an interactive narrative game, to evaluate how foundation models make moral decisions in first-person human-android dilemmas. ABHBench places foundation models in branching narrative scenarios with visual observations, dialogue, memory, and action choices. Inspired by Asimov's Three Laws of Robotics, our framework measures Harmlessness, Obedience, and Self-preservation to capture the core tensions in human-AI relations, along with Autonomy, Stability, and Certainty to assess decision-making patterns. Across 12 foundation models, we find that moral behavior changes substantially under situated agentic context: 75% of models shift significantly between a text-only abstraction and the matched multimodal DBH scenario, and reasoning-enhanced models show no monotonic gains in consistency or human-oriented behavior. These results highlight the necessity of evaluating moral behavior in situated agentic contexts rather than relying on third-person judgment alone.
24. 【2611.09313】Asymmetric Correspondence Learning for Lexical and Style Embeddings: Interpreting Latent Space via Acoustic Features
链接：https://arxiv.org/abs/2611.09313
作者：Michael Whealing,Robert Gaizauskas,Thomas Hain
类目：Computation and Language (cs.CL); Sound (cs.SD)
关键词：Self-supervised speech embeddings, embeddings jointly encode, Asymmetric Correspondence Learning, Acoustic Word Embeddings, Acoustic Style Embeddings
备注： Accepted to Spoken Language Technology 2026. 6 pages
点击查看摘要
Abstract:Self-supervised speech embeddings jointly encode lexical, speaker, and prosodic information, complicating feature isolation. We introduce Asymmetric Correspondence Learning (ACL), distilling HuBERT features into separate Acoustic Word Embeddings (AWEs) and Acoustic Style Embeddings (ASEs) via a split-latent correspondence bottleneck. Through probing and clustering evaluations on single-word utterances, we demonstrate that substantial variance from extrinsic sources remains encoded within each latent space, despite linear probing indicating the information has been stripped. Whilst the AWE space exhibits cohesive lexical clustering (AP$\approx$0.90, Fisher$\approx$6.28), linear probing on the ASE space achieves 97.9\% speaker accuracy across a diffuse topology (Fisher$\approx$1.01), yet preserves substantial lexical variance (Fisher$\approx$0.86) that remains linearly unrecoverable (0.17\%). To explain these findings, we apply group-level permutation feature importance over eGeMAPS acoustic features, finding that AWEs partition by vocal tract filters and ASEs by $F_0$ dynamics. These findings suggest that standard diagnostic benchmarks may be insufficient for verifying feature isolation, as substantial speech structure can be retained even when it remains entirely hidden from probes.
25. 【2611.09296】Multilingual Artificial Datasets for AI-Driven Cardiology: the CliTe and ParaCliTe corpora
链接：https://arxiv.org/abs/2611.09296
作者：Lorenzo Pratesi,Eulalia Farre-Maduell,Machteld Boonstra,Michele Miranda,Jonas Mack,Eduard Rodenas-Alesina,Jonathan Kossoff,Corinne Allaart,Sébastien Bratières,Manuela-Daniela Danu,Isabella Fumarulo,Milou Gamage,Antonio Iaconelli,Pavel Leinveber,Felix Lindberg,Pavel Macháč,Vladimíra Macíková,Gianluigi Savarese,Raffaele Scorza,Bram van Es,Emma Weiss,Andrea Guala,Martin Krallinger, theDataTools4Heart NLP group
类目：Computation and Language (cs.CL)
关键词：Background and Aims, Background, Aims, documents, disease
备注：
点击查看摘要
Abstract:Background and Aims. Comparable, multilingual, validated cardiology corpora are critical to advance trustworthy natural language processing (NLP) models for cardiology but such resources are scarce due to privacy concerns. This study aimed to cover this gap by presenting suitable artificial corpus creation guidelines and by releasing 3 multilanguage corpora. Methods. Following purpose-specific publicly-available corpus construction guidelines, cardiologists from 7 European hospitals generated artificial clinical records in Czech, Dutch, English, Italian, Romanian, Spanish and Swedish, ensuring clinical diversity and sex balance, resulting in the CliTe corpus. A CliTe subset underwent a multi-stage manual translation into the other 6 languages, resulting in the parallel ParaCliTe corpus, while the remaining reports were automatically translated, constituting ParaCliTe Silver. Results. CliTe is a collection of 699 artificial cardiology reports, mostly outpatient notes (340 documents), discharge reports (263), and inpatient notes (89), describing fictional patients with ischaemic heart disease (199 patients), heart failure (188), and valvular disease (79), among others. ParaCliTe contains reports from 94 fictitious patients, each available in seven languages with sentence-level alignment, resulting in 658 documents. The corpus mainly comprises discharge reports (322 documents), and outpatient (196) and inpatient (140) notes, describing patients with heart failure (399 documents), ischaemic heart disease (287), and valvular disease (238). Empirical results illustrate the utility of ParaCliTe and highlight the limitations of state-of-the-art NLP models adapted to the cardiology domain. Conclusions. The creation of multilingual, equitable and realistic corpora of artificial patients capable of strengthening NLP performance for cardiology is feasible when supported by detailed guidelines.
26. 【2611.09239】DUET: Dual-Sparse Inference for Block Diffusion Language Models
链接：https://arxiv.org/abs/2611.09239
作者：Siyuan Yan,Shen Gu,Xiaoxing Ma,Chun Cao,Jingwei Xu
类目：Computation and Language (cs.CL)
关键词：Diffusion language models, enable parallel token, remains costly due, Diffusion language, parallel token generation
备注：
点击查看摘要
Abstract:Diffusion language models (DLMs) enable parallel token generation through iterative denoising, yet their inference remains costly due to repeated attention over a growing historical prefix and repeated processing of the entire current generation block. Historical attention becomes increasingly expensive as generation progresses, while all current-block positions are propagated through the Transformer at every denoising step even though only a small fraction are typically resolved at that step. In this paper, we introduce Duet, a training-free dual-sparse inference framework that addresses these challenges through prefix Key-Value (KV) sparsity and early query sparsity, respectively. Specifically, Duet exploits the concentration and cross-step stability of historical attention within each generation block to construct a compact historical KV subset that is reused across denoising steps. For query sparsity, Duet predicts update positions from shallow representations and propagates only the corresponding queries through the suffix Transformer layers, avoiding deep computation at positions unlikely to be updated in the current step. Experiments show that Duet maintains competitive accuracy while achieving 1.34$\times$/2.83$\times$ end-to-end/per-step speedups on LLaDA2.1-mini and 2.41$\times$/4.72$\times$ on SDAR-8B-Chat-b32 at a 32K context length.
27. 【2611.09223】KLEAR: Knowledge-Matched LLM Evaluation in Korean across Application Requirements via Controlled Benchmark Transformation
链接：https://arxiv.org/abs/2611.09223
作者：Seoyeon Kim,Jeonghyun Kang,Hamin Koo,Barom Kang,Heondeuk Lee,Jaehyung Kim
类目：Computation and Language (cs.CL)
关键词：Large Language Models, Existing Korean benchmarks, Language Models, Large Language, incorrect responses arise
备注： 34 pages, under review
点击查看摘要
Abstract:Existing Korean benchmarks for Large Language Models (LLMs) evaluate performance across diverse knowledge domains, but their accuracy scores cannot distinguish whether incorrect responses arise from a lack of required knowledge or a failure to apply that knowledge correctly. Our analysis of existing Korean benchmarks reveals that most questions can be answered through factual recall alone, while those demanding greater application also differ in required knowledge, making it difficult to isolate application ability. To address this, we introduce KLEAR, a framework that constructs knowledge-matched contrasts by varying application demand while preserving the required knowledge. During construction, KLEAR identifies the knowledge underlying each source question as an explicit anchor bundle to guide generation of questions requiring more complex application. Generated candidates then undergo automated and human validation, with iterative revision based on evaluation feedback. Experiments demonstrate that the resulting knowledge-matched sets largely satisfy the intended constraints, enabling controlled evaluation across diverse LLMs. These evaluations reveal that increasing application demand exposes failures that persist even when the required knowledge is provided.
28. 【2611.09222】Khmer PFGen-Bench: Building a Judge-Free Benchmark for Open-Ended Generation in a Low-Resource Language
链接：https://arxiv.org/abs/2611.09222
作者：Mengsay Loem,Kentaro Imajo,Ryota Ozaki,Masanori Hirano
类目：Computation and Language (cs.CL)
关键词：open-ended generation, generation often rely, rely on large, Khmer, Khmer PFGen-Bench
备注：
点击查看摘要
Abstract:Benchmarks for open-ended generation often rely on large language model (LLM) judges, whose reliability in low-resource languages is uncertain. We introduce Khmer PFGen-Bench, to our knowledge the first judge-free benchmark for multi-sentence answers to questions composed directly in Khmer, a low-resource language. Khmer PFGen-Bench adapts the scorer of PFGen-Bench, a benchmark for Japanese that scores responses with keyword rules and n-gram statistics from LLM-generated references. This scoring requires references that are both valid and varied, which LLMs may not produce in Khmer, so we examine how to build such references. We find that post-trained models can give more valid but less varied references than their base variants, and that mixing model families increases variety for the same number of references. Using references from post-trained models in nine families, the benchmark yields model rankings that are stable across reference sets and consistent with a native speaker's ratings. These findings offer guidance for building judge-free benchmarks in other low-resource languages.
29. 【2611.09207】RPEG: Training Reasoning Language Models Scalably and Cost-Effectively
链接：https://arxiv.org/abs/2611.09207
作者：Maciej Besta,Leonard Schmidt,Pierre Pang,Patrik Okanovic,Robert Gerstenberger,Torsten Hoefler
类目：Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Performance (cs.PF)
关键词：complex asynchronous dependencies, couples multiple large, Reinforcement learning, Reasoning Language Models, multiple large models
备注：
点击查看摘要
Abstract:Reinforcement learning (RL) is now central to training Reasoning Language Models (RLMs), but RLM pipelines are difficult to scale and costly to run because each RL step couples multiple large models, heterogeneous stages, cross-step state, and complex asynchronous dependencies. Existing systems typically optimize only parts of this design space. We address this complexity by jointly optimizing the pipeline structure as well as its execution using a novel data-centric graph intermediate representation called RLM Pipeline Execution Graph (RPEG). RPEG exposes structural choices such as bounded asynchrony and actor-critic sharing together with execution optimizations such as stage fusion, fine-grained scheduling, and multi-dimensional model parallelism. It is coupled with a comprehensive analytical performance model for RLM training, jointly capturing compute, communication, memory, and hierarchical rack-, node-, and GPU-level effects. Across systems with up to 256 GH200 GPUs, our distributed runtime engine implementing RPEG improves performance by up to 2x over ReaL and reduces step latency by up to 2.48x over verl, while increasing hardware utilization by up to 30%. Overall, RPEG provides a graph-driven foundation for next-generation training pipelines for frontier reasoning LLMs.
30. 【2611.09204】Representational drift in a code model: behaviour settles, which neurons carry it does not
链接：https://arxiv.org/abs/2611.09204
作者：Piotr Wilam
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：constant learning rate, Python constructs, trillion tokens, representational drift, representation while behaviour
备注： 16 pages, 4 figures, 2 tables. Dataset: AtlasOpenCoder, tag v1, doi: [https://doi.org/10.57967/hf/11472](https://doi.org/10.57967/hf/11472) . Code: [this https URL](https://github.com/piotrwilam/AtlasRepresentationalDrift)
点击查看摘要
Abstract:In neuroscience, representational drift is a change in which neurons carry a representation while behaviour stays the same; we measure its analogue in OpenCoder-1.5B during pretraining, for 169 Python constructs over two trillion tokens at a constant learning rate, with a noise unit on every change, at checkpoints as close as 1,000 training steps. For 16 of the 169, those whose grammar fixes a next token, the loss at those positions reaches its floor within the first 4% of training, while the model's reliance on the neurons carrying them grows to the end: removing them costs 0.06, 0.25 and 0.40 nats more than removing a random set, at 4 billion, 84 billion and 2 trillion tokens. Which neurons carry a construct never settles: for all 169 the carrier set is still changing at the last checkpoint, and an abrupt settling at any date from 84 billion to 1.5 trillion tokens, or a gradual one before 500 billion, would have been detected in 99% of injected cases. The set measured at 84 billion tokens, removed at the end, cannot be separated from a random set, so the function is carried by whichever neurons are current. Up close the change is a persisting pool and a changing sample: a neuron that leaves a construct's set returns at three times the rate of a matched neuron, and no set reassembles. The hypothesis we fixed in advance, that the carriers settle, is refuted; we discuss candidate causes and name the experiment that would separate them.
31. 【2611.09203】Copies Are Not Confirmations: How News Duplication Fools LLM Judges and Continual Learners
链接：https://arxiv.org/abs/2611.09203
作者：Abdelkader Metales,Miriam Grabenheinrich,Aicha Metales
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：wire stories, content shared, media group, syndicated features, press releases
备注： 19 pages, 13 tables. Code, labels and results: [this https URL](https://github.com/Metalesaek/copies-experiment)
点击查看摘要
Abstract:Many news reports of a claim are copies of one source: wire stories, content shared within a media group, syndicated features and press releases. We ask whether LLM judges and continual learners treat such copies as independent confirmations. In 200,000 English CC-News articles, a MinHash detector links 18.9% to a near-copy from another outlet (precision 0.97 once boilerplate is removed); it links 92% of edited reprints to their originals but none of the LLM rewrites by phi4, Llama 3.2 or Gemini 2.5 Flash. Shown three identical reprints of a claim about an unknown person instead of one report, Llama 3.2 3B and phi4 14B raised the share of lies they accepted from 0.06 to 0.71 and from 0.21 to 0.90 and ignored a note that the reports came from one source; Gemini 2.5 Flash already believed a single report, and Gemini 2.5 Pro followed provenance notes and tables. In a simulated continual-learning stream, showing the judge one report per detected chain cut the copied lies it accepted by 0.10-0.24 across four judges, at a mean cost of no more than 4.2 percentage points of accepted truths. Against reworded copies, a test of how many of a report's named entities are absent from an earlier look-alike separates LLM rewrites from 100 labelled independent reports of the same event with AUC 0.98-0.99 and wrongly flags one; entity overlap alone does as well, TF-IDF and a current embedding model come close, and the test catches few natural same-source derivatives. With the miss patterns of generated rewrite networks, it cut the reworded-copy lies accepted from 0.67 to 0.20 (0.40 when the rewriter invents details). Counting reports or chains alone is not a reliable defence, the effect of provenance information depends on the judge, and colluding sources remain the open problem. Code and labels: this https URL
32. 【2611.09200】Structure and Lineage Evidence for Vietnamese Statutory Article Retrieval on DRiLL
链接：https://arxiv.org/abs/2611.09200
作者：Duc-Vu Nguyen,Ngan Luu-Thuy Nguyen
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：Vietnamese statutory Article, study Vietnamese statutory, statutory Article retrieval, study Vietnamese, Vietnamese statutory
备注： Accepted at SOICT 2026
点击查看摘要
Abstract:We study Vietnamese statutory Article retrieval on DRiLL using features for provision identity and local form, same-law support, and citation and lineage evidence. Across five random seeds, selectors sharing candidates, listwise Qwen evidence, and learner settings improve official $F_2$ from 71.77% to 72.91%, with the largest descriptive gain on two-Article questions. Added features account for 18.20% of the proposed selector's total decision-tree split gain, measured as training-objective reduction, mainly from same-law and citation evidence. Cases reveal base provisions and amendments, companion recovery, distractor removal, and failures. These findings motivate research on other datasets, representations, and learners without establishing individual feature effects or requiring LightGBM, hand-crafted scores, or explicit graphs.
33. 【2611.09196】Calibrated concept profiles: making the reading of a model's neurons a measurement
链接：https://arxiv.org/abs/2611.09196
作者：Piotr Wilam
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Interpretability has largely, Toggle, Toggle Hugging Face, reading, Bibliographic Explorer Toggle
备注： 25 pages, 5 figures, 11 tables. Dataset: AtlasOpenCoder, tag v1, doi: [https://doi.org/10.57967/hf/11472](https://doi.org/10.57967/hf/11472) . Code: [this https URL](https://github.com/piotrwilam/AtlasCalibratedConceptProfiles)
点击查看摘要
Abstract:Interpretability has largely moved from reading a model's neurons directly to reading a second model trained on the first: a probe, a sparse autoencoder, a crosscoder. The move answered real faults -- mixed meanings, thresholds without a unit, readings that did not transfer from one study to the next -- but gave up what a direct reading alone provides: nothing trained in between, the neurons themselves named, and a reading that can be repeated and compared. Here the direct reading is made a measurement. A neuron's activation varies with the prompt, so its reading is a distribution over a population of stimuli. We declare that population: every factor around a target construct is drawn at its rate in a reference corpus and logged. From the declared distribution we generate a battery of prompts, and draw it twice. From the battery we compute the calibrated concept profile, one number per neuron, stated in units of the neuron's own spread on ordinary input; the two draws give every number a noise unit. Before the profile is read, a fixed set of checks licenses the battery on the model, and the smallest change the profile can resolve across training checkpoints is measured. Realised for Python on OpenCoder-1.5B and followed across checkpoints spanning two trillion training tokens, the profile gives what the alternatives do not report: a unit on every number, a chance level for every comparison, and which neurons carry a construct at every checkpoint. The battery, the code and the data behind every result are released.
Comments:
25 pages, 5 figures, 11 tables. Dataset: AtlasOpenCoder, tag v1, doi:https://doi.org/10.57967/hf/11472. Code: this https URL
Subjects:
Computation and Language (cs.CL); Machine Learning (cs.LG)
ACMclasses:
I.2.6; I.2.7
Cite as:
arXiv:2611.09196 [cs.CL]
(or
arXiv:2611.09196v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2611.09196
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Piotr Wilam [view email] [v1]
Fri, 6 Nov 2026 09:17:39 UTC (446 KB)
Full-text links:
Access Paper:
View a PDF of the paper titled Calibrated concept profiles: making the reading of a model’s neurons a measurement, by Piotr WilamView PDFHTML (experimental)TeX Source
view license
Additional Features
Audio Summary
Current browse context:
cs.CL
prev
|
next
new
|
recent
| 2026-11
Change to browse by:
cs
cs.LG
References Citations
SciXGoogle Scholar
Semantic Scholar
export BibTeX citation
Loading…
BibTeX formatted citation
loading…
Data provided by:
Bookmark
checked="checked"class=“labs-tab-input”>
Bibliographic Tools
Bibliographic and Citation Tools
Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media
Code, Data and Media Associated with this Article
alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos
Demos
Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
Related Papers
Recommenders and Search Tools
Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
Author
Venue
Institution
Topic
About arXivLabs
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv’s community? Learn more about arXivLabs.
Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)
mathjaxToggle();
We gratefully acknowledge support from our major funders,
member institutions, ,
and all contributors.
About
Help
Contact
Subscribe
Copyright
Privacy
Accessibility
Operational Status (opens in new tab)
34. 【2611.09178】A Taxonomy-Driven Synthetic Dataset for Retrieval Effectiveness and Fairness Evaluation in Hiring
链接：https://arxiv.org/abs/2611.09178
作者：Warren Jouanneau,Morgane Hoffmann,Emma Jouffroy,Marc Palyart
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Computers and Society (cs.CY); Information Retrieval (cs.IR)
关键词：benchmarking legally complex, machine learning hiring, learning hiring tools, commercial sensitivity makes, sensitivity makes public
备注：
点击查看摘要
Abstract:While machine learning hiring tools are ubiquitous, the need for privacy regulations and commercial sensitivity makes public benchmarking legally complex. We address this challenge by introducing a taxonomy-driven, fully synthetic HR dataset and benchmark to simultaneously evaluate retrieval effectiveness and algorithmic fairness. Grounded in 660K real freelancer profiles, our multilingual corpus features candidate profiles, project briefs, and counterfactual demographic twins. Auditing state-of-the-art embedding models reveals performance divergence from general MTEB scores, alongside fairness disparities in grammatically gendered languages. This demonstrates that general benchmarks are insufficient for HR, requiring tailored evaluations to identify Pareto-optimal models that balance semantic accuracy and fairness.
35. 【2611.09147】BMMS: Policy-Conditioned Measurement of Behavioral Compliance in Language Models
链接：https://arxiv.org/abs/2611.09147
作者：Anthony Rhodes,Gadi Singer
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Behavioral Misalignment Metric, language models fixes, Behavioral Disposition Index, Compliance Robustness Margin, Misalignment Metric Suite
备注： 21 pages, 4 figures. NeurIPS 2026 Workshop on Trust-AI-Eval (TAE). Artifact: [this https URL](https://doi.org/10.5281/zenodo.22064759)
点击查看摘要
Abstract:Behavioral evaluation of language models fixes its dimensions in advance: hallucination, sycophancy, toxicity, over-refusal. An operator in a regulated industry needs a different question answered: does a system do what a particular rulebook requires? We introduce the Behavioral Misalignment Metric Suite (BMMS), which measures policy-conditioned misalignment by taking a policy corpus as an argument and returning a compliance profile over it, for any published policy and any system that answers in natural language. The Compliance Attainment Score (CAS) measures severity-weighted attainment over the obligations that bind the system, and the Compliance Robustness Margin (CRM) the share of that attainment surviving graded adversarial pressure; Behavioral Invariance (BIV) and the Behavioral Disposition Index (BDI) are specified and released with the suite. Dimensions enter only by passing a published admission test whose binding criterion is attribution: a quantity that moves when the judge changes, holding the target fixed, is measuring the instrument. Applying it excluded one of the quantities the suite itself reported. Across 1,003 obligations from eleven documents in five registers, the admission criterion holds 94.4% precision against blinded human judgment on vendor specifications and 50.0% on analytical guidance, extraction fidelity is 94.6%, and re-scoring under judges from two other providers leaves target ordering invariant while the absolute score of a single target spans up to 0.22. We apply it to the two most detailed published behavioral specifications. Own-specification advantage is not resolved from zero once document difficulty is subtracted, but absolute self-compliance is another matter: GPT-4o fails 70.7% of the hard constraints binding it in the Model Spec published by OpenAI, where the two Claude models fail 0.0% and 9.1% of theirs.
36. 【2611.09117】PathXAI: Evidence-guided structured pathology reporting by transferable tissue segmentation
链接：https://arxiv.org/abs/2611.09117
作者：Zhaorui Tan,Jun Aun Tan,Weixiang Zhong,Xiaoxi Wang,Tan Pan,Xingdong Xue,Li Liu,Jing Zhang,Jing Zhang,Weimiao Yu
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Pathology reporting requires, supporting morphological descriptions, reporting requires translating, Pathology reporting, requires translating tissue
备注： More experimental results will be added in the future version
点击查看摘要
Abstract:Pathology reporting requires translating tissue observations across regions and slides into specific diagnoses and supporting morphological descriptions. However, the use of explicit tissue-composition measurements to guide HE-based report generation remains underexplored. Thus, we developed PathXAI, which combines segmentation-derived tissue information with HE images and optional domain knowledge to guide diagnostic reasoning, targeted reinspection and structured report writing. Its segmentation component exceeded baselines in mean Dice on internal and external tests. In automated report evaluation on 1,200 public and 151 private cases, PathXAI achieved higher agreement with reference diagnoses and documented morphology than the HE-based comparators. On the public evaluation cohort, PathXAI-Report exceeded Qwen + HE in cancer family match rate by 4.4 percentage points and in finding F1 by 5.7 percentage points. PathXAI generates evidence-linked reports with a self-hosted pretrained vision-language model, without updating its weights.
37. 【2611.09107】PhoPunct: A Large-Scale Benchmark of Transformer Architectures for Vietnamese Punctuation Restoration
链接：https://arxiv.org/abs/2611.09107
作者：Khoa D. Nguyen,Thai Bao Huynh,Binh T. Nguyen
类目：Computation and Language (cs.CL)
关键词：Vietnamese punctuation restoration, Vietnamese punctuation, architectural choices scale, limiting conclusions, data volume
备注： Accepted at PACLIC 40 (2026)
点击查看摘要
Abstract:Vietnamese punctuation restoration is often evaluated on relatively small benchmarks, limiting conclusions about how architectural choices scale with data volume. We present a controlled benchmark on News and Novels corpora containing 22.1 million labeled tokens (19.9M News and 2.2M Novels). We evaluate 17 architectures formed from four pretrained Transformer backbones and optional bidirectional long short-term memory (Bi-LSTM) and conditional random field (CRF) layers, together with a PhoBERT-large-Bi-LSTM-CRF model, PhoPunct. Every model is trained for eight epochs with the same learning rate and without architecture-specific tuning. Under this fixed budget, adding Bi-LSTM and CRF layers does not reliably improve macro F1: in seven of eight matched domain-backbone comparisons, a plain Transformer classifier matches or outperforms its Bi-LSTM-CRF counterpart. PhoPunct obtains the best News result (61.35), whereas XLM-R with a CRF obtains the best Novels result (50.18), exceeding PhoPunct (48.97). These results show that the value of recurrent and structured-prediction heads depends on their optimization regime and motivate explicit separation between architectural improvements and improvements due to architecture-specific tuning. Our source code is available at: this https URL
38. 【2611.09094】AlienBench: A Benchmark of Structural Novelty in Language Model Outputs
链接：https://arxiv.org/abs/2611.09094
作者：Jonas Oppenlaender,Johanna M. Silvennoinen
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language models, Large language, models, Large, task
备注： 21 pages, 2 figures, 13 tables
点击查看摘要
Abstract:Large language models (LLMs) are increasingly used for creative tasks such as writing, design, and idea generation. For these uses, it matters whether a model's ideas depart from familiar examples or stay close to them. Novelty is one standard measure of creativity, and current creativity evaluations ask human experts or LLM judges to rate how novel an output is. However, these ratings have no fixed reference for what counts as novel (or, in other terms, departure from the familiar). Measuring this departure requires a task with known familiar defaults. The structured imagination task from cognitive psychology is such a task. In this creativity test, people imagine a creature from another planet. The departure from features of Earth animals, such as bilateral symmetry and legs as mode of locomotion, is used as measure of creativity. We introduce AlienBench, a benchmark that adapts the structured imagination task to language models. Models describe alien creatures, and a panel of three LLM judges extracts ten biological features from the description and labels them as either Earth-typical or a departure. The sum of feature departures is the score of a description, from 0 to 10. Each model describes alien creatures under six prompt conditions that vary the framing of the task and the planetary environment. Each model generates 30 descriptions per condition (180 in total), and its overall score is the mean across these descriptions. We evaluate 10 language models, from frontier to open-weight models. Overall scores range from 3.28 (GPT-6 Luna) to 6.55 (Ministral 3 14B). Interestingly, open-weight models score higher than proprietary models in this task (5.40 vs. 4.58). Under the baseline prompt, the models depart from Earth defaults more often on average than 100 human participants on every feature. We release all prompts, generations, judge outputs, and scores.
39. 【2611.09090】MARS: Training Multilingual Search Agents for Retriever-Free Evidence Acquisition
链接：https://arxiv.org/abs/2611.09090
作者：Rui Qi,Yunlong Liang,Yufeng Chen,Jinan Xu,Fandong Meng,Kaiyu Huang
类目：Computation and Language (cs.CL)
关键词：Existing multilingual retrieval-augmented, retrieval-augmented generation relies, generation relies heavily, cross-lingual retrieval errors, Existing multilingual
备注：
点击查看摘要
Abstract:Existing multilingual retrieval-augmented generation relies heavily on learned retrievers and similarity-based ranking from multilingual collections, which are vulnerable to cross-lingual retrieval errors and indexing overhead. In this paper, we explore retriever-free multilingual search, where the model directly interacts with raw corpora through executable shell commands. This paradigm shifts the bottleneck to multilingual search action generation, where exact search is sensitive to entity surface forms and outcome-only supervision provides limited guidance for multi-turn search. To address these challenges, we propose MARS, a multilingual search agent in direct corpus interaction (DCI) with reinforcement learning (RL). MARS introduces corpus-native entity grounding to recover reliable lexical anchors from corpus evidence, mitigating failure to retrieve evidence. Meanwhile, we present a redundancy-aware search reward to encourage concise and effective search trajectories, addressing training collapse in RL of multilingual scenarios. Experiments show that \ours~consistently outperforms strong retrieval-based and DCI baselines, while demonstrating robust cross-lingual generalization and substantially reducing redundant corpus interactions.
40. 【2611.09085】he Invisible Gap: Romanized Indic Generation Fails Where Automatic Metrics Succeed
链接：https://arxiv.org/abs/2611.09085
作者：Madhu Sudhan Rao Beesetty,Surbhi Sharma,Devesh Maheshwari,Lokesh Meesala
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：romanized Latin characters, aap kaise hain, Latin characters, Hundreds of millions, millions of Indians
备注： 11 pages, 2 figures, 5 tables. All authors contributed equally
点击查看摘要
Abstract:Hundreds of millions of Indians communicate with digital systems in romanized Latin characters -- typing "aap kaise hain" rather than native script -- yet romanized Indic generation is absent from NLP benchmarks and evaluation frameworks. We demonstrate that automatic metrics (BGE-M3, BERTScore) systematically misrepresent the quality of romanized Hindi, Telugu, and Kannada generation. We evaluate four LLMs (Claude Opus 4.8, GPT-5.5, Gemini 2.5-flash, Qwen3.5-35B) on 142 OpenAssistant query-response pairs. On a 72-response diagnostic subset, native speakers rate GPT-5.5 1.43 points higher than Claude Opus 4.8 on a 12-point rubric, whereas their full-dataset BGE-M3 means differ by only 0.004. Two distinct model-specific failure modes emerge: Gemini produces script spillage (16.9% of Telugu responses leak native script), while Qwen collapses to English-only output (16.2% of Kannada responses). We introduce a failure-aware evaluation policy that assigns zero to empty outputs, script-corrupted responses, and instruction collapses -- revealing failures metrics alone cannot detect. Our results show that evaluating romanized Indic generation requires a coordinated bundle: semantic similarity, script compliance, failure coverage, and native-speaker acceptability.
41. 【2611.09075】Large Language Model Deployment on Resource-Constrained Edge Devices: A Practitioners Survey
链接：https://arxiv.org/abs/2611.09075
作者：Rahul Maliakkal,Yashasvi Makin,Plawan Rath,Rohit Jain,Ankur Sadhoo
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large Language Models, Large Language, substantial resource requirements, resource requirements limit, Language Models
备注：
点击查看摘要
Abstract:Large Language Models (LLMs) have transformed many areas of artificial intelligence (AI), but their substantial resource requirements limit their deployment on mobile and edge devices. Although LLMs have demonstrated impressive capabilities in various applications, the next challenge is deploying these models on resource-limited edge devices. Recent innovations in software optimizations and specialized hardware have made it feasible to deploy LLMs on edge devices. Edge deployment offers benefits including local data processing, cost savings, reduced latency, and personalized responses. This paper reviews the latest techniques that make the deployment of LLMs on edge devices feasible.
42. 【2611.09061】Does Reasoning Improve Psychological Depth in Large Language Models?
链接：https://arxiv.org/abs/2611.09061
作者：Ruichen Zheng,Yihe Wang,Fabrice Harel-Canada,Sara Khosravi,Zeynep Senahan Yildiz,Amit Sahai,Nanyun Peng
类目：Computation and Language (cs.CL)
关键词：creative domains shaped, large language models, language models encourage, reasoning-enhanced large language, Benchmark gains
备注：
点击查看摘要
Abstract:Benchmark gains from reasoning-enhanced large language models encourage the assumption that these models should broadly perform better on complex generative tasks, but this remains underexplored in open-ended, creative domains shaped by nuances of reader experience. We tested this assumption through the lens of psychological depth in short stories. We compared DeepSeek-R1 vs. DeepSeek-V3, our closest available contrast for reasoning-oriented post-training, and GPT-5 vs. GPT-4o, through 60 blinded pairwise evaluations in which seven human annotators and an ensemble LLM-as-a-Judge rated prompt-matched story outputs. Human evaluations showed no universal reasoning advantage: GPT-5 was slightly preferred over GPT-4o (60.0-62.9% across two reasoning-effort settings), whereas DeepSeek-R1 fell behind DeepSeek-V3 (42.9%). Although this pattern was marked by low inter-annotator agreement (Krippendorff's $\alpha = 0.070$), our annotation-quality checks suggested genuine evaluative subjectivity, plausibly reflecting distinct annotator decision schemes rather than annotation failure. In contrast, the LLM-as-a-Judge showed a strong pro-reasoning bias (98.3% of pairs vs. 55.2% of human votes), consistent across its five configurations and partly tracking sentence length. These findings suggest that, at the frontier, reasoning-related quality differences are small enough to be dominated by reader subjectivity, and that LLM-as-a-Judge evaluators can obscure this subjectivity in nuanced creative-generation tasks.
43. 【2611.09057】Real-Time Short-Response Selection for Spoken Dialogue Systems
链接：https://arxiv.org/abs/2611.09057
作者：Hien Ohnaka,Kazuyo Onishi,Koichiro Yoshino
类目：ound (cs.SD); Computation and Language (cs.CL)
关键词：realize spoken dialogue, spoken dialogue systems, realize spoken, interact naturally, user utterances
备注： 10 pages, 2 figures, 7 tables
点击查看摘要
Abstract:To realize spoken dialogue systems that can interact naturally with users, it is important for the system to respond to user utterances at appropriate timings. To achieve such natural turn-taking, the system needs not only to predict appropriate response timings but also to mask delays caused by language generation and speech synthesis so that they are not perceived by the user. We propose a real-time short-response selection task that can be integrated with existing turn-taking models to mask generation delay. To address this task, the proposed model learns the mapping between dialogue context and short responses using contrastive learning. When a turn-taking event is detected, the system selects a response from a set of pre-generated candidates. The selected response is played while the main response is being generated. Experimental results show that the proposed method learns to select short responses based on dialogue context, outperforming random and LLM-based baselines. Moreover, integrating response selection maintained turn-taking prediction performance and added minimal processing overhead.
44. 【2611.09042】Failure Profiling and Reachable Trajectory Selection for Reasoning Distillation
链接：https://arxiv.org/abs/2611.09042
作者：Yijun Zhu,Jianxin Wang,Chengchao Shen
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：smaller language models, larger teacher model, Training smaller language, mathematical reasoning capabilities, reasoning solutions generated
备注： Accepted to NeurIPS 2026. The source code and trained weights are available at \url{ [this https URL](https://github.com/visresearch/FPRT) }
点击查看摘要
Abstract:Training smaller language models on reasoning solutions generated by a larger teacher model is the prevailing approach for transferring mathematical reasoning capabilities. However, the student tends to overfit the output distribution of the teacher and generalizes poorly when its own behavior at inference time deviates from the training data. Recent methods attempt to bridge this gap by incorporating error data, yet the corrective trajectories still reflect the reasoning patterns of the teacher, which the student cannot reliably reproduce, leaving the distribution mismatch largely unresolved. We propose a method, Failure Profiling and Reachable Trajectory Selection (FPRT), built on the insight that effective training data should be jointly determined by what the student fails on and what it can realistically learn. Our method first profiles the failure behavior of the student on each problem through repeated sampling, characterizing it in terms of error rate and error consistency to reveal qualitatively distinct failure modes. Each mode demands a fundamentally different training signal. The diagnosed mode then guides candidate generation from the teacher via distinct prompting strategies tailored to each failure type. Among the correct candidates, our method selects the one whose initial reasoning steps after the point of divergence are most reproducible by the student. These first corrective steps constitute the primary bottleneck, while the remaining steps follow an already corrected context and can therefore be continued more readily. This contrasts with standard reranking approaches, which score the trajectory as a whole and thereby dilute the signal at the critical reasoning transition. Experiments demonstrate that our method achieves the SOTA performance across the five benchmarks on both student backbones.
45. 【2611.09027】Language, Not Code Abstraction: Natural-language Training Shapes Brain-aligned Geometry
链接：https://arxiv.org/abs/2611.09027
作者：Iñigo Parra
类目：Computation and Language (cs.CL)
关键词：abstract structure learned, positive brain scores, Code-trained language models, produce positive brain, Code-trained language
备注： Accepted for the Neureps Workshop at NeurIPS 2026
点击查看摘要
Abstract:Code-trained language models produce positive brain scores, which raises the question of whether abstract structure learned from programming languages can substitute for natural-language training. We trained 25 GPT-2-small models on TinyStories, Python, C functions, x86-64 assembly, and the corresponding machine code, and scored them using a shared tokenizer and encoding procedure against matched random-weight models. On Pereira-243 and Tuckute2024, TinyStories exceeds the mean of the four code models by $\Delta r = 0.053$ and $0.059$ (Holm-corrected $p0.001$), while code training leaves alignment near the random-weight level. The language advantage is benchmark-specific: Blank2014 shows no corrected language-code difference, and Fedorenko2016 shows no language benefit. Geometry tracks the encoding result on Pereira-243: TinyStories seeds converge on the most similar representations, and its fit-free correspondence with neural dissimilarity peaks at $\rho = 0.14$, twice the code and random-weight levels. Binary-trained models have about three effective dimensions, so seed agreement alone does not imply neural correspondence. Updating only the embedding matrix on English improves mean-over-depth alignment for every code model more than an equal update on its own corpus. Within this architecture and training setup, natural-language training produces a distinct representational geometry with closer neural correspondence on Pereira-243
46. 【2611.08998】Seeing vs. Counting: Complexity Twins Show Where Multimodal LLMs Fail on Diagrams
链接：https://arxiv.org/abs/2611.08998
作者：Yin Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：multimodal LLM miscounts, multimodal LLM, LLM miscounts, LLM, Existing visual graph
备注： 8 pages main text + 96 pages appendix (107 pages in total, including references)
点击查看摘要
Abstract:When a multimodal LLM miscounts in a diagram, does it fail at seeing or at counting? Existing visual graph and puzzle benchmarks vary visual density and algorithmic hardness together, confounding the two. We pair counting questions about the same drawing that sit in different counting-complexity classes, such as its spanning trees (a determinant) and its simple paths (#P-complete), and use a transcription probe and a text-only control to separate reading from computing. We test Gemini, Gemma and Qwen3-VL models; for the Gemini models, the answer depends on how the model computes. In chain of thought, most of them read small drawings correctly and then fail at counting, at a rate set far more by the size of the answer than by its complexity class (for the primary model, the odds of an exact answer fall 2.38-fold per decade of the answer). Given code and an exact transcription, the primary model counts correctly even on 10x10 grids, and reading becomes the bottleneck: a single view misses horizontal edges, and a second reading of a rotated copy with crop checks reads 86/96 large grids exactly, against 57/96 when the upright reading is simply repeated.
47. 【2611.08995】Same Facts, Different Remedy: Linguistic Profiling and Arbitrariness in LLM and System One Decisions
链接：https://arxiv.org/abs/2611.08995
作者：Colin Priest
类目：Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large language models, complainants write varies, Large language, resolve consumer complaints, varies with age
备注： 29 pages, 7 figures. Code, prompts and pre-registrations: [this https URL](https://github.com/colinpriest/llm-jev-linguistic-profiling)
点击查看摘要
Abstract:Large language models are increasingly used to resolve consumer complaints, and the way complainants write varies with age, education and socioeconomic status (SES). We audit three remedy-decision systems using sociolinguistic rewrites of US consumer financial complaints that are instructed to preserve every fact: two generative LLMs that return a single label (GPT-4o-mini and GPT-5-mini) and a probabilistic "System One" model that returns a distribution over remedies (Jev). Using pre-registered hypotheses tested once on held-out complaints, we separate two phenomena that single-label audits conflate. At the group scale, older, college-educated and higher-SES styles receive slightly more generous remedies; these effects replicate but are small, with every monetary-remedy gap within 0.5 percentage points. At the individual scale, two style versions of the same complaint receive different monetary decisions 2.6-6.3% of the time. In a variance-component analysis of the probabilistic model, persona components shared across the two rewrite models account for about 1.6% of within-complaint variation. The persona gaps are associated mainly with delivery (vocabulary, grammar, politeness) rather than content. Positive controls show that all three systems respond 49-387 times more strongly to remedy-relevant facts than to style. Rewriting every complaint into one standard style reduced GPT-4o-mini's education and SES gaps by 94% and 87% while retaining fact sensitivity, but reversed two of the probabilistic model's gaps and did not make individual decisions more stable. Independent LLM auditors flagged material fact changes in 3.3% and 11.7% of rewrites, and instability persisted among unflagged rewrites. Fairness audits of LLM decision systems should report group disparities and individual instability as separate outcomes.
48. 【2611.08975】Beyond Truncation? Entailment-Licensed Elision and the Limits of Semantic Preservation in LLM Decoding
链接：https://arxiv.org/abs/2611.08975
作者：Mahmoud Alyosify,Mirna Imbabi,Eman Elkhamisi
类目：Computation and Language (cs.CL)
关键词：Instruction-tuned large language, large language models, Instruction-tuned large, large language, greater length
备注： 8 pages, 3 figures, 2 tables
点击查看摘要
Abstract:Instruction-tuned large language models (LLMs) answer at greater length than a request needs. We ask whether a training-free controller inside the decoding loop can remove that surplus while preserving content, judged against the simplest possible baseline: truncating the model's own answer to the same length. An entropy-gated logits processor removes 25.5-34.9% of tokens on MT-Bench development questions and 19.9-34.2% on a sealed test split within pre-registered BERTScore non-inferiority margins, yet we prove and confirm by audit that its output is always a prefix of the unmodified answer: the saving is truncation. A survey of 23 training-free mechanism families finds none that selects content better than truncation without oracle labels. We therefore introduce Entailment-Licensed In-Decoding Elision (ELIDE), which, at each sentence boundary, withholds a span from the reader only when a natural-language inference model judges it entailed by the text already shown, while leaving the model's generation unchanged. ELIDE beats matched-length truncation on three model families, but reading 936 of its elisions on 670 public prompts shows that 59% harm the answer, a failure that no automatic measure detects. Scoping the licence to its discourse unit reduces the harmful share to about one elision in ten on two fresh tests.
49. 【2611.08971】Phantom Consensus: Measuring Social Reasoning in Multi-Agent LLM Decision-Making
链接：https://arxiv.org/abs/2611.08971
作者：Disha Sheshanarayana,Rajat Subhra Pal,Manjira Sinha,Tirthankar Dasgupta
类目：Multiagent Systems (cs.MA); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：increasingly aggregate judgments, systems increasingly aggregate, LLM systems increasingly, Multi-agent LLM systems, Multi-agent LLM
备注： Accepted at NeurIPS 2026, SocialAgent Workshop
点击查看摘要
Abstract:Multi-agent LLM systems increasingly aggregate judgments across model instances, but reasoning about other agents can itself introduce failure. We study a setting in which LLMs shift their public decisions after observing ambiguous social signals while reporting inaccurate estimates of what other agents privately judged, even when the group's recorded private judgments do not support the apparent consensus. We call this failure phantom consensus and study it as a pluralistic-ignorance-style pattern in controlled LLM collectives. To measure this phenomenon, we introduce PHANTOM-Bench, a benchmark that separates isolated private judgments, public decisions after ambiguous social signals, elicited estimates of the group's private judgment, transparency-based recovery, and controls for neutral public text and explicit vote-following. Across nine closed- and open-weight models, ambiguous public signals consistently degrade decision quality and can turn correct private group judgments into incorrect public collective outcomes. Public accuracy drops by as much as 47.8 percentage points, and collective rationality failures reach 47.3% in the most susceptible setting. We observe substantial errors in reported group-private beliefs alongside public-stage failures, while control conditions reveal model-dependent differences in susceptibility to ambiguous and explicit peer signals. Revealing the agents' recorded private decisions repairs many failures without revealing the gold label, although recovery varies across models. Our results show that evaluating multi-agent LLM systems requires measuring not only final agreement, but whether that agreement reflects independently measured private judgments or an apparent consensus.
50. 【2611.08967】Using an LLM to Tackle Difficult Cases in NER for Nepali Tweets
链接：https://arxiv.org/abs/2611.08967
作者：Claire Wang
类目：Computation and Language (cs.CL)
关键词：Named entity recognition, social media data, Named entity, entity recognition, challenging for social
备注：
点击查看摘要
Abstract:Named entity recognition (NER) is challenging for social media data in a low-resource language. LLMs often lag behind pretrained language models (PLMs) in NER performance, but they show promise in handling cases that PLMs struggle with. Using a dataset of Nepali tweets, we split the test set into "easy" and "hard" cases using token probabilities from a fine-tuned pretrained language model (PLM). We then evaluate an LLM on the hard test cases using 16 different prompt configurations. We find that selecting examples based on semantic similarity and increasing the number of examples improves F1 score by almost 10 points from the baseline configuration. Although the LLM underperforms the PLM on the full and easy test sets, it surpasses the PLM on the hard test set, resulting in an improved score when the two models are combined.
51. 【2611.08924】ResQAdam: Residual-Preserving Adaptive Optimization for Memory-Efficient Quantization Aware Training
链接：https://arxiv.org/abs/2611.08924
作者：Liqun Ma,Shengkun Tang,Liangyu Wang,Lin Zhao,Wei Luo,Xinjun Niu,Spandan Tiwari,Ashish Sirasao,Kun Zhang,Zhiqiang Shen
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：large language models, obtain accurate low-bit, accurate low-bit large, low-bit large language, language models
备注：
点击查看摘要
Abstract:Quantization-aware training (QAT) is the most reliable way to obtain accurate low-bit large language models (LLMs), but training with AdamW keeps two dense FP32 states for every weight matrix. We find that low-rank memory-efficient optimizers such as GaLore and LDAdam degrade substantially in QAT. A considerable part of the QAT momentum lies outside its top-r singular subspace, and projection-based methods discard this part at every step. We further observe that this residual remains useful when only its sign is kept. Based on these observations, we propose ResQAdam. It keeps a single BF16 momentum, applies Adam only to the r x r coordinates of the principal subspace, and adds a normalized sign update computed from the residual. We evaluate ResQAdam with two from-scratch QAT methods and three QAT fine-tuning pipelines, with weights quantized down to 2 bits. It reduces optimizer-state memory by 71% to 74% relative to AdamW, stays close to AdamW in most settings, and lowers training throughput by less than 2%.
52. 【2611.08916】On the Incompleteness of do-calculus for Universal Identifiability
链接：https://arxiv.org/abs/2611.08916
作者：Yaroslav Kivva,Aliaksandra Novik,Negar Kiyavash
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Probability (math.PR)
关键词：call Universal Identifiability, Universal Identifiability, call Universal, interventional distributions, arbitrary set
备注：
点击查看摘要
Abstract:We study the problem of causal effect identification from an arbitrary set of observational and/or interventional distributions, which we call Universal Identifiability (uID). The uID problem generalizes existing classical identifiability (ID) and general identifiability (gID) problems, which considered the identification problem from either mere observational distributions or a specific type of interventional distributions. Prior research has established graphical criteria to determine when a causal effect is identifiable in ID and gID problems. Moreover, algorithms that leverage do-calculus and basic probability manipulations have been proposed to compute these effects. Consequently, it has been shown that do-calculus is both sound and complete in these problems. Despite these well-established results, a formal definition of what it means for the do-calculus to be complete does not exist. We propose a rigorous formalization for the completeness of the do-calculus and show that the completeness results in previous work remain valid. However, for more general problems, such as uID, the rules of do-calculus are no longer complete. This is perhaps the reason why the uID problem has remained open thus far.
53. 【2611.08905】From Procedures to Permissions: Learning Precise Subagent Authorization from Agent Skills
链接：https://arxiv.org/abs/2611.08905
作者：Wenkai Yu,Ning Ding,Wentao Zhang,Yehui Tang
类目：Computation and Language (cs.CL)
关键词：tackle increasingly complex, coordinate specialized work, agents tackle increasingly, language agents tackle, increasingly complex tasks
备注：
点击查看摘要
Abstract:As language agents tackle increasingly complex tasks, they increasingly rely on multiple agents to coordinate specialized work, requiring decisions not only about what each subagent should do but also which tools and workspace resources it should access. Existing agent systems provide mechanisms for controlling tools and execution environments, but do not directly specify the resources required by each delegated subtask. Moreover, task outcomes and execution trajectories alone provide limited supervision for determining whether a subagent has received appropriate permissions. We observe that Agent Skills encode procedural knowledge describing the operations, tools, and files required at each step, providing a natural source of supervision for authorization. Building on this observation, we synthesize tasks and step-by-step procedures from Skills, execute them through subagent delegation in interactive environments, and use verified trajectories to construct training data for task execution and authorization. On ClawArena-Team, our method improves tool permission precision by 13.4 percentage points and workspace permission precision by 24.1 percentage points, while increasing overall task success by 11.6 percentage points for Qwen3.5-35B-A3B. On Terminal-Bench 2.1 and SkillsBench, our method remains competitive with existing agent data synthesis approaches. These results show that the procedural knowledge embedded in Agent Skills provides a source of supervision for precise subagent orchestration that task outcomes alone cannot provide.
54. 【2611.08892】Richness Is Not Evenness: Ordered Renyi Crossings under Self-Training
链接：https://arxiv.org/abs/2611.08892
作者：Pranjal Srivastava
类目：Computation and Language (cs.CL)
关键词：Recursive self-training, making frequent words, self-training of language, reduce vocabulary, vocabulary while making
备注：
点击查看摘要
Abstract:Recursive self-training of language models, a setting studied in model collapse, can reduce vocabulary while making frequent words, mostly function words, less dominant. We fine-tune English GPT-2 on its own output for nine generations, vary the training-data sampling temperature, and measure every model with one fixed sampler. As training temperature rises, Renyi entropy changes turn from loss to gain at distinct temperatures: min-entropy first, then collision entropy, Shannon entropy and observed richness. Between the outer crossings, word types fall while the most-common word becomes less dominant. Untruncated training at T = 1 lies in this interval: at 13,000 words, generation 9 has 24% fewer types than generation 0 yet collision entropy is 0.91 bits higher. The ordering persists with a finer grid, different measurement samplers, a fixed word budget and five fresh training seeds. Min-entropy again crosses before richness in four further settings (in Hindi only at interpolated roots) and in 12 of 13 distinct measurements under eight text representations. Next-token identities and a categorical simulation isolate decoding and sampling effects; the crossing order remains empirical. Fine-tuning on human text can produce the same split while likelihood improves, and no single order's sign reliably identifies worse likelihood across the tested settings. We recommend reporting entropy profiles at stated budgets with an independent quality measure.
55. 【2611.08790】SteerGR: Steering Generative Recommendation via Sparse Autoencoders for Controllable Game Discovery
链接：https://arxiv.org/abs/2611.08790
作者：Sunkyung Lee,Xiaokai Wei,Da Long,Hyunsik Jeon,Jiajun Wu,Rithwik Seth,Jongwuk Lee,Michelle Gong,Gungor Polatkan
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：user interaction histories, items remains underexplored, predict item identifiers, recommended items remains, Steerable Generative Recommender
备注： Preprint (15 pages, 11 figures, 11 tables)
点击查看摘要
Abstract:Generative recommendation aims to predict item identifiers from user interaction histories, but explicit control over the properties of recommended items remains underexplored. A key challenge is to connect human-readable concepts to internal features whose interventions effectively change the recommended items. To address this, we propose Steerable Generative Recommender (SteerGR), a framework that uses sparse autoencoders for concept-level control in game discovery. SteerGR proceeds through three stages: (i) Concept Definition and Grounding for defining play concepts with an LLM; (ii) Feature Discovery and Selection for discovering candidate features by their concept associations and selecting one by its steering effect; and (iii) Sparse Feature Intervention for amplifying or suppressing selected features to steer recommendations without retraining the recommender. Extensive experiments with two industrial generative recommendation models on a real-world game dataset show that the selected features successfully steer recommendations toward or away from target concepts. We believe this work takes a first step to extend SAE-based steering from LLMs to industrial generative recommendation.
56. 【2611.08780】Guardrail Erosion in Domain Fine-Tuned Large Language Models: A Paired Audit of Knowledge-Centric Abstention in Biomedical LLMs
链接：https://arxiv.org/abs/2611.08780
作者：Stephen Peng,Vineet Jagadeesan Nair,Noah Broestl,Anne Friederike Kleppe,Steven Mills,Adi Zolotov
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：rapidly expanding, Fine-tuning, domain fine-tuned, biomedical domain, models
备注： To be published in the Proceedings of the 6th Machine Learning for Health Symposium (ML4H 2026), PMLR volume 346
点击查看摘要
Abstract:The number of domain fine-tuned models, particularly in the biomedical domain, is rapidly expanding. Fine-tuning promises high-performing models at a fraction of the cost of training a base model, but it can also produce unintended behavioral changes. Multiple studies have shown that safety guardrails can erode with fine-tuning, yet large-scale studies across model architectures, data mixtures, and fine-tuning methodologies remain limited. Where prior work in this space has studied value-centric refusal, this work focuses on knowledge-centric abstention. We audit 25 biomedical domain fine-tuned large language models against 11 paired base checkpoints on MedAbstain and ClinDet-Bench to evaluate the impact of fine-tuning on knowledge-centric abstention. We find that defined appropriate abstention measured by these benchmarks, already low in base models (median 8.3% on MedAbstain), falls further after fine-tuning (median 4.2%, decreasing in 21 of 25 pairs on MedAbstain), and that the magnitude and direction of change are heterogeneous across pairs. These results motivate fine-tuning methods that improve domain-specific capability while preserving appropriate caution.
57. 【2611.08779】Jacobian-Causal Memory Control for Persistent Memory in Language Model Systems
链接：https://arxiv.org/abs/2611.08779
作者：Marvin Danig(Achiral Research)
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Persistent-memory systems choose, alter current inference, Persistent-memory systems, current inference, systems choose
备注： Architecture and formal analysis preprint. Four conditional theorems; no benchmark measurements. Companion research essay: [this https URL](https://achiral.ai/research/jacobian-causal-memory-control)
点击查看摘要
Abstract:Persistent-memory systems choose not only which records are retrieved but which prior information can alter current inference. We propose Jacobian-causal memory control (JCMC), which represents each authorized memory intervention by a predicted influence signature in a shared behavioral measurement space, selects interventions against a target effect and side-effect budget, and compares predicted with observed effects before retaining or rolling back the intervention. Under explicit smoothness and bounded-estimation assumptions, we prove a quadratic local-approximation bound, characterize the target effects reachable by a set of signatures, bound selection regret under signature error, and bound non-additive interactions between simultaneous memories. The paper reports no benchmark measurements; it defines a paired counterfactual estimator and an evaluation protocol comparing JCMC with relevance, graph, and policy-filtered retrieval baselines. The central claim is narrowed or falsified if those simpler baselines match effect targeting, side-effect control, and rollback utility under equal model, memory, policy, and cost budgets.
58. 【2611.08778】Semantic Conditional Similarity (SCS): A Formal Mathematical Framework
链接：https://arxiv.org/abs/2611.08778
作者：Mehmet Murat Albayrakoğlu
类目：Computation and Language (cs.CL)
关键词：Semantic Textual Similarity, Semantic Textual, Textual Similarity, returning a single, Semantic Conditional Similarity
备注： 34 pages, 6 figures, 8 tables, to be submitted for publication
点击查看摘要
Abstract:Semantic Textual Similarity (STS) operates on document pairs, returning a single scalar per comparison. In a multi-document setting where several sources may have contributed to one or more targets, pairwise STS cannot disentangle each source's marginal semantic contribution from their shared vocabulary. In this paper, Semantic Conditional Similarity (SCS) is introduced as a conditional form of STS that computes similarity between two documents after eliminating semantic elements shared with a third via set-theoretic operations. SCS makes four contributions: 1) it introduces directionality, partitioning pairwise relations into lateral (inter-source) and vertical (source-to-target) classes; 2) conditioning induces role-dependent asymmetry by extending the comparison domain from unordered pairs to ordered, conditioned triples of a target, a reference, and a conditioning document; 3) SCS introduces inter-document conditioning by subtracting shared content from a third document, complementing the intra-document conditioning in recent C-STS work; and 4) the set-theoretic decomposition achieves threshold-free partitioning of shared and residual content, requiring no arbitrary similarity cutoff. Although developed for the $n \to 1$ configuration, the framework extends to $1 \to n$ via vertical role reversal and to $m \to n$ via independent composition of source- and target-side conditioning. With the established $1 \to 1$ case, these span the full spectrum of document cardinality. SCS scores should be interpreted ordinally, as rankings of marginal contributions rather than absolute measurements. The broader implication is that metric space axioms commonly assumed in similarity formalizations constrain expressiveness in role-differentiated multi-document settings, and that extending the domain to conditioned triples can recover information that pairwise-symmetric comparisons suppress.
59. 【2611.08752】AttentionSwitch: Jailbreak Defense for LLMs via Joint Learning of Sparse Attention-Head Selection and Scaling
链接：https://arxiv.org/abs/2611.08752
作者：Doniyorkhon Obidov,Honggang Yu,Xiaolong Guo,Kaichen Yang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR)
关键词：achieved remarkable performance, circumvent safety mechanisms, Large language models, range of tasks, Large language
备注：
点击查看摘要
Abstract:Large language models have achieved remarkable performance across a wide range of tasks, yet they remain susceptible to jailbreak attacks that circumvent safety mechanisms and elicit harmful or unintended outputs. Although safety can be improved through model fine-tuning, such approaches can be computationally expensive and may degrade previously acquired capabilities through catastrophic forgetting. Recent jailbreak defenses have therefore explored targeted interventions on specific model components associated with unsafe behavior. However, existing approaches typically decouple two inherently related decisions: where to intervene and how to modify the selected components. Such sequential optimization may be suboptimal because the optimal intervention location can depend on the intervention applied there, and vice versa. In this work, we introduce AttentionSwitch, the first jailbreak defense to jointly optimize intervention sites and strengths within a frozen LLM. Specifically, AttentionSwitch learns a sparse set of attention heads together with query-conditioned multiplicative scaling factors, allowing the outputs of the selected heads to be either attenuated or amplified without altering the directions of their representations. Across popular language models and jailbreak attacks, AttentionSwitch outperforms existing defenses, with particularly strong results when training data is scarce.
60. 【2611.08730】Structuring Survey Histories for LLM Digital Twins: A Controlled Study of Background, Decision Procedure, and Evaluation Profiles
链接：https://arxiv.org/abs/2611.08730
作者：Iris Ye,Tianze Deng,Ozan Candogan
类目：Computation and Language (cs.CL)
关键词：LLM-based digital twins, digital twins aim, LLM-based digital, prior responses, digital twins
备注： 10 pages. Camera-ready version for SocialAgent: Second Workshop on Large Language Models for Social Reasoning and Simulation, NeurIPS 2026
点击查看摘要
Abstract:LLM-based digital twins aim to predict how individuals would respond in new settings from representations of their prior responses. Existing evidence that compression of survey histories need not reduce predictive accuracy suggests that representation structure, rather than information volume alone, may be an important design choice. We study BDE, a fixed representation that organizes each respondent's survey history into Background, Decision procedure, and Evaluation. We evaluate it on Twin-2K-500 (Toubia et al., 2025) by predicting each respondent's held-out answers on 17 tasks. In a paired evaluation with 100 respondents, a fully inferred BDE profile improves overall accuracy over the raw survey transcript by 1.27 percentage points (pp) on gpt-5.4-nano (p 0.01) and 1.19 pp on gpt-5.4-mini (p 0.001). Three analyses then examine the schema, extraction depth, and component composition. Against a length-matched free-form profile written from the same transcript by the same extractor, BDE improves pricing accuracy on both simulators (2.15 pp on nano, p 0.01; 1.38 pp on mini, p 0.05), while its overall advantage is significant only on nano (1.05 pp, p 0.05). Allowing deeper inference during extraction yields no statistically significant gain on either simulator. By contrast, adding Evaluation to a Background--Decision procedure profile improves overall accuracy by 1.44 pp on nano (p 0.001) and 1.22 pp on mini (p 0.001). These results indicate that the advantage over raw transcripts is not explained by compression or length alone, and attribute it primarily to profile composition rather than deeper extraction.
61. 【2611.08714】Patching the Blind Spots: Reversible LLM Rule Overlay for Frozen Fraud Detectors
链接：https://arxiv.org/abs/2611.08714
作者：Bo Qu,Zhurong Wang,Frank Zahradnik,Ming Ouyang
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：gradient-boosted trees remain, tabular fraud classification, industrial tabular fraud, gradient-boosted trees, trees remain
备注： 11 pages, 1 figure, 7 tables
点击查看摘要
Abstract:In industrial tabular fraud classification, gradient-boosted trees remain state-of-the-art, but even a well-trained model has blind spots, and retraining the deployed model is not always safe. We propose a framework that patches such a model without modifying it: LLMs propose rules anchored on features the model underweights by SHAP, and the resulting noisy pool is screened for empirical support and calibrated into an additive, reversible log-lift overlay that runs at the production cut-off. Single-LLM benefit is high-variance and inverts between datasets, so we pool three diverse backbones by equal-weight logit averaging, trading peak gain for a bounded worst case. On a real-world e-commerce fraud detector trained on selection-biased data, continued training regresses even when carefully tuned, whereas the overlay gains on average +2.26% recall at equal precision ($\Delta$R@P) and +1.60% precision at equal recall ($\Delta$P@R) over production cut-offs spanning 30-57% precision and 23-63% recall. On a public benchmark of seven designed bias-shift variants it raises $\Delta$P@R on every variant and keeps $\Delta$R@P near neutral. Each amendment is a readable predicate naming the fraud pattern it covers.
62. 【2611.08711】RL-ATTACK: A Generalized Black-Box Adversarial Attack on Language Models via Reinforcement Learning
链接：https://arxiv.org/abs/2611.08711
作者：Taikun Chen,Yue Zhang,Wei Qian,Hui Fang
类目：Computation and Language (cs.CL); Cryptography and Security (cs.CR)
关键词：induce unintended responses, Large language models, Large language, unintended responses, induce unintended
备注： Accepted as a regular paper at IEEE EdgeCom 2026
点击查看摘要
Abstract:Large language models (LLMs) exhibit vulnerabilities to adversarial perturbations that can induce unintended responses. These vulnerabilities can be identified via intentional attacks and subsequently used to improve model safety. In black-box settings where gradients are inaccessible, existing methods tend to guess adversarial transformations using external knowledge, ignoring the information provided by the target model. To mitigate this, we propose a trainable black-box framework based on reinforcement learning, which learns from the target model to generate tailored adversarial transformations. We demonstrate that our approach achieves lower post-attack accuracy, greater query efficiency and better semantic preservation on both natural language inference and generative QA tasks. On natural language inference, it drives post-attack accuracy to 2% within 20 queries. Against generative language models, our trained attacker consistently achieves lower post-attack accuracy than the untrained attacker and wins in 4 out of 6 settings when compared to a strong optimization-based baseline. We further experiment with multiple reward designs and training settings, and we find that no design or setting is consistently dominant. Our code is available at this https URL.
63. 【2611.08706】Dual-Stream LLM-Guided Reward Design for Reject-Inference-Aware Reinforcement Learning in E-Commerce Payment Fraud Detection
链接：https://arxiv.org/abs/2611.08706
作者：Bo Qu,Zhurong Wang,Frank Zahradnik,Ming Ouyang
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：fraud-detection models learn, receive fraud labels, Production fraud-detection models, legacy system blocked, fraud-detection models
备注： 12 pages, 1 figure, 3 tables. Extends Qu et al., ACL 2025 Industry Track: [this https URL](https://aclanthology.org/2025.acl-industry.9/)
点击查看摘要
Abstract:Production fraud-detection models learn from a censored slice of their own traffic: transactions a legacy system blocked never receive fraud labels, so models train on a biased, approved-only distribution. We extend LLM-guided reward design, the framework of Qu et al. (2025) in which an LLM evolves the reward of a two-step REINFORCE fraud-blocking policy, to attack this reject-inference problem inside the reward. A single LLM designs a dual-stream reward: stream 1 applies the standard dollar-weighted precision objective to labeled transactions; stream 2 scores legacy-blocked, unlabeled transactions by contrasting the newest gradient-boosted risk signal against the legacy scores that drove the original block. Rather than prescribe which signals matter, we expose a superset of evidence and let the LLM decide for itself which to use, guided by evaluation feedback alone; because it writes the reward as code, that choice is directly auditable. On a held-out four-month out-of-time test, the dual-stream agent beats the prior labeled-only agent at every target recall, by +4.7, +2.4 and +3.0 points of dollar-weighted precision at 80%, 85% and 90% recall, and the production baseline by +6.8 points on average. The resulting policy is architecturally identical to that of Qu et al. (2025) and adds no inference cost.
64. 【2611.08704】Contextuality and Contradictions: Exploring Real-World Identifications of AI-Generated Writing
链接：https://arxiv.org/abs/2611.08704
作者：Michelle Morgenstern,Julia Witte Zimmerman,Tabia Tanzin Prama,Kristine Harootunian,June Clark,Bryn Loftness,Calla Beauregard,Juniper Lovato
类目：Computation and Language (cs.CL)
关键词：formal and informal, AI-generated content spreads, everyday part, people interact, practices and discourses
备注：
点击查看摘要
Abstract:As AI-generated content spreads into nearly every domain of human interaction, practices and discourses of AI detection, both formal and informal, have become an everyday part of how people interact with text and with each other. In this paper, we explore the real-world practices and discourses of AI identification that have emerged in response to a shifting discursive landscape where the human provenance of a text can no longer be taken for granted. We pair qualitative coding with computational analysis of lexical change, grounded in linguistic anthropological perspectives on language and communication, to investigate AI identifications among English Wikipedia editors and students. We find that these identifications draw on a diversity of evidentiary types, from discrete textual features and judgments about content to circular sense-making claims and presumptions about the author's moral character, and that they are contradictory, dynamic, and contextually dependent. In practice, what often motivates an AI identification is not the presence of any specific textual element, but pragmatic infelicity: a perceived mismatch between the elements present and those deemed appropriate within the text's particular context. Consequently, real-world identifications of AI-generated writing do not merely neutrally point out the perceived presence of "AI-like" features, but can be leveraged as a discursive resource to maintain and define sociolinguistic norms: what can be said in a given context, what is appropriate, and, ultimately, what is human. Further, the design and implementation of systems and tools that treat AI-likeness as a context-free property of text may therefore inherit, and enforce at scale, the norms of whichever contexts they were trained on.
65. 【2611.08683】Compression of Emotion in Language Model Representations
链接：https://arxiv.org/abs/2611.08683
作者：Laya Iyer,Sanmi Koyejo,Chen Shani
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：produce fluent emotional, Large language models, fluent emotional language, identify emotions expressed, Large language
备注：
点击查看摘要
Abstract:Large language models (LLMs) have been evaluated on their ability to identify emotions expressed in text and produce fluent emotional language. However, output predictions alone do not reveal how fine-grained emotion distinctions are organized internally. We study seven LLMs on GoEmotions, an English Reddit dataset annotated with 27 fine-grained emotion categories plus neutral. We compare model predictions and emotion-prompted final-token representations with the 28 GoEmotions categories and with coarser emotion-family and sentiment groupings. We find a consistent pattern of $\textit{overcompression}$ relative to the fine-grained GoEmotions taxonomy. Under the tested KMeans protocol, when we cluster their hidden representations without using emotion labels, the clearest split is into two groups that largely separate positive from negative emotion. Coarser emotion groupings are also recovered with fewer clusters than the full 28-category taxonomy. Yet linear probes retain substantial fine-grained predictive information. These results suggest that fine-grained emotion information remains accessible even though broader affective structure more strongly organizes the unsupervised geometry.
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2611.08683 [cs.CL]
(or
arXiv:2611.08683v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2611.08683
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
66. 【2611.08671】Greedy Byte-Pair Encoding Achieves at Least 0.361 of the Optimal Compression
链接：https://arxiv.org/abs/2611.08671
作者：Kundan Baliga,Aiden Xie,Aditya Byju
类目：Data Structures and Algorithms (cs.DS); Computation and Language (cs.CL)
关键词：frequent adjacent pair, Byte-Pair Encoding, string length achieved, builds a tokeniser, pair of symbols
备注： 27 pages, 5 figures. Code and certificates: [this https URL](https://doi.org/10.5281/zenodo.23970171)
点击查看摘要
Abstract:Byte-Pair Encoding (BPE) builds a tokeniser by repeatedly merging a most frequent adjacent pair of symbols; its utility is the total reduction in string length achieved by $k$ merges. It was known that this greedy rule achieves at least a third of the optimal reduction. We prove that it always achieves at least 0.361 of the optimal reduction in string length, for every string, every budget and every tie-breaking rule; this is the first improvement of the bound one third. We also explain why one third was a barrier: the pair-packing relaxation behind it is tight, so a better bound must use more of the optimum's structure. When greedy destroys three of the optimum's merge points at once, one of them can usually be moved next door, because all copies of a rule of the optimum look alike; the remaining cases are paid for later. Along the way we determine the worst-case ratio for two merges exactly, bound it for three, and isolate a single inequality that would settle the problem.
67. 【2611.08669】ChainFlow: Few-Step Latent Flow Matching for Speculative Decoding
链接：https://arxiv.org/abs/2611.08669
作者：Selim Aktas,Yusuf Erdem Erdem,Ahmed Zeer,Himmet Toprak Kesgin,Muzaffer Kaan Yuce,Mehmet Fatih Amasyali
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：accelerate LLM inference, LLM inference, accelerate LLM, drafters generate tokens, drafter proposes tokens
备注：
点击查看摘要
Abstract:Speculative decoding has become a standard way to accelerate LLM inference: a lightweight drafter proposes tokens that the target verifies in one parallel pass. Existing drafters face trade-offs that limits their speedups: autoregressive drafters generate tokens one at a time, so drafting cost grows with draft length, while diffusion drafters generate tokens in parallel but predict each position independently, ignoring inter-token dependencies. We introduce ChainFlow, a new speculative decoding paradigm and the first flow-matching drafter conditioned on the target's hidden states. ChainFlow treats drafting as a short transport over hidden states, needing one or two flow steps instead of the many denoising steps of generation from noise. A variational autoencoder compresses these states so drafting cost barely grows with target size, lightweight feedback heads restore inter-token dependencies, and tree drafting raises acceptance. On Qwen3.5 models, at matched drafter size and training data, ChainFlow outperforms EAGLE-3 and DFlash in vLLM by 39% and 11%, respectively. These gains further widen as drafters are adapted to new languages sequentially. Our ablations cover drafter design and concurrent serving, and we open-source our code and drafter models.
68. 【2611.08651】urkish Multimodal Video Fact-Checking: A New Dataset and a Comparison of Zero-Shot Agentic and Fine-Tuned Systems
链接：https://arxiv.org/abs/2611.08651
作者：Azra Açıl
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Video-based misinformation spreads, misinformation spreads rapidly, English text, Video-based misinformation, exclusively on English
备注： 11 pages, 3 figures, 5 tables. MSc dissertation, Queen Mary University of London, 2026
点击查看摘要
Abstract:Video-based misinformation spreads rapidly on social media, but almost all existing fact-checking systems focus exclusively on English text. Tools for low-resource languages such as Turkish are severely limited. In this work, we present TeViD (Turkish Video Fact-checking Dataset), to the best of our knowledge the first multimodal video fact-checking dataset for Turkish. We compiled the dataset from articles published by this http URL, an IFCN-certified organisation, and enriched it with translated Snopes articles and synthetic examples to reduce class imbalance. Building on TeViD, we develop two verification pipelines that share the same open-source base model. First, in 3MFact-TR (Pipeline 1), we adapt the multi-role 3MFact framework to Turkish with the Qwen2.5-7B large language model and the Qwen2-VL-7B vision-language model, and add three modules of our own: a semantic inconsistency checker, a 5W1H question manager, and a bilingual evidence retriever that excludes fact-checking sites to prevent leakage. Second, as our Fine-Tuned Model (Pipeline 2), we fine-tune a single Qwen2.5-7B with Low-Rank Adaptation (LoRA) to produce closed-book verdicts from the claim and the video's textual description. We report accuracy, macro F1, True class F1, and True class recall for both systems, together with ablation studies.
69. 【2611.08643】FinEvolveKG: Controlled and Attributable Prompt Evolution for Financial Knowledge Graph Construction
链接：https://arxiv.org/abs/2611.08643
作者：Abhinav Arun,Jayita Bhattacharyya,Fabrizio Dimino,Bhaskarjit Sarmah,Stefano Pasquali
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Financial institutions construct, construct knowledge graphs, serve risk analysis, institutions construct knowledge, Financial institutions
备注： 8 pages, 1 figure, 5 tables
点击查看摘要
Abstract:Financial institutions construct knowledge graphs (KGs) from shared SEC 10-Ks to serve risk analysis, portfolio management, and investment research, whose analytical needs differ. Extraction must adapt without fragmenting shared grounding, typing, and temporal rules. Hand-authored persona prompts and fine-tuning add cost. Weight-free prompt optimization offers an alternative, but unconstrained evolution of a monolithic prompt can rewrite shared rules alongside persona guidance, obscuring changes and complicating review. We introduce FinEvolveKG, a KG-construction harness separating reusable general and persona-policy blocks and mechanically confining GEPA, a reflective prompt optimizer, to the designated block. During persona adaptation, the approved general block remains byte-stable and every optimizer edit is localized to a separately versioned persona policy. A dual objective balances generic temporal-KG quality with persona-relevant facts, motifs, and multi-hop connectivity. We evaluate five mutation scopes on ticker-disjoint 10-K splits, with three seeds for the persona-conditioned arms (v3-v5) across three personas. On the three-seed mean, the complete two-stage block-constrained workflow (v4) improves over the frozen prompt baseline (v1) by 19.4-30.9% and over the tested unconstrained full-prompt workflow (v5) by 2.2-6.4%, leading v5 on both objective components and winning all nine paired-seed comparisons with the lowest seed variance in every persona. Without further optimization, v4 also exceeds v5 across all evaluated out-of-distribution (OOD) shifts. An SME audit supports using the generated triplets as ground truth; a blinded two-SME audit favors v4 over v5 in 70.1% of contrast-enriched judgments. These results show that mechanically attributable evolution can coexist with strong empirical performance, without attributing the gains causally to the boundary.
70. 【2611.08639】Forcing a Letter Suppresses Refusal: Mechanistic Evidence from WMDP
链接：https://arxiv.org/abs/2611.08639
作者：Stepan Epifantsev,Anna Antipova,Oleg Chernikov,Leon Strelkov,Alexey Dontsov
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：large language models, MCQ format, Mass Destruction Proxy, MCQ, commonly use multiple-choice
备注： Accepted to BlackboxNLP 2026 (EMNLP 2026 workshop). 17 pages, 15 figures
点击查看摘要
Abstract:Safety benchmarks for large language models (LLMs) commonly use multiple-choice question (MCQ) format. However, prior studies documented that MCQ format reduces refusal rates, which may significantly affect the safety behavior of the model. We provide a first mechanistic explanation of this effect on the Weapons of Mass Destruction Proxy (WMDP) dataset across two models - Llama-3.1-8B and Qwen3-8B. First, we use the tuned lens technique to show that when processing MCQ the model commits to an answer-letter token very quickly, which is in contrast to the gradual refusal build-up in open-ended formats. Additionally, we observe that activations on the MCQ format lie roughly 3x further from the refusal direction, compared with their open-ended counterparts. Moreover, ablating the attention heads that carry the MCQ format answer increases the refusal, which is a direct evidence that the MCQ answer-selection competes with refusal. These findings indicate that MCQ safety scores primarily measure knowledge capabilities and do not assess the safety-mechanisms.
71. 【2611.08551】How Small Can We Go? Calibrating Activation-Cache Compression for SAE Training
链接：https://arxiv.org/abs/2611.08551
作者：Abraham Yeung
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：SAE, sparse autoencoder, train a sparse, retraining test, massive cache
备注： Accepted at the NeurIPS 2026 Workshop on Interpretability as a Science (InterpScience), non-archival. 27 pages, 5 figures, 30 tables
点击查看摘要
Abstract:To train a sparse autoencoder (SAE), you need a massive cache of model activations. We look into the effects that compression has on an SAE in two ways: we keep the original fp32-trained SAE and pass the compressed cache into the same SAE to see how many feature activations stay the same (the frozen-SAE test), and we retrain an SAE on the compressed cache and see how many of the original features still exist (the retraining test). We found that in the retraining test, there is no clear scale for retained features. On a GPT-2 cache, rounding everything to fp16 keeps 60.6% of features, but changing one value in a million by the smallest step fp32 allows (a change eight orders of magnitude smaller) keeps only 70.5%. Meanwhile, changing the random seed keeps 23.0%. For the frozen-SAE test, the frozen SAE's correlation with the original increases in order of how precise the codecs are, but plain $L_2$ distance gives nearly the same ordering. We also see the same frozen reading correspond to different percentages retained at different sites. This leaves the question of the right measurement. We build one by calibrating: retraining on identical bytes sets the ceiling, and a reseed sets the floor. We then measure the effect of each compressed codec against its own site's floor. With TopK SAEs on GPT-2 small and Pythia-1.4B at research-scale budgets, naïve per-token int4 loses more features than a reseed everywhere we tested, as do PCA and random projection on GPT-2. Standardizing each channel before quantizing brings int4 back above the floor in terms of retained features, at the same raw file size. At our smallest budget, a bf16 forward pass, which some pipelines use to save memory, loses slightly more features than rotated 8-bit storage. Calibrating a site costs four training runs and two evaluation passes.
72. 【2611.08538】Subliminal Learning in Vision-Language Models
链接：https://arxiv.org/abs/2611.08538
作者：Arman Hatami,Romina Aalishah,Ilya E. Monosov
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Image and Video Processing (eess.IV)
关键词：Subliminal learning, large language models, phenomenon in large, large language, passes a hidden
备注： Accepted to WACV 2027
点击查看摘要
Abstract:Subliminal learning is a phenomenon in large language models (LLMs) where a teacher passes a hidden preference to a student through training data unrelated to that preference. We study whether subliminal learning also occurs in vision-language models (VLMs). We finetune a teacher VLM to prefer a specific animal or facial attribute and use a control teacher from the same base model. Both teachers generate numbers for an unrelated visual task involving geometric shapes. Two students initialized from the same base VLM are finetuned on the same images, using numbers generated by either the biased or control teacher. Across VLMs ranging from 2B to 7B parameters, we find that both animal and facial preferences can transfer through this unrelated task. Students trained on biased-teacher outputs select the target more often than control students, with a difference of up to $\sim$10 percentage points in the animal preference task. Transfer can become stronger with more training data and varies with the target preference, model, and how the numbers are generated. Beyond preferences, we show that the biased student's explanations use more of the same words and phrases as the biased teacher's explanations than those of the control student, even when all three models select the same image. These results matter for training VLMs and show that training on unrelated data may change both a VLM's image preferences and how it explains its choices, and that transfer can become stronger with more training samples.
73. 【2611.08498】Improving Contextual Retrieval for Long Documents using Semantic Chunking and Hybrid Retrieval Strategies
链接：https://arxiv.org/abs/2611.08498
作者：Sakshi Garg,William B. Andreopoulos
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：relevant answers difficult, distributed documents makes, answer requires connecting, finding relevant answers, documents makes finding
备注：
点击查看摘要
Abstract:The vast amount of information available in lengthy, distributed documents makes finding relevant answers difficult, especially when the answer requires connecting evidence from multiple sources. Standard Retrieval-Augmented Generation (RAG) systems often struggle with this type of "multi-hop" reasoning and frequently face issues with context fragmentation. In this paper, we propose a hybrid RAG framework that integrates the structured reasoning of knowledge graphs with the broad semantic coverage of dense vector retrieval. Our approach employs a multi-stage pipeline using transformer-based summarization and semantic chunking to improve context retention. We construct a dynamic knowledge graph to capture explicit relationships between entities while simultaneously maintaining a dense vector index. During inference, the system uses a hierarchical mechanism that prioritizes graph traversal for precision and falls back to vector retrieval when necessary. We evaluated our framework on the MultiHop-RAG dataset. The results show that this hybrid approach outperforms standalone vector and graph-based baselines, achieving higher Exact Match scores and improved retrieval accuracy for complex queries. This confirms that merging structured reasoning with standard vector retrieval creates a more robust system for handling complex knowledge-intensive questions.
74. 【2611.08495】Rethinking Data Selection as Distribution Matching on Semantic Manifolds
链接：https://arxiv.org/abs/2611.08495
作者：Peng Sun,Yi Yang,Mingshuo Chen,Chunxiao Li,Yao Zhu,Huawen Shen,Tianfan Fu
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：large vision language, incurs substantial computational, large language models, language models relies, vision language models
备注：
点击查看摘要
Abstract:Instruction tuning of large language models and large vision language models relies on massive training data, which incurs substantial computational and storage costs. Meanwhile, training data often contains redundancy, noise, and low quality samples. Existing data selection methods mostly rely on diversity, importance, or a combination of both, without explicitly constraining the distributional consistency between the selected subset and the full data in the embedding space. We propose QMAC, a quality aware multiband characteristic function matching method that formulates data selection as a joint optimization problem of distribution matching and quality filtering. QMAC matches the empirical characteristic functions of the selected subset and the full data across multiple frequency scales, capturing both global semantic coverage and local perturbations, while using task related quality scores to filter noisy and low quality samples. We systematically evaluate QMAC on 4 data types, 8 target models, and 44 benchmarks. Experimental results show that QMAC outperforms existing data selection baselines on standard image-text instruction data, substantially surpasses random selection on standard text instruction, image-text reasoning, and text reasoning data, and exceeds full data training in multiple model and budget combinations. The code will be made publicly available upon acceptance of the paper.
75. 【2610.42039】Same Question, Different Answers: Auditing Persona-Dependent Variation in Six LLMs on Smoking-Cessation Advice
链接：https://arxiv.org/abs/2610.42039
作者：Artin Yousefi,Aizierjiang Aiersilan,Lorien C Abroms,David A Broniatowski
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Hundreds of millions, large language model, hard to answer, millions of people, large language
备注：
点击查看摘要
Abstract:Hundreds of millions of people now ask large language model (LLM) chatbots for health advice, which raises a question that is simple to pose and hard to answer: does everyone get the same advice? We audit six widely deployed LLMs from four providers on smoking cessation, a domain with codified clini- cal guidance and substantial public-health stakes, by putting the same four cessation questions to twelve user personas that differ in life stage, self-described expertise, and smoking history, for a total of 2,880 responses. What the models say depends on who appears to be asking. Every model named FDA-approved prescription cessation medications less often to teen personas than to adult personas, by 32 to 67 percentage points, and in five of six models a persona presenting health- care expertise received fewer facts than a persona presenting none. We then evaluate one deployable intervention: a short system prompt specifying a factual floor, the set of core med- ical facts every user should receive when they are relevant, while leaving tone, vocabulary, and framing free to adapt. The prompt narrows persona differences in every model, but its effect on overall fact coverage varies in both magnitude and direction across models, so a prompt validated on one system cannot be assumed to transfer to another. Two cautions frame these results. Equal mention rates are not always the correct clinical target, because prescription cessation pharmacother- apy is not recommended for minors, so a defensible factual floor must be age-aware rather than uniform. And because our personas vary on several attributes at once, we report scenario- level differences rather than isolated effects of age or expertise. We release all 2,880 responses and the analysis code.
76. 【2605.16336】On Seeding Watermarks to Detect Verbatim LLM Copy-Paste Responses
链接：https://arxiv.org/abs/2605.16336
作者：Aizierjiang Aiersilan,Artin Yousefi,Robert Pless
类目：Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Emerging Technologies (cs.ET)
关键词：Large language models, fluent essay writing, made fluent essay, quiz answering instantly, Large language
备注： We are pleased to announce that this paper has been accepted by the 9th AAAI/ACM Conference on AI, Ethics, and Society (AIES 2026). We appreciate the valuable feedback from the reviewers and look forward to sharing our findings with the community
点击查看摘要
Abstract:Large language models (LLMs) have made fluent essay writing, code drafting, and quiz answering instantly available to students at every level, from secondary school through graduate study. Many educators do not object to LLM use \emph{per~se}; what they need to detect is the case in which a student pastes the assignment prompt into a chatbot and submits the model's reply verbatim, without engaging with the work. Existing post-hoc AI-text detectors remain unreliable and have been shown to penalise non-native English writers, while output-side watermarks require cooperation from the model provider. We propose an alternative that the educator controls directly: an input-side watermark in which an invisible instruction is embedded inside the visible assignment prompt itself. An LLM that ingests the prompt verbatim quietly reads the hidden instruction and writes a tell-tale signature into its reply, exposing the copy-and-paste pathway specifically. We describe SteganoPrompt, a single-page, zero-dependency web tool that encodes an arbitrary printable-ASCII payload into the deprecated Unicode Tags block (\texttt{U+E0000}--\texttt{U+E007F}). The encoded string is visually identical to the original, survives common copy-paste channels (Word, Google Docs, PDF, Markdown, Slack, e-mail, the major learning-management systems), and is tokenized as ordinary text by most frontier models. We evaluate compliance across eight LLM families and a representative set of educational content channels. To keep deployment transparent, disclosure is built into the tool itself: every encoded brief also carries a brief, always-on academic-integrity reminder for the student, and we set out concrete guidance recommending for its disclosed, ethical use in the classroom. The tool is released under the MIT licence at this https URL.
77. 【2509.18719】LLM-Enhanced Self-Evolving Reinforcement Learning for Multi-Step E-Commerce Payment Fraud Risk Detection
链接：https://arxiv.org/abs/2509.18719
作者：Bo Qu,Zhurong Wang,Daisuke Yagi,Zhen Xu,Yang Zhao,Yinan Shan,Frank Zahradnik
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large Language Models, Large Language, integrating reinforcement learning, Markov Decision Process, Language Models
备注： 12 pages, 12 figures, ACL 2025 industry track
点击查看摘要
Abstract:This paper presents a novel approach to e-commerce payment fraud detection by integrating reinforcement learning (RL) with Large Language Models (LLMs). By framing transaction risk as a multi-step Markov Decision Process (MDP), RL optimizes risk detection across multiple payment stages. Crafting effective reward functions, essential for RL model success, typically requires significant human expertise due to the complexity and variability in design. LLMs, with their advanced reasoning and coding capabilities, are well-suited to refine these functions, offering improvements over traditional methods. Our approach leverages LLMs to iteratively enhance reward functions, achieving better fraud detection accuracy and demonstrating zero-shot capability. Experiments with real-world data confirm the effectiveness, robustness, and resilience of our LLM-enhanced RL framework through long-term evaluations, underscoring the potential of LLMs in advancing industrial RL applications.
78. 【2611.08506】Structure is in the zoom: probing neural symmetry through dimensionality scaling
链接：https://arxiv.org/abs/2611.08506
作者：Adil Amin
类目：Neurons and Cognition (q-bio.NC); Disordered Systems and Neural Networks (cond-mat.dis-nn); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Scaling exponents, models against cortex, compare representations, representations and benchmark, benchmark models
备注： 63 pages, 20 figures. Code, data and the rung tool: [this https URL](https://github.com/adilamin89/structure-in-the-zoom)
点击查看摘要
Abstract:Scaling exponents of neural dimensionality are read as properties of the code, and used to compare representations and benchmark models against cortex. Yet one recording of 11,311 mouse V1 neurons gives 0.25, 0.30 or 0.35, depending only on how it is subsampled. We show that such an exponent measures the population and the probe together. We split it exactly into a floor, which random subsets of the same sizes give, and a shift, which a declared axis of stimulus classes adds. The usual random-subsample exponent is almost all floor. Stimulus direction lifts the exponent in every grating recording by reading both symmetry sectors of the code: orientation, which repeats every half turn, and direction, which does not. The lift lives in trial-to-trial fluctuations that differ between directions, while the class means, which linear decoders read, pull it down. Two measured terms, how much the classes' fluctuations overlap and how the means sit against them, account for the shift. They give its sign where it changes: in Allen Neuropixels recordings, whose class means mostly raise the exponent, and in macaque V1. In an XY lattice whose classes stay on one orbit, temperature flips the sign as the two terms say, and in GPT-2 the shift ranks the indirect-object circuit's name-mover and backup heads. Reported with its path, its floor and its shift, an exponent says how much structure a probe finds and what carries it. Our open tool, rung, reports all three for any labelled neural recording or language-model layer: this https URL
信息检索
1. 【2611.09728】SAGE-PAIR: Source-Pretrained Routed Residual Adaptation for Sparse-Feedback Recommendation
链接：https://arxiv.org/abs/2611.09728
作者：Weiqing Zeng,Zida Yang,Guquan You,Jiexin Zheng,Cong Wang
类目：Information Retrieval (cs.IR)
关键词：Recommendation systems, systems often enter, serving window, retrain the deployed, Recommendation
备注： 14 pages, 2 figures, including 3 pages of supplementary material
点击查看摘要
Abstract:Recommendation systems often enter a new serving window before enough outcomes are available to retrain the deployed model. We study this regime with 0.05-1.0% target feedback, a range that spans our stress tests while keeping supervision far below the degrees of freedom of the source recommender. At this scale, existing fine-tuning and meta-learning methods still estimate target-specific updates from extremely sparse feedback, leaving the update direction weakly identified. SAGE-PAIR instead transfers a source-supported residual correction space and only calibrates this space using target outcomes. We introduce SAGE-PAIR, a staged adapter that pretrains a low-dimensional global residual on an adjacent source period and adds a soft router over residual experts conditioned on source user profiles. Target feedback then calibrates this residual state rather than relearning the recommender. On a locked test split of KuaiSAR-v2, SAGE-PAIR (Full) achieves a 1.77% relative improvement in NDCG@10, while a core-protocol comparison shows a further 0.25% gain from routed experts beyond source-pretrained PAIR. Matched source-pretrained LoRA and Adapter-Tuning baselines remain near the source model, supporting the need for a different adaptation space. Thus, SAGE-PAIR improves ranking quality with millisecond-scale adaptation and inference costs. Sparse-feedback adaptation is fundamentally governed by the identifiability of the update space rather than by label count alone. Source pretraining supplies estimable correction directions for scarce labels, while user-conditioned routing contributes a consistent, differentiated cross-user correction on top of the global correction. Our code is available at this https URL.
2. 【2611.09680】SPARSEUP: Towards Better Recipes for Training Modern Learned Sparse Retrievers
链接：https://arxiv.org/abs/2611.09680
作者：Thibault Formal,Pierre Erbacher,Cosimo Rulli
类目：Information Retrieval (cs.IR)
关键词：late interaction models, Learned sparse embeddings, dense retrieval, interaction models, Learned sparse
备注：
点击查看摘要
Abstract:Learned sparse embeddings are a powerful alternative to dense retrieval, yet they have fallen behind single-vector and late interaction models. One reason for their limited adoption is that they are notoriously difficult to train, generally requiring very tight conditions to converge. We present a recipe for training Splade-like encoders on modern backbones and data that achieves a better efficiency-effectiveness trade-off. We discuss the role of logit distribution and its impact on the training stability and the final sparsity of the encoder. We also introduce a new per-position fan-out control - a hard cap on how many vocabulary dimensions each position may emit. We further apply a simple vocabulary merging strategy that removes redundant entries - such as case and word-boundary variants of the same word - which are common in cased BPE-based backbones. We apply our recipe to the LateOn backbone and training data, obtaining SPARSEUP, a sparse encoder that reaches 56.4 average nDCG@10 on BEIR-13, the highest we know of among public vocabulary-based sparse encoders below 150M parameters.
3. 【2611.09472】ENGRAM: From Agent Experience to Weights through Verified Consolidation
链接：https://arxiv.org/abs/2611.09472
作者：Ruiyi Yang,Zechen Li,Lihuan Li,Du Yin,Hao Xue,Flora D. Salim
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Language-model agents, parameter learning, Language-model, experience, retrieval
备注： 22 pages, 4 figures
点击查看摘要
Abstract:Language-model agents use experience through external retrieval and parameter learning. Consolidating stored experience into model weights requires deciding both which experience to train on and when its external records can leave retrieval. Admission based solely on student mastery can exclude useful teacher demonstrations, while removal immediately after training can discard guidance that the model still needs. We introduce ENGRAM, a framework that separates training admission from memory release. A demonstration-aware gate admits skills based on student mastery or sufficient successful teacher demonstrations. The student learns from selected action traces with context from an Engram Trace Graph (ETG). A verification gate then compares the updated model without episodic retrieval against the base model with retrieval on reserved probes. Release requires valid training participation and scores meeting both relative and absolute criteria; records for skills that fail verification remain retrievable. Experiments across interactive and reasoning benchmarks show consistent gains over frozen-weight ETG controls, with ablations supporting demonstration-aware admission and selective adapter activation. A controlled held-out comparison shows that verified release substantially reduces the retrievable footprint while remaining close to retain-all performance and outperforming immediate and budget-matched random release. ENGRAM also improves task performance while reducing input-token usage and model calls. Skill-level verification further reduces retrievable experience through selective archival, retaining external guidance for skills that do not meet the release criteria. Code is available in this http URL.
4. 【2611.09294】Orthogonal Norm Growth in Two-Tower Retrieval: A Popularity Mechanism for Unified Discovery
链接：https://arxiv.org/abs/2611.09294
作者：Andrei Atamaniuk
类目：Information Retrieval (cs.IR)
关键词：Unified search, interaction streams, item vector, Unified, item
备注： 6 pages, 1 figure. Accepted at USRW 2026 (non-archival), co-located with ACM RecSys 2026. Supplementary material included as an ancillary file. Workshop: [this https URL](https://usrw-workshop.github.io/2026/accepted-papers.html) . Code: [this https URL](https://gitlab.com/wrapper228/usrw_pb)
点击查看摘要
Abstract:Unified search and recommendation systems may update the same item vectors from both interaction streams. We study how repeated updates can increase an item vector's norm and affect retrieval under an unnormalized dot product. A cosine-only loss makes the output gradient perpendicular to the current item vector - tangent to its constant-norm sphere. Training changes encoder parameters, however, so the realized item-vector movement need not remain tangent. We derive sufficient conditions under which it does; every nonzero update then increases squared norm by its squared length. When the tasks share an item encoder, sequential updates from both can accumulate in the same norm, which raw-inner-product serving can expose for either task. This conditional result is not a theorem about joint SGD. Controlled ablations test these conditions. On MovieLens 32M and Amazon Books, accumulated tangent movement accompanies frequency-norm association and additional head-item exposure under raw-dot rather than normalized-item ranking. In a nonlinear tower combining a per-item ID vector with a shared content encoding, active item movement remains near-tangent. We separate its norm change into the ID-update contribution and other output changes, then use a matched training intervention that removes immediate norm growth caused by the ID-row update. The intervention reduces norm-related exposure but also recommendation utility, so it is diagnostic rather than a proposed mitigation. Our logs are recommendation-only: the formulation supplies a shared-representation audit, while prevalence in joint traffic remains open.
5. 【2611.09274】FondueQA: A Benchmark for Evaluating Parametric Compensation in Multi-Hop QA
链接：https://arxiv.org/abs/2611.09274
作者：Laurin Schmid,Suman Navaratnarajah,Koel Dutta Chowdhury,Steffen Eger,Josif Grabocka,Christian Frey
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Large Language Models, Large Language, remarkable performance based, show remarkable performance, Language Models
备注：
点击查看摘要
Abstract:Large Language Models (LLMs) show remarkable performance based on parametric knowledge, i.e., their ability to recall facts and associations internalized in a model's weights. However, studying this capability on established multi-hop benchmarks may be complicated by benchmark contamination, as many of these benchmarks have been publicly available long enough to plausibly appear in modern pretraining corpora. As a result, correct answers under missing evidence may reflect either general parametric knowledge or memorization of benchmark-specific instances. To study how models use internal knowledge when retrieval evidence is incomplete, we introduce FondueQA, in which every required multi-hop fact is uniquely localized to a designated evidence document. This enables controlled document-level evidence ablations to study parametric compensation under incomplete retrieval. Our empirical evaluation reveals that parametric compensation strongly depends on both entity popularity and the structural role of missing evidence. Generally, models compensate more successfully for facts involving popular entities. On FondueQA, we show that bridging evidence can be more useful than the answer-bearing document itself. Moreover, models may recall a missing fact in isolation but fail to use it under partial evidence, particularly when the context contains plausible competing entities, which can reduce Exact Match by up to 15 percentage points.
6. 【2611.09200】Structure and Lineage Evidence for Vietnamese Statutory Article Retrieval on DRiLL
链接：https://arxiv.org/abs/2611.09200
作者：Duc-Vu Nguyen,Ngan Luu-Thuy Nguyen
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：Vietnamese statutory Article, study Vietnamese statutory, statutory Article retrieval, study Vietnamese, Vietnamese statutory
备注： Accepted at SOICT 2026
点击查看摘要
Abstract:We study Vietnamese statutory Article retrieval on DRiLL using features for provision identity and local form, same-law support, and citation and lineage evidence. Across five random seeds, selectors sharing candidates, listwise Qwen evidence, and learner settings improve official $F_2$ from 71.77% to 72.91%, with the largest descriptive gain on two-Article questions. Added features account for 18.20% of the proposed selector's total decision-tree split gain, measured as training-objective reduction, mainly from same-law and citation evidence. Cases reveal base provisions and amendments, companion recovery, distractor removal, and failures. These findings motivate research on other datasets, representations, and learners without establishing individual feature effects or requiring LightGBM, hand-crafted scores, or explicit graphs.
7. 【2611.09194】Large Language Model Consensus and Corpus-Adaptive Topic Modeling for Classifying and Mapping Patent Innovation
链接：https://arxiv.org/abs/2611.09194
作者：Sercan Ozcan,Enes Ozgozler,C. Okan Sakar
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：analytics increasingly relies, interpretation requires explicit, large language models, Patent analytics increasingly, linking conceptual classification
备注：
点击查看摘要
Abstract:Patent analytics increasingly relies on transformer representations and large language models (LLMs), yet linking conceptual classification, topic formation and interpretation requires explicit decisions about model roles and the evidence retained at each stage. In this design-oriented study, we propose and demonstrate a patent analytics pipeline that links these tasks and keeps each decision open to audit. Three LLMs separately classify each patent by novelty (radical or incremental) and innovation type (product, process, service). Radical and innovation-type labels each require two supporting votes, with Incremental used as the fallback novelty label. Topics are discovered by clustering PatentSBERTa embeddings, with parameter ranges scaled to corpus size. A patent-specific stopword list is applied only when topics are represented with class-based term frequency--inverse document frequency (c-TF-IDF), and a second embedding model supports inter-topic similarity, hierarchical refinement and visualization. An LLM then labels each topic from its ranked keywords and representative patents. We demonstrate the pipeline on 30,964 public-sector-related patents retrieved from this http URL. Across five category corpora ranging from 591 to 29,215 patents, the pipeline produced 74 category-specific topic instances with a macro-average document coverage of 98.1% and topic diversity of 0.900--1.000, and fewer than 1% of classification outputs returned UNKNOWN. Because every model vote and the evidence behind each topic label are retained, analysts can audit and revise the outputs. The demonstration establishes the feasibility and traceability of the pipeline; testing its labels against expert coding and benchmarking it against alternative pipelines are identified as the next steps. The pipeline offers a reusable basis for LLM-assisted patent analysis in technology intelligence.
8. 【2611.09178】A Taxonomy-Driven Synthetic Dataset for Retrieval Effectiveness and Fairness Evaluation in Hiring
链接：https://arxiv.org/abs/2611.09178
作者：Warren Jouanneau,Morgane Hoffmann,Emma Jouffroy,Marc Palyart
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Computers and Society (cs.CY); Information Retrieval (cs.IR)
关键词：benchmarking legally complex, machine learning hiring, learning hiring tools, commercial sensitivity makes, sensitivity makes public
备注：
点击查看摘要
Abstract:While machine learning hiring tools are ubiquitous, the need for privacy regulations and commercial sensitivity makes public benchmarking legally complex. We address this challenge by introducing a taxonomy-driven, fully synthetic HR dataset and benchmark to simultaneously evaluate retrieval effectiveness and algorithmic fairness. Grounded in 660K real freelancer profiles, our multilingual corpus features candidate profiles, project briefs, and counterfactual demographic twins. Auditing state-of-the-art embedding models reveals performance divergence from general MTEB scores, alongside fairness disparities in grammatically gendered languages. This demonstrates that general benchmarks are insufficient for HR, requiring tailored evaluations to identify Pareto-optimal models that balance semantic accuracy and fairness.
9. 【2611.09126】PAGSL: Path-Augmenting Graph Structure Learning for explainable scholar recommendation
链接：https://arxiv.org/abs/2611.09126
作者：Jiale Xu,Mingshu Ai,Junjie Huang,Tao Jia
类目：Information Retrieval (cs.IR); Social and Information Networks (cs.SI)
关键词：identify potential scholars, Explainable scholar recommendation, scholar recommendation aims, Explainable scholar, aims to identify
备注： 24pages, 12 figures
点击查看摘要
Abstract:Explainable scholar recommendation aims to identify potential scholars of interest and provide reasonable explanations for the recommendations. However, existing frameworks struggle with optimization-induced noise and "hub node bias", yielding trivial explanations that lack hierarchical depth and personalization. To this end, we propose a novel explainable scholar recommendation model, Path-Augmenting Graph Structure Learning (named PAGSL). PAGSL combines representation learning and semantic path knowledge to ensure recommendation performance while providing interpretable results from two perspectives. Specifically, it activates latent academic paths among entities through graph augmentation and employs a path-based neural network to encode these paths for recommendation. A masking mechanism with path score optimization is designed to generate concise and informative explanations. We evaluate PAGSL on three academic datasets (Scholat, AMiner, and ResearchGate), comprising approximately 49,000 authors and over 330,000 interaction records. Experimental evaluations validate that PAGSL outperforms state-of-the-art baselines, achieving significant improvements of 6.31\% in F1-score, 6.29\% in Accuracy and 5.95\% in AUC for recommendation. Crucially, in terms of explainability, we provide quantitative results and visualization effects. Furthermore, ablation studies validate the effectiveness of our heterogeneous convolution and path representation learning. PAGSL achieves strong performance in both recommendation accuracy and explainability.
10. 【2611.09040】MV-IVF: Multi-Vector Retrieval via Multi-Vector Clustering
链接：https://arxiv.org/abs/2611.09040
作者：Kishen N Gowda,Laxman Dhulipala,Lars Gottesbüren,Rajesh Jayaram
类目：Information Retrieval (cs.IR); Databases (cs.DB)
关键词：relevance via fine-grained, Chamfer similarity, Multi-vector retrieval represents, Multi-vector retrieval, Multi-vector
备注：
点击查看摘要
Abstract:Multi-vector retrieval represents each query and document as a set of embeddings and scores relevance via fine-grained set-to-set interactions such as MaxSim (Chamfer similarity). This expressiveness improves retrieval quality over single-vector representations, but makes search substantially more expensive. Existing systems address this challenge primarily through proxy representations or filter-and-rerank pipelines that reduce candidate generation to single-vector search. We study the complementary direction of building a native IVF-style index directly over multi-vector data. We introduce MV-IVF, an inverted-file index for multi-vector retrieval built on MV-Lloyd, a new Lloyd-style algorithm for clustering point clouds under a Chamfer objective. Our key observation is that once point clouds are assigned to clusters, the center-update step reduces to standard single-vector clustering over the flattened embeddings in each cluster. This enables efficient construction of a hierarchical IVF tree with center point clouds at internal nodes. At query time, MV-IVF performs best-first beam search over the tree to identify promising leaf clusters, then scores the documents in those leaves. We further accelerate search using low-bit quantization, query compression, and cache-efficient batched search. We implement MV-IVF in MVSIC, an optimized C++ library and unified evaluation framework for multi-vector retrieval that includes several major approaches. Across BEIR and LoTTE text retrieval benchmarks, MV-IVF achieves strong latency--recall tradeoffs, the best batched throughput frontiers, and favorable build-time and index-size profiles. At $90\%$ Recall-$10$@$10$, MV-IVF achieves up to $8.03\times$ lower single-query latency and up to $173.5\times$ higher QPS than the baselines, demonstrating that native IVF-style indexing is practical and effective for scalable multi-vector retrieval.
Subjects:
Information Retrieval (cs.IR); Databases (cs.DB)
Cite as:
arXiv:2611.09040 [cs.IR]
(or
arXiv:2611.09040v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2611.09040
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
11. 【2611.09006】Rethinking Latent Reasoning for Generative Recommendation: Beyond Teacher-Generated CoT and Recurrent Hidden-State Feedback
链接：https://arxiv.org/abs/2611.09006
作者：Yiwen Chen,Fuwei Zhang,Zehao Chen,Deqing Wang,Hehan Li,Peizhi Xu,Hanmeng Liu,Shuanglong Li,Xin Pei,Fuzhen Zhuang,Zhao Zhang
类目：Information Retrieval (cs.IR)
关键词：specialized execution loop, Latent reasoning, generative recommendation faces, hidden-state feedback requires, constructing teacher-generated
备注：
点击查看摘要
Abstract:Latent reasoning in generative recommendation faces two practical barriers: constructing teacher-generated chain-of-thought (CoT) supervision is costly, and recurrent hidden-state feedback requires a specialized execution loop. We revisit both the supervision source and the computation interface. A step-level diagnosis measures how recommendation CoT supports next-item prediction and trace coherence. In the analyzed traces, history analysis is the only step with positive mean contributions on both dimensions, while later preference and intent steps have negative mean answer contributions. Guided by this finding, we propose PHiT (Prefilled, History-Informed Thought Tokens), which learns intermediate states from semantic targets extracted directly from observed item histories. PHiT aggregates cached sparse item encodings to construct these targets and supervises the contextual states of distinct vocabulary thought tokens. All thought tokens are supplied together as ordinary input IDs during a single causal prefill, removing the need for recurrent final-state feedback. With supervised fine-tuning alone, PHiT outperforms the compared baselines across four recommendation benchmarks. Controlled ablations support the value of input-matched semantic supervision, while cost measurements show fast target construction with training time comparable to the recommendation-only thought-token baseline.
12. 【2611.08935】SkinMind: Equipping Agentic RAG with Human-Inspired Graph Probing for Reliable Dermatology AI
链接：https://arxiv.org/abs/2611.08935
作者：Jing Hao,Weinan Zhou,Zhihong Lu,Yaling Shen,Yiming Xu,Yefeng Liu,Siyuan Yan,Shuaibo Li,Ming Dai,Junjun He,Zuyi Zhu,Jinjie Gu,Lijun Wu,Jian Wang
类目：Information Retrieval (cs.IR)
关键词：verifiable evidence distributed, Reliable dermatology, requires access, access to verifiable, distributed across heterogeneous
备注： 35 pages, 7 figures
点击查看摘要
Abstract:Reliable dermatology AI requires access to verifiable evidence distributed across heterogeneous textual and visual sources. However, conventional retrieval-augmented generation (RAG) typically relies on one-shot retrieval from flat corpora, limiting its ability to adapt retrieval granularity, explore multi-hop relations, and integrate multimodal clinical evidence. We introduce SkinMind, a multimodal agentic RAG framework that equips policy models with human-inspired graph probing for autonomous evidence seeking. SkinMind organizes retrieval as an iterative interaction between an orchestrator and a graph environment. Through eight hierarchical graph-probing tools, the orchestrator progressively identifies relevant entities, inspects node-level information, traverses relations and paths, and retrieves source-text and visual evidence. This progressive-disclosure design allows the model to adaptively determine the retrieval modality, exploration direction, and evidence granularity while constructing a query-specific evidence subgraph. To support autonomous graph probing, we construct SkinMind-KG from a 62M-token corpus of dermatology guidelines and textbooks and 423K images, guided by a dermatologist-informed schema and a conflict-resolution mechanism. The resulting graph contains over 1.0M nodes and 2.0M edges, unifying textual, relational, and visual evidence for retrieval. Across six dermatology VQA benchmarks and two policy-model settings, SkinMind improves the average score over direct answering by 8.70 and 8.89 points with GPT-5.4-mini and Gemini-2.5-Flash, respectively, while consistently outperforming competing RAG methods. Together, SkinMind and SkinMind-KG provide an effective foundation for evidence-grounded multimodal reasoning in dermatology.
13. 【2611.08804】Generative Search and Recommendation at Shopify
链接：https://arxiv.org/abs/2611.08804
作者：Juhana Kangaspunta,Khalil Hajji,Darshan Fofadiya,Kyumin Park,Michael Garner,Anthony Maltsev,Ryan Synk,Jose Sepulveda,Joshua Crisologo,Shuying Sun,Akshay Soni
类目：Information Retrieval (cs.IR)
关键词：require retrieving relevant, Shopify require retrieving, retrieving relevant products, strict latency constraints, require retrieving
备注：
点击查看摘要
Abstract:Search and recommendation at Shopify require retrieving relevant products from a changing catalog of billions of products under strict latency constraints. We present SID-LLM, which casts both tasks as generating semantic IDs: short sequences of content-derived tokens representing products. We jointly pre-train SID-LLM on catalog and behavioral data, giving search and recommendation a shared representation and training objective. We show that reinforcement learning further improves judged search relevance. Furthermore, distillation from task-specific experts improves recommendation quality over joint supervised fine-tuning without a statistically detected loss in search quality. Finally, for efficient serving, we pair multi-token prediction with a lightweight ranker, improving retrieval quality over our autoregressive baseline while reducing latency. We evaluate SID-LLM both as a standalone retriever and as a component of Shopify's production search and recommendation systems. As a standalone search system, SID-LLM achieves quality comparable to Shopify's existing multi-model search stack while meeting production latency requirements. Integrating SID-LLM into the search and recommendation stacks provides significant gains in both offline evaluations and online A/B tests. Together, these results demonstrate the practical value of semantic-ID generation as a unified approach to product discovery at scale.
14. 【2611.08790】SteerGR: Steering Generative Recommendation via Sparse Autoencoders for Controllable Game Discovery
链接：https://arxiv.org/abs/2611.08790
作者：Sunkyung Lee,Xiaokai Wei,Da Long,Hyunsik Jeon,Jiajun Wu,Rithwik Seth,Jongwuk Lee,Michelle Gong,Gungor Polatkan
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：user interaction histories, items remains underexplored, predict item identifiers, recommended items remains, Steerable Generative Recommender
备注： Preprint (15 pages, 11 figures, 11 tables)
点击查看摘要
Abstract:Generative recommendation aims to predict item identifiers from user interaction histories, but explicit control over the properties of recommended items remains underexplored. A key challenge is to connect human-readable concepts to internal features whose interventions effectively change the recommended items. To address this, we propose Steerable Generative Recommender (SteerGR), a framework that uses sparse autoencoders for concept-level control in game discovery. SteerGR proceeds through three stages: (i) Concept Definition and Grounding for defining play concepts with an LLM; (ii) Feature Discovery and Selection for discovering candidate features by their concept associations and selecting one by its steering effect; and (iii) Sparse Feature Intervention for amplifying or suppressing selected features to steer recommendations without retraining the recommender. Extensive experiments with two industrial generative recommendation models on a real-world game dataset show that the selected features successfully steer recommendations toward or away from target concepts. We believe this work takes a first step to extend SAE-based steering from LLMs to industrial generative recommendation.
15. 【2611.08566】CascadeRec: Deployed Adaptive LLM Compute Allocation for Multi-Tenant Content Recommendation
链接：https://arxiv.org/abs/2611.08566
作者：Kai Zhao,Guilin Zhang,Xiang Cheng,Xiquan Cui,Henry Heng,Xu Chu,Alet Blanken
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Large language models, attractive rerankers, Large language, language models, LLM reranking
备注： IAAI-27 (Oral)
点击查看摘要
Abstract:Large language models (LLMs) are attractive rerankers for recommendation. Running an expensive model on every request is costly, and for users with sparse interaction histories it often lowers quality. We present CascadeRec, a two-tier LLM reranking cascade deployed in production at a large financial planning and analysis (FPA) SaaS provider. It serves content recommendations to enterprise tenants on AWS EKS and GKE. A lightweight Tier-1 model reranks every request. A router escalates only the requests where extra inference-time compute is likely to help, and sends them to a more expensive Tier-2 procedure (self-consistency sampling, multi-path reasoning, or a larger model). The system has run in a production A/B experiment for over a month. Compared with uniform use of the expensive tier, CascadeRec has reduced inference cost by about 10%, with minimal latency impact and no quality regression observed to date. Tenant data cannot be released, so we also evaluate the pipeline on public benchmarks (MovieLens-1M and Amazon-Electronics). Segment-level analysis with paired-bootstrap confidence intervals shows that uniform LLM reranking lowers NDCG@10 for sparse-history users by up to 30%, and its only statistically significant gain appears on the segment with the longest histories. Escalating cold users can make the loss larger instead of repairing it. Which segments benefit from escalation depends on the domain, and this motivates the segment-gated rollout we use in production. We describe the deployment architecture, the measured benefits, and lessons learned, including inter-tenant load imbalance as a driver for cascading and the handling of LLM output-parsing failures at the serving layer.
16. 【2611.08519】RedMall: Generative Recommendation for Large-Scale E-commerce
链接：https://arxiv.org/abs/2611.08519
作者：Kunyang Zhou,Xin Jia,Yi Yang,Yongjun Yang,Manjie Xu,Honglei Zhang,Yan Zhu,Kai Zuo,Xu Tang,Zheng Wang
类目：Information Retrieval (cs.IR)
关键词：shown considerable potential, industrial recommendation systems, shown considerable, considerable potential, potential in industrial
备注： Work in progress
点击查看摘要
Abstract:Generative recommendation has shown considerable potential in industrial recommendation systems. However, the performance of existing generative methods is limited by several challenges. 1) Semantic IDs (SIDs) are treated as one-dimensional sequences, overlooking the hierarchical dependencies among different layers. 2) Next-token prediction used is unable to explicitly optimize session-wise recommendation. 3) Although reinforcement learning has been applied to align generated recommendations with user preferences, few existing methods explicitly optimize the ranking of positive items in session-wise recommendation. To address the above issues, we propose RedMall, a generative recommender designed for large-scale e-commerce. Firstly, RedMall constructs hierarchical SIDs through residual quantization over multimodal representations. Secondly, RedMall introduces a lightweight SID encoder to explicitly model layer-wise dependencies in SIDs. Moreover, RedMall incorporates sparse mixture-of-experts, dual gated attention, and multi-target prediction to scale model size, enhance user interest representation, and optimize session-wise recommendation. We further design an exposure-aware loss that treats exposed but unclicked items as negative feedback. To better align user preferences and list-wise ranking objectives, we combine Group Relative Policy Optimization with an auxiliary LambdaRank loss, using both real user feedback and item ranking to guide optimization. Experiments on four public datasets-Amazon Beauty, Amazon Toys, Amazon Food, and MovieLens-1M---show that RedMall outperforms the evaluated baselines across all reported Recall and NDCG metrics. Online A/B tests show improvements of 2.24% in advertiser value (ADVV) and 0.59% in click-through rate (CTR) for e-commerce advertising, as well as gains of 1.08% in GMV and 0.95% in daily active buyers (DAB) for e-commerce recommendations.
17. 【2611.08498】Improving Contextual Retrieval for Long Documents using Semantic Chunking and Hybrid Retrieval Strategies
链接：https://arxiv.org/abs/2611.08498
作者：Sakshi Garg,William B. Andreopoulos
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：relevant answers difficult, distributed documents makes, answer requires connecting, finding relevant answers, documents makes finding
备注：
点击查看摘要
Abstract:The vast amount of information available in lengthy, distributed documents makes finding relevant answers difficult, especially when the answer requires connecting evidence from multiple sources. Standard Retrieval-Augmented Generation (RAG) systems often struggle with this type of "multi-hop" reasoning and frequently face issues with context fragmentation. In this paper, we propose a hybrid RAG framework that integrates the structured reasoning of knowledge graphs with the broad semantic coverage of dense vector retrieval. Our approach employs a multi-stage pipeline using transformer-based summarization and semantic chunking to improve context retention. We construct a dynamic knowledge graph to capture explicit relationships between entities while simultaneously maintaining a dense vector index. During inference, the system uses a hierarchical mechanism that prioritizes graph traversal for precision and falls back to vector retrieval when necessary. We evaluated our framework on the MultiHop-RAG dataset. The results show that this hybrid approach outperforms standalone vector and graph-based baselines, achieving higher Exact Match scores and improved retrieval accuracy for complex queries. This confirms that merging structured reasoning with standard vector retrieval creates a more robust system for handling complex knowledge-intensive questions.
计算机视觉
1. 【2611.09894】Video-Coder: Reinforcing Agentic Coding for Video Generation
链接：https://arxiv.org/abs/2611.09894
作者：Chaoyang Wang,Sicheng Gao,Junan Hu,Kunyang Li,Dongyang Chen,Yiyang Zhou,Huaxiu Yao,Yong Jae Lee,Radu Timofte,Yuzhang Shang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：witnessed remarkable progress, Recent years, temporal consistency, video generation, years have witnessed
备注： Project Page: [this https URL](https://cywang735.github.io/Video-Coder/) Code: [this https URL](https://github.com/CYWang735/Video-Coder)
点击查看摘要
Abstract:Recent years have witnessed remarkable progress in video generation in terms of visual quality and temporal consistency. However, generating videos with precise spatial structure, coherent motion dynamics, and controllable scene composition remains challenging. In this paper, we introduce Video-Coder, the first attempt to train a code-driven video generation agent, which autonomously writes and executes code to construct a dynamic 3D scene (Draft Video) that provides structure and motion signals to downstream video generators. To support this paradigm, we design a dedicated data pipeline and curate two high-quality datasets, Video-Coder-SFT-6k and Video-Coder-RL-2k, which contain diverse prompts and ground-truth reference videos. We further develop the Video- Coder Harness, a unified interactive environment integrating code execution, 3D scene rendering, and execution feedback for agent training and inference. We then train Video-Coder with SFT fol- lowed by harness-native agentic reinforcement learning with dual reward feedback, which combines execution-based and video-based rewards. Additionally, we design an annealing training strategy that gradually reduces the execution reward over time, allowing the model to rely more on the video reward in the later training stages. Experiments show that Video-Coder achieves significant gains, improving Minimax-H3 by approximately 7 points on PhyGenBench and 24 points on VBench-2.0. We hope this work can serve as an open foundation for coding agents in video generation, and we fully open-source our data, models, and code
2. 【2611.09892】On Agentic Manipulation Policies
链接：https://arxiv.org/abs/2611.09892
作者：Chen Chen,Omid Bagherieh,Naveen Nikamanth Appiah Balaji,Jesse T. Gonzalez,Negin Heravi,Fahad Islam,Xueting Li,Jean-Baptiste Regli,Kejia Ren,Petr Švec,David J. Yoon,Matthias Müller,Vladlen Koltun
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Recent work, specialist policies trained, specialist policies, specialist manipulation policies, Recent
备注： Videos and code available at: [this https URL](https://apple-aiml-research.github.io/ml-amp/)
点击查看摘要
Abstract:Recent work on robot manipulation has focused on specialist policies trained on demonstrations. We show that generalist AI models can control manipulators more reliably than specialist policies such as vision-language-action models (VLAs) and world-action models (WAMs). We systematically analyze agentic manipulation policies (AMPs), in which a generalist AI model commands the manipulator directly, adapting its actions as the task unfolds. We present AMP1, a reference harness that runs unchanged across single-arm, bimanual, and mobile manipulation. AMP1 achieves state-of-the-art results on the RoboLab-120 and CaP-Gym benchmarks, with no demonstrations or task-specific training. On RoboLab-120, AMP1 reaches an 85.6\% success rate zero-shot, compared to 49.2\% and 42.9\% for leading VLA and WAM policies. The agent succeeds zero-shot in 104 of 108 real-world trials spanning twelve tasks and three robot instances, reducing failure rates by 20x and 15x relative to strong VLA and WAM baselines. The basic harness supplies no grasping, pushing, or placing skills; the agent develops its own strategies, such as searching for hidden objects, using objects as tools, and calibrating its cameras. With the addition of a persistent memory store, the agent can also learn from experience: an augmented harness with a memory representation that is carried across episodes lowers the failure rate on RoboDojo bimanual manipulation tasks by 4.6x relative to zero-shot deployment. Our analysis suggests that AMPs are substantially more general and robust than specialist manipulation policies, providing a promising foundation for robot manipulation.
3. 【2611.09882】FlowMoP: Stochastic Multi-Person Motion Prediction
链接：https://arxiv.org/abs/2611.09882
作者：Aadya Agrawal,Ho Kei Cheng,Alexander Schwing
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：plausible continuations depending, observed history admits, inherently stochastic, depending on intent, people is inherently
备注： Accepted at NeurIPS 2026. 22 pages, including references and appendix
点击查看摘要
Abstract:Predicting the future motion of multiple people is inherently stochastic: the same observed history admits many plausible continuations depending on intent, coordination, and social context. Yet the dominant paradigm in multi-person 3D motion prediction remains deterministic, with existing methods producing a fixed number of outputs per agent. In contrast, we present a conditional flow matching framework that jointly generates diverse future motions for multiple agents, modeling both global trajectories and root-relative poses. A B-spline reparameterization compresses the generative state space while enforcing temporal smoothness, and a dual-stream transformer conditions each agent's predictions on observed neighbor motion for interaction-aware forecasting. Our method achieves state-of-the-art performance on CMU-Mocap (UMPM) and 3DPW, outperforming deterministic baselines on joint position error, pose error, and final displacement error despite producing a full predictive distribution. We additionally establish the first motion prediction baseline on WorldPose, a large-scale professional soccer dataset, where social conditioning demonstrably concentrates predictive uncertainty along interaction-constrained directions.
4. 【2611.09880】ZeoBench: A Benchmark for Self-Supervised Learning on 3D Zeolite Representations
链接：https://arxiv.org/abs/2611.09880
作者：Aaron Sun,Yachan Liu,Ping Yang,Peng Bai,Subhransu Maji
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：porous crystalline materials, gas storage, important class, class of porous, porous crystalline
备注： NeurIPS 2026 Datasets and Benchmarks Track
点击查看摘要
Abstract:Zeolites are an important class of porous crystalline materials with broad applications in gas storage, separations, and catalysis. Although hundreds of thousands of experimentally realized and hypothetical zeolite structures are known, identifying materials optimized for a target application remains challenging because property labels are expensive to obtain and available only for limited structure-molecule pairs. While prior work has demonstrated that 3D neural representations can predict zeolite properties effectively, it remains unclear which representation-learning strategies are most effective in the low-data regime relevant to materials discovery. We present ZeoBench, a benchmark for self-supervised learning on dense 3D representations of all-silica zeolites, and evaluate the resulting features on six existing downstream adsorption-property prediction tasks, across a range of training set sizes. Our study compares self-supervised 3D pretraining on volumetric zeolite data, adaptations of image-pretrained 2D ConvNets and vision transformers to 3D via multiview and channel-inflation strategies, and 3D ConvNets pretrained on out-of-domain volumetric datasets, alongside hand-crafted descriptors and supervised baselines. Using our pretraining and evaluation framework, we find self-supervised 3D representations outperform existing methods and achieve state-of-the-art performance across both in-domain label regimes and for the unseen domain of metal organic frameworks. Learned representations consistently outperform hand-crafted descriptors, and convolutional architectures are generally more effective than vision transformers in this setting. These results establish ZeoBench as a practical benchmark for 3D representation learning in zeolites and provide guidance for data-limited adsorption property prediction.
5. 【2611.09878】Graded convolutional networks: scale invariance without the scale and robustness to unknown blur
链接：https://arxiv.org/abs/2611.09878
作者：Tanush Shaska
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：graded vector space, vector space, Lindeberg Gaussian derivative, lambda, graded vector
备注： 26 pages, 2 figures, 7 tables. Code, trained networks and results: [this https URL](https://doi.org/10.5281/zenodo.23997172)
点击查看摘要
Abstract:The Gaussian jet of an image is a graded vector space: a dilation by $\lambda$ multiplies derivatives of order $k$ by $\lambda^{-k}$. Local graded convolutions are exactly homogeneous differential operators, and a local feature is dilation-invariant if and only if it factors through the scale-normalized jet or, without the scale, through the retraction onto the weighted sphere of the grading. Under unknown Gaussian blur the retraction changes only by a change of scale, whereas the scale-normalized jet acquires a grading factor that no radial normalization removes. At the zero jet the retraction separates image families that radial normalizations and continuous classifiers cannot. Networks built on the retraction are universal for invariant features. On MNIST such a network keeps 88.4% accuracy under a two-pixel blur, against 66.2% for the same network on scale-normalized derivatives; in Lindeberg's Gaussian derivative network the retraction raises accuracy at that blur from 91.5% to 95.1%.
6. 【2611.09866】GRAC: Graph-Based Retrieval-Augmented Captioning for Surgical Scene Description
链接：https://arxiv.org/abs/2611.09866
作者：Rochak Dhakal,Chen Zhao,Soup Cobb,Xin Qian,Xiaofeng Yang,Weihua Zhou
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：support procedural documentation, operative reports support, reports support procedural, Surgical operative reports, performance assessment
备注： 20 Pages and 4 Figures
点击查看摘要
Abstract:Purpose: Surgical operative reports support procedural documentation, surgical training, performance assessment, and workflow review. However, extracting meaningful information often requires extensive manual review and clinical expertise. Automated surgical scene descriptions could reduce this burden by leveraging recurring surgical activities and prior knowledge. Methods: We propose GRAC (Graph-Based Retrieval-Augmented Captioning), a framework that represents surgical scenes as graphs capturing relationships among instruments, actions, and anatomical structures. Given an input scene graph, GRAC learns to retrieve relevant graph-caption pairs from training data. It compares instrument-tissue interactions between retrieved examples and the input scene, using comparison features to condition retrieved-caption representations during generation. Results: On the EndoVis-18 benchmark, GRAC achieved a CIDEr-D of 5.88, compared with 4.23 for SGT and 3.36 for the strongest conventional Transformer baseline. Exact instrument-action-target triplet-set accuracy reached 52.6%, compared with 32.7% for SGT and 26.2% for the strongest conventional baseline. These results demonstrate improvements in language quality and factual agreement. On TORS, GRAC achieved a CIDEr-D of 5.06, compared with 3.80 for the strongest baseline. Conclusion: GRAC demonstrates that combining structured surgical scene representations with retrieved examples improves surgical scene captioning and produces more contextually meaningful descriptions.
Comments:
20 Pages and 4 Figures
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2611.09866 [cs.CV]
(or
arXiv:2611.09866v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2611.09866
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Weihua Zhou [view email] [v1]
Fri, 6 Nov 2026 18:47:23 UTC (2,201 KB)
7. 【2611.09863】Flow-Guided Target-Space Alignment via Path Consistency
链接：https://arxiv.org/abs/2611.09863
作者：Ruizhi Yuan,Zeqiu Yu,Wei Gao,Wei Chen,Xiwei Tang,Lu Tang
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：problems require mapping, multimodal alignment problems, alignment problems require, problems require, require mapping
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:Many multimodal alignment problems require mapping a source modality into a fixed space defined by a target modality, where the target space is not merely an intermediate embedding but is used directly for downstream analysis. In this setting, successful alignment should preserve both the global structure of the target distribution and the instance-level correspondence observed in paired source--target training data. Existing objectives typically address only part of this goal: contrastive losses encourage relative similarity, distribution-matching losses improve marginal agreement, and pointwise regression fits each source sample to its paired target without explicitly modeling target-space path geometry. We propose FlowAlign, a flow-guided target-space alignment method that repurposes conditional flow matching as a training-time alignment signal rather than an inference-time transport model. FlowAlign uses the learned flow field to guide the alignment of source-side representations with the fixed target space, encouraging them to preserve paired correspondence while remaining compatible with the global target-space structure. We further provide theoretical analysis showing how FlowAlign helps improve paired correspondence by controlling endpoint accuracy and capturing local target-space geometry. Experiments on synthetic data, paired single-cell multiome benchmarks, and image--text alignment demonstrate that FlowAlign improves instance level correspondence while preserving target-space structure across different modality settings.
8. 【2611.09851】Health-System-Wide Mapping of Demographic Information in Routine Clinical Histopathology
链接：https://arxiv.org/abs/2611.09851
作者：Shengjia Chen,Ruchika Verma,Kevin Clare,Paula Restrepo,Jannes Jegminat,Eugenia Alleva,Kuan-lin Huang,Aryeh Stock,Brandon Veremis,Thomas Fuchs,Gabriele Campanella
类目：Computer Vision and Pattern Recognition (cs.CV); Quantitative Methods (q-bio.QM)
关键词：histopathology remains unclear, clinical histopathology remains, remains unclear, disease states, self-reported race
备注： 35 pages, 4 main figures, 2 supplementary figures, and 10 supplementary tables. Interactive Results Atlas and Hypothesis Explorer accompany the manuscript
点击查看摘要
Abstract:The extent to which demographic-associated information is detectable across organs and disease states in routine clinical histopathology remains unclear. Here, we analyzed 1.3 million hematoxylin and eosin whole-slide images from 257,322 patients across 25 organs, using pathology foundation-model representations and multiple-instance learning to systematically map information associated with sex, age group, and self-reported race. Across 69 organ-demographic combinations, demographic attributes were broadly recoverable, with pan-organ mean AUROCs of 0.828 for sex, 0.733 for age group, and 0.662 for self-reported race, and substantial variation across organs. Demographic-class balancing produced relatively small changes in performance, while evaluation within diagnosis-text clusters showed modest attenuation. Under training with diagnosis-based grouping, demographic-associated signals remained detectable across multiple organs, including sex in gastric tissue (AUROC 0.865), age group in breast (0.816), and self-reported race in skin (0.728). Literature-guided analysis of these settings generated candidate histomorphological and contextual explanations for further investigation. Together, these findings provide a systematic map of demographic-associated information in routine histopathology, informing investigations of its sources, assessments of potential shortcut learning, and the development of more interpretable computational pathology models.
9. 【2611.09816】BEV3SR: Evidence-Aware 3D Spatial Reasoning from Video
链接：https://arxiv.org/abs/2611.09816
作者：Fan Zhu,Rui Yu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：videos provide sequential, video remains challenging, provide sequential, remains challenging, persistent metric scene
备注： WACV camera ready
点击查看摘要
Abstract:3D spatial reasoning from video remains challenging for VLMs because videos provide sequential, view-local observations rather than persistent metric scene records. Many questions must be answered in a query-specified perspective rather than the observed camera viewpoint, and prompting with a fixed set of RGB views may miss sparse or occluded visual cues. To address these gaps, we introduce BEV3SR, a training-free and backbone-agnostic framework for RGB-D videos with camera parameters. BEV3SR turns video observations into queryable metric bird's-eye-view (BEV) scene memory and formalizes each query into an evidence-aware spatial task. The Spatial Task Formalizer specifies the query's reference frame, spatial constraints, objective, and evidence requirement. The evidence requirement determines the appropriate reasoning pathway. A query treated as requiring geometric evidence is handled by the Geometric Reasoner, which deterministically computes the answer using the metric BEV records in the query-specified reference frame. Otherwise, a query treated as requiring visual evidence is passed to the Visual Evidence Aligner, which uses BEV-indexed object records and their associated supporting views to retrieve object-consistent and scene-context RGB frames for VLM grounding. Within a standard 16-frame budget, BEV3SR consistently improves different VLM backbones across multiple 3D scene QA benchmarks, delivering large gains on spatially intensive questions and significant improvements on open-ended scene QA. These results demonstrate that BEV3SR offers an effective, efficient, and interpretable framework for explicit 3D spatial reasoning from video.
10. 【2611.09795】AR-Edit: Training-Free Autoregressive Video Editing without Inversion
链接：https://arxiv.org/abs/2611.09795
作者：Hovhannes Margaryan,Quentin Bammey,Christian Sandor,Vicky Kalogeiton
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：real time, future frames, interactive applications, stream in real, essential for interactive
备注：
点击查看摘要
Abstract:Editing a video stream in real time, without access to future frames, is essential for interactive applications. Existing training-free video editing methods, however, assume full offline access to the entire sequence, while streaming approaches either rely on additional training or are limited to specific editing techniques. We show that this limitation can be removed by analyzing the self-attention dynamics of DMD-distilled autoregressive (AR) video diffusion models. We uncover a key asymmetry: queries and keys remain stable and aligned with their source counterparts across denoising timesteps, while values diverge and encode the evolving content. Inherited from the non-distilled bidirectional teacher, this asymmetry is strongest at high noise, where few-step streaming models operate. The resulting mechanism is simple: a single forward pass suffices to capture source identity in the value features, which can be reused throughout generation. Starting from pure Gaussian noise and injecting only these source values reconstructs the input with fidelity matching or surpassing inversion-based methods, effectively eliminating inversion. Based on this insight, we introduce AR-Edit, a training-free, inversion-free method that caches source values once and selectively injects them during denoising. Across multiple AR backbones, AR-Edit enables real-time streaming editing with superior source preservation and tonal fidelity at minimal overhead.
11. 【2611.09794】Seeing What Matters: Benchmarking Task-Conditioned Actionable Spatial Belief for Manipulation
链接：https://arxiv.org/abs/2611.09794
作者：Yina Jian,Mingkun Xu
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Spatial-reasoning benchmarks evaluate, manipulation, command, current command executable, current command
备注： 22 pages (8 main + 14 supplement). Extended cross-domain evaluation and physical robot validation in progress
点击查看摘要
Abstract:When should a robot look at the cup, and when at the portafilter? Spatial-reasoning benchmarks evaluate whether a model can describe a scene, but manipulation needs something more specific: the ability to acquire the particular evidence that makes the current command executable. A view that is informative for one task can be useless for another, even at the same workstation. We introduce Seeing What Matters, a benchmark for task-conditioned actionable spatial belief in simulated tabletop manipulation. Across three domains--coffee workstation, drawer/cabinet, and microwave/appliance--the benchmark provides 860 frozen evaluation cases; expanding across methods, budgets, and inference repeats yields more than 115,000 evaluator episodes under two protocols: closed-loop actionability and same-object functional out-of-distribution generalization. Each case pairs a set of candidate RGB views with a manipulation command, shared scripted skills, and hidden postconditions, so the benchmark directly measures whether a view-selection policy acquires the observations its command actually needs. We also provide a diagnostic reference pipeline that maintains a spatial-functional belief state and ranks views by missing evidence. At primary budget settings, this pipeline reaches 98.8% closed-loop and 98.9% functional-OOD success; ablating the functional or command-binding components collapses performance to near zero. Seven vision-language models, evaluated on the same cases, reach only 26-43%. Replacing the reference pipeline's coverage metadata with frozen RGB-derived scores preserves 98.5%/98.9% success; shuffling the visual scores collapses it to 15%/11%, confirming that the result depends on image content. These gaps suggest that spatial belief for manipulation should be evaluated not by scene-level completeness, but by whether it acquires the evidence the current command requires.
12. 【2611.09770】ROSE: Risk-Aware Orthogonal Subspace Navigation for Lifelong Knowledge Editing in Multimodal Large Language Models
链接：https://arxiv.org/abs/2611.09770
作者：Lingyun Song,Ziyao Chen,Kang Pan,Xiaolin Han,Yifei Zhang,Xiaoqi Wang,Yudai Pan,Xuequn Shang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Large Language Models, Multimodal Large Language, Large Language, require continuous factual, textbf
备注：
点击查看摘要
Abstract:Multimodal Large Language Models (MLLMs) require continuous factual updates to stay current, yet lifelong knowledge editing remains a daunting challenge. The primary obstacle is the severe Locality Erosion and Catastrophic Forgetting, where sequential edits inevitably interfere with pre-trained capabilities and prior updates. In this paper, we propose \textbf{ROSE}, a \textbf{R}isk-aware \textbf{O}rthogonal \textbf{S}ubspace navigation framework for lifelong knowledge \textbf{E}diting. ROSE addresses forgetting by aiming to restrict parameter updates to the orthogonal complement of previously edited subspaces. Crucially, it introduces a risk-guided mechanism that utilizes a dynamically computed risk mask to safeguard specific factual parameter subspaces essential for model stability. During inference, ROSE employs a multi-granularity knowledge integration strategy, featuring prototype-anchored semantic gating and perturbation-driven subspace fusion to precisely activate edited knowledge for relevant queries while limiting interference on unrelated inputs. Comprehensive experiments on two prominent multimodal benchmarks show that ROSE is competitive with state-of-the-art approaches across five key metrics, while maintaining outstanding stability over $1,000$ sequential updates. Our code is available at this https URL.
13. 【2611.09769】AnimWeb-Bench: Benchmarking Animated Webpage Code Generation from Videos
链接：https://arxiv.org/abs/2611.09769
作者：Zhongyi Zhang,Jingyu Xiao,Shuqing Li,Michael R. Lyu
类目：oftware Engineering (cs.SE); Computer Vision and Pattern Recognition (cs.CV)
关键词：CSS animation property, CSS animation, webpage code generation, Web, animated webpage code
备注：
点击查看摘要
Abstract:Animation is pervasive on the Web, the CSS animation property alone appears on over three-quarters of webpages. Yet existing webpage code generation benchmarks target static screenshots, user-triggered interactions, or isolated motion graphics, leaving the ability of multimodal large language models (MLLMs) and coding agents to reconstruct complete animated webpages largely unexplored. To fill this gap, we introduce AnimWeb-Bench, the first benchmark for animated webpage code generation from videos. It comprises 124 real-world webpages spanning 7 application domains and 33 animation types, with 91.9% of pages combining multiple types, each paired with a reference video and the static assets of the original webpage. We further propose a human-aligned, two-dimensional evaluation protocol: Static Appearance Fidelity measures structure, text, color, and visual similarity on aligned keyframes, while Animation Fidelity tracks UI components across frames and compares their position, size, velocity, and appearance with those in the reference video. Evaluating 14 MLLMs and three coding agents reveals: (1) reproducing webpage animations is substantially more difficult than reproducing static appearance; (2) explicit frame inspection and render feedback improve the reconstruction quality of coding agents; and (3) rapid, continuous changes are harder to reproduce than discrete state transitions. Our code and dataset are available at this https URL .
14. 【2611.09756】A lightweight convolutional neural network for target detection in an edge environment
链接：https://arxiv.org/abs/2611.09756
作者：Hughes Perreault,Ola Ahmad,Daniel Czuboka
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：convolutional neural network, lightweight convolutional neural, neural network, paper proposes, convolutional neural
备注： Presented at GVSETS 2023, Novi, MI. Distribution A: approved for public release
点击查看摘要
Abstract:This paper proposes a novel, lightweight convolutional neural network (CNN) designed for edge device deployment. The CNN is developed to recognize and classify threats or targets of interest. The model is equipped with a real-time hotspot detection algorithm, which enables it to process information quickly and accurately, resulting in improved inference time of up to 20 fps and a detection range of more than 400 meters with typical thermal situational awareness sensors. The proposed CNN has been rigorously tested and validated to demonstrate its high accuracy, sensitivity, and low false positive rate, providing a reliable solution for edge devices to detect potential targets. Additionally, the lightweight design of the CNN allows for easy deployment, making it an ideal solution for extending the security bubble for edge devices. The proposed model can be used for a variety of applications, including surveillance, security, and object recognition.
15. 【2611.09740】Zero-Shot Benchmarking of Unified Multimodal Models for Shallow-Water UAV Image Distortion Assessment and Restoration
链接：https://arxiv.org/abs/2611.09740
作者：Dario Scilla,Omar A. Lopez,Mattia Rosso,Kasper Johansen,Matthew F. McCabe
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：distortions complicate interpretation, water-induced distortions complicate, benthic environments, complicate interpretation, Shallow-water UAV imagery
备注：
点击查看摘要
Abstract:Shallow-water UAV imagery provides centimeter-scale observations of benthic environments, but water-induced distortions complicate interpretation. To our knowledge, we present the first systematic zero-shot benchmark of unified multimodal large language models (MLLMs) for both assessing water-induced distortions and restoring shallow-water imagery within the same model framework. We evaluate five open-weight unified MLLMs with frozen pretrained weights and without access to paired reference images or descriptions of the true seabed. The benchmark contains 1,000 image pairs: 600 semi-synthetic UAV scenes created by applying synthetic water distortions to real shallow-water imagery and 400 fully synthetic through-water scenes. Three independent human annotations cover five distortion types. We evaluate four assessment prompts (P0-P3), from direct instruction to structured task decomposition, on all 1,000 images and four diagnosis-guided restoration prompts (R0-R3) on a common 100-image subset. Assessment varies substantially by model and prompt, with systematic prediction biases and a best pooled balanced accuracy of 0.654 for distortion presence. The best pooled PSNR gain is +0.255 dB, no unified MLLM improves pooled LPIPS, and some outputs alter scene structure or hallucinate content. Two restoration-only baselines also show limited transfer: InstructIR achieves a pooled PSNR gain of +0.040 dB, while PromptFix degrades all four pooled metrics under every prompt. These results show that recognizing shallow-water degradation does not imply reliable physical restoration and provide a reproducible baseline for future work.
16. 【2611.09725】riNetra: Thermal-Reliability-Guided RGB-Thermal Fusion and Tracking for Surveillance
链接：https://arxiv.org/abs/2611.09725
作者：Sadique Khatib,Aditya Ahirrao,Vedant Sonawane,Disha Kapse,Y. D. Bhise
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Visible cameras fail, thermal sensors fail, cameras fail, sensors fail, Thermal Reliability Coefficient
备注：
点击查看摘要
Abstract:Visible cameras fail at night and thermal sensors fail under saturation, blur or loss of contrast, yet most RGB-thermal (RGB-T) detectors mix the two streams with fixed weights and cannot tell when one modality has become unreliable. TriNetra is a reliability-aware surveillance framework built around this problem. The proposed solution computes a frame-level Thermal Reliability Coefficient (TRC) from five label-free image cues, uses it to gate the thermal features of a dual-branch YOLOv8m detector whose visible branch, neck and head are frozen and COCO-pretrained, and passes the same score to a ByteTrack-based tracker that feeds a rule-based behaviour analyser. On the M3FD benchmark (2,940/630/630 split) the detector reaches 87.6% precision, 79.4% recall, 70.0% mAP@50 and 47.8% mAP@50:95 on the test split, with 17.0 M of its 42.9 M parameters trained. TRC stays near 0.78 on clean frames (standard deviation 0.012), decreases with the severity of thermal saturation and blur, reaching 0.53 and 0.69 at full severity, and is insensitive to RGB-thermal misalignment. With identical weights, the adaptive gate matches a fixed gate on clean data (70.0% versus 69.8% mAP@50) but keeps 43.6% mAP@50 when the thermal stream is corrupted, against 38.4%, 29.2% and 25.0% for a fixed gate, full thermal admission and a closed gate; the 5.1-point gain over the fixed gate has a 95% bootstrap confidence interval of +3.6 to +6.5 points. In tracking, the TRC-gated association performs on par with ByteTrack on a synthetic benchmark with exact ground truth and on 14 M3FD clips, and is slightly less stable under thermal saturation, so its measured benefit is confined to the detector. The limitations of the current evaluation are reported together with the results.
17. 【2611.09724】Evaluating Anterior Cruciate Ligament Risk of Injury Using a Graph Convolutional Autoencoder
链接：https://arxiv.org/abs/2611.09724
作者：Athanasios Babouras,Paul A. Martineau,Thomas Fevens
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：anterior cruciate ligament, expensive motion-capture labs, require substantial resource, substantial resource investment, Drop Vertical Jump
备注： 14 pages, 9 figures
点击查看摘要
Abstract:Current solutions for assessing the risk of anterior cruciate ligament (ACL) injury typically rely on expensive motion-capture labs that require substantial resource investment or subjective evaluations of specific athletic stress tests by experts. The Drop Vertical Jump (DVJ) and the Single Leg Hop (SLH) are two examples of such tests typically used to track progress in ACL rehabilitation. In this paper, we develop an unsupervised learning model that runs entirely on a smartphone for two tasks, based on an autoencoder architecture with multiple layers of graph convolutional networks, which utilizes pose estimation data to determine a person's injury risk status. Our model accurately predicts athletes at high risk of injury for both athletic stress tests, with average sensitivities and specificities of 78% and 78% for the DVJ, and 75% and 74% for the SLH. Our findings support the development of a widely accessible smartphone solution for real-time screening of ACL injury risk.
18. 【2611.09717】Direct Regression and Geometric Recovery for Event-based Spacecraft Pose Estimation
链接：https://arxiv.org/abs/2611.09717
作者：Pruthvi Nandan Janga,Kashyap Hegde Kota,Bharatesh Chakravarthi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：cameras offer high, spacecraft pose estimation, Event cameras offer, uncooperative spacecraft pose, offer high temporal
备注：
点击查看摘要
Abstract:Event cameras offer high temporal resolution and dynamic range for uncooperative spacecraft pose estimation, but models trained on synthetic event streams must generalize to the noise, background activity, and contrast variation of physical sensors. We present a comparative systems study of two independently developed approaches to synthetic-to-real, event-based 6-DoF spacecraft pose estimation. The first is a modular pipeline that combines learned keypoint detection and unlabeled target-domain adaptation with geometry-based pose recovery and temporal smoothing. The second directly regresses translation and rotation from global and cropped event representations using an apparent-scale cue, physics-motivated synthetic corruptions, and feature-consistency regularization. We evaluate both systems under the same SPARK 2026 hidden-test protocol on the real-event split of SPADES, with predictions for all test frames. The results reveal a component-wise reversal concealed by the aggregate challenge score: direct regression reduces orientation error by 22.7% (1.1767 to 0.9101 rad) and obtains a 13.4% lower composite score, whereas the modular pipeline reduces relative translation error by 78.7% (0.1335 to 0.0285). Archived configurations and a qualitative failure case identify plausible explanations for these complementary error profiles, without isolating their causes. These findings motivate a testable hybrid design that combines direct orientation estimation with geometry-constrained translation recovery.
19. 【2611.09692】PoseRieFlow: Riemannian Flow Matching for Whole-Body Text-to-Pose Generation
链接：https://arxiv.org/abs/2611.09692
作者：Jan Spindler,Bardia Ardakanian,Patrick Stotko,Reinhard Klein
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：compact flow-matching framework, human poses, compact flow-matching, flow-matching framework, present PoseRieFlow
备注：
点击查看摘要
Abstract:We present PoseRieFlow, a compact flow-matching framework for text-conditioned generation of whole-body 3D human poses. Prior text-to-pose methods either neglect articulated hands or model rotations in Euclidean space despite their non-Euclidean geometry. PoseRieFlow instead formulates generation directly on the product manifold of SMPL-H joint rotations, learning a text-conditioned vector field that transports samples from an isotropic $\mathrm{SO}(3)$ Gaussian prior to the data distribution along Riemannian geodesics. A part-tokenized Diffusion Transformer aggregates the 52 joints into eight body-part tokens, allocating a dedicated token and nonlinear projector to each hand, and restores per-joint resolution through part-specific decoders, shortening the sequence while improving kinematic fidelity over per-joint tokenization. With only 21.6M trainable parameters, PoseRieFlow supports expressive SMPL-H generation with detailed hand articulation at a fraction of the scale of recent LLM-based generators. On PoseScript, it attains the lowest whole-body kinematic error among all hand-producing methods, with consistent kinematic gains from the Riemannian formulation over its Euclidean counterpart at every practical inference budget, while distributional and retrieval metrics remain comparable between them.
20. 【2611.09664】Dual Architecture Fusion Vehicle Lidar 3D Target Detection
链接：https://arxiv.org/abs/2611.09664
作者：Muyun Li,Weizheng Jin,Yuan Sun
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Transformer architecture branch, convolutional architecture branch, convolutional neural networks, architecture branch, Transformer branch
备注： 5 pages, 6 figures. Published in CAIBDA 2026
点击查看摘要
Abstract:In this paper, a 3D backbone network (SpconvTransformer) based on the fusion of convolutional architecture branch and Transformer architecture branch is proposed. The convolution branch uses 3D sparse convolution and submanifold convolution to learn local voxel features and semantic information, and the Transformer branch uses the self-attention mechanism to model the remote relationship between voxels, uses the broad receptive field to capture rich context information, and complementing the advantages of the two architectures by fusing the local features extracted from the two branches and the global features solves the problem of limited receptive fields of 3D convolutional neural networks. The experimental results show that the average accuracy of SpconvTransformer in 3D object detection and bird's-eye view detection tasks reaches 81.45% and 88.09%, respectively, and the average directional similarity reaches 91.10%, which is significantly better than other existing algorithms.
21. 【2611.09661】Video2Asset: Online Construction of Persistent 3D Street-Scene Assets
链接：https://arxiv.org/abs/2611.09661
作者：Zihan Zheng,Chunlei Cai,Zhenlong Wu,Linjun Li,Yichen Gong,Xiaoyun Zhang,Qiang Hu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：independently editable objects, construction turns multi-view, street-scene asset construction, continually updated scene, asset construction turns
备注：
点击查看摘要
Abstract:Online 3D street-scene asset construction turns multi-view video into a continually updated scene of independently editable objects. The central challenge is to accumulate partial, intermittent observations under motion and occlusion without fragmenting identities or mixing evidence across objects. To address this challenge, we propose Video2Asset, an online framework for constructing persistent 3D assets from multi-view video. Using occupancy as an intermediate representation, we construct identity-aware observations with Historical Carrier Guidance for instance decoding and an identity encoder fusing instance-aligned 3D features with multi-view appearance. Accumulated-Evidence Association compares current observations with identity, geometric, and appearance evidence accumulated within asset records to determine identity inheritance and update world-coordinate states. We instantiate meshes from an asset library using these states and combine them with an occupancy-derived static background to support scene visualization, mesh replacement, object deletion, and trajectory editing. Experiments on several datasets demonstrate improvements in temporal identity consistency and asset quality across multiple occupancy models, including a 15.4% reduction in asset fragmentation on nuScenes with SGE.
22. 【2611.09655】Decoupled Mode Connectivity for Base-to-Novel Generalization in Vision-Language Models
链接：https://arxiv.org/abs/2611.09655
作者：Imad Eddine Marouf,Khalid Oublal,Enzo Tartaglione,Stéphane Lathuilière
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Prompt learning adapts, short learnable prompt, Toggle, Decoupled Mode Connectivity, Prompt
备注： Accepted at NeurIPS 2026. 46 pages (10 main + references, appendix and checklist), 15 figures. Project page: [this https URL](https://iemprog.github.io/DMC/) Code: [this https URL](https://github.com/IemProg/DMC)
点击查看摘要
Abstract:Prompt learning adapts vision-language models such as CLIP by optimizing a short learnable prompt. The cross-entropy objective pulls this prompt toward base-class specialization, whereas generalization to unseen classes benefits from staying close to CLIP's zero-shot feature space. Because both objectives act on the same prompt, their gradients conflict at convergence, and in our experiments no single-prompt loss design clearly improves on the cosine baseline. We propose Decoupled Mode Connectivity (DMC), which gives each objective its own prompt. Starting from a base-trained prompt, DMC trains a specialization prompt and a generalization prompt, and merges their text features with a fixed coefficient at test time, at the inference cost of a single prompt. A linear mode connectivity (LMC) corridor in text-feature space keeps the classification loss low for every classifier interpolated between the two endpoints, and a Visual Anchor KL term preserves CLIP's zero-shot class-similarity distribution of each image during specialization. We further argue that such regularizers should satisfy class-permutation invariance (CPI), and show via Fano's inequality, in an idealized model, that violating CPI lower-bounds the drop in novel accuracy by a term proportional to the mutual information between the prompt and the base-class labels. Across 11 datasets, DMC improves the average harmonic mean of base and novel accuracy over MergeTune for both CoOp and KgCoOp, and its interpolation curves pass beyond the single-prompt operating point, shifting the base-novel frontier rather than trading along it. Code is available at this https URL.
Comments:
Accepted at NeurIPS 2026. 46 pages (10 main + references, appendix and checklist), 15 figures. Project page: this https URL Code:this https URL
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2611.09655 [cs.CV]
(or
arXiv:2611.09655v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2611.09655
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Imad Eddine Marouf [view email] [v1]
Fri, 6 Nov 2026 16:04:41 UTC (437 KB)
Full-text links:
Access Paper:
View a PDF of the paper titled Decoupled Mode Connectivity for Base-to-Novel Generalization in Vision-Language Models, by Imad Eddine Marouf and 3 other authorsView PDFHTML (experimental)TeX Source
view license
Additional Features
Audio Summary
Current browse context:
cs.CV
prev
|
next
new
|
recent
| 2026-11
Change to browse by:
cs
References Citations
SciXGoogle Scholar
Semantic Scholar
export BibTeX citation
Loading…
BibTeX formatted citation
loading…
Data provided by:
Bookmark
checked="checked"class=“labs-tab-input”>
Bibliographic Tools
Bibliographic and Citation Tools
Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media
Code, Data and Media Associated with this Article
alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos
Demos
Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
Related Papers
Recommenders and Search Tools
Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
Author
Venue
Institution
Topic
About arXivLabs
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv’s community? Learn more about arXivLabs.
Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)
mathjaxToggle();
We gratefully acknowledge support from our major funders,
member institutions, ,
and all contributors.
About
Help
Contact
Subscribe
Copyright
Privacy
Accessibility
Operational Status (opens in new tab)
23. 【2611.09652】Breaking the Privacy Promise: Gradient Inversion Attacks on Federated Low-Rank Adapted Vision Transformers
链接：https://arxiv.org/abs/2611.09652
作者：Ritik K. Badiya,Siladittya Manna,Ashmit Sinha,M Yashwanth,Anirban Chakraborty
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)
关键词：low computational cost, fine-tune pretrained models, federated learning paradigm, LoRA-adapted Vision Transformers, Parameter-efficient fine-tuning
备注： Accepted at WACV 2027
点击查看摘要
Abstract:Parameter-efficient fine-tuning (PEFT) has been increasingly adopted to fine-tune pretrained models with low computational cost and is therefore also preferred in the federated learning paradigm to reduce computational and communication overhead. In this work, we investigate the sparsely explored problem of the risk of private data leakage in LoRA-adapted Vision Transformers (ViTs), where low-rank updates weaken the gradient signal available to a server with access to individual client updates. We show that quality of reconstruction is limited by two coupled ambiguities: reduced information in LoRA gradients and missing spatial cues from frozen positional embeddings. To address this, we propose a spatially anchored generative inversion framework that incorporates server-prescribed trainable positional embeddings into ViT blocks during fine-tuning at clients. The resulting positional gradients act as layer-wise spatial anchors, providing additional positional cues, while the generative prior keeps reconstructions on a realistic image manifold, reducing duplicate-data and patch-permutation artifacts, {which produce similar gradients as those produced when the target client images are used}. Adding our proposed spatial anchoring to GIAS improves PSNR by 10.14 dB, SSIM by 0.45, and LPIPS by 0.098 on CIFAR-10, as well as PSNR gains of 7.83 and 11.74 dB on high-resolution CelebA and CARS datasets, respectively, in the FedSGD setting. Such gains in reconstructed image quality metrics are also maintained at higher batch sizes and in FedAvg settings. These results indicate that LoRA-based PEFT does not, by itself, prevent data leakage in FL, and carefully incorporated positional embeddings can help in exposing private information.
24. 【2611.09625】Encoding Memory in World Models with Test-Time Model-Based Reinforcement Learning
链接：https://arxiv.org/abs/2611.09625
作者：Maxime Burchi,Fayaz Ali Dharejo,Radu Timofte
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Model-based reinforcement learning, learning accurate world, recent years, Model-based reinforcement, Memory Maze
备注：
点击查看摘要
Abstract:Model-based reinforcement learning (MBRL) approaches have demonstrated strong performance across diverse domains in recent years, learning accurate world models from agent trajectories. However, despite this progress, current approaches still struggle to surpass human performance on tasks that require long-term memory and planning. In this work, we address the problem of long-term memory in MBRL by moving beyond the commonly studied paradigm of architecture design. We introduce Test-Time Model-Based Reinforcement Learning (TT-MBRL), using gradient descent at test time to encode the memory of episode observations into world model parameters. This enables the agent to learn a distinct world model for each episode, improving memory capabilities compared to traditional approaches that solely rely on contextual memory. We first establish a proof of concept on a simplified two-dimensional variant of the Memory Maze environment, which we refer to as Memory Maze 2D, showing consistent improvements across different world model architectures. We then demonstrate the effectiveness of TT-MBRL in the 3D domain, achieving new state-of-the-art results on the Memory Maze benchmark. Finally, we show that TT-MBRL maintains strong performance on non-memory benchmarks such as DeepMind Control and Atari 100k.
25. 【2611.09617】CRTrack-Cap: A New Benchmark for Cross-View Dense Video Object Captioning
链接：https://arxiv.org/abs/2611.09617
作者：Xiangqun Zhang,Likai Wang,Zekun Qian,Rui Zhou,Ruize Han,Wei Feng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Dense video object, video object captioning, Dense video, describes object trajectories, video object
备注：
点击查看摘要
Abstract:Dense video object captioning (DVOC) localizes, tracks, and describes object trajectories within a video. Existing methods process each camera view independently, producing separate camera-local tracklets and captions for the same person across cameras. These outputs lack a unified description and leave complementary appearance evidence across views unused. We therefore formulate cross-view DVOC (CVDVOC), which associates these tracklets into scene-level global trajectories and generates one caption for each trajectory from synchronized views. To support this task, we construct CRTrack-Cap from CRTrack by auditing text-identity links and converting usable referring expressions into canonical captions. It retains 425 global trajectories and 838 local tracklets across 13 scenes, with canonical captions for 335 identities. We adapt CHOTA to the cross-view setting as CV-CHOTA to jointly evaluate tracking and caption quality. Our reference framework combines View-Exclusive Cross-Camera Association (VECA) for grouping tracklets with Conflict-Evidence Gating (CEG) for integrating caption evidence using its reliability and disagreement across views. Against three single-view methods adapted with MvMHAT for cross-view association, our framework achieves CV-CHOTA scores of 83.43 and 33.48 on the scene-disjoint in-domain and cross-domain tests, respectively. Together, CRTrack-Cap and our framework provide a benchmark and a strong baseline for describing the same person consistently across camera views.
26. 【2611.09599】Dual-Region Slice Aggregation for CT-Based Renal Tumor Classification
链接：https://arxiv.org/abs/2611.09599
作者：Yuan Liang,Sourav Bhattacharjee,Abraham Campbell
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Clear cell renal, common kidney cancer, Clear cell, cell renal cell, renal cell carcinoma
备注： Submitted to IEEE ISBI 2027
点击查看摘要
Abstract:Clear cell renal cell carcinoma (ccRCC) is the most common kidney cancer in adults. We present a region-aware architecture for CT-based ccRCC classification. Tumor and 0--10 mm peritumoral context are pooled separately from shared frozen DINOv3 feature maps. A shared position-aware slice aggregator precedes fixed training-only principal component analysis (PCA). The resulting representations are fused with radiomics using two scalar feature gates. Evaluation on KiTS23 and 111 external cases yields internal test and external AUCs of 0.8078\pm0.0154 and 0.9094\pm0.0015. Compared with matched single-tumor readout, mean AUC increases by 1.50 and 2.34 percentage points, respectively. Early-PCA and reconstruction controls yield lower internal mean AUCs, while external AUC is similar for early and late PCA. These findings highlight the joint role of regional readout and slice aggregation in adapting frozen visual features to renal CT.
27. 【2611.09583】MSR-ABC: Complementary Feature Fusion for Clear Cell Renal Cell Carcinoma Classification
链接：https://arxiv.org/abs/2611.09583
作者：Yuan Liang,Sourav Bhattacharjee,Abraham Campbell
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Clear cell renal, Clear cell, cell renal cell, renal cell carcinoma, cell carcinoma
备注： Submitted to IEEE ISBI 2027
点击查看摘要
Abstract:Clear cell renal cell carcinoma (ccRCC) classification from computed tomography (CT) may benefit from representations that capture different aspects of tumour phenotype. However, simply concatenating reconstruction-derived features, image--text embeddings, and radiomic descriptors may not fully exploit their complementary information. We propose MSR-ABC, a global--local framework integrating MedVAE, MedSigLIP, and radiomics. Spatially matched local image descriptors interact through cross-representation attention, while radiomic auxiliary supervision encourages the pooled local representation to retain quantitative tumour attributes. A gated residual mechanism integrates local information with global summaries. Area-aware pooling and visual and soft-text prompting complete the framework. We evaluate discrimination using a patient-level split of 396 KiTS23 cases and an external cohort of 111 TCGA/TCIA cases, reporting mean AUROC over three training seeds with 95% patient-bootstrap confidence intervals. MSR-ABC achieves mean AUROCs of 0.806 internally and 0.879 externally. Internally, it exceeds global MedVAE--radiomics and three-source concatenation by 3.35 and 3.61 AUROC percentage points, respectively. Removing any source lowers mean AUROC in both cohorts, with the largest decreases following radiomics removal. Individual removal of cross-representation attention, auxiliary supervision, or gated fusion also lowers internal mean AUROC. These findings are consistent with complementary contributions within the integrated architecture and support further investigation of structured representation fusion for non-invasive renal tumour characterisation.
28. 【2611.09570】Video Stitching from Multiple Moving Cameras
链接：https://arxiv.org/abs/2611.09570
作者：Shira Ifergane,Roy Amoyal,Shahar Benishay,Oren Freifeld
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：address geometric video, address geometric, scene captured, captured by multiple, geometric video alignment
备注： Accepted to NeurIPS 2026
点击查看摘要
Abstract:We address geometric video alignment for the same scene captured by multiple freely moving cameras. Existing methods, which are based on image stitching or video stabilization, are typically limited to two cameras or must assume the restrictive setting of a fixed linear ordering of the cameras. We propose MViS, a lightweight test-time optimization framework for joint multi-view alignment with temporal consistency. MViS uses a spatial-transformer-inspired net to jointly process frames from all views within a short temporal window and predict per-view, per-time homographies. Optimization proceeds in two stages: geometry-guided alignment followed by appearance-based refinement, with both stages enforcing multi-view and temporal consistency across the sequence. The method requires no scene-specific hyperparameter tuning, handles arbitrary and time-varying view-intersection graphs, and remains robust under rapid camera motion. On a standard two-view video benchmark, MViS matches or surpasses the state of the art. To facilitate evaluation in more complex scenarios, we introduce an annotated dataset with more than two freely moving cameras and establish the first benchmark for this setting. Project page: this https URL .
29. 【2611.09536】Multimodal Training with Knowledge Traction for Video Anomaly Detection
链接：https://arxiv.org/abs/2611.09536
作者：Xiao Tan
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：weakly supervised video, supervised video anomaly, video anomaly detection, detection is challenging, weakly supervised
备注： 15 pages, 10 figures, 8 tables
点击查看摘要
Abstract:The task of weakly supervised video anomaly detection is challenging. Existing approaches mainly model video frame features and determine whether anomalies are present based on their magnitudes. In this work, we propose a novel method that incorporates external knowledge into training to improve model performance, robustness, and generalization. We leverage textual prompts and a large language model (LLM) to establish prior information for the specific task, and employ dictionary learning to normalize and compress this information. Moreover, during experiments, we observed inconsistencies in the textual descriptions extracted from similar video frames by image caption models. To address this, we devise a method that leverages an LLM and auxiliary information to ensure consistency in the textual descriptions of similar frames within a video. Finally, we introduce a feature processing approach that incorporates prior knowledge and cross-modal attention mechanisms. This approach learns the relationships and characteristics among different modalities to construct more accurate and reliable feature representations, thereby improving the accuracy and stability of downstream tasks. Experimental results demonstrate that our method surpasses other state-of-the-art approaches.
30. 【2611.09527】ExQuery: Explicit Structured Query Priors for Temporal 3D Object Detection
链接：https://arxiv.org/abs/2611.09527
作者：Honglin Sun,Yifei Zhang,Junyang Zhang,Kenji Hashimoto
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：detectors commonly encode, commonly encode heterogeneous, Sparse query-based, encode heterogeneous semantic, detectors commonly
备注： BMVC 2026
点击查看摘要
Abstract:Sparse query-based 3D detectors commonly encode heterogeneous semantic, geometric, and motion information into unified latent queries, including when explicit 3D anchors are used. We introduce ExQuery, an explicit structured query framework for temporal 3D object detection. Each decoded query is organized into a shared semantic context slice and physical-state-specific slices for center, dimensions, orientation, and velocity. This structure is preserved from prior encoding to branch-specific regression and is reused to reconstruct temporal queries: predicted physical states are transformed by ego motion, classification scores form soft semantic priors, and the reconstructed query is fused with the stored latent instance feature through gated affine modulation. Experiments on the nuScenes benchmark show that our method achieves competitive detection performance, and ablation studies validate the effectiveness of our proposed modules.
31. 【2611.09524】RadarDINO: Distilling a Visual Foundation Model into mmWave Radar for Human Mesh Reconstruction
链接：https://arxiv.org/abs/2611.09524
作者：Furkan Mert Algan,Zhifan Ni,Eckehard Steinbach
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：human mesh reconstruction, mesh reconstruction, offers a privacy-preserving, privacy-preserving and illumination-robust, illumination-robust alternative
备注：
点击查看摘要
Abstract:Millimeter-wave (mmWave) radar offers a privacy-preserving and illumination-robust alternative for human mesh reconstruction (HMR). However, high-fidelity radar HMR remains challenging. Sparse point cloud-based methods suffer from information loss and missed detections, while raw radar tensor methods like RT-Mesh lack fine-grained semantics and explicit local body modeling. In this paper, we propose RadarDINO, a radar HMR framework that distills visual semantics from a DINOv3 teacher into 3D radar representations and introduces explicit geometric supervision. DINOv3 descriptors are transferred to radar voxels via calibrated RGB-radar geometry, providing voxel- and body-part-level supervision for part-aware radar representations. We further incorporate vertex- and joint-losses to directly constrain reconstructed geometry. On the M4Human dataset, our method outperforms the SOTA baseline across all three evaluation splits.
32. 【2611.09521】Embedding Predictive Adaptation and Refinement for Multi-Modal Industrial Anomaly Detection
链接：https://arxiv.org/abs/2611.09521
作者：Jaeho Cho,Jinsik Bang,Taehwan Kim
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Industrial Anomaly Detection, nature of RGB, RGB images, Industrial Anomaly, Anomaly Detection
备注： Accepted to WACV 2027
点击查看摘要
Abstract:Industrial Anomaly Detection (IAD) has evolved from 2D image-based approaches to multi-modal methods that leverage the complementary nature of RGB images and 3D point clouds. Among these, memory bank-based methods, which identify anomalies by the discrepancy between each query patch feature and its nearest normal prototype, have proven particularly effective. However, two limitations remain: (i) employing frozen pretrained encoders yields insufficient discrimination between normal and anomalous features due to the domain gap, while existing contrastive learning-based adaptation struggles to capture the spatial relationships required for precise localization; and (ii) pixel-level anomaly maps interpolated from patch-level distance scores remain coarse, lacking fine-grained detail. To address these limitations, we propose EPAR (Embedding Predictive Adaptation and Refinement). We adapt encoders by predicting the embeddings of masked regions to capture spatial relationships, together with patch-level Variance-Invariance-Covariance (VIC) regularization, resolving the poor discriminability between normal and anomalous features caused by the domain gap. We further propose a Noise Suppression Network that refines coarse maps by learning the relational discrepancy between each patch feature and its nearest normal prototype, rather than the anomaly's appearance. This relational signal remains valid for unseen real defects, despite being learned from synthetic anomalies. EPAR demonstrates strong practical applicability, excelling in few-shot settings and improving AUPRO@1% on MVTec 3D-AD and Eyecandies by +1.8% and +1.9%, respectively.
33. 【2611.09511】V-STORM: A Structure-Aware Grounded Chain of Thought Dataset for Faithful and Fine-Grained Spatio-Temporal Video Reasoning
链接：https://arxiv.org/abs/2611.09511
作者：Dian Jiao,Yuqian Yuan,Jiaqi Zhu,Mingjian Gao,Siwen Tan,Yunqi Cao,Jinhui Li,Sijing Li,Zhenxuan Fan,Haoyang Wang,Wenqiao Zhang,Siliang Tang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Spatio-Temporal Scene Graphs, coherent reasoning chain, requires precise grounding, fine-grained spatio-temporal reasoning, http URL
备注： 9 Pages, 5 figures
点击查看摘要
Abstract:While MLLMs can often identify what happens in a video, they still struggle with fine-grained spatio-temporal reasoning, which requires precise grounding when and where the supporting evidence appears and composing such evidence into a coherent reasoning chain. This challenge is exacerbated by the lack of scalable data construction and evaluation pipelines that provide granular, verifiable supervision linking reasoning steps to explicit spatio-temporal this http URL address this gap, we present V-STORM, a structure-aware framework that transforms videos into Spatio-Temporal Scene Graphs (STSGs) and derives Grounded Chain of Thought (GCoT) from validated evidence paths, making each reasoning step traceable to structured and verifiable spatio-temporal this http URL this framework, we construct a 260K-sample training set and a 3K-sample human-verified benchmark, both featuring GCoT annotations that link reasoning to explicit spatio-temporal this http URL reveal a clear separation between evidence localization and evidence composition: current MLLMs can often identify relevant spatio-temporal cues, yet still fail to integrate them into correct multi-step reasoning, exposing a bottleneck that answer-only evaluation largely obscures. Moreover, fine-tuning with V-STORM substantially improves both answer accuracy and grounding faithfulness, validating its effectiveness as supervision for faithful and evidence-grounded video reasoning. Our dataset, benchmark, and source code will be publicly released.
34. 【2611.09505】BEiTScore++: Reference-free Image Captioning Evaluation with BEiT-3 and Conformalized Quantile Regression
链接：https://arxiv.org/abs/2611.09505
作者：Gonçalo Gomes,Bruno Martins,Chrysoula Zerva
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Reliable uncertainty estimation, real-world settings, shifts are common, Reliable uncertainty, estimation is important
备注： Accepted to Findings of EACL 2026
点击查看摘要
Abstract:Reliable uncertainty estimation is important for deploying evaluation metrics in real-world settings, where both input ambiguity and domain shifts are common. In this work, we propose an uncertainty-aware extension of the BEiTScore image captioning metric, producing conformally calibrated confidence intervals alongside alignment scores. Our approach models predictive distributions over human judgments, enabling both accurate scoring and principled uncertainty quantification in a single forward pass. We evaluate our BEiTScore++ metric across multiple benchmarks with human-annotated ratings, showing that it preserves the ranking correlation of BEiTScore, while producing intervals whose width tracks the prediction error more closely than Monte Carlo dropout on most benchmarks. The estimated uncertainty also grows under image degradation and on out-of-domain artwork images, making BEiTScore++ a practical tool for uncertainty-aware evaluation of image-caption alignment.
35. 【2611.09493】FusionCLIP: Multimodal Contrastive Pretraining for Fusion Plasma Diagnostics
链接：https://arxiv.org/abs/2611.09493
作者：Qiang Chen,Xiao Wang,Qingquan Yang,Hao Si,Zikang Yan,Guosheng Xu,Jin Tang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：provide complementary observations, signals provide complementary, Visible-light videos, Spatiotemporal Stability Selection, provide complementary
备注：
点击查看摘要
Abstract:Visible-light videos and multivariate diagnostic signals provide complementary observations of tokamak discharges. However, existing fusion pretraining methods, primarily learn representations by reconstructing or predicting observations, leaving the correspondence between these modalities underexplored. Representation learning is further challenged by the fact that plasma-related regions occupy only part of each video frame and diagnostic variables have substantially different sampling rates. We propose FusionCLIP, a multimodal contrastive pretraining framework. Spatiotemporal Stability Selection retains informative visual tokens, while a Temporal Query Encoder integrates asynchronous diagnostic signals using their observation timestamps. Contrastive learning then aligns the two modality representations. We construct EAST Multimodal Diagnostics (EAST-MMD), comprising 1307 EAST discharges, and evaluate the model on three independently fine-tuned tasks: disruption prediction, edge-localized mode (ELM) classification, and $H_{98}$ regression. FusionCLIP achieves an aggregate score of 89.07\%, exceeding the best general-purpose pretraining configuration and an in-domain contrastive pretraining configuration without Spatiotemporal Stability Selection by 6.27 and 2.12 percentage points, respectively. Ablations and attention visualizations further support the contributions of its key components.
36. 【2611.09458】Left-Right-Consistent Iterative Stereo Matching via Cross-Injection
链接：https://arxiv.org/abs/2611.09458
作者：Manuel Knott,Diogo Luvizon,Daniel Scharstein,Elias Vansteenkiste
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：models predominantly predict, predominantly predict, matching models predominantly, stereo matching models, models predominantly
备注： Accepted to WACV 2027
点击查看摘要
Abstract:State-of-the-art stereo matching models predominantly predict the disparity of only the left (reference) view. However, applications such as per-eye AR/VR rendering, novel view synthesis, or two-view depth fusion require disparity for both views, and need those two maps to agree. The usual workaround of running the network a second time on the horizontally flipped and swapped pair gives two independent predictions that can be inconsistent, especially on transparent surfaces, in textureless regions, and at occlusion boundaries. We introduce cross-injection (CI), a lightweight extension for iterative (refinement-based) models that can be added to any pretrained left-only iterative matcher. It couples the two passes by injecting the explicit, signed left-right inconsistency as an additional input cue at every step of the refinement stage. We empirically show that CI substantially reduces left-right disagreement on every benchmark (more than halving it on Booster for FoundationStereo), while largely preserving sharp object boundaries. Furthermore, using two state-of-the-art stereo matching models, we show that CI also reduces the single-view disparity error, making it a worthwhile extension even if only left disparity is needed.
37. 【2611.09455】Overview of the ImageCLEFmedical 2026 GANs task: Exploring fingerprint detection, privacy leakage, and synthetic medical image generation
链接：https://arxiv.org/abs/2611.09455
作者：Alexandra-Georgiana Andrei,Mihai Gabriel Constantin,Mihai Dogariu,Dzmitry Karpenka,Yuri Prokopchuk,Ahmedkhan Radzhabov,Dan-Cristian Stanciu,Liviu-Daniel Ştefan,Vassili Kovalev,Henning Müller,Bogdan Ionescu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Exploring Fingerprint Detection, Medical Image Generation, Task Exploring Fingerprint, Image Generation continues, Synthetic Medical Image
备注： CLEF 2026 Working Notes, 21-24 September 2026, Jena, Germany
点击查看摘要
Abstract:The 2026 ImageCLEFmedical GANs Task Exploring Fingerprint Detection, Privacy Leakage, and Synthetic Medical Image Generation continues to investigate privacy and security concerns around using patient data to generate synthetic medical images, now in its fourth edition. This edition introduces three complementary subtasks: the first extends prior editions by asking participants to detect which real images were used in training a Generative Adversarial Network to produce given synthetic outputs; the second is a novel subtask requiring participants to identify which latent vector produced each synthetic image, probing the faithfulness and reversibility of the latent-to-image mapping; the third asks participants to generate privacy-preserving CT slices, quantifying the trade-off between image fidelity and patient privacy. Ground-truth annotations and benchmark datasets of real and GAN-generated lung CT slices are provided for all subtasks. Evaluation is based on Cohen's Kappa for Subtask 1, matching accuracy for Subtask 2, and a combination of FID and Privacy Preservation Score (PPS) for Subtask 3. Overall, 37 teams registered for the task, with 10 teams submitting runs across subtasks and 6 teams submitting working notes papers. This paper presents an overview of the task setup, datasets, evaluation metrics, and summarises the approaches and results of participating teams.
38. 【2611.09436】he Role Of Recurrent Refinement In Medical Image Segmentation
链接：https://arxiv.org/abs/2611.09436
作者：Joao D.S. Marques,David Calhas,Arlindo L. Oliveira
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：constrained clinical settings, feed-forward segmentation networks, segmentation networks perform, large cohorts, imaging artifacts
备注：
点击查看摘要
Abstract:While feed-forward segmentation networks perform well on large cohorts, they degrade in constrained clinical settings with few training samples and imaging artifacts. Human vision, by contrast, remains robust under these conditions, a property partly attributed to the recurrent and feedback connectivity of the visual cortex, which refines visual information over time. Inspired by this, we append lightweight recurrent refinement blocks to segmentation backbones, namely Conditional Random Fields (CRFs), modern Hopfield networks and convolutional GRUs, and study their behaviour as the number of iterations increases at test time (including beyond the training horizon). Evaluated on two open-source datasets, Kvasir- SEG and ARCADE, our recurrent blocks add less than 1.5% parameters and yield gains on clean data (up to 1.4 pp) and under noise (up to 17 pp) while reducing HD95. Code is available at this https URL .
39. 【2611.09387】A Bridge from Paste to Place: Physics-Guided One-Step Image Composition via Object-Scene Interaction
链接：https://arxiv.org/abs/2611.09387
作者：Hongzhen Li,Youwei Pan,Yingfang Zhu,Sen Zhu,Fengjie Zhu,Leilei Cao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：naturally present, scene while preserving, preserving the fine, fine details, foreground harmonization methods
备注：
点击查看摘要
Abstract:Realistic image composition must make a pasted object appear naturally present in a scene while preserving the fine details of both foreground and background. Reference-based insertion methods can change object pose and appearance, while foreground harmonization methods and shadow-specific synthesis methods each address only part of this task. An efficient, unified solution to this task remains an open challenge. We introduce Paste2Place, an end-to-end, physics-guided flow-based model that learns a direct, one-step latent bridge from pasted inputs to realistic composites, guided by explicit albedo-shading-residual decomposition and recomposition within the model. To support model training and evaluation, we develop a Blender rendering and validation pipeline to generate paired composites with physical annotations, and construct real-scene pairs from open-source object-removal data. This effort yields 86,273 training pairs and a 1,500-example benchmark. Extensive qualitative and quantitative experiments demonstrate that Paste2Place achieves substantial advantages in image composition quality and inference speed. Overall, our work provides a clear task definition and an effective solution for image composition, and fills a gap in large-scale, high-quality datasets and benchmarks for training and evaluating image composition.
40. 【2611.09380】SPSC: Zero-Shot Cross-Subject EEG-to-Image Reconstruction via Semantic Preservation and Subspace Calibration
链接：https://arxiv.org/abs/2611.09380
作者：Yutang Lu,Shuai Jiang,Fei Su,Zhicheng Zhao
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Pretrained vision-language models, driven rapid progress, Pretrained vision-language, cross-subject semantic shifts, Mask Contrastive Regularization
备注：
点击查看摘要
Abstract:Pretrained vision-language models and diffusion generators have driven rapid progress in brain-to-image generation, while EEG-based reconstruction is still constrained by low signal-to-noise ratio and cross-subject semantic shifts. Zero-shot cross-subject reconstruction poses even greater challenges: EEG semantic embeddings learned from source subjects deviate from the manifold of image embeddings of the unseen target subject, particularly when neither target labels nor target image embeddings are available. To address this issue, we introduce the Semantic Preservation and Subspace Calibration (SPSC) framework, which first uses Object Mask Contrastive Regularization (OMCR) with object identity for backend training, and then constructs Subspace Candidate Gate (SCG) to achieve label-free semantic correction for target subjects during inference. Specifically, OMCR regularizes the conditioning space with object-level positive samples to preserve object-level feature neighborhoods within the reconstruction prior and low-level branch, while SCG exploits training image prototypes and batch statistics of unlabeled target EEG to select candidates for each task within subspaces of image prototypes. Under the leave-one-subject-out (LOSO) setting across ten subjects on the THINGS-EEG dataset, SPSC improves the cross-subject reconstruction from 0.552 to 0.713 on CLIP and from 0.612 to 0.745 on Alex.5. These significant gains indicate that the semantically calibrated conditions can better support generation for the target subjects under label-free inference.
41. 【2611.09355】HiMEM: Hippocampus-Inspired Memory Consolidation, Pruning, and Composition for Vision-Language-Action Models in 3D Scenes
链接：https://arxiv.org/abs/2611.09355
作者：Boran Zhao,Yanbin Hu,Jun Ye,Zhenxian Hu,Yuxin Zhai,Jin Cui,Pengju Ren
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：plays a crucial, crucial role, VLA, Memory, long-horizon task execution
备注：
点击查看摘要
Abstract:Memory plays a crucial role in long-horizon task execution and cross-task generalization for Vision-Language-Action (VLA) models operating in complex 3D scenes. However, existing VLA memory mechanisms suffer from memory noise, particularly in complex 3D scenes, as stored episodic memories contain extensive redundant details about scene layouts, object configurations, and robot-specific states, which obscure generalizable manipulation principles and hinder cross-task transfer. To address this challenge, we first introduce a hippocampus-inspired memory consolidation mechanism that synthesizes extensive episodic experiences into a compact set of essential semantic memories, enabling VLA models to derive generalizable principles from practical experience. Second, we propose an episodic memory pruning mechanism that removes redundant episodic memories whose contents are captured by consolidated semantic memories, thereby increasing effective memory capacity and improving long-horizon task execution. Finally, to handle complex task scenarios, we develop a flexible memory composition mechanism that jointly leverages multiple episodic and semantic memories to enhance cross-scenario generalization. Experiments on LIBERO, LIBERO-Plus demonstrate the effectiveness of HiMEM across different VLA backbones, improving the average success rate of pi_0 from 91.88% to 98.20% on LIBERO.
42. 【2611.09336】RegNC-Mamba3: Shared Structural Feature Learning Using Non-Causal State Space Principles for Multi-Modal Image Registration
链接：https://arxiv.org/abs/2611.09336
作者：Zhikang Li,Yan Wu,Xin Hu,Yi Dai,Ming Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：State Space Model, State Space Principles, lower computational complexity, State Space, Space Model
备注：
点击查看摘要
Abstract:The main challenge of multi-modal image registration is shared structural feature extraction with higher accuracy and lower computational complexity. Compared with a State Space Model (SSM), the State Space Principles (SSP) formulation of Mamba-3 uses a more accurate discretization with lower truncation error while maintaining linear complexity. However, vanilla SSP is designed for natural language processing (NLP) and is not directly suitable for images. To address this issue, we propose a novel non-causal SSP (NC-SSP) with shared structure awareness and develop a coarse-to-fine registration method named RegNC-Mamba3. First, NC-SSP is designed to eliminate the dependence of the integral computation on the scanning path. By combining relative-weight normalization with aggregation over all circular scan paths, NC-SSP constructs a globally hidden state without long-range decay, which provides a wider receptive field and higher efficiency than the original Mamba-3. Second, NC-SSP is modified to strengthen the extraction of cross-modal structural features. When computing hidden states and feature interactions, we construct complex-valued sequences in NC-SSP by applying learnable Log-Gabor kernels, with different orientations to each head for frequency-domain modulation. This improves the perception of shared structural information across modalities and increases both registration accuracy and quality. Experiments on VIS-SAR and VIS-IR demonstrate that RegNC-Mamba3 outperforms the compared detector-based and semi-dense multi-modal registration methods.
43. 【2611.09316】Keyline Detection with YOLO: Runway Perception for Vision-Based Aircraft Landing
链接：https://arxiv.org/abs/2611.09316
作者：Leander Fritsch,David Rügamer,Alexej Klushyn
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Modern object detectors, Modern object, per-object geometric features, occlusion and truncation, per-object geometric
备注： WACV 2027
点击查看摘要
Abstract:Modern object detectors can predict keypoints as per-object geometric features, but keypoints are inherently vulnerable to occlusion and truncation. Object edges can provide complementary information, often remaining observable even when partially occluded or when their defining endpoints leave the field of view. We therefore introduce object keyline detection, the task of predicting a fixed, semantically ordered set of infinite lines per object instance. Unlike the outputs of general line-segment detectors, each keyline is associated with an object instance and identified by a semantic index, providing a line-level analog of keypoints. To solve this task, we extend YOLO with keyline prediction parameterized in continuous Hesse-normal form $[\rho,\cos\theta,\sin\theta]$, and introduce Object Keyline Similarity (OKLS), which serves as an evaluation metric, target assignment signal, and regression loss. We instantiate this formulation on runway perception in vision-based landing, a motivating example containing semantic linear features that remain partially observable throughout the approach. Experiments show that our representation achieves the highest detection accuracy among four evaluated line parameterizations, and keylines integrate directly into standard YOLO heads as additional output channels without degrading keypoint performance or adding meaningful latency.
44. 【2611.09309】Interpretable Context-Aware Multi-Label Retinal Classification with Dual-Hub Heterogeneous Graph Neural Network
链接：https://arxiv.org/abs/2611.09309
作者：Proshanto Chanda,Munib Mesinovic,Tingting Zhu,Abhirup Banerjee
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Multi-label retinal screening, retinal screening requires, screening requires capturing, requires capturing co-occurring, capturing co-occurring pathologies
备注：
点击查看摘要
Abstract:Multi-label retinal screening requires capturing co-occurring pathologies and clinical context, yet standard multimodal fusion remains opaque. We propose a dual-hub heterogeneous graph neural network (GNN) that couples spatial fundus features and structured clinical covariates through cross-modal message passing while providing inherent interpretability. Rather than relying on post-hoc saliency approximations, our architecture exposes multi-level decision pathways during forward aggregation: spatially biased self-attention captures lesion-level patch interactions, while modality-specific graph attention coefficients explicitly quantify the contribution of visual regions and clinical risk factors to each disease node. Evaluated on the BRSET dataset (16,266 photographs from 8,524 patients), the proposed model achieves 76.1% Macro-AUPRC across seven conditions, matching or exceeding image-only (75.9%) and ResNet-50+MLP fusion (75.9%) baselines, with largest contextual gains in macular edema (+3.5 percentage points, pp) and diabetic retinopathy (+2.1 pp). Codebase is available at: this https URL.
45. 【2611.09304】2I Models Rarely Invert Negation but Often Fail to Suppress Negated Concepts: Benchmarking Negation Suppression in Text-to-Image Generation
链接：https://arxiv.org/abs/2611.09304
作者：Akansha Gautam,Aparna Bharati,Mayank Vatsa,Richa Singh
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：suppress explicitly negated, explicitly negated concepts, explicitly negated, lamp, Basic CLIP estimator
备注： Accepted at WACV 2027. Code and data: [this https URL](https://github.com/IAB-IITJ/T2I-NSI)
点击查看摘要
Abstract:Text-to-image diffusion models often fail to suppress explicitly negated concepts, such as a lamp for "a desk without a lamp." We introduce T2I-NSI, a benchmark and metric for measuring negation sensitivity in text-to-image generation. It pairs each negated prompt with a canonical positive counterpart and factorizes negation by linguistic form (lexical/semantic, morphological, syntactic) and target type (objects, attributes, relations, compositions, and nested cases). The benchmark contains 759,869 paired prompt atoms over a 5,082-object catalog, with 916,272 images (911,982 open-weights, 4,290 closed-source), scored by a Basic CLIP estimator and a Robust ensemble of CLIP, VQA and open-vocabulary detection. Negation sensitivity is low: open-weights generators score NSI = 0.038, while GPT-Image-1.5 and Gemini-2.5-Flash-Image reach about 0.09. The dominant failure is under-suppression rather than misdirection. Inverse interpretation is essentially absent (0.00% across over 450K atom-model evaluations), whereas models render the concept under both prompts on 8-19% of atoms and only partly suppress it on a further 9-25%; most remaining atoms are too weakly rendered to label. A blinded human study (420 atoms, nine annotators) corroborates the near-absence of inversion and the high persistence rate, and a matched-prompt comparison shows the open-versus-closed gap (~3.5x) is not a prompt-generator artifact. Code and data: this https URL
46. 【2611.09302】A Stochastic Latent Variable Generalization of Joint-Embedding Predictive Architectures
链接：https://arxiv.org/abs/2611.09302
作者：Nikos Giakoumoglou,Paschalis Giakoumoglou,Tania Stathaki
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Joint-Embedding Predictive Architectures, original JEPA blueprint, target signal, context signal, Joint-Embedding Predictive
备注： WACV 2027
点击查看摘要
Abstract:Joint-Embedding Predictive Architectures (JEPAs) predict the latent embedding of a target signal from a context signal, with an auxiliary variable z conditioning the predictor. Despite its prominent role in the original JEPA blueprint, the content of z has been carried by a fixed deterministic token in every prior instantiation, collapsing the genuinely multi-modal distribution over plausible completions to a point estimate. We present S-JEPA, which realises z as a proper stochastic latent variable for masked image prediction: a learned posterior infers z from context and target during training, while a learned context-conditioned prior approximates the distribution of plausible completions at inference, with no decoders and no reconstruction. In its deterministic limit the objective reduces to the I-JEPA loss in functional form, generalising that objective rather than strictly containing the I-JEPA model. Our central finding is that stochasticity adds capabilities, error-correlated predictive uncertainty and diverse completions, at no cost to representation quality: under matched architectures and schedules S-JEPA improves over the deterministic I-JEPA baseline and exceeds LeJEPA at matched architecture, while additionally producing spatially structured uncertainty maps and semantically diverse completions, neither of which the deterministic predictor produces.
47. 【2611.09224】HMMF-Net: A Lightweight Hierarchical Multi-Frame Multimodal Fusion Network for Accurate Fish Feeding Intensity Assessment
链接：https://arxiv.org/abs/2611.09224
作者：Phi-Hung Hoang,Van-Manh Tran,Nam-Thuan Trinh,Thi-Thu-Hong Phan
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Automated fish feeding, feed cost optimization, Automated fish, feeding intensity assessment, fish feeding intensity
备注： 47 pages, 10 figures, 15 tables
点击查看摘要
Abstract:Automated fish feeding intensity assessment (FFIA) is important for precision aquaculture and feed cost optimization. However, unimodal methods are vulnerable to acoustic noise and visual disturbances, while existing multimodal frameworks often rely on computationally intensive 3D convolutions or Transformers, limiting their use on edge devices. To address these limitations, we propose HMMF-Net, a lightweight multimodal architecture that combines early multi-frame visual encoding and multi-axis acoustic modeling through a hierarchical bidirectional messenger cross-modal fusion (BMCF) mechanism. The visual branch captures temporal variations in feeding behavior by stacking temporally distant frames as a multi-channel input to an adapted 2D EfficientNetB0 backbone. The acoustic branch employs adaptive multi-axis residual units (AMARU) to extract temporal, frequency, and local time-frequency representations from log-mel spectrograms. BMCF progressively exchanges information between the two modalities at intermediate representation levels through compact messenger tokens, reducing the computational overhead of dense cross-modal attention. Evaluated on the AV-FFIA dataset using five-fold cross-validation, HMMF-Net achieves 96.77% accuracy and 96.88% F1-score on the held-out test folds, with 3.987M parameters and 1.002 GFLOPs. Compared with the best-performing visual configuration (95.49% accuracy), HMMF-Net reduces the classification error by 28.38%. Deployment on an NVIDIA Jetson Orin Nano using TensorRT with FP32 precision maintains comparable accuracy, with an inference time of 11.54 ms per 2-second sample and a model size of 18.81 MB. These results demonstrate that HMMF-Net combines effective multimodal representation learning with computational efficiency, enabling accurate and practical FFIA on resource-constrained edge platforms.
48. 【2611.09195】InstantHMR : Real-Time Human Mesh Recovery on Your Phone
链接：https://arxiv.org/abs/2611.09195
作者：Mohamed Adjel,Kahina Chalabi(LAAS-GEPETTO),Vincent Bonnet(LAAS-GEPETTO)
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：human mesh recovery, Momentum Human Rig, mobile devices, challenging problem, Real-time
备注：
点击查看摘要
Abstract:Real-time 3D human mesh recovery from a single image on mobile devices is a challenging problem with many applications, including robotics, biomechanics, AR/VR, and exergames. Current state-of-the-art models are either too slow to run efficiently on mobile devices or sacrifice accuracy for speed. We present InstantHMR, a family of open-source single-image regressors suited for mobile inference, based on the Momentum Human Rig (MHR) parametric model and trained exclusively on publicly available annotations from the SAM 3D Body dataset. Our approach achieves remarkable performance on a Samsung Galaxy S23 NPU, recovering a 6,890-vertex body mesh in 5.5 ms per person, and 0.98 ms on an NVIDIA RTX 4070 GPU. This speed surpasses all existing methods we evaluated. On mobile, it is 12x faster than the single mobile-compatible method that slightly outperforms ours in accuracy, while achieving competitive accuracy with 40.0 mm PA-MPJPE on 3DPW, 48.8 mm on EMDB and 41.7 mm on RICH. To ensure fair comparisons, we re-evaluate 11 state-of-the-art methods under a unified protocol aligned with the closest MHR-based competitors, including Meta's official MHR-to-SMPL conversion, and report their reproduction results. Additionally, we measure latency across eight different targets, ranging from desktop TensorRT to two phone NPUs. Code and models are available at this https URL.
49. 【2611.09191】Bootstrap Your Own AV-Proxies: Adaptive Contrastive and Prototype Learning for Audio-Visual Segmentation
链接：https://arxiv.org/abs/2611.09191
作者：Junbo Zhang,Hang Su,Zhaofan Li,Hang Dong,Chao Sun
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：audio-visual correspondence cues, leveraging audio-visual correspondence, accurately segment sounding, segment sounding objects, Audio-Visual Segmentation
备注： Accepted to CVPR 2026
点击查看摘要
Abstract:Audio-Visual Segmentation (AVS) aims to accurately segment sounding objects in video frames by leveraging audio-visual correspondence cues. However, it remains challenging due to the intrinsic semantic incompleteness within a single modality and the semantic gap between audio and visual representations. Traditional feature-fusion decoding approaches struggle to suppress fusion noise effectively, while recent methods that incorporate data-dependent priors often increase the complexity of modeling audio-visual correlations, leading to poor cross-domain generalization. To address these issues, we propose a novel adaptive contrastive and prototype learning framework, BYOAVP, for AVS. Specifically, we design a Self-Supervised Audio Enhancement (SSAE) module that introduces contrastive learning to adaptively align audio representations with gradient-blocked visual embeddings, thus narrowing the semantic gap between modalities. Furthermore, a Dynamic Prototype Constraint (DPC) module is developed to refine pixel-wise category perception via momentum-based prototype updating, while enhancing localization of sounding regions through cross-modal interaction. Extensive experiments demonstrate that our method achieves SOTA performance across two AVS benchmarks and six sub-tasks, exhibiting strong robustness and generalization ability.
50. 【2611.09175】SIFR: Stable Signed Flow Reinforcement
链接：https://arxiv.org/abs/2611.09175
作者：Runlong Liao,Xingqian Xu,Lizhang Chen,Baiyu Su,Yufan Huang,Zhonghao Wang,Akash Gokul,Ming-Yu Liu,Qiang Liu,Yogesh Balaji
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：suppressing low-reward samples, requires effectively promoting, effectively promoting high-reward, models requires effectively, maintaining training stability
备注：
点击查看摘要
Abstract:Reward-based fine-tuning of flow models requires effectively promoting high-reward and suppressing low-reward samples, while maintaining training stability over many rounds of iterative updates. Iterative reward fine-tuning provides a simple starting point, but the positive reward weights give no explicit unfitting signal, and repeated reweighting concentrates the distribution and causes collapse. We propose Stable Signed Flow Reinforcement (SIFR), which replaces the reward weights by signed advantages to supply the missing unfitting signal, and constrains the velocity drift from a reference model to stabilize the updates, with a Lagrange multiplier that adapts the regularization strength to a prescribed drift budget. We further show that existing flow RL methods fall within this framework: they implicitly minimize the signed loss, differing in their regularization choices. We validate SIFR on SD3.5 Medium (2.5B) and FLUX.2 Klein (9B) and scale it to Cosmos 3 Super Text2Image (64B): across all 12 backbone--reward pairs with preference and rule-based rewards, it matches or exceeds existing methods, reaches their peak rewards much faster, and keeps improving over long training where they plateau or collapse.
51. 【2611.09170】FIND: Frequency Invariance Disentanglement for Test-Time Adaptation in LiDAR 3D Detection
链接：https://arxiv.org/abs/2611.09170
作者：Dongxiao Li,Zixuan Hu,Ling-Yu Duan
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Object Detection, diverse sensor configurations, perception task, domain shifts arising, environmental conditions
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:LiDAR-based 3D Object Detection (L3OD) is a fundamental 3D perception task, yet its performance is often compromised by domain shifts arising from diverse sensor configurations and environmental conditions. Existing Test-Time Adaptation (TTA) methods primarily leverage self-supervision in the spatial domain, yet they frequently confound semantic content with domain style due to the sparse, non-Euclidean nature of point clouds. To overcome this limitation, we propose FIND (Frequency INvariance Disentanglement), a novel TTA framework that precisely disentangles domain-invariant content from domain-specific interference within the frequency domain. Our methodology utilizes B-Spline fitting to construct locally adaptive filters integrated into a dual-stream architecture: an Invariant Stream extracts robust features to guide pseudo-labeling, while a Specific Stream enforces consistency against domain perturbations. By combining invariance-driven alignment with stability-guided regularization, our approach dynamically extracts robust domain-invariant features while suppressing domain-specific interference. Extensive experiments on cross-dataset adaptation and robust corruption benchmarks demonstrate that FIND significantly outperforms state-of-the-art methods. The source code is publicly available at this https URL.
52. 【2611.09133】DINO-Nucleus: Multi-Level Self-Supervised Features for Nucleus Instance Segmentation
链接：https://arxiv.org/abs/2611.09133
作者：Mohammad Sarhangzadeh,Elyar Esmaeilzadeh,Doruk Oner
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：enabling reliable analysis, Nucleus instance segmentation, tissue organization, enabling reliable, cell populations
备注： 10 pages, 2 figures
点击查看摘要
Abstract:Nucleus instance segmentation and counting are essential for quantitative microscopy, enabling reliable analysis of cell populations, tissue organization, and disease-related changes. However, accurately separating touching nuclei remains difficult, and many existing approaches rely on complex models or sensitive post-processing procedures. We present DINO-Nucleus, a parameter-efficient framework that leverages multi-level self-supervised DINOv2 representations for nucleus instance segmentation and counting. The model jointly predicts nucleus regions, pixel-wise instance flows, and explicit nucleus centers, while a consistency objective encourages the predicted flows to converge toward their corresponding centers. Multi-level transformer features provide complementary spatial and semantic information, and the pretrained backbone is adapted using lightweight LoRA modules to reduce fine-tuning cost. Experimental results show that DINO-Nucleus achieves strong segmentation and counting performance with parameter-efficient backbone adaptation. These findings demonstrate that parameter-efficient adaptation of multi-level self-supervised features can provide an effective solution for nucleus instance segmentation in microscopy images.
53. 【2611.09129】ouchAnnotator: Multi-Source Tactile Supervision with Privileged-View Distillation
链接：https://arxiv.org/abs/2611.09129
作者：Ao Li,Zhihao Yuan,Chubin Zhang,Kunrui Huang,Sheng Xu,Zengjue Chen,Junjie Wang,Jiawei Li,Yansong Tang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：captures human-object interaction, rarely includes tactile, includes tactile labels, video captures human-object, Egocentric video captures
备注：
点击查看摘要
Abstract:Egocentric video captures human-object interaction at scale but rarely includes tactile labels for hidden contact and pressure. We introduce TouchAnnotator, an ego-only bimanual tactile annotator trained with multi-source tactile supervision and privileged-view distillation. A canonical hand field unifies glove pressure, geometry-derived human contact, and robot fingertip deformation from six datasets and three embodiments, while source-aware masks preserve valid targets. During training, an EMA teacher observes synchronized ego and wrist views and distills hand-local representations and tactile predictions into a student that uses only ego video and estimated pose at inference. Compact past-clip memory supplies temporal context. We evaluate on EgoTouch, zero-shot FPHA transfer, and 860 synchronized glove recordings. The model transfers to bare-hand contact and produces qualitatively coherent tactile responses across bare-hand, gloved-hand, and robot embodiments. On measured recordings, it improves temporal accuracy by 5.38 points and Volumetric IoU by 5.02 points under a shared protocol. These results show that heterogeneous human--robot supervision and privileged training views can turn egocentric video into dense tactile annotations.
54. 【2611.09123】Look Closer, Align Better: Explicit Visual Attributes for Robust EEG-to-Image Decoding
链接：https://arxiv.org/abs/2611.09123
作者：Ke Xiao,Banghua Yang,Wenbin Guo,Fenqi Rong
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：commonly aligns neural, aligns neural responses, pretrained vision encoders, retrieval commonly aligns, vision encoders
备注：
点击查看摘要
Abstract:EEG-to-image retrieval commonly aligns neural responses with representations from pretrained vision encoders. However, these representations may underrepresent fine-grained visual details needed to distinguish semantically similar images. To address this limitation, we first investigate the EEG decodability and complementary predictive value of explicit visual attributes, identifying visual cues that capture EEG-relevant information beyond pretrained representations. Building on these findings, we propose AttrEcho, a framework that enriches pretrained visual representations with complementary, spatially aligned visual attributes. Specifically, Region-Aligned Visual Attribute Fusion (RAVF) integrates EEG-relevant local visual attributes with spatially corresponding pretrained features through a learnable signed residual gate. We further employ Feature Token Aggregation (FTA), which learns dimension-specific weights across regions to aggregate refined visual features for contrastive alignment with EEG representations. Experiments on THINGS-EEG demonstrate that AttrEcho achieves 94.8% Top-1 and 99.7% Top-5 accuracy in intra-subject 200-way retrieval, while maintaining 82.1% Top-1 accuracy as the gallery expands to 1,600 images with same-concept distractors. AttrEcho also achieves 25.3% Top-1 and 53.0% Top-5 accuracy in inter-subject retrieval. These results highlight the importance of EEG-relevant visual attributes and spatially aligned fusion for fine-grained EEG-to-image retrieval.
55. 【2611.09121】CoMET: Tracking the Shared Pose Error of Roadside Messages for Asynchronous Vehicle-Infrastructure Cooperative 3D Detection
链接：https://arxiv.org/abs/2611.09121
作者：Shuwei Sun,Jian Huang,Hui Cao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：detect vehicles hidden, pose error shifts, error shifts, Common-Mode Error Tracking, CoMET
备注： 25 pages, 4 figures. Code and experimental results archived at [this https URL](https://doi.org/10.5281/zenodo.23999418)
点击查看摘要
Abstract:A roadside sensor can detect vehicles hidden from the ego vehicle, but a pose error shifts every detection in the same message. We study asynchronous vehicle-infrastructure cooperative 3D detection on V2X-Seq using only information available at decision time, without ground truth, future frames, or per-pair calibration offsets at inference. Objects seen by both sensors reveal the shared translation, but even at zero added delay, 38% of validation messages have no matched pair. We propose CoMET (Common-Mode Error Tracking), which estimates this translation over time. At each message arrival, CoMET matches vehicle and roadside detections, estimates the offset from mutually nearest pairs, and updates a Kalman filter for that sender. When no pair matches, the filter carries its estimate forward. The correction applies to all roadside boxes, including those unseen by the ego vehicle. The estimator has no learned parameters; a separate frozen head ranks the merged detections. Across four delays from 0 to 400 ms on 21 validation sequences, CoMET averages 66.63 bird's-eye-view AP at IoU 0.7, compared with 63.18 for the same late fusion using uncorrected online poses and 62.96 for the best intermediate-fusion baseline. Across five detectors from three architectures, CoMET gains 2.2 to 3.5 AP points over online poses and 0.3 to 0.6 over estimating the offset from the current message alone. We find that the benchmark uses a zero offset as a placeholder in 28% of validation messages and that its offset search reaches the boundary in 45% of the rest. These offsets affect the labels for objects seen only from the roadside. Under two alternative label references, CoMET improves on uncorrected online poses in every evaluated population. Retraining intermediate fusion with CoMET poses and corrected labels improves detection on all three architectures tested, with statistically significant gains on two.
56. 【2611.09120】Finite-sample Calibration Guarantees for Binary Segmentation
链接：https://arxiv.org/abs/2611.09120
作者：Bruno Viti,Martin Holler
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Machine learning based, Machine learning, true underlying probability, learning based segmentation, frequently miscalibrated
备注： Published in Transactions on Machine Learning Research 10/2026
点击查看摘要
Abstract:Machine learning based segmentation models are frequently miscalibrated, producing for each pixel a label prediction whose associated confidence does not accurately reflect the true underlying probability. This limitation is particularly critical in high-stakes applications such as medical image segmentation. Although several calibration methods have been proposed, only a small subset of them provides theoretical guarantees on the calibration error, i.e., they do not typically ensure that, with high probability, the model exhibits a low calibration error. In this work, we develop a post-hoc calibration method for which formal calibration guarantees can be established. To achieve this, we derive from standard concentration inequalities an improved theoretical bound that explicitly accounts for the spatial dependence inherent in binary segmentation outputs. We empirically demonstrate that the proposed calibrator satisfies the derived guarantee and outperforms existing post-hoc calibration approaches.
57. 【2611.09117】PathXAI: Evidence-guided structured pathology reporting by transferable tissue segmentation
链接：https://arxiv.org/abs/2611.09117
作者：Zhaorui Tan,Jun Aun Tan,Weixiang Zhong,Xiaoxi Wang,Tan Pan,Xingdong Xue,Li Liu,Jing Zhang,Jing Zhang,Weimiao Yu
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Pathology reporting requires, supporting morphological descriptions, reporting requires translating, Pathology reporting, requires translating tissue
备注： More experimental results will be added in the future version
点击查看摘要
Abstract:Pathology reporting requires translating tissue observations across regions and slides into specific diagnoses and supporting morphological descriptions. However, the use of explicit tissue-composition measurements to guide HE-based report generation remains underexplored. Thus, we developed PathXAI, which combines segmentation-derived tissue information with HE images and optional domain knowledge to guide diagnostic reasoning, targeted reinspection and structured report writing. Its segmentation component exceeded baselines in mean Dice on internal and external tests. In automated report evaluation on 1,200 public and 151 private cases, PathXAI achieved higher agreement with reference diagnoses and documented morphology than the HE-based comparators. On the public evaluation cohort, PathXAI-Report exceeded Qwen + HE in cancer family match rate by 4.4 percentage points and in finding F1 by 5.7 percentage points. PathXAI generates evidence-linked reports with a self-hosted pretrained vision-language model, without updating its weights.
58. 【2611.09100】BayesCrop: Real-Time Probabilistic Multi-Crop Video Reframing
链接：https://arxiv.org/abs/2611.09100
作者：Cheng-Han Lee,Rajesh Sureddi,Neil Birkbeck,Yilin Wang,Balu Adsumilli,Alan Bovik
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：heterogeneous display formats, adapting landscape content, Automatic video reframing, Automatic video, display formats
备注： This paper is accepted by WACV 2027. We plan to publicly release the source code at [this https URL](https://github.com/steven413d/BayesCrop)
点击查看摘要
Abstract:Automatic video reframing is increasingly important for adapting landscape content to heterogeneous display formats. Existing methods typically predict a single deterministic crop, despite the subjective nature of reframing and the presence of multiple plausible regions of interest. We present \textbf{BayesCrop}, a real-time probabilistic framework for multi-crop video reframing. BayesCrop represents crop preferences using a two-component spatially isotropic Gaussian mixture over crop position and scale. Each component defines a representative reframing mode together with its local uncertainty, enabling both dual-view prediction and sampling of additional plausible crop candidates. For efficient video processing, we introduce an anchor-and-propagate strategy that performs neural prediction only on sparse anchor frames and propagates crop trajectories using motion vectors available from the compressed video bitstream. The resulting trajectories can be combined into a single output using a lightweight periodic view-switching strategy. Experiments on LIVE-YT-MC, LIVE-YT-VC++, and a multi-target long-video benchmark demonstrate competitive single-output localization, high multi-crop reference coverage, diverse yet coherent crop hypotheses, and stable perceptual quality. BayesCrop achieves real-time throughput of 112 FPS at the default operating point, while sampling from the learned distributions further improves reference coverage beyond the two representative crop means.
59. 【2611.09096】rajectory Forcing: Exploiting Diffusion Trajectories for Autoregressive Long Video Generation
链接：https://arxiv.org/abs/2611.09096
作者：Bohan Wang,Shuo Chen,Yunzhi Li,Zhaozheng Chen,Junzhe Zhang,Hanwang Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：fixed-length video diffusion, modeling is arguably, extend a fixed-length, video diffusion model, Autoregressive
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:Autoregressive (AR) modeling is arguably the only way to extend a fixed-length video diffusion model to longer or even streaming videos. However, existing AR diffusion methods use only the previously predicted chunk as context for the next, discarding the intermediate predictions that constitute the chunk's generation history. In contrast, conventional AR models such as LLMs condition on the entire history of preceding tokens. To this end, we propose Trajectory Forcing (TraF), an AR diffusion method that exploits the denoising trajectories of previous video chunks as context. TraF operates under two training regimes: (1) with ground-truth videos, where pseudo-trajectories are constructed from Gaussian interpolations and re-predicted by the model, and (2) with a teacher model, where real trajectories are obtained from the student's own denoising rollout. The first regime naturally provides a strong initialization for the second. On the 5-second VBench benchmark, TraF achieves a Total score of 85.15, outperforming Self Forcing (+0.84) and Causal Forcing (+1.11), with Quality and Semantic improving simultaneously. On 30-second generation---6$\times$ the training horizon---TraF achieves the highest overall quality among all compared methods.
60. 【2611.09092】AdaAlloc: Adaptive Visual Token Allocation for Long-Video Question Answering
链接：https://arxiv.org/abs/2611.09092
作者：Joungbin An,Kristen Grauman
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：question answering forces, answering forces multimodal, forces multimodal large, multimodal large language, large language models
备注： Accepted to NeurIPS 2026. Project page: [this https URL](https://vision.cs.utexas.edu/projects/adaalloc)
点击查看摘要
Abstract:Long-video question answering forces multimodal large language models to reason under strict visual-token budgets, creating a tradeoff between broad temporal coverage and fine-grained spatial detail. Uniform sampling preserves coverage but often obscures decisive local cues, while caption-based or frame-similarity retrieval operates over lossy proxies that can miss motion, state changes, and before-after relations. We recast long-video reasoning as a visual-token allocation problem: given a fixed budget, decide how much to spend on global context versus high-resolution local evidence, and where in the video to draw that local evidence from. We introduce AdaAlloc, a training-free inference framework that adaptively allocates visual tokens between a global video overview and localized visual detail. AdaAlloc first plans a global/local allocation policy, then uses temporal grounding to locate candidate evidence segments and refines them into a compact temporal memory. The selected policy controls both frame sampling density and resolution, combining sparse, lower-resolution global frames with denser, higher-resolution local frames drawn from the refined memory. The final answerer reasons over the allocated global context and refined local evidence. Across LVBench, MLVU, VideoMME, and LongVideoBench, AdaAlloc improves over budget-matched uniform sampling by up to 10.5 percentage points and outperforms the compared frame-selection and agentic methods on their reported benchmarks.
61. 【2611.09089】EventHOI: Event-Driven Resource-Efficient Hand-Object Interaction Logging on Smartglasses
链接：https://arxiv.org/abs/2611.09089
作者：Le Zhang,Kailai Cui,Hao Chen,Vlad Roznyatovskiy,Jianzhong Zhang,Anhong Guo,Kang G. Shin,Ke Sun
类目：Distributed, Parallel, and Cluster Computing (cs.DC); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)
关键词：people manipulate objects, Hand-object interactions, learn how people, people manipulate, manipulate objects
备注： 15 pages, 21 figures, 3 tables
点击查看摘要
Abstract:Hand-object interactions (HOIs) can be captured by smartglasses to learn how people manipulate objects in daily life. Automatic logging of these interactions from an egocentric perspective provides time-stamped evidence of daily actions for applications like memory assistance. However, continuous RGB capture and wireless transmission exceed the energy and bandwidth budgets of smartglasses. We present EventHOI, an event-driven sensing and compression system that couples selective RGB capture with HOI-aware encoding to enable egocentric logging over Bluetooth Low Energy (BLE) while preserving downstream HOI logging performance. Our key insight is to use low-power event sensing both to determine when RGB capture is needed and to identify where visual detail must be preserved. A lightweight IMU-based egomotion cancellation pipeline suppresses egomotion-induced events so that residual HOI motion can guide RGB triggering and spatial compression. We build a smartglasses prototype and conduct an end-to-end evaluation of EventHOI on a 50-hour egocentric benchmark with 97 subjects and a 20-hour real-world dataset we collect from 10 participants, together covering a broad range of daily-life scenarios and environments. Compared to RGB-only baselines, EventHOI reduces always-on backend power consumption by 5.8-10.4x and uplink bandwidth by 2.9x, with minimal HOI recognition accuracy loss. The resulting RGB uplink of less than 130 kbps fits within commodity BLE bandwidth budgets, making stable BLE video streaming feasible for egocentric HOI logging. Demo video and project website: this https URL
62. 【2611.09084】raining-Free Active Test-Time Adaptation for Vision-Language Models
链接：https://arxiv.org/abs/2611.09084
作者：Jihwan Bang,Sumyeong Ahn,Hwanjun Song,Jae-Gil Lee
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：fully unsupervised regime, confidence scores, relies on pseudo-labels, Active Test-time Adaptation, fully unsupervised
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:Test-time adaptation (TTA) for vision-language models (VLMs) is usually studied in a fully unsupervised regime, where adaptation relies on pseudo-labels, confidence scores, or entropy computed by the model itself. This is a severe restriction on hard shifted samples: the model is asked to repair its own uncertain predictions without any external evidence. At the other extreme, supervised online adaptation assumes labels can directly train or correct the model. We study the intermediate deployment regime between these two extremes. In Active Test-time Adaptation for VLMs (Active VLM-TTA), a pretrained VLM may spend an explicit labeling budget on selected test samples, but the prediction for the current sample must be emitted before its label can be used; queried labels are therefore costed, delayed evidence for future samples rather than free correction for the present one. Under this future-only constraint, the central question is how to reuse sparse labels conservatively. We instantiate this setting with ACTive VLM-TTA for Online Retrieval (ACTOR), a training-free plug-in module that routes uncertain samples among base prediction, label query, and memory-based correction using a consistency-and-reliability check over previously queried labels. Across ten cross-domain benchmarks and a domain-transfer benchmark based on ImageNet, ACTOR consistently improves strong VLM-TTA baselines on ResNet and ViT backbones with negligible inference overhead. Our implementation is publicly available at this https URL.
63. 【2611.09077】GlobalPuzzle: Globally Informed Genetic Search for Eroded Jigsaw Puzzle Reassembly
链接：https://arxiv.org/abs/2611.09077
作者：Lunyan Wang,Chuanzhi Xu,Ziyuan Tao,Weidong Cai
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：highly challenging task, Jigsaw puzzle reassembly, challenging task, cultural artifacts, puzzle reassembly remains
备注： 22 pages (10 pages main paper and 12 pages supplementary material), 16 figures
点击查看摘要
Abstract:Jigsaw puzzle reassembly remains a highly challenging task, particularly when piece boundaries are irregularly eroded to simulate damage to cultural artifacts. On the GAP benchmark, existing methods achieve a perfect assembly accuracy of only 0.3% on $5 \times 5$ puzzles, whereas humans can solve jigsaw puzzles with remarkably high accuracy. Humans typically approach puzzle solving by identifying potentially adjacent pieces, evaluating the current assembly, and iteratively performing complex operations such as adding pieces, replacing incorrectly placed pieces, and moving entire connected groups of pieces. However, existing methods face a fundamental limitation: approaches that leverage global visual information typically predict piece arrangements directly, making it difficult to explicitly perform such complex iterative operations, while search based methods can rearrange pieces but primarily rely on pairwise boundary compatibility, lacking global visual information to evaluate and guide the search process. To bridge this gap, we propose GlobalPuzzle, a jigsaw puzzle reassembly framework that integrates global canvas level evaluation, action guidance, and genetic search. By incorporating global visual information into the evaluation and optimization of candidate assemblies, GlobalPuzzle aims to resolve ambiguous adjacency relationships that are difficult to determine from irregularly eroded piece boundaries alone, enabling flexible, globally informed reconstruction.
64. 【2611.09074】Emo-LiveSync: Real-Time Universal Lip Synchronization with Explicit Emotion Control
链接：https://arxiv.org/abs/2611.09074
作者：Sangjoon Yu,Seungeun Lee,JoonHeyok Shin,Ji-Su Kang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：generating realistic lip, realistic lip movements, lip movements synchronized, Lip synchronization, realistic lip
备注： Accepted to BMVC 2026, 23 pages, 16 figures
点击查看摘要
Abstract:Lip synchronization, the task of generating realistic lip movements synchronized with audio signals, is fundamental to applications such as film dubbing, virtual avatars, and digital content creation. Recent GAN-based methods offer computational efficiency but often lack visual fidelity, while diffusion-based approaches achieve high-quality results at the cost of substantial computational overhead. Moreover, most existing methods are limited to photo-realistic human faces, restricting their applicability to stylized characters and non-human entities. In this paper, we propose an efficient universal lip-sync video generation framework that achieves high-quality results without compromising computational efficiency. We build on LivePortrait, a warp-based portrait animation model, and introduce a training strategy that aligns audio signals to an implicit motion space by distilling knowledge from a pre-trained video-to-motion model. This enables real-time inference while maintaining high visual fidelity, and naturally generalizes to diverse stylistic characters beyond photo-realistic humans. Furthermore, we introduce an expressive control gate that enables explicit manipulation of emotional expressions for content enrichment. Extensive experiments demonstrate that our method achieves state-of-the-art performance in both visual quality and lip-sync accuracy while ensuring real-time inference.
65. 【2611.09069】UniRGBA: Unifying RGB and Alpha in Pretrained Video Diffusion Models
链接：https://arxiv.org/abs/2611.09069
作者：Lei Xu,Zhuo Li,Yongyi Jin,Aoyu Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：achieved remarkable photorealistic, photorealistic RGB synthesis, remarkable photorealistic RGB, Recent advances, open challenge
备注：
点击查看摘要
Abstract:Recent advances in video diffusion models have achieved remarkable photorealistic RGB synthesis, yet generating videos with a native alpha channel remains an open challenge. Existing approaches often rely on matting-style data and non-native RGBA designs, causing them to specialize in real-object scenes and to degrade severely on visual-effect content whose semi-transparency is spatially non-local and non-elliptical. We present UniRGBA, a unified framework whose key insight is that RGBA generation does not require a dedicated alpha encoder or complex latent-space restructuring---a minimal, targeted extension of the existing RGB pathway is sufficient. UniRGBA-VAE extends a causal video VAE to 4-channel RGBA via zero-initialized channel expansion, symmetric selective layer unfreezing (5% trainable), and a six-term progressive reconstruction loss anchored by a KL reference loss that prevents latent drift, followed by a two-stage schedule that introduces a lightweight GAN objective. We then apply standard DoRA to the pretrained DiT, reusing the unified 4-channel latent without any alpha-specific architectural changes. On a visual-effect RGBA benchmark, UniRGBA substantially outperforms Wan-Alpha on RGBA reconstruction while preserving RGB fidelity. For generation, UniRGBA outperforms Wan-Alpha on RGBA text-to-video tasks and matches or surpasses the original pretrained Wan2.1 backbone on RGB-only metrics, demonstrating that native alpha support can be integrated without compromising the underlying RGB prior or the model's architectural versatility.
66. 【2611.09058】ProtoCouncil: Multi-Encoder Anatomical Prototypes for Prostate Cancer Detection in Micro-Ultrasound
链接：https://arxiv.org/abs/2611.09058
作者：Mohammad Mahdi Abootorabi,Nooshin Maghsoodi,Armin Saadat,Obed Dzikunu,Zhuoxin Guo,Hannes Cash,Ferdinand Luger,Adam Kinnaird,Brian Wodlinger,Parvin Mousavi,Purang Abolmaesumi
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：identifying suspicious tissue, suspicious tissue depends, tissue depends heavily, prostate cancer, promising modality
备注： 12 pages, 3 figures, Under Review
点击查看摘要
Abstract:Purpose: Micro-ultrasound ($\mu$US) is a promising modality for prostate cancer (PCa) detection, but identifying suspicious tissue depends heavily on clinical experience. Models trained on sparse, noisy core-level pathology offer little insight into their decisions and can fail under domain shift. Clinical use needs a traceable decision process and a flag for uncertain predictions. Methods: We introduce ProtoCouncil, in which three foundation encoders (MedSAM, DINOv3 and V-JEPA 2.1) learn case-based prototypes at three anatomical levels: whole gland, needle track and gland sectors. Prototypes are projected onto real training-core regions, and label-free fusion keeps every class logit as a bias plus an exact sum of prototype similarity contributions. Encoder disagreement triggers selective prediction. Results: In five-fold patient-level cross-validation (6,588 cores, 693 patients), ProtoCouncil reaches 82.9% AUROC for clinically significant PCa (csPCa, Grade Group $\geq$3), 4.3 points above the best previously published method. In zero-shot evaluation on two external cohorts, ProtoCouncil achieves higher all-cancer and csPCa AUROC than all previous methods. Nearest same-class exemplars match test-core tumor involvement better than random same-class cases. Externally, csPCa accuracy falls from 79% when encoders agree to 27% when two oppose the fused call. Abstaining on disagreement raises balanced accuracy by 7 and 15 points, while retaining 58% and 54% of the cores. Conclusion: ProtoCouncil grounds core-level predictions in exact similarity-based evidence from real, anatomically indexed training cases, which makes its reasoning interpretable. It achieves the highest csPCa AUROC across three cohorts and identifies unreliable predictions through encoder disagreement.
Comments:
12 pages, 3 figures, Under Review
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
Cite as:
arXiv:2611.09058 [cs.CV]
(or
arXiv:2611.09058v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2611.09058
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Mohammad Mahdi Abootorabi [view email] [v1]
Fri, 6 Nov 2026 06:33:28 UTC (3,995 KB)
67. 【2611.09055】OmniLatent: Unified Latent for 3D Part Modeling
链接：https://arxiv.org/abs/2611.09055
作者：Yunhan Yang,Yunfei Zhao,Zeqiang Lai,Jiachen Xu,Minxiu Wang,Xintong Han,Xiangyu Yue,Xihui Liu,Chunchao Guo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：limited part-level annotations, existing workflows typically, workflows typically segment, editable asset creation, post-processing step
备注：
点击查看摘要
Abstract:3D part decomposition is a central capability for editable asset creation, yet existing workflows typically segment a completed mesh as a post-processing step, making the result sensitive to geometric artifacts, texture ambiguity, and limited part-level annotations. We present OmniLatent, a unified latent modeling framework for 3D part decomposition. Instead of predicting part labels in isolation, OmniLatent learns a shared latent space that jointly encodes geometry, deformation, appearance, and binary part IDs, allowing data-rich geometric and visual priors to support data-scarce part learning. Given a single input image, the base model generates geometry, deformation, texture, and surface part IDs in one pass, producing a part-aware 3D asset without a separate segmentation stage. We further tune the pretrained model for two extensions: a point-prompt adapter that maps arbitrary 3D point prompts with binary part IDs into latent tokens for full segmentation, refinement, and part subdivision, and an amodal part completion model that completes partial surface masks into a coherent full-object decomposition through dynamic per-part token allocation, cross-attention to the given geometry latent, and alternating part-local and global attention. Extensive experiments show that OmniLatent produces semantically meaningful part segmentations with precise boundaries, supports interactive part editing, and completes partial part observations while preserving global object consistency.
68. 【2611.09047】Grounding-Aware Judge Reward Reinforcement Learning for Out-of-Domain Face Anti-Spoofing
链接：https://arxiv.org/abs/2611.09047
作者：Xiaoyong Yu,Xinge Yu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：distinguish genuine faces, Multimodal Large Language, Face Anti-Spoofing, Large Language Model, genuine faces
备注：
点击查看摘要
Abstract:Face Anti-Spoofing (FAS) must distinguish genuine faces from presentation attacks. A unified Multimodal Large Language Model (MLLM) is an attractive solution: it detects physical attacks (print, replay, mask) in one model and produces interpretable forensic evidence via Chain-of-Thought (CoT). A central obstacle to post-training such a model with reinforcement learning is that FAS reasoning has no rule-verifiable ground truth: only the binary verdict is checkable, while the reasoning chain cannot be verified by any hand-crafted rule. Optimizing the verdict alone is therefore a sparse, hackable signal. The model can reach the correct answer through a shortcut such as a false-rejection bias, which does not generalize. We address this with a grounding-aware judge reward. A 32B vision-language judge scores each reasoning chain against the image on evidence anchoring, logical coherence, and domain knowledge, turning the image itself into the verification signal. The reward is applied in a Group Relative Policy Optimization (GRPO) stage after CoT supervised fine-tuning. It is the judge, rather than the RL objective, that supplies the process supervision a verdict-only reward cannot. Our study starts from a model that already performs well In-Domain (ID) after CoT-based supervised fine-tuning and asks how to improve its Out-of-Domain (OOD) generalization. We find that grounding-aware rewards are an effective means to that end. We validate the method on OOD generalization, where the reward reduces ACER on two physical benchmarks (LCC-FASD 0.288 to 0.273, MSU-MFSD 0.431 to 0.409) while preserving ID accuracy (CelebA-Spoof 0.033 to 0.035). Against ResNet-50/101 and CLIP-ViT-B/16 baselines, the MLLM dominates ID and matches or surpasses the strongest baseline OOD. To our knowledge this is the first use of LLM-as-judge process supervision for FAS.
69. 【2611.09041】DobotTrack: Target-Grounded Vision-Language-Action Learning for Embodied Person Tracking
链接：https://arxiv.org/abs/2611.09041
作者：Shengjun Deng,Yinghan Zhang,Chengrui Wei,Liu Liang,Songyuan Liu,Pengkun Zheng,Yajun Zheng,Ying Zhang,Yuan Tian,Xi Li,Teng Wang
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Language-guided embodied person, Language-guided embodied, egocentric observations, requires a mobile, mobile agent
备注：
点击查看摘要
Abstract:Language-guided embodied person tracking requires a mobile agent to identify a target from a referring description and consistently follow the target under egocentric observations. We present DobotTrack, a target-grounded vision-language-action (VLA) framework that integrates auxiliary grounding supervision with efficient temporal modeling. We systematically investigate five auxiliary tasks---person segmentation, bounding-box grounding, visual-spatial classification (VSC), future DINO feature prediction, and future-frame prediction---and adopt complementary mask and bounding-box supervision to enhance target delineation and localization. We introduce Q-identity, a target-conditioned historical visual compression module that leverages target-grounding predictions to selectively preserve identity-discriminative appearance features and spatial cues in compact historical tokens. On EVT-Bench, our 0.8B-parameter model achieves an average success rate of 77.9%, exceeding OmTrackVLA by 16.9 percentage points across the three tasks. We further construct a real-world person-tracking dataset collected using a quadruped robot, comprising 126 episodes and 596,323 mask-annotated frames. The target masks enable automatic derivation of bounding boxes and visual-spatial labels encoding horizontal position and apparent image scale, providing additional grounding supervision without separate manual annotation of these labels. Together, our framework and annotation pipeline support learning target-grounded tracking policies from simulated and real-world data. Code is available at this https URL.
70. 【2611.09017】Frontier3DBench: Benchmarking Coding Agents for 3D Creation across Objects, Scenes, and Interactive Open Worlds
链接：https://arxiv.org/abs/2611.09017
作者：Xinjie Lin,Qingle Liu,Wenyi Li,John Lam,Xiaoqiu Wang,Deyao Hong,Mingju Gao,Zheng Jiang,Yizhe Chi,Youjie Zheng,Calvin Xiao,Kaisen Yang,Huan-ang Gao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：combine visual understanding, route to automated, Coding agents combine, program execution, agents combine visual
备注： 19 pages, 7 figures, 4 tables. Project page: [this https URL](https://lab.einsia.ai/frontier3dbench)
点击查看摘要
Abstract:Coding agents combine visual understanding with program execution, offering a new route to automated 3D creation. By translating images and instructions into editable programs, they bring reconstruction, generation, and editing into a shared workflow. Yet existing benchmarks fragment evaluation across task scopes and protocols, leaving their capabilities across construction levels unclear. We propose Frontier3DBench, a unified benchmark of 145 tasks across 9 categories spanning object, scene, and interactive open-world creation, with joint evaluation of appearance, structure, and behavior. Experiments with 11 model-harness configurations reveal strengths that vary by level: GPT-6.1-sol leads the object and scene levels and achieves the highest overall score of 66.02/100, whereas GPT-6-astra leads interactive world construction. However, all configurations score lower on reference reconstruction than on text-driven generation in object and scene tasks. Producing plausible content thus remains easier than reproducing specified geometry, layouts, and visual details. Moreover, generated worlds average 83.08/100 on local mechanisms but only 20.82 on motion clearance and 30.26 on stateful workflows: individual mechanisms often function, whereas complete activities that require coordinated actions and persistent state remain difficult. These results identify reference fidelity and coordinated activity completion as central bottlenecks for coding agents in 3D creation.
71. 【2611.09014】Did I See It or Think It? Probing Reality Monitoring in Vision-Language Models with Concept Injection
链接：https://arxiv.org/abs/2611.09014
作者：Tina Khezresmaeilzadeh,Seyedarmin Azizi,Mehdi Kamal,Massoud Pedram
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Recent work tests, Recent work, work tests, tests whether language, introspect by injecting
备注：
点击查看摘要
Abstract:Recent work tests whether language models can introspect by injecting a concept direction into their activations and asking whether they notice it and can name it. These studies are text-only. Vision-language models (VLMs) face an additional problem, known in cognitive psychology as reality monitoring: they must keep internally generated content separate from what they actually see. We therefore ask: can VLMs distinguish injected concepts from image content? We introduce a paradigm that varies the image and the injected concept independently. On each trial, the model reports what it sees, whether a thought was injected, and what that thought is. This design scores both whether the model identifies the concept and which source it assigns to it. Across six VLMs, only Gemma-3-27B reliably identifies injected concepts (35% vs. 3% for steering alone), with almost no false alarms. Even then, the source it reports is fragile. Strong or visual-pathway injections are reported as seen, and a visible object nearly eliminates correct thought reports. The same failure appears in ordinary captioning, where injected objects appear in up to 87% of captions of real photographs. Evaluating multimodal self-reports therefore requires checking both their content and their reported source.
72. 【2611.08998】Seeing vs. Counting: Complexity Twins Show Where Multimodal LLMs Fail on Diagrams
链接：https://arxiv.org/abs/2611.08998
作者：Yin Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：multimodal LLM miscounts, multimodal LLM, LLM miscounts, LLM, Existing visual graph
备注： 8 pages main text + 96 pages appendix (107 pages in total, including references)
点击查看摘要
Abstract:When a multimodal LLM miscounts in a diagram, does it fail at seeing or at counting? Existing visual graph and puzzle benchmarks vary visual density and algorithmic hardness together, confounding the two. We pair counting questions about the same drawing that sit in different counting-complexity classes, such as its spanning trees (a determinant) and its simple paths (#P-complete), and use a transcription probe and a text-only control to separate reading from computing. We test Gemini, Gemma and Qwen3-VL models; for the Gemini models, the answer depends on how the model computes. In chain of thought, most of them read small drawings correctly and then fail at counting, at a rate set far more by the size of the answer than by its complexity class (for the primary model, the odds of an exact answer fall 2.38-fold per decade of the answer). Given code and an exact transcription, the primary model counts correctly even on 10x10 grids, and reading becomes the bottleneck: a single view misses horizontal edges, and a second reading of a rotated copy with crop checks reads 86/96 large grids exactly, against 57/96 when the upright reading is simply repeated.
73. 【2611.08996】UniMore: Fine-Grained Supervision for Unified Understanding and Generation
链接：https://arxiv.org/abs/2611.08996
作者：Haoyue Bai,Yinyi Luo,Yicheng He,Qingsong Wen,Sharon Li,Jindong Wang
类目：Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV)
关键词：Unified multimodal models, multimodal models combine, creating an opportunity, pretrained unified model, unified model
备注：
点击查看摘要
Abstract:Unified multimodal models combine image understanding and generation within one system, creating an opportunity to improve both capabilities through paired image--text supervision. We examine the outputs of a pretrained unified model in both directions and observe a loss of specificity: generated images can contain the requested objects with incorrect attributes, while captions identify a scene without expressing its distinguishing details. These failures call for supervision that specifies both the visual content to realize and the descriptive differences to distinguish. We propose UniMore, a post-training method that derives these complementary learning tasks from the fine-grained content of image--text pairs. The generation route predicts grounded crops from their corresponding phrases, matching the scope of the condition and visual target while using the native visual objective. The understanding route combines positive-caption fitting with ranking against captions that omit or alter details, conditioned on the full image. The two routes are optimized independently, and their learned updates are combined into a single unified model without changing its inference procedure. Experiments show gains across multiple understanding and generation benchmarks.
74. 【2611.08989】LEF-JEPA: Denoising-Trained Latent Energy Fields for Spatial Representation Learning
链接：https://arxiv.org/abs/2611.08989
作者：Zhiyuan Liu,Zhihao Xu,Sicheng Liu,Huanhuan Huang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：joint-embedding predictive architecture, masked positions struggles, capture object shapes, predictive architecture, joint-embedding predictive
备注： 14 pages, 7 figures, 7 tables. Includes supplementary material
点击查看摘要
Abstract:A joint-embedding predictive architecture (JEPA) that applies prediction supervision only at masked positions struggles to clearly capture object shapes and boundaries in its latent representations. We further observe that some existing methods improve spatial structure while also retaining rich variations in texture and color. However, preserving more low-level visual information does not necessarily make representations better suited to prediction and action. This raises a key question: how can we strengthen the spatial structure in latent representations that supports prediction and action without over-encoding these details? We introduce LEF-JEPA, which learns spatial structure through target-guided latent recovery and transfers this supervision to the visual encoder through a relative-energy constraint; the energy module is used only during pretraining and adds no inference overhead. To reduce the cost of energy optimization during pretraining, we further construct a conditional Ising Hamiltonian that allows low-energy-state search to be performed by specialized Ising solvers. On physical hardware, we validate the feasibility of achieving lower forward latency with fewer local updates. Under a unified CIFAR-10 pretraining and frozen-encoder evaluation protocol, both realizations outperform V-JEPA2.1 in image classification, foreground segmentation, and visual planning.
75. 【2611.08976】Refer-CityFlow and M3Track: A Benchmark Dataset and Reference Framework for Language-Driven Multi-Target Multi-Camera Tracking
链接：https://arxiv.org/abs/2611.08976
作者：Phuong T. Nguyen,Hao Vo,Tam Bang,Hoang K. Tran,Hoang-Minh Dau,Mahshid Malazizi,Tuan-Anh Hoang,Mina Sartipi,Thanh-Nam Doan,Ngan Le,Hoang H. Nguyen
类目：Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：multi-object tracking enables, tracking enables users, Referring multi-object tracking, existing Refer-MOT benchmarks, Refer-MOT benchmarks primarily
备注： Accepted for publication at the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV 2027), Evaluations and Datasets Track. 10 pages, 4 figures, 7 tables
点击查看摘要
Abstract:Referring multi-object tracking enables users to specify targets through natural language, but existing Refer-MOT benchmarks primarily focus on single-camera settings. We formalize Referring Multi-Target Multi-Camera Tracking (Refer-MTMCT), where free-form queries specify identity-consistent trajectories to be recovered across a network of sequential, sparse-overlap cameras. We introduce Refer-CityFlow, a benchmark built on CityFlow's global cross-camera identity annotations and augmented with language queries requiring joint language grounding, cross-camera association, and spatio-temporal reasoning. Refer-CityFlow covers 96 videos from 40 roadside cameras with 660+ identity-consistent cross-camera trajectories, 4,362 trajectory-level descriptions, and 7,699 queries, including 1,699 real-user queries collected from 50 participants. Reference experiments on the four-camera Scenario 02 show that single-camera referring trackers reach 14.95-18.28 HOTA on real-user queries, while the evaluated cross-view method achieves about 0.05 HOTA in direct transfer. To establish reference performance, we provide M3Track, a modular multimodal reference framework in which a large language model (LLM)-based agent orchestrates interchangeable detection, tracking, and cross-camera association modules. M3Track reaches 44.10 HOTA and 65.40 IDF1 on the same real-user query set. The project repository is available at this https URL.
76. 【2611.08962】Region-aware error triage for medical image segmentation with groupwise conformal risk control
链接：https://arxiv.org/abs/2611.08962
作者：Nishi Kanta Paul,Md Shihabul Islam Shovo,Hoileong Lee
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：increasingly reviewed, requires knowing, segmentation mask unchanged, Segmentation masks, segmentation mask
备注： 22 pages, 7 figures, 12 tables. Submitted to Biomedical Signal Processing and Control (BSPC)
点击查看摘要
Abstract:Segmentation masks are increasingly reviewed rather than redrawn, which requires knowing where a mask is likely wrong. Learned error maps rank pixels by risk, but the number of pixels to warn is chosen ad hoc, and calibrating one warning threshold over all error pixels may leave errors far from the predicted contour under-flagged. We propose RACE-Triage, a post-hoc error triage framework that leaves the segmentation mask unchanged. A risk network is trained on out-of-fold predictions from backbone-independent inputs. The predicted contour partitions each image into a boundary band and a non-boundary region, and conformal risk control is applied separately in each region to bound the expected fraction of missed errors among cases with errors there. On ISIC 2018 dermoscopy and BUSI breast ultrasound (where patient identifiers are unavailable, so independence across images is assumed), pooled control met its overall target but missed on average 31.8% and 36.4% of non-boundary errors. Regional control reduced these fractions to 19.3% and 20.9% and raised the recall of size-filtered false-negative components from 0.722 to 0.818 and from 0.611 to 0.763. The mean warned area grew by 1.6 and 4.9 percentage points, and its 95th percentile reached 23.5% and 38.5%. The effect held across three seeds and a second backbone, and area-matched heuristics did not reproduce it. On the external PH$^2$ set, frozen thresholds exceeded both targets, whereas recalibration with 100 local images brought the mean over repeated splits below them. Regional calibration improves non-boundary error coverage at a measured increase in warned area.
77. 【2611.08954】MetricPose: Flexible 3D Human Pose Estimation with Depth and Geometric Cues
链接：https://arxiv.org/abs/2611.08954
作者：Shifan Zhu,Sabad Modi,Hang Yang,Arushi Agrawal,Steven Gao,Meghan Huber,Nathan Wycoff,Donghyun Kim
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：metrically accurate human, predicts metrically accurate, accurate human joint, human joint positions, camera coordinate frame
备注： 9 pages, 3 figures, ICRA submission
点击查看摘要
Abstract:In this paper, we present a 3D human pose estimator that predicts metrically accurate human joint positions in the camera coordinate frame. This task requires recovering the configuration of the body joints, scale, and metric camera-local placement. In monocular images, body size and camera distance are coupled through perspective projection and therefore cannot be determined uniquely from image alone. This ambiguity can be reduced by combining three complementary sources of information: learned RGB priors, direct depth measurements, and geometric constraints (e.g., ground contact) from the environment. We extend a pretrained full-body estimator with optional metric depth and geometry-processing modules that improve camera-distance estimation and depth-guided body refinement while preserving RGB-only operation. The resulting unified model supports RGB, RGB-Ground, and RGB-D using shared learned parameters. Unlike pelvis-relative error, camera-local error also measures placement relative to the camera. Compared with the existing foundation model SAM 3D Body, our methods with RGB, RGB-Ground, and RGB-D modes reduce camera-local joint-position error by 12.16%, 31.00% and 54.61% respectively.
78. 【2611.08946】Flex-RSI: Benchmarking Recursive Self-Improvement of Frontier Agents
链接：https://arxiv.org/abs/2611.08946
作者：Jingdong Zhang,Jionghao Wang,Zhengming Yu,Yancheng Cai,Wei Chow,Chris Choy,Zhiyang Dou,Hang Hua,Jiachen Li,Zhixuan Liu,Chen Wang,Songlin Wei,Siyuan Yang,Yu Yuan,Xiaohang Zhan,Yucheng Zhang,Shuhong Zheng,Xin Li,Lingjie Liu,Wojciech Matusik,Zhengzhong Tu,Wenping Wang
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：Frontier language models, agent performs depends, Frontier language, increasingly deployed, performs depends
备注： Project page: [this https URL](https://flex-rsi.github.io) . Jingdong Zhang and Jionghao Wang contributed equally
点击查看摘要
Abstract:Frontier language models are increasingly deployed as agents, and how well an agent performs depends not only on its model but also on its harness: the prompts, tools, memory, and control loop through which the model acts. When an agent is applied to a new problem, a natural question is whether it can use the feedback of the task to improve the way it works, and not merely its answer. Most existing benchmarks keep the agent's harness fixed and score the solution it produces, or target large-scale model training. We introduce Flex-RSI, a benchmark for the recursive self-improvement of agents on vision and robotics tasks under a fixed budget. In each round, an executor improves the task solution, which is kept only if it scores higher on held-out validation data, and an improver then revises the harness, including the executor and itself. Every run starts from the same general-purpose harness, and the final solution is scored on hidden test data. Evaluating closed-source and open-weight models on tasks spanning perception, reasoning, robot action, 3D reconstruction, visual creation, and infrastructure, we find that self-improvement helps most when the agent builds its own solution, that feedback recording only success or failure holds back open-weight models, and that open-weight models fall furthest behind where outputs must pass strict checks of physical stability or exact correctness. Paired runs further show that editing the harness itself contributes to the gains.
79. 【2611.08943】MESAM: Enhancing SAM2 for Few-Shot Segmentation through Semantic-Visual Memory Generation and Refinement
链接：https://arxiv.org/abs/2611.08943
作者：Tianyu Zou,Shengwu Xiong,Rui Wu,Ruilin Yao,Yi Rong
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Segment Anything Model, tackle few-shot segmentation, paper investigates, leverage the powerful, powerful capabilities
备注： 17pages, 12figures
点击查看摘要
Abstract:This paper investigates how to leverage the powerful capabilities of the Segment Anything Model 2 (SAM2) to tackle few-shot segmentation (FSS) tasks. One major challenge lies in the substantial appearance differences between the support and query images, which may diminish the effectiveness of the memory-matching process in SAM2. Through systematic analysis, we find that the memory generated based on the categorical semantic information is robust to this appearance divergence and is more compatible with SAM2. Based on these observations, we propose a new Memory-Enhanced SAM2 (MESAM) method, which first introduces a Semantic-Visual Memory Generation (SVMG) module to separately construct a query semantic memory, a query foreground visual memory, and a support adaptive visual memory. Then, in our designed Interactive Semantic Memory Refinement (ISMR) module, we further enrich the obtained semantic memory with fine-grained visual details, and suppress its misatcivated background responses. Extensive experiments on the PASCAL-$5^i$, COCO-$20^i$, and LVIS-$92^i$ datasets demonstrate that MESAM consistently outperforms existing FSS methods, achieving new state-of-the-art segmentation performance. Our source code is available at: \href{this https URL}{this https URL}.
80. 【2611.08928】UAV-Based Computer Vision for Cattle Detection and Feed Bunk Spatial Analysis
链接：https://arxiv.org/abs/2611.08928
作者：Pedro Oliveira Torrente,Diego Giaretta de Paulo,Lucas Pascotti Valem,Jianglong Yan,Everton Castelão Tetila,Jayme Garcia Arnal Barbedo,Liang Zhao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Beef cattle production, faces growing demands, central to Brazilian, Brazilian agribusiness, Precision Livestock Farming
备注： 12 pages, 6 figures, 6 tables. Preprint of paper accepted in IEEE Transactions on AgriFood Electronics
点击查看摘要
Abstract:Beef cattle production is central to Brazilian agribusiness and faces growing demands for efficiency, sustainability, and animal welfare. Precision Livestock Farming (PLF) offers tools to address these challenges, particularly through monitoring feeding-related spatial patterns in confined systems. Feeding management plays a decisive role in animal performance, yet its evaluation still relies largely on subjective, labor-intensive visual inspections that are hard to scale and prone to bias. This work proposes a computer vision framework based on Unmanned Aerial Vehicles (UAVs) to quantify cattle alignment and spatial dispersion at the feed bunk under real-world feedlot conditions. A UAV dataset was collected during flight campaigns at a commercial feedlot in Mato Grosso do Sul, Brazil. Images were manually annotated into cattle head and cattle back classes to support object detection and image-level spatial analysis of cattle distribution. You Only Look Once (YOLO) models, namely YOLOv8 and YOLOv11, were evaluated, with YOLOv8 small used for the downstream spatial analysis. The feed bunk region was segmented using the Segment Anything Model (SAM), and geometric metrics based on detected head positions were developed to characterize alignment, spacing regularity, and clustering. The selected detector achieved 84.30% mAP50 and 35.50% mAP50-95, with an inference time of approximately 2.7 ms per image on an NVIDIA RTX 5060 Ti GPU. The resulting metrics distinguished representative regular and irregular spatial distributions by Root Mean Square Deviation - RMSD (1.06 m and 4.26 m), Coefficient of Variation - CV (42.70% and 96.31%), and clustering (0 and 2 clusters), respectively. These findings indicate that the proposed approach can provide indicators for assessing feed bunk spatial patterns in PLF.
81. 【2611.08923】FANO: Anchored Forward-Noise Optimization for Diffusion Inverse Problems
链接：https://arxiv.org/abs/2611.08923
作者：Shilong Han,Hongxia Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Pre-trained diffusion models, widely adopted zero-shot, annealed decoupling methods, Pre-trained diffusion, adopted zero-shot prior
备注： 26 pages, 9 figures, 8 tables. Preprint, under review
点击查看摘要
Abstract:Pre-trained diffusion models have become a widely adopted zero-shot prior for image inverse problems, among which annealed decoupling methods achieve leading reconstruction performance on nonlinear tasks. We find, however, that annealed methods that directly optimize the denoiser input $x_t$ exhibit radial drift in later layers: within-layer optimization drives the noise-component norm of $x_t$ away from its typical value, pushing the denoiser out of its high-performance regime and degrading reconstruction quality. To address this, we propose FANO (Anchored Forward-Noise Optimization). At each annealing layer, FANO fixes the previous denoiser estimate as an anchor and optimizes only the forward noise $e$, whose distribution is known, instead of $x_t$, thereby preserving the forward-diffusion structure of the denoiser input. The standard Gaussian prior on $e$ concentrates its norm near the typical value, and deviations degrade denoiser performance. We accordingly decompose $e$ in polar coordinates into a direction and a radial magnitude, and apply a soft potential to regulate the radius, keeping $x_t$ in the high-density region of the forward distribution. On multiple linear and nonlinear inverse problems, FANO matches the strongest current baselines on linear tasks and achieves consistent improvements on nonlinear tasks.
82. 【2611.08904】MotionCore: A Latent Neural Simulator for Video Generation with Rigid-Body Dynamics
链接：https://arxiv.org/abs/2611.08904
作者：Zheng Wang,Zhengwei Gong,Yuanzhi Liang,Chi Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：produce highly realistic, generating physically inconsistent, highly realistic videos, physically inconsistent object, produce highly
备注：
点击查看摘要
Abstract:Video generation models can produce highly realistic videos while generating physically inconsistent object motion. This limitation suggests that visual modeling alone may not provide a transferable representation of physical dynamics. We introduce MotionCore, a framework for learning physical dynamics via a learnable partial differential equation solver and focuses on rigid-body motion. We introduce a latent neural simulator learning to predict the evolution of object-level physical states from observed motion. Its predictions are then converted into spatially aligned latent controls for a controllable video diffusion model. The generator serves as a visual interface: it provides appearance and scene detail, while the learned dynamics model specifies the physical trajectory. To preserve this trajectory through the interface, MotionCore combines a diffusion-matching objective with a low-capacity decodability constraint on object identity and position. We evaluate MotionCore on public physical-consistency benchmarks and on paired data with known trajectories. Results indicate that MotionCore improves physical consistency and trajectory obedience in the evaluated rigid-body settings, while maintaining comparable visual quality. A controlled ablation protocol compares learned dynamics with an analytic prior and studies the choice of latent evolution processor.
83. 【2611.08897】Segmenting Geometric Textures of 3D Meshes
链接：https://arxiv.org/abs/2611.08897
作者：Weidan Xiong,Kaijie Qu,Shihao Feng,Shunqi Fan,Rongyu Xiong,Hui Huang
类目：Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV)
关键词：Recognizing geometric texture, Recognizing geometric, heritage protection, Recognizing, geometric
备注： Pacific Graphics 2026
点击查看摘要
Abstract:Recognizing geometric texture patterns on 3D models is critical for applications such as heritage protection, model editing, and 3D printing. Existing 3D model segmentation methods predominantly focus on identifying high-level semantic parts, thereby failing to capture middle-level textures. While recent Vision-Language Models can perform image segmentation with appropriate text prompts, they still struggle to recognize 3D geometric textures. In this work, we present a method that segments 3D mesh models based on middle-level geometric textures. We further introduce a new geometric texture segmentation benchmark and fine-tune SAM3 accordingly. The segmented texture regions are then clustered based on DINO feature similarity and lifted from 2D to 3D. Additionally, we develop an interactive tool to enable both 3D model editing based on our segmentation results and model retrieval from the dataset based on geometric and texture similarity. Experiments demonstrate that our method significantly outperforms existing methods in segmenting geometric textures and can facilitate various applications.
84. 【2611.08887】Decoding spatial and semantic information from large-scale visual cortical activity for natural-movie reconstruction
链接：https://arxiv.org/abs/2611.08887
作者：Yukai Huang,Haoyu Albert Wang,Jiawei Zhang,Jialun Ma,Jiayao Ding,Yiran Lin,Xingyu Chen,Ziqi Gao,Yuguo Yu
类目：Computer Vision and Pattern Recognition (cs.CV); Neurons and Cognition (q-bio.NC)
关键词：paired neural-video data, Reconstructing natural visual, Calcium Activity, temporally filtered, Reconstructing natural
备注： 24 pages, 6 figures, 2 tables; 11-page supplementary information included as ancillary file
点击查看摘要
Abstract:Reconstructing natural visual experience from cortical population activity is a central challenge in neural decoding, particularly for calcium imaging, where signals are noisy, temporally filtered, and paired neural-video data are limited. Here we present Ca2REAL (Calcium Activity to Reconstruct Events, Appearance, and Layout), a neural-to-video framework that conditions a pretrained video diffusion model through separate layout and semantic controls derived from calcium activity. Using measured responses from 7,863 V1 neurons in one mouse, Ca2REAL reconstructed held-out natural-movie clips with 81.4% all-pairs stimulus-identification accuracy, with its clearest gains over deterministic baselines in perceptual and semantic measures. We further evaluated the framework in a stimulus-aligned virtual population of 116,705 neurons assembled from encoding-model-predicted responses across 11 independently recorded datasets. Perturbation and ablation analyses showed that reconstruction depends on distributed, stimulus-specific population structure, with layout and semantic pathways providing complementary spatial and identity information. Temporal analyses further showed improved preservation of semantic dynamics across reconstructed clips. These results show that large-scale cortical population activity constrains the spatial, semantic, and temporal structure of natural visual experience, providing a generative framework for high-fidelity neural reconstruction of dynamic visual scenes.
85. 【2611.08886】Computer Vision by YOLOs for Detection of Major Diseases in Vietnamese Custard Apple Using Fruit Imagery
链接：https://arxiv.org/abs/2611.08886
作者：Tri Nhut Do,Quoc Tuan Vo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Amid Vietnam rapid, Vietnam rapid digital, rapid digital transformation, artificial intelligence technologies, predicting crop pests
备注：
点击查看摘要
Abstract:Amid Vietnam rapid digital transformation in agriculture, the integration of artificial intelligence technologies for identifying, monitoring, and predicting crop pests and diseases has emerged as an inevitable trend.
86. 【2611.08879】GeoJeV: Unified Spatial Probability for Training-Free Efficient Evidence Acquisition in Ultra-High-Resolution Remote Sensing
链接：https://arxiv.org/abs/2611.08879
作者：Xinyi Niu,Lingfeng Chen,Jiehua Zhang,Panhe Hu,Li Liu,Zhen Liu,Yongxiang Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Signal Processing (eess.SP)
关键词：remote sensing imagery, efficient multimodal understanding, rich spatial details, remote sensing, sensing imagery
备注：
点击查看摘要
Abstract:Ultra-high-resolution (UHR) remote sensing imagery provides rich spatial details but poses challenges for accurate and efficient multimodal understanding. Existing evidence acquisition methods selectively explore relevant image regions, yet largely rely on generative multimodal large language models (MLLMs) for intermediate search control. However, reinforcement learning from human feedback (RLHF) primarily aligns these models with human-preferred responses rather than explicitly optimizing region-level relevance judgments, while repeated autoregressive decoding introduces additional computational overhead. To address these limitations, we propose GeoJeV, a training-free method that formulates evidence acquisition as spatial probability-driven decision making. At each evaluated region, a frozen JeV model produces a probability distribution over candidate regions. Specifically, Region Rank prioritizes candidate regions, Sparse Branch adaptively determines branching width through sparse probability support, and Depth Gate controls refinement depth based on branch sparsity and distribution concentration. By coordinating search priority, branching width, and refinement depth through a shared distribution, GeoJeV reduces reliance on RLHF-aligned generation and eliminates intermediate decoding. Experiments on LRS-GRO, MME-RealWorld-RS, and LRS-VQA achieve accuracies of 60.59%, 52.79%, and 34.32%, respectively. Across the three benchmarks, GeoJeV improves the average accuracy of Qwen3-VL-8B by +5.32pp with only 1.12 additional seconds per question, while achieving a 7.8-fold inference speedup over the recent method.
87. 【2611.08861】Align3D: Image-Structure Co-Aligned 3D Scene Generation with Observability-Aware Fidelity-Preserving Guidance
链接：https://arxiv.org/abs/2611.08861
作者：Chenliang Zhou,Yifan Wang,Andrzej Banburski-Fahey
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：image-conditioned diffusion model, model that generates, observed view, single input photograph, image-conditioned diffusion
备注：
点击查看摘要
Abstract:We present Align3D, an image-conditioned diffusion model that generates 3D indoor layouts that are both faithful to a single input photograph and physically plausible beyond the observed view. From the photograph we infer a confidence-calibrated scene graph and train a set-diffusion layout denoiser with image-structure co-alignment where confidence-weighted modality fusion balances image and scene-graph alignment using predicted confidences, while observability-aware fidelity-preserving guidance projects conflicting scene-quality gradients and reweighs them with an object-level confidence mask so under-observed degrees of freedom absorb physical priors without undoing the image-graph match. On 3D-FRONT, Align3D improves image-alignment and scene-quality metrics over recent baselines; once trained, it maps previously unseen photographs to layouts in a single feed-forward pass.
88. 【2611.08838】he APL Doesn't Fall Far From The Tree: Unsupervised Artefact Prototype Learning in Histopathology
链接：https://arxiv.org/abs/2611.08838
作者：Emilia Agasi,Charlie Gourley,C. Simon Herrington,Robert L. Hollis,T. Ian Simpson
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Histopathology foundation models, impact diagnostic accuracy, foundation models provide, models provide rich, provide rich representations
备注：
点击查看摘要
Abstract:Histopathology foundation models provide rich representations of tissue morphology, but technical artefacts in whole slide images introduce noise that may impact diagnostic accuracy. We introduce Artefact Prototype Learning (APL), a novel approach to detecting these artefacts that exploits the geometry of pre-trained embedding spaces without manual labels or fine-tuning. Rather than treating artefacts as isolated outliers, APL computes prototypes of out-of-distribution patches and uses them to distinguish artefact-associated patterns from tissue. Evaluation on a single-centre dataset shows that APL outperforms prior methods GrandQC and HistoART in detecting artefacts such as blur, dark spots, slide edges and pen marks, but struggles with tissue folds and blood. These results show that frozen pre-trained embeddings already carry information that allows artefact detection without expensive labels or vast computational resources.
89. 【2611.08831】Global Solar Siting from Geospatial Embeddings
链接：https://arxiv.org/abs/2611.08831
作者：Abdullah Rehman,Quentin Paletta,Rui Song
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY)
关键词：rapidly growing, helping decrease, fossil fuels, Global solar photovoltaic, decrease our emissions
备注： Accepted at Tackling Climate Change with Machine Learning workshop at NeurIPS 2026. 17 pages, 11 figures
点击查看摘要
Abstract:Global solar photovoltaic (PV) capacity is rapidly growing, helping decrease our emissions and dependence on fossil fuels. However, optimally siting a solar plant remains challenging, requiring anticipation of geographical, urban, and infrastructure needs. Current methods rely on multi-criteria decision analysis (MCDA) using hand-picked geophysical layers and solar-resource products, however these strategies are not geographically transferable and do not capture the practical requirements of solar sites. We use geospatial embeddings, dense vectors representing geophysical properties of a location, to analyse 38,591 existing solar sites and the land they were built on to learn the latent solar suitability signal. We assess a set of linear and non-linear models and select a soft-voting ensemble of a random forest and a multilayer perceptron (RF+MLP ensemble), chosen for accuracy and large scale deployability. Validated against future installations in thirteen countries, the ensemble separates existing solar sites from random land with a median ROC-AUC of 0.90. Compared with published MCDA strategies, the ensemble increases ROC-AUC by 0.06-0.30 in every country. The ranking also concentrates real deployment: the most-suitable 20% of land holds 84% of estimated generation (annual energy yield) and 67% of installed capacity (potential power output). After applying standard siting constraints, 5.6% of global land (9.8% if cropland is permitted) remains highly suited to solar. The global 10 m resolution solar suitability dataset and code can be found here: this https URL.
90. 【2611.08808】Impact of color in computer and human-based object recognition under occlusion
链接：https://arxiv.org/abs/2611.08808
作者：Courtney M. King,Elissa Aminoff,Daniel D. Leeds
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Partial occlusions challenge, challenge object recognition, impact is largely, largely dependent, occlusions challenge object
备注：
点击查看摘要
Abstract:Partial occlusions challenge object recognition in both human and computer vision (CV), but the impact is largely dependent on the occlusion and model design. Properties relating to color are particularly important in biological recognition and frequently leveraged for camouflage, however there are still open questions about what makes them effective and how they translate to CV. This work studies partial occlusions that create camouflage, including those that blend in with target objects or with scenes, which alter object representations in distinct ways. Experiments evaluate recognition performance on both human participants and models ranging from convolutional neural networks (CNNs) to transformers, and additional analysis is performed on models to uncover trends in processing and object representations under multiple occlusion types. Novel metrics offer explainability of model behavior under occlusion: non-occlusion precision (NOP) and non-occlusion recall (NOR) measure alignment of model activations with and without occlusion, and activation in occlusion (AIO) measures the percentage of activations that occur in occluded regions. Findings show that human recognition, and most transformers, are negatively impacted by generated camouflaging occluders, with scene-based camouflage performing worse than object-based. Classical CNNs show a strong opposite trend, performing the worst on neutral-colored occlusions, suggesting that contextually-related colors, particularly scene-based, benefit object recognition rather than disrupting shape or boundary cues. Additionally, generated camouflaging occluders for training augmentation improves robustness to unseen camouflage for selected CNN model, and occlusion metrics suggest trends about learned mechanisms. Findings have interesting implications for alignment in human and computer vision, model vulnerabilities, and explainability.
91. 【2611.08802】Scale as a Modality: Multi-Scale Pixel-Space Diffusion Transformers
链接：https://arxiv.org/abs/2611.08802
作者：Ruibo Chen,Kaishen Wang,Tianyi Xiong,Chenxi Liu,Yanshuo Chen,Heng Huang,Jian Du
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Latent diffusion models, constrain spatial granularity, diffusion models rely, introduce lossy compression, Latent diffusion
备注：
点击查看摘要
Abstract:Latent diffusion models rely on pretrained autoencoders that introduce lossy compression and constrain spatial granularity. Pixel-space diffusion avoids this bottleneck and enables flexible tokenization at multiple spatial scales, yet existing approaches largely adopt two-level coarse-to-fine architectures with limited cross-scale interaction. We introduce MS-pDiT, a multi-scale pixel-space diffusion transformer that treats spatial scale as a modality. MS-pDiT tokenizes the same noisy image at multiple patch sizes, processes each scale in a dedicated transformer stream, and enables bidirectional information exchange through compacted MM-DiT-style joint attention, with attention cost independent of the finest patch size. This design establishes the number of scales as a new architectural scaling dimension. On ImageNet $256\times256$, increasing the number of scales from two to five consistently improves FID from 4.39 to 2.31, 2.26, and 2.19, while adding an intermediate scale substantially outperforms increasing depth under comparable parameter budgets. Further analysis highlights the importance of bidirectional cross-scale interaction and late introduction of fine-grained streams. MS-pDiT achieves FID scores of 1.43 and 1.44 on ImageNet $256\times256$ and $512\times512$, respectively, and naturally extends to text-to-image generation, achieving 0.86 on GenEval and 83.9 on DPG-Bench.
92. 【2611.08800】On the Few-Shot Adaptation of Vision-Language Models: A Few Gradient Signs Are All You Need
链接：https://arxiv.org/abs/2611.08800
作者：Nairouz Mrabah,Ismail Ben Ayed,Mahdi S. Hosseini,Eric Granger
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：vision-language models makes, makes gradient estimation, models makes gradient, estimation particularly noisy, limited supervision
备注： 98 pages, including supplementary material
点击查看摘要
Abstract:The limited supervision available for the few-shot adaptation of vision-language models makes gradient estimation particularly noisy. We find that the gradient magnitudes are severely miscalibrated, while the signs of a small top-magnitude subset remain informative. This motivates SignSparseSGD and DynSignSparseSGD, two state-free optimizers that use gradient magnitudes only to select where to update and fixed-magnitude signs to decide how to update. The static variant fixes the support after the first minibatch. The dynamic variant refreshes it at every step. Across 11 datasets, three CLIP backbones, and five shot levels, the proposed methods are competitive with or outperform parameter-efficient and optimization-based baselines on average, while exhibiting markedly lower sensitivity to long training schedules. They introduce no task-specific modules, maintain no first- or second-moment optimizer states, and use one shared configuration across datasets, backbones, and shot levels. Our code is included in the supplementary materials and will be released upon publication.
93. 【2611.08782】Extrapolation Matters: Sparse-Only Depth Completion Beyond LiDAR Coverage
链接：https://arxiv.org/abs/2611.08782
作者：Maximilian Jansen,Gasser Elazab,Praveen Kulkarni
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：important yet under-evaluated, under-evaluated challenge, LiDAR, Extrapolation, depth
备注：
点击查看摘要
Abstract:Extrapolation beyond LiDAR coverage is an important yet under-evaluated challenge of depth completion. In real camera--LiDAR systems, partial sensor overlap, occlusions, and limited field coverage often leave large image regions weakly observed or completely unobserved by LiDAR. Thus, we investigate depth completion in this beyond-coverage regime using only sparse supervision from raw single-sweep LiDAR, without dense depth labels, LiDAR accumulation, or pseudo-LiDAR generation. Our approach leverages a frozen monocular depth foundation model, lightweight per-frame alignment to sparse LiDAR geometry, and a refinement module that fuses the aligned prior with sparse LiDAR anchors to predict dense metric depth. To regularize learning under raw sparse supervision, we introduce a high-frequency normal-consistency loss defined as the image-space gradient of the per-pixel normal cosine discrepancy. This term penalizes spatial variation in scalar angular error; it does not directly match changes in neighboring normal vectors. We further introduce an evaluation protocol that explicitly separates LiDAR-supported and beyond-coverage regions, revealing extrapolative behavior that conventional depth-completion metrics can obscure. Our method achieves strong depth accuracy beyond LiDAR coverage while remaining competitive in LiDAR-covered regions, providing a practical way to deploy monocular foundation priors in multi-sensor systems.
94. 【2611.08771】Federated training performs as well as centralized for 3D Latent Diffusion for Diagnosis-Conditioned Brain MRI Synthesis
链接：https://arxiv.org/abs/2611.08771
作者：Abhijith Shaji,Paul Kurian,Greg Ver Steeg,Paul M. Thompson,Jose-Luis Ambite
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：understand brain conditions, imbalanced neuroimaging data, enrich scarce, scarce and imbalanced, imbalanced neuroimaging
备注：
点击查看摘要
Abstract:Generative models of brain MRI are useful to understand brain conditions, and to enrich scarce and imbalanced neuroimaging data. However, training these models requires large, multi-site training sets, which is challenging. Federated learning (FL) allows for training deep learning models without sharing data. We show that training a 3D conditional latent model federatedly (where data is kept private at each site) performs similarly to centralized training (where all the data have been copied to a single site). We evaluate three metrics: conditional fidelity (how well generated MRIs perform in classification), diversity (how the generated images match the real data distribution, using MultiScale-SSIM), and realism (how close generated images are to real images, using Fréchet Inception Distance). Our results show that federated training is a viable route to develop multi-site generative models of brain MRI.
95. 【2611.08755】AtariBench: Evaluating Spatiotemporal Reasoning of Vision-Language Models in Atari Gameplay
链接：https://arxiv.org/abs/2611.08755
作者：Mingjia Huo,Yao Fu,Bo Chang,Yaqing Wang,Dawei Zhu,Dylan Zhang,Xinyang Yi,Lichan Hong,Ed H. Chi,Hao Zhang,Jiaxi Tang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：static visual understanding, achieved strong performance, achieved strong, visual understanding benchmarks, dynamic environments remains
备注： 26 pages, 14 figures. Accepted to NeurIPS 2026, Evaluations and Datasets Track
点击查看摘要
Abstract:Vision-Language Models (VLMs) have achieved strong performance on static visual understanding benchmarks, yet their ability to act in dynamic environments remains less well understood. We introduce AtariBench, a controlled benchmark that evaluates VLMs across 20 Atari 2600 games, requiring models to make sequential decisions from high-temporal-resolution gameplay streams. By decoupling fast in-game dynamics from wall-clock inference speed, AtariBench focuses on whether models can perceive rapid visual state changes, reason over spatiotemporal dynamics, and ground actions in the current observation. Our experiments reveal substantial limitations in state-of-the-art VLMs: models often fail to infer object motion and direction, exhibit brittle sequential decision-making, and over-rely on textual interaction history despite newly appended visual feedback. We further introduce a separability analysis to identify which in-game scores provide reliable signals of model competence, and use the benchmark to study how memory design and prompting strategies affect performance. Overall, AtariBench exposes a persistent gap between passive visual perception and active decision-making, providing a lightweight and rigorous testbed for developing VLMs that can reason and act in dynamic environments.
96. 【2611.08732】FishSense Lite: A Camera-Based, Single Laser Hardware Framework with Software System for In Situ Fish Length Measurement
链接：https://arxiv.org/abs/2611.08732
作者：Christopher L. Crutchfield,Kyle Hu,Nathan Hui,Omair Qazi,Jennifer Loch,Alli Candelmo,Brice X. Semmens,Curt Schurgers,Ryan Kastner
类目：Computer Vision and Pattern Recognition (cs.CV); Systems and Control (eess.SY)
关键词：Fish stock assessments, Fish, surveyors can reach, stock assessments, trained surveyors
备注： 27 pages with 14 figures
点击查看摘要
Abstract:Fish stock assessments need fish lengths paired with species from far more places than trained surveyors can reach. Recreational divers already visit many of those places, but measuring a fish underwater has required trained observers or specialist equipment. We present FishSense Lite, which recovers fish length from a single photograph taken with a recreational dive camera, a dive laser pointer, and a 3D-printed mount. The diver aims the laser at a fish and takes a picture; afterward, the dot's position in the image gives the range to the fish, and the range turns the fish's size in the image into a length. A citizen-science program, trained by the system's builders, taught its own divers and collected lengths paired with species for 73 wild fish across seven open-water dives. On seven wild fish also measured by an underwater stereo-imaging system, the two instruments agreed without detectable bias (mean difference +0.8%). On rigid targets of known length, FishSense Lite recovered every target to within 1.3%, and 99% of 1,055 frames fell within a 15% error budget. From the error sources we measure, we derive a field protocol: calibrate against a dive slate on every dive, photograph fish within 15 degrees of perpendicular and beyond 1 m, and take at least ten frames of each.
97. 【2611.08731】Sharp: Diffusion-based Sharp Monocular Metric Event-to-Depth Estimation
链接：https://arxiv.org/abs/2611.08731
作者：Qiushi Dai,Aniket Dashpute,Yuhao Liu,Rishubh Parihar,Guha Balakrishnan,Ashok Veeraraghavan
类目：Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)
关键词：industrial inspection, autonomous navigation, fundamental for autonomous, MDE, Depth
备注：
点击查看摘要
Abstract:Depth perception is fundamental for autonomous navigation, industrial inspection, and mixed-reality systems. It often operates under strict constraints on power and form factor. In such cases, monocular depth estimation (MDE) is often used. Even as recent advances continue to improve monocular depth quality, conventional frame-based MDE systems remain challenged by fast motion and high-dynamic-range scenes. This work introduces eSharp, an MDE framework that addresses these problems using an event camera. eSharp repurposes pretrained diffusion priors for event-only MDE and produces accurate metric depth with unparalleled sharpness on real data. Real-world event datasets provide only sparse LiDAR depth maps for ground-truth supervision, making dense prediction challenging. We address this limitation through cross-modal distillation, using LiDAR-calibrated dense pseudo-labels generated from a spatially co-registered frame camera to train eSharp. Experiments show that eSharp outperforms prior event-to-depth baselines in both metric-depth accuracy and spatial fidelity, establishing diffusion models as a promising foundation for event-driven 3D perception.
98. 【2611.08665】Dynamic GPU Voxel Grids and Voxel-sequential Processing in NanoVDB
链接：https://arxiv.org/abs/2611.08665
作者：Eftychios Sifakis,Francis Williams,Christopher Horvath,Rohan Sawhney,Mark Harris,Jonathan Swartz,Ken Museth
类目：Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC)
关键词：GPU-native topological updates, dramatically accelerates point-wise, dynamic GPU-native topological, topological updates, data structure
备注：
点击查看摘要
Abstract:We introduce two fundamental advances to the NanoVDB data structure: dynamic GPU-native topological updates, and a voxel-sequential access paradigm that dramatically accelerates point-wise and stencil-based operators on sparse grids. NanoVDB's linearized memory layout has delivered strong GPU performance, and the Index-Grid concept introduced in the fVDB framework [Williams et al 2024] provided topology/data separation and optimal compactness of storage in sparse machine learning workloads. However, all these prior iterations of NanoVDB assume a static topology that has precluded use of this data structure in simulation and dynamic geometric processes. We eliminate this limitation by introducing a suite of dynamic topology operators -- morphological dilation, grid merging, pruning, and cross-resolution coarsening and refinement. These operators use bit-parallel algorithms to reconstruct grids containing hundreds of millions of voxels in just a few milliseconds. We also introduce a voxel-sequential access paradigm and data structure for GPU kernels operating on sparse data. We stream active voxels as a flat linear sequence, minimizing or eliminating the need for tree traversal in the process. This achieves compute density and regularity that allow even complex stencil-based operators to approach peak memory bandwidth, with minimal storage overhead. Together, these contributions remove the read-only constraint from NanoVDB, establishing it as a high-performance primary representation for dynamic GPU simulation and geometry manipulation. We evaluate the efficacy of our newly introduced operators in benchmarks sourced from applications such as 3D reconstruction, fluid simulation, and large-scale mesh voxelization.
Subjects:
Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC)
Cite as:
arXiv:2611.08665 [cs.GR]
(or
arXiv:2611.08665v1 [cs.GR] for this version)
https://doi.org/10.48550/arXiv.2611.08665
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Related DOI:
https://doi.org/10.1145/3842564
Focus to learn more
DOI(s) linking to related resources</p>
99. 【2611.08657】JEPAhead: From Inpainting to Causal Forecasting for Urban Driving
链接：https://arxiv.org/abs/2611.08657
作者：Daniel G. P. Petrini,Davi Pincinato,Fabio Grassiotto,Pedro L. F. Prado,Alexandre F. S. Osorio,Raphael V. Ramos,Felipe Pamboukian
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：fine-tune a pre-trained, bidirectional latent inpainting, inpainting to action-free, action-free causal forecasting, action-free causal
备注： 7 pages, 2 figures
点击查看摘要
Abstract:We fine-tune a pre-trained V-JEPA1 predictor from bidirectional latent inpainting to action-free causal forecasting while keeping the encoder frozen. Using contiguous past observations, horizon-aligned targets, and group-level causal attention, the model forecasts eight future token groups, corresponding to sixteen frames, in one forward pass. On CARLA Town12, it retrieves the correct future among 591 candidates in 69.0% of cases, compared with 55.3% for persistence, with greater gains at longer horizons and on tokens exhibiting greater change. It also outperforms a compact predictor trained from scratch with six times fewer parameters. Semantic analysis indicates driving-relevant information in predicted features: a fixed linear probe trained on real encoder tokens achieves 0.16 mIoU on patches undergoing semantic-class changes, versus 0.13 for persistence. Vehicle-conditioned retrieval improves over persistence by 15 percentage points at the longest horizon. Pixel-space evaluation shows modest L1 gains but little improvement under LPIPS, motivating direct evaluation through latent and semantic measures alongside an oracle reconstruction reference. These findings support further investigation of latent forecasting for driving perception, while downstream utility remains unverified.
100. 【2611.08655】Scoring, Not Learning: Decomposing Catalog-Consolidation Gains in Web-Scraped Retail Product Recognition
链接：https://arxiv.org/abs/2611.08655
作者：Kaden Leis,Xiang Ma
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Retail product catalogs, Retail product, product catalogs assembled, queries return packaging, web image search
备注： 9 pages, 4 figures, was accepted by a computer vision conference workshop
点击查看摘要
Abstract:Retail product catalogs assembled from web image search are cheap to build and pervasively noisy: queries return packaging shots instead of products, and entries proliferate under names that cannot be distinguished visually. Consolidating such a catalog can look like an alternative to scaling the model. We show this is not a comparison between two ways of improving a recognizer, but between improving a recognizer and changing what counts as correct. We study a public archive of 165,769 cheese images across 1,824 query-named entries. A packaging filter and near-duplicate removal reduce it to a 998-class recognition set on one fixed, group-aware split. Canonicalizing entries to their base type (844 classes) raises top-1 accuracy by 4.0 points. Scoring the unchanged model against the merged label space, by summing its predicted probability within each canonical group, recovers +4.27 points with no retraining (+4.25 over six seeds). Retraining on the consolidated catalog then adds -0.10$\pm$0.53, +0.08$\pm$0.65 and -0.10$\pm$0.65 points at 28, 50 and 88 M parameters, indistinguishable from zero at every capacity ($\pm$ is the across-seed standard deviation). That component is specific, not mechanical: random merges with the identical size profile yield only +0.68 points, and the three backbones agree to within 0.1 points. But it is overwhelmingly category coarsening, not alias correction: across the 37 merged groups, type coarsenings supply 94% of the gain and alias collapses only 7%. We also detect no interaction between consolidation and backbone size: tripling backbone parameters is worth +1.50$\pm$0.57 points on the raw catalog and +1.42$\pm$00.44 on the canonical one, a within-seed interaction of -0.08 [-0.79,+0.63]. On this archive, the reported consolidation gain primarily reflects the evaluation label space, and separating that out costs one evaluation
101. 【2611.08652】An Anatomy-guided 3D Segmentation Pipeline for Prostate Surgical Phantoms from CT Scans
链接：https://arxiv.org/abs/2611.08652
作者：Iven Chen,Kuan-I Chung,Ayberk Acar,Susheela Sharma Stern,Alejandro O. Chara,Jie Ying Wu,Daniel Moyer
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：long-term goal, goal for prostatectomy, robotic surgery, Full autonomy, goal
备注： 11 pages, 2 figures, 3 tables, 10 algorithms. Extended abstract accepted at SPIE Medical Imaging 2027: Image Processing
点击查看摘要
Abstract:Full autonomy has been a long-term goal in robotic surgery and a near-to-medium-term goal for prostatectomy. Due to the relatively closed structure of the procedure, its standard-of-care robotic/laparoscopic solutions, and procedure economics, prostate procedures are an optimal early target for surgical automation. Prototyping and testing of possible solutions is done in constructed laboratory phantoms, either synthetic tissues or animal phantoms. To enable measurement of perceptual and robotic motion error, phantoms undergo volumetric imaging; these images are critical to both a potential deployed automatic system, used in planning motion and treatment (cutting, ablation, suturing, etc.), as well as post-hoc assessment of system performance. Rapid iteration on these phantom models yields small, inconsistent datasets, while the current workflow for human annotation is often anatomically unreliable and prohibitively time-consuming, rendering deep learning unsuitable at reasonable scales. To address these limitations, we present an automated 3D segmentation pipeline that uses classical medical image-processing techniques to encode the known anatomy of the phantoms as explicit geometric and intensity priors, which requires no training corpus and is transferred to each new phantom revision without re-annotation. Across 57 scans spanning multiple phantom revisions, our pipeline recovers the capsule interior at 0.83 median Dice on 11 contrast-suppressed scans and detects all 32 annotated focal lesions without false positives, completing a full scan in 2-8 minutes on commodity CPU hardware versus 1-2 hours by hand.
102. 【2611.08651】urkish Multimodal Video Fact-Checking: A New Dataset and a Comparison of Zero-Shot Agentic and Fine-Tuned Systems
链接：https://arxiv.org/abs/2611.08651
作者：Azra Açıl
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Video-based misinformation spreads, misinformation spreads rapidly, English text, Video-based misinformation, exclusively on English
备注： 11 pages, 3 figures, 5 tables. MSc dissertation, Queen Mary University of London, 2026
点击查看摘要
Abstract:Video-based misinformation spreads rapidly on social media, but almost all existing fact-checking systems focus exclusively on English text. Tools for low-resource languages such as Turkish are severely limited. In this work, we present TeViD (Turkish Video Fact-checking Dataset), to the best of our knowledge the first multimodal video fact-checking dataset for Turkish. We compiled the dataset from articles published by this http URL, an IFCN-certified organisation, and enriched it with translated Snopes articles and synthetic examples to reduce class imbalance. Building on TeViD, we develop two verification pipelines that share the same open-source base model. First, in 3MFact-TR (Pipeline 1), we adapt the multi-role 3MFact framework to Turkish with the Qwen2.5-7B large language model and the Qwen2-VL-7B vision-language model, and add three modules of our own: a semantic inconsistency checker, a 5W1H question manager, and a bilingual evidence retriever that excludes fact-checking sites to prevent leakage. Second, as our Fine-Tuned Model (Pipeline 2), we fine-tune a single Qwen2.5-7B with Low-Rank Adaptation (LoRA) to produce closed-book verdicts from the claim and the video's textual description. We report accuracy, macro F1, True class F1, and True class recall for both systems, together with ablation studies.
103. 【2611.08649】VoluCompose: Constructing Compact Volumetric Visual Representations for Medical Image Understanding
链接：https://arxiv.org/abs/2611.08649
作者：Zanting Ye,Yunrui Lin,Shengyuan Liu,Jing Hao,Chen Hu,Yefeng Zheng,Lijun Lu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：redundant visual-token sequences, interpret volumetric images, processing full volumes, Medical vision, slices produce long
备注：
点击查看摘要
Abstract:Medical vision--language models can interpret volumetric images, but processing full volumes is costly because hundreds of slices produce long, redundant visual-token sequences. Existing compression methods often couple content selection with budget determination. We observe that neighboring slices share visual features and that attention concentration varies across visual encoders. We propose VoluCompose, a training-free, model-agnostic framework that separates what visual content to retain from how many tokens to allocate. Its hyperbolic token composition module groups contiguous slices into ordered support units and uses the Lorentz distance to account for feature magnitude and direction during token allocation, anchor selection, and refinement. Its capacity control module uses visual-encoder attention entropy to allocate more tokens when attention is more dispersed. We evaluate VoluCompose on two tasks across three datasets and four backbones. Across nine calibrated settings, VoluCompose attains the highest mean quality--retention hypervolume among the compared methods. It achieves a mean relative quality of 121.68\% against the uncompressed references while retaining 22.78% of visual tokens on average. Compression remains robust even at a 10% token budget. Across settings, the lowest ROUGE-L ratio to the uncompressed reference is 96.4\% for VoluCompose. The corresponding minima for the compression baselines range from 15.0% to 70.5%. Code is available at this https URL.
104. 【2611.08645】From Geometry to Function: A Multi-Task LiDAR Benchmark Dataset for Semantic and Functional Parsing of Urban Facades
链接：https://arxiv.org/abs/2611.08645
作者：Abdiaziz Muse,Tooba Javed,Tao Pu,Jiju Poovvancheri,Dong Chen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Graphics (cs.GR); Machine Learning (cs.LG)
关键词：sustainable city analysis, urban digital twins, LiDAR benchmarks stop, existing LiDAR benchmarks, heritage modelling
备注： Accepted to WACV 2027. 19 pages (8 main + supplementary), includes appendix. Project page: [this https URL](https://jijup.github.io/hfx3d-benchmark/) ; Code: [this https URL](https://github.com/jijup/hfx3d-benchmark)
点击查看摘要
Abstract:Understanding building facades is central to urban digital twins, heritage modelling, and sustainable city analysis, yet existing LiDAR benchmarks stop at geometry and semantic segmentation and offer little support for reasoning about the functional role of each architectural element. We introduce HFX3D, a large-scale urban facade benchmark of approximately 492 million LiDAR points from 26 buildings in Halifax, Canada, captured across four seasons, day and night, and varied weather. Each facade is annotated at three tiers, semantic, instance, and per-instance functional attributes, making it, to our knowledge, the first facade dataset to pair geometry and semantics with functional labels. Annotations are produced by a semi-automatic pipeline that combines geometry-guided heuristics with expert validation. We benchmark representative point-based, graph-based, convolutional, and transformer architectures and find that semantic segmentation is already challenging under severe class imbalance, while instance separation of repetitive structures and functional reasoning from geometry are substantially harder. The benchmark establishes a new foundation for function-aware 3D urban understanding. Project page: this https URL ; code: this https URL
105. 【2611.08631】BEVCast: Path-Adaptive BEV for Efficient End-to-End Autonomous Driving
链接：https://arxiv.org/abs/2611.08631
作者：Qiren Wang,Mingyu Guo,Zixuan Wang,Weisong Shi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Camera-based driving models, Camera-based driving, build a dense, planning horizon, driving models build
备注：
点击查看摘要
Abstract:Camera-based driving models build a dense bird's-eye-view (BEV) grid and spend the same computation on every cell of it, although the vehicle crosses only a few of those cells within the planning horizon. We present BEVCast, a two-stage BEV whose resolution adapts to the predicted driving path. A coarse pass encodes the whole scene on a grid of 4.096 m cells. A heat head trained on the recorded path assigns a heat to every coarse cell and the cells with the highest heat are refined into 1.024 m cells under a fixed budget. The remaining cells keep their coarse resolution, so the trajectory head reads a mixed-resolution BEV that still covers the entire scene and needs neither an HD map nor a navigation command. Against a full grid of 1.024 m cells with the same architecture and training recipe, BEVCast at a 10% refinement budget encodes 28% of the BEV queries and needs 66% of the BEV encoder time at batch size 1. On nuScenes its mean displacement error is 1.078 m against 1.149 m and its drivable area violation rate is 1.46% against 2.29%. On NAVSIM navtest its mean displacement error is 0.577 m against 0.598 m and its extended predictive driver model score is 82.51 against 81.28. Next to published planners BEVCast reaches a comparable error on both benchmarks without a navigation command. The resolution of a driving BEV can therefore follow the task instead of the grid.
106. 【2611.08610】InstaGen: Group-Shared Importance Sampling for Fast Video Generation
链接：https://arxiv.org/abs/2611.08610
作者：Kislay Aditya Oj,Kumar Krishna Agrawal,Sri Surya Varma Datla,Aditya Desai
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Diffusion Transformers, quadratic attention complexity, attention complexity results, substantial computational cost, dominant architecture
备注： 13 pages, 6 figures, 2 tables
点击查看摘要
Abstract:Diffusion Transformers (DiTs) are the dominant architecture for video generation, but their quadratic attention complexity results in substantial computational cost and latency. Permuted block-sparse attention (PBSA) offers a promising approach to reducing this cost by selectively computing blocks of a semantically permuted attention matrix. However, existing approaches typically select only the top few key blocks for each query block, following a top-$p$ paradigm. We find that top-$p$ selection can be highly sample inefficient in high-entropy attention regimes, which are common in video generation. In these regimes, we show that sampling can provide substantially better approximations under the same computational budget. More generally, we cast block selection as importance sampling, where the top-scoring keys form an exact set that is computed in full and the remaining keys are represented by a sample drawn in proportion to their estimated attention and reweighted by inverse sampling probability. Building on this formulation, we present InstaGen, which can be parameterized by any PBSA method: it replaces the method's block selection with an exact set plus a weighted sample. Each query cluster draws one sample shared by all its queries, so the sampled keys form blocks amenable to efficient GPU execution. In this paper, we take the SVG family of PBSA methods and show that, on Wan2.1-T2V-1.3B and Wan2.1-T2V-14B, InstaGen parameterized by SVG2 improves PSNR over SVG2 by 3.4 dB and 2 dB, respectively, at matched attention density, and by 1.6 dB and 2.2 dB at matched wall-clock time. On Wan2.1-T2V-14B, InstaGen also beats SVG-EAR by 1.1 dB PSNR at nearly the same density while running faster (1.65x against 1.48x over dense).
107. 【2611.08578】HaNDF: Object-Conditioned Geometric Neural Hand Distance Fields
链接：https://arxiv.org/abs/2611.08578
作者：Zuhao Liu,Melih Darcan,Zhengdi Yu,Riza Alp Guler,Tolga Birdal
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Robotics (cs.RO)
关键词：object-conditional neural distance, product manifold, plausible hand-object configurations, plausible, data-driven priors
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:We propose, HaNDF, object-conditional neural distance fields as data-driven priors for modeling the plausible hand-object configurations, in the product manifold of hand articulations. While recent unconditional generative priors showed success in modeling human pose, hands are versatile articulated bodies often found in interaction with other objects. This makes it crucial to develop a generative prior which can model the plausible hand poses conditioned on the object under interaction. To this end, our HaNDF proposes a geometry-aware, object-conditioned neural distance field, representing the plausible articulations in the zero-level set of a conditional field. We leverage tools from Riemannian geometry to (i) represent plausible hands in the zero level-set of an object-induced neural field, and (ii) project a given pose onto this field. Using HaNDF, we can also optimize for a plausible condition, determining the object under interaction. Our extensive evaluations demonstrate that our HaNDF provides a flexible and powerful prior for hand-object interaction, suitable for applications such as pose refinement, reconstruction under occlusion, and physically plausible manipulation synthesis.
108. 【2611.08577】Meituan-Robotics-0: A Vision-Language-Action Foundation Model for Desktop Manipulation
链接：https://arxiv.org/abs/2611.08577
作者：Meituan Robotics Team:Caicheng Wang,Chen Zhao,Chengpeng Jin,Duo Xu,Fengjiao Chen,Guanglu Wan,Heqing Yang,Jia Wang,Jiacong Zhou,Jie Hu,Jiyuan Ru,Lingfeng Zhang,Linjiang Huang,Manyuan Zhang,Ningchu Liu,Shijie Zhou,Si Liu,Shuo Li,Tianyi Zhang,Xi Zhang,Xin Chen,Xuezhi Cao,Xunliang Cai,Yanbin Zeng,Yang Yang,Yang Yi,Yanli Tan,Yifu Xu,Yimeng Jia,Yuchen Tang,Yuchen Xie,Yuxiang Zheng,Zerwei Chng,Zilong Huang,Zipeng Ye,Ziyuan Qin,Ziqin Wang
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：stationary-base desktop manipulation, foundation model, desktop manipulation, model and embodied-agent, embodied-agent system
备注： 25 pages. Project page: [this https URL](https://meituan-robotics.github.io/Meituan-Robotics-0/) ; Code: [this https URL](https://github.com/Meituan-Robotics/Meituan-Robotics-0)
点击查看摘要
Abstract:We present Meituan-Robotics-0 (MR0), a vision-language-action foundation model and embodied-agent system for stationary-base desktop manipulation. MR0 combines 147 million vision-language samples with 15,060 hours of curated robot trajectories spanning 12 embodiments. A three-stage training recipe aligns multimodal representations with robot behavior through discrete action-token pre-training, transfers these priors to continuous cross-embodiment control through flow-matching mid-training, and adapts the policy through real-world post-training. We introduce Rollback, which pairs replaced policy segments with human corrections to provide positive and negative supervision for CFG-DAgger without value learning or advantage labeling. A unified end-effector interface supports heterogeneous embodiments, while asynchronous action-chunk merging maintains smooth execution under variable inference latency. An event-driven agent maintains persistent task events and reassesses plans when progress or feasibility changes, enabling cross-task retrieval and conditional task resumption. MR0 achieves 93.6% success on RoboTwin 2.0 and ranks fifth in the RoboDojo VLA track. Under matched HG-DAgger post-training, MR0 achieves higher average success rate and progress score than $\pi_{0.5}$ across three real-robot tasks. On Ethernet insertion, CFG-DAgger trained with Rollback data reaches 70% success and a progress score of 0.90. Qualitative agent deployments demonstrate cross-task event retrieval and recovery from temporarily unsatisfied task conditions.
109. 【2611.08561】owards Label-Efficient Geospatial Foundation Model Adaptation via Positive-Unlabeled Learning for Building Damage Mapping
链接：https://arxiv.org/abs/2611.08561
作者：Hengwei Zhao,Qirui Wang,Zhuo Zheng,Xiaoyan Lu,Rusty Feagin,Wenzhe Jiao
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Geospatial foundation models, general-purpose geospatial intelligence, reshaping remote sensing, GFM adaptation, foundation models
备注：
点击查看摘要
Abstract:Geospatial foundation models (GFMs) are reshaping remote sensing by shifting the field from task-specific modeling toward general-purpose geospatial intelligence. Mapping the damage to buildings stands to benefit substantially from this shift, as GFMs pretrained on large-scale Earth observation data provide generalizable geospatial representations that can facilitate effective responses to sudden-onset disasters. Although parameter-efficient fine-tuning (PEFT) facilitates GFM adaptation, parameter efficiency does not necessarily translate into label efficiency. Building damage mapping remains challenging due to scarce pre-existing labeled data or limited time for annotation. When weak supervision is introduced to alleviate the labeling bottleneck, we identify the difficulty of learning sufficiently discriminative representations as a key challenge for label-efficient GFM adaptation. To address this challenge, we propose a Positive-Unlabeled GFM Adaptation (PUMA) framework that requires annotations for only a small number of damaged buildings. More specifically, PUMA integrates non-contrastive weakly supervised representation refinement to mitigate the impact of noisy supervision on representation learning from a gradient perspective, and latent-state-based label disambiguation to enable reversible supervision refinement without requiring class prior estimation. Extensive experiments on disaster benchmark datasets from around the world demonstrated the effectiveness and robustness of PUMA. A real-world application to the 2025 Los Angeles wildfires further highlighted its potential to accurately map damage under highly limited supervision. More broadly, these findings suggest that weakly supervised PEFT offers a label-efficient pathway from GFMs to real-world applications.
110. 【2611.08538】Subliminal Learning in Vision-Language Models
链接：https://arxiv.org/abs/2611.08538
作者：Arman Hatami,Romina Aalishah,Ilya E. Monosov
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Image and Video Processing (eess.IV)
关键词：Subliminal learning, large language models, phenomenon in large, large language, passes a hidden
备注： Accepted to WACV 2027
点击查看摘要
Abstract:Subliminal learning is a phenomenon in large language models (LLMs) where a teacher passes a hidden preference to a student through training data unrelated to that preference. We study whether subliminal learning also occurs in vision-language models (VLMs). We finetune a teacher VLM to prefer a specific animal or facial attribute and use a control teacher from the same base model. Both teachers generate numbers for an unrelated visual task involving geometric shapes. Two students initialized from the same base VLM are finetuned on the same images, using numbers generated by either the biased or control teacher. Across VLMs ranging from 2B to 7B parameters, we find that both animal and facial preferences can transfer through this unrelated task. Students trained on biased-teacher outputs select the target more often than control students, with a difference of up to $\sim$10 percentage points in the animal preference task. Transfer can become stronger with more training data and varies with the target preference, model, and how the numbers are generated. Beyond preferences, we show that the biased student's explanations use more of the same words and phrases as the biased teacher's explanations than those of the control student, even when all three models select the same image. These results matter for training VLMs and show that training on unrelated data may change both a VLM's image preferences and how it explains its choices, and that transfer can become stronger with more training samples.
111. 【2611.09854】Super-resolved digital terrain models for GEDI geolocation correction: agreement with airborne LiDAR DTM-based corrections at the beam level, not the footprint level
链接：https://arxiv.org/abs/2611.09854
作者：Natsuki Yuda,Shinichiro Shirota
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Geophysics (physics.geo-ph)
关键词：Ecosystem Dynamics Investigation, International Space Station, Global Ecosystem Dynamics, Dynamics Investigation, Space Station
备注： Appendices will be added in a future version
点击查看摘要
Abstract:The Global Ecosystem Dynamics Investigation (GEDI) mission measures three-dimensional forest structure with a LiDAR aboard the International Space Station. GEDI observations have geolocation errors of about 10 m, which cause misalignment with other remote sensing data and reduce the accuracy of downstream tasks. Matching GEDI ground elevations against high-resolution digital terrain models (DTMs) from airborne LiDAR is one way to correct these errors, but such DTMs exist in few regions. To widen this method's applicability, we super-resolved a more widely available low-resolution DTM and used it for the matching. Our question is whether a super-resolved DTM yields the same correction as a 1 m-resolution airborne LiDAR DTM and, if not, why. In steep forests of western Japan, we super-resolved an existing 10 m-resolution DTM to 1 m. Improving its accuracy required fusion with a global 30 m-resolution DTM from a different source. Using the resulting DTM, we corrected GEDI observation positions first by a single shift per ground track, then per observation. For most tracks, the shifts nearly matched those from the airborne LiDAR DTM, likely because DTM errors canceled out across many observations. Per-observation corrections, however, did not match. At a single observation, the error does not cancel out and is too large for the correction. This error likely originates mainly from the input DTM. Therefore, even without a 1 m-resolution DTM, a roughly 10 m-resolution DTM, fused with a global DTM and super-resolved to 1 m, should yield track-wise corrections nearly matching those from a 1 m-resolution DTM.
112. 【2611.09845】AdaptivePnP: Fast Auto-Tuned Plug-and-Play for Deconvolution
链接：https://arxiv.org/abs/2611.09845
作者：Haley Duba-Sullivan,Emma J. Reid,Charles A. Bouman,Gregery T. Buzzard
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：sigma, gamma, methods reconstruct images, PnP, image denoiser
备注： Submitted to IEEE Transactions on Computational Imaging
点击查看摘要
Abstract:Plug-and-play (PnP) methods reconstruct images by alternating a data-fitting step with an image denoiser. Their performance depends on two parameters: the step size $\gamma$ and the measurement noise level $\sigma$. In practice, $\gamma$ is often tuned by grid search over validation images and must be retuned whenever the problem setting changes, and $\sigma$ is assumed known or estimated separately. We propose AdaptivePnP, a PnP framework that jointly estimates $\sigma$ and $\gamma$ at every iteration from the data-fitting residual. To do so, we apply the PnP virtual model to the data-fitting proximal map and show that the residual is zero-mean Gaussian with covariance parameterized by $\gamma$ and $\sigma$. However, when one parameter is much larger than the other, the residual carries little information about the smaller one and using the maximum likelihood (ML) estimator can degrade the PnP iterations. We therefore introduce the identifiable maximum likelihood (IML) estimator, which restricts the ML estimator to an identifiable window in which the normalized Cramér--Rao bound of every parameter is bounded by a user-specified tolerance. For the virtual model, this window is an interval of ratios $\rho = \gamma/\sigma$, so computing the IML estimate reduces to a one-dimensional search over $\rho$. We apply AdaptivePnP to two standard PnP methods, yielding algorithms that require neither a tuned $\gamma$ nor a known $\sigma$. On image deblurring and super-resolution, AdaptivePnP matches or outperforms PnP baselines tuned with the true $\sigma$. Code is available at this https URL.
113. 【2611.09745】Multiscale Closing Index (MCI) for measuring structural similarity between 2D point sets
链接：https://arxiv.org/abs/2611.09745
作者：Nicolò Zava,Angel Franco-Alvarez,Samy Blusseau,Santiago Velasco-Forero,Maria-Jose Jimenez
类目：Metric Geometry (math.MG); Computational Geometry (cs.CG); Computer Vision and Pattern Recognition (cs.CV)
关键词：Multi-scale Closing Index, introduce Multi-scale Closing, Closing Index, Multi-scale Closing, introduce Multi-scale
备注：
点击查看摘要
Abstract:We introduce Multi-scale Closing Index (MCI), a new dissimilarity measure for evaluating the alignment of two 2D point sets. MCI is bounded between 0 and 1 and is based on multiscale mathematical morphology operations, with smaller values indicating greater structural agreement. The measure was motivated by the need to assess the quality of registration between point sets representing cell populations in biological images. To evaluate its behaviour under controlled conditions, we generated synthetic point clouds from Perlin-noise-based spatial structures, following established approaches for simulating biologically plausible spatial organization. We assessed MCI between those point clouds and different transformed versions, obtained by local perturbation, point removal, translation, rotation and addition of impulsive noise. Across these experiments, the dissimilarity MCI increased gradually and consistently with perturbation severity, while showing a clear discontinuity between clouds originating from the same underlying spatial structure and point clouds generated from different structures. We further compared MCI with commonly used point-set distances, including Hausdorff-based measures and Sliced Wasserstein distance. These experiments show the ability of MCI to capture structural agreement and quantify deviations between point sets, highlighting its potential as a complementary metric for evaluating two-dimensional point-set registration.
114. 【2611.09714】Beyond Segmentation: Enriching ImageCAS with Coronary Ostia Landmarks, Rooted Centerline Graphs, and Open-Weight Localization Models
链接：https://arxiv.org/abs/2611.09714
作者：Matteo Leccardi,Andrea Moglia,Marco Morandini,Michele Brembilla,Alessandro Nicosia,Andrea Penserini,Christian Brandini,Ender Konukoglu,Marco Marcon,Luca Mainardi,Pietro Cerveri
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：computed tomography angiography, intraoperative vessel tracking, coronary computed tomography, tomography angiography, vessel tracking
备注： 52 pages including the appendices. Dataset, centerlines, code and model weights: [this https URL](https://hal9000-lab.github.io/)
点击查看摘要
Abstract:Coronary ostia and centerlines are key reference points for automated analysis of coronary computed tomography angiography (CCTA), from surgical planning to intraoperative vessel tracking. However, the only public ostium annotations cover 77 non-gated aortic scans, not CCTA, while CAT08 and ASOCA (32 and 40 CCTA scans) mark the ostia only implicitly, as centerline start points. This work enriches ImageCAS, the largest public dataset for coronary artery segmentation, with ostium annotations for its 1000 patients and centerline graphs rooted at these new ostia, making it, to the authors' knowledge, the largest public dataset for ostium localization and the only one with centerlines following the official ImageCAS masks and starting at annotated ostia. Three annotators marked each ostium in the first 500 volumes; in the next 500, the candidates of a model trained on the first batch were corrected (human-in-the-loop). Six 3D localization models, trained on ImageCAS, CAT08 and ASOCA, were benchmarked on 58 held-out volumes (50 ImageCAS, 4 CAT08, 4 ASOCA). SwinUNETR-V2 and nnResUNet localized all ostia without failure (5 mm error), with median errors of 0.70-0.87 mm. Trained on CAT08 and ASOCA alone, SwinUNETR-V2 fails on 34% of right and 53% of left ostia, whereas adding 250 ImageCAS volumes removes all failures. The centerlines were extracted by a deterministic, quality-controlled minimal-path procedure; on ASOCA, they cover a median of 99.5% of the reference length, with a median per-patient mean distance of 0.22 mm between matched reference points and centerlines. Annotations, centerlines, code, and weights are available at this https URL.
115. 【2611.09714】Beyond Segmentation: Enriching ImageCAS with Coronary Ostia Landmarks, Rooted Centerline Graphs, and Open-Weight Localization Models
链接：https://arxiv.org/abs/2611.09714
作者：Matteo Leccardi,Andrea Moglia,Marco Morandini,Michele Brembilla,Alessandro Nicosia,Andrea Penserini,Christian Brandini,Ender Konukoglu,Marco Marcon,Luca Mainardi,Pietro Cerveri
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：computed tomography angiography, intraoperative vessel tracking, coronary computed tomography, tomography angiography, vessel tracking
备注： 52 pages including the appendices. Dataset, centerlines, code and model weights: [this https URL](https://hal9000-lab.github.io/)
点击查看摘要
Abstract:Coronary ostia and centerlines are key reference points for automated analysis of coronary computed tomography angiography (CCTA), from surgical planning to intraoperative vessel tracking. However, the only public ostium annotations cover 77 non-gated aortic scans, not CCTA, while CAT08 and ASOCA (32 and 40 CCTA scans) mark the ostia only implicitly, as centerline start points. This work enriches ImageCAS, the largest public dataset for coronary artery segmentation, with ostium annotations for its 1000 patients and centerline graphs rooted at these new ostia, making it, to the authors' knowledge, the largest public dataset for ostium localization and the only one with centerlines following the official ImageCAS masks and starting at annotated ostia. Three annotators marked each ostium in the first 500 volumes; in the next 500, the candidates of a model trained on the first batch were corrected (human-in-the-loop). Six 3D localization models, trained on ImageCAS, CAT08 and ASOCA, were benchmarked on 58 held-out volumes (50 ImageCAS, 4 CAT08, 4 ASOCA). SwinUNETR-V2 and nnResUNet localized all ostia without failure (5 mm error), with median errors of 0.70-0.87 mm. Trained on CAT08 and ASOCA alone, SwinUNETR-V2 fails on 34% of right and 53% of left ostia, whereas adding 250 ImageCAS volumes removes all failures. The centerlines were extracted by a deterministic, quality-controlled minimal-path procedure; on ASOCA, they cover a median of 99.5% of the reference length, with a median per-patient mean distance of 0.22 mm between matched reference points and centerlines. Annotations, centerlines, code, and weights are available at this https URL.
116. 【2611.09118】Semantic Extraction Framework for Goal-Oriented V2X Communication Supporting Safe Intersection Passage
链接：https://arxiv.org/abs/2611.09118
作者：Haoran Yang,Shan Lu,Takaya Yamazato
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：safe intersection passage, communication supporting safe, supporting safe intersection, transmitter-side semantic extraction, communication supporting
备注： Accept by 2026 Asia-Pacific Conference on Communications
点击查看摘要
Abstract:This paper proposes a transmitter-side semantic extraction framework for goal-oriented Vehicle-to-Everything (V2X) communication supporting safe intersection passage. Instead of transmitting raw sensory data, roadside infrastructure extracts task-relevant semantic information from video and traffic-signal sequences and organizes them into compact semantic packets for low-latency driving-decision assistance. The intersection-passing problem is formulated as a set of traffic tasks under Japanese traffic regulations, and the proposed pipeline generates perception and intent semantics through object detection, object tracking, region-of-interest (ROI)-based semantic extraction, and recommended-action generation. The framework is implemented and evaluated on a self-constructed, CARLA-based single-vehicle dataset collected under clear weather conditions. Experimental results show high recommended-action accuracy within the tested task set, while the mean processing latency remains below the frame interval of the 15~fps input video.
117. 【2611.08754】Measurement-Aware Multimodal LLM for No-Reference Low-Dose CT Quality Assessment
链接：https://arxiv.org/abs/2611.08754
作者：Kerem Basim,Tolga Demiroglu,Mehmet Ozan Unal,Metin Ertas,Isa Yildirim
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：No-reference image quality, compare dose protocols, image quality assessment, No-reference image, quality assessment
备注： 5 pages, 2 figures, 3 tables. Submitted to IEEE ISBI 2027
点击查看摘要
Abstract:No-reference image quality assessment (IQA) of low-dose CT predicts the score that radiologists would assign to a slice without a full-dose reference, as needed to compare dose protocols and denoisers. Trained CT IQA networks agree well with radiologists but output only a score, whereas multimodal large language models (MLLMs) can explain a score but perform poorly on CT when only prompted. We propose a measurement-aware MLLM, built on Qwen3.8-27B, that rates a slice from its image together with six image-domain measurements of noise, sharpness, high-frequency content and streaks, given to the language model as percentiles in text. On the LDCT-IQA 2023 test set, it reaches an Overall score of 2.735, on par with the retrained challenge winner (2.735) and MedSigLIP-FiLM (2.713), and substantially above its base MLLM used as a zero-shot agent. Shuffling the measurements at test time reduces the score by 0.048, mostly through noise, but the same measurements also lead the model to assign higher scores to over-smoothed denoised images.
